Hi,
Can you check for java.outofmemory exceptions in catalina.out logs?
After last update we had 2 creams down - we managed to fix this by
removing entries from the database and increasing
-Xms ans -Xmx memory limits for tomcat
https://ggus.eu/tech/ticket_show.php?ticket=88207
--
LKF
On 06.11.2012 09:47, Feyza Eryol wrote:
> Hi all,
>
> Our CREAM CEs are migrated to EMI-2 CREAM CE last month. One of the
> CREAM CE is give some periodical errors in nagios.
>
>>Current Status: Aborted
>>Logged Reason(s):
>>- Transfer to CREAM failed due to exception: CREAM Register raised
> std::exception EOF detected during communication. Probably service
> closed connection or SOCKET TIMEOUT occurred.
>>- Transfer to CREAM failed due to exception: CREAM Register raised
> std::exception The endpoint is blacklisted
>
>
> When we checked the server, we saw that the query of
> glite_cream_load_monitor script could not be ended in a short time.
>
>>tomcat 28235 954 0 10:10 ? 00:00:00 /usr/bin/perl
> /usr/bin/glite_cream_load_monitor
> /etc/glite-ce-cream-utils/glite_cream_load_monitor.conf --show
>>tomcat 28268 28235 0 10:10 ? 00:00:00 mysql -B
> --skip-column-names -h localhost -u krema --password=x xxxxxxx -e use
> creamdb;select count(*) from job_status AS status LEFT OUTER JOIN
> job_status AS latest ON latest.jobId=status.jobId AND status.id <
> latest.id WHERE latest.id IS null AND status.type IN
> ('0','1','2','3','4','6');
>
> I have checked the creamdb and the job_status table. The job_status
> table of the CREAM CE which has problems has nearly 250.000 lines where
> the others are only 20.000 lines. I think that the
> glite_cream_load_monitor script could not be ended because of the
> joining the job_status table with itself. When this query is running,
> CREAM CE could not except jobs and gives the reason which is above.
>
> Do you have any ideas for this issue. I have checked the pages but could
> not find a proper solutions.
>
> Thanks and best regards,
>
> --feyza
> --
> *Feyza ERYOL*
> Senior Researcher
> Network Technologies Department
> TUBITAK ULAKBIM
> YOK Binasi B5 Blok Kat:3 Bilkent
> 06539 ANKARA TURKEY
> T +90 312 298 9365
> F +90 312 298 9393
> www.ulakbim.gov.tr <http://www.ulakbim.gov.tr>
> [log in to unmask]
> ................................................................................................................................
>
> <http://www.ulakbim.gov.tr/>
>
> Disclaimer <http://www.tubitak.gov.tr/disclaimer>
|