Yves suggested that the sporadic failure of the tests suggested a WN issue.
We therefore drained the queues to half our WN nodes, and we started
passing the tests consistently. Perusing all the logs on the drained WN
showed only one error source, the output from the daily log rotations
(see below). We suspected a filesystem problem, but the problem only seemed
to be apparent with logrotate.
We shut down the WN node, checked the disk and rebooted. logrotate now runs
OK, and we are still passing the SAM tests. Difficult to see how we
could monitor
for such a strange problem
Dave
Can't load '/usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so' for module POSIX: /usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so: ELF file version ident does not match current one at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/XSLoader.pm line 83.
at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/POSIX.pm line 26
Compilation failed in require at /etc/log.d/scripts/shared/applystddate line 14.
BEGIN failed--compilation aborted at /etc/log.d/scripts/shared/applystddate line 14.
Can't load '/usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so' for module POSIX: /usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so: ELF file version ident does not match current one at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/XSLoader.pm line 83.
at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/POSIX.pm line 26
Compilation failed in require at /etc/log.d/scripts/logfiles/autorpm/applydate line 6.
BEGIN failed--compilation aborted at /etc/log.d/scripts/logfiles/autorpm/applydate line 6.
Can't load '/usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so' for module POSIX: /usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so: ELF file version ident does not match current one at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/XSLoader.pm line 83.
at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/POSIX.pm line 26
Compilation failed in require at /etc/log.d/scripts/logfiles/cron/applydate line 15.
BEGIN failed--compilation aborted at /etc/log.d/scripts/logfiles/cron/applydate line 15.
Can't load '/usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so' for module POSIX: /usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so: ELF file version ident does not match current one at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/XSLoader.pm line 83.
at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/POSIX.pm line 26
Compilation failed in require at /etc/log.d/scripts/logfiles/xferlog/applydate line 14.
BEGIN failed--compilation aborted at /etc/log.d/scripts/logfiles/xferlog/applydate line 14.
Can't load '/usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so' for module POSIX: /usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so: ELF file version ident does not match current one at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/XSLoader.pm line 83.
at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/POSIX.pm line 26
Compilation failed in require at /etc/log.d/scripts/shared/applystddate line 14.
BEGIN failed--compilation aborted at /etc/log.d/scripts/shared/applystddate line 14.
Can't load '/usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so' for module POSIX: /usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so: ELF file version ident does not match current one at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/XSLoader.pm line 83.
at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/POSIX.pm line 26
Compilation failed in require at /etc/log.d/scripts/shared/applystddate line 14.
BEGIN failed--compilation aborted at /etc/log.d/scripts/shared/applystddate line 14.
Can't load '/usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so' for module POSIX: /usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so: ELF file version ident does not match current one at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/XSLoader.pm line 83.
at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/POSIX.pm line 26
Compilation failed in require at /etc/log.d/scripts/shared/applystddate line 14.
BEGIN failed--compilation aborted at /etc/log.d/scripts/shared/applystddate line 14.
Can't load '/usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so' for module POSIX: /usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so: ELF file version ident does not match current one at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/XSLoader.pm line 83.
at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/POSIX.pm line 26
Compilation failed in require at /etc/log.d/scripts/logfiles/samba/applydate line 14.
BEGIN failed--compilation aborted at /etc/log.d/scripts/logfiles/samba/applydate line 14.
Can't load '/usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so' for module POSIX: /usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so: ELF file version ident does not match current one at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/XSLoader.pm line 83.
at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/POSIX.pm line 26
Compilation failed in require at /etc/log.d/scripts/shared/applystddate line 14.
BEGIN failed--compilation aborted at /etc/log.d/scripts/shared/applystddate line 14.
Can't load '/usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so' for module POSIX: /usr/lib/perl5/5.8.0/i386-linux-thread-multi/auto/POSIX/POSIX.so: ELF file version ident does not match current one at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/XSLoader.pm line 83.
at /usr/lib/perl5/5.8.0/i386-linux-thread-multi/POSIX.pm line 26
Compilation failed in require at /etc/log.d/scripts/logfiles/up2date/applydate line 6.
BEGIN failed--compilation aborted at /etc/log.d/scripts/logfiles/up2date/applydate line 6.
Burke, S (Stephen) wrote:
> Testbed Support for GridPP member institutes
>
>> [mailto:[log in to unmask]] On Behalf Of David Robson said:
>> EFDA-JET has now passed the last 65 SAM CE tests. The
>> problem was taced to a faulty WN.
>>
>
> Faulty in what way - is it something which could be monitored?
>
> Stephen
>
>
|