Hi Graeme, Do you see any improvement now? Cheers, Santanu > On Wed, Jul 22, 2009 at 12:01, Santanu Das<[log in to unmask]> wrote: > >> Hi Graeme, >> >> >>> ANALY_CAM: Bad. SE broken, "pilot: Get error: Copy command returned >>> error code 256 and output: globus_ftp_client: the server responded >>> with an error 530 Login incorrect. : Could not get virtual id!". Check >>> /etc/sysconfig/dpm-gsiftpd has DPM/DPNS hosts properly defined (we got >>> burned at Glasgow by that last week, DPM 1.7.2 cares about this). >>> >>> >> I don't think SE itself is broken but there were some other problems at site >> while a couple of nodes were down. So, I need to know the exact (or as close >> as possible) time you saw that. As far as I can see, dpm-gsiftp got correct >> entries. >> >> [root@serv02 ~]# cat /etc/sysconfig/dpm-gsiftp >> export DPNS_HOST=serv02.hep.phy.cam.ac.uk >> export DPM_HOST=serv02.hep.phy.cam.ac.uk >> > > I have a lots of examples for you: > > http://panda.cern.ch:25980/server/pandamon/query?mode=archive&type=analysis&computingSite=ANALY_CAM&jobStatus=failed&hours=24 > > in particular try: > > http://panda.cern.ch:25880/server/pandamon/query?job=1016500401 > > You can pick up timestamps to your heart's content. > > If you see "upstream job failed" then follow the link to the build job, e.g., > > http://panda.cern.ch:25980/server/pandamon/query?job=1016622449 > > goes to > > http://panda.cern.ch:25980/server/pandamon/query?job=1016621879 > > Which digs down to the same error: > > http://www.hep.lancs.ac.uk/~love/pyfactory/logs/2009-07-22/ANALY_CAM/482861.0.out > > > " 0 bytes 0.00 KB/sec avg 0.00 KB/sec inst > 0 bytes 0.00 KB/sec avg 0.00 KB/sec > instglobus_ftp_client: the server responded with an error > 530 Login incorrect. : Could not get virtual id! > > > lcg_cr: Transport endpoint is not connected" > > > Cheers > > Graeme > >