I attach the output of srmcp into the DPM (successful) and trying to
srmcp the same file back to the UI (fails). I also attach what appears
on /var/log/messages on the DPM head node.
In this case the file is copied on the head node storage area (not on
the nfs mounted directory), but logs are similar if trying to copy back
a file that is stored on the nfs mounted directory, suggesting that the
problem is elsewhere. The "(No route to host)"
message should be revealing, but I'm not sure what it refers to.
cheers,
gianfranco
On Thu, 2005-12-08 at 12:06, Greig A Cowan wrote:
> Hi,
>
> Can you give me the output of trying an srmcp into your DPM, using the
> atlas VO. Make sure to include the -debug=true option.
>
> Cheers,
> Greig
>
> > This is what we currently have on the former classic_SE:
> >
> > [dpmmgr@pc30 dpmmgr]$ cd /storage
> > [dpmmgr@pc30 storage]$ ll
> > total 24
> > drwxrwx--- 6 dpmmgr dpmmgr 4096 Dec 6 14:32 atlas
> > drwxrwx--- 3 dpmmgr dpmmgr 4096 Sep 22 17:56 dteam
> > drwxrwx--- 2 dpmmgr dpmmgr 16384 Sep 9 12:15 lost+found
> > [dpmmgr@pc30 storage]$ cd atlas
> > [dpmmgr@pc30 atlas]$ ll
> > total 16
> > drwxrwx--- 4 dpmmgr dpmmgr 4096 May 3 2005 bphys
> > drwxrwx--- 7 dpmmgr dpmmgr 4096 May 12 2005 datafiles
> > drwxrwx--- 83 dpmmgr dpmmgr 4096 Nov 17 11:39 generated
> > drwxrwx--- 7 dpmmgr dpmmgr 4096 May 7 2005 logfiles
> > [dpmmgr@pc30 atlas]$ df -H
> > Filesystem Size Used Avail Use% Mounted on
> > /dev/hda2 21GB 2.6GB 18GB 13% /
> > /dev/hda1 152MB 15MB 129MB 11% /boot
> > none 163MB 0 163MB 0% /dev/shm
> > /dev/hda5 40GB 181MB 38GB 1% /storage
> > pc72.hep.ucl.ac.uk:/mnt/data/atlas/lcg/data
> > 2.1TB 2.0TB 104GB 95% /storage/atlas
> >
> > cheers,
> > gianfranco
> >
gs> srmcp -debug=true file:////home/gs/MyLocalFile.txt srm://pc55.hep.ucl.ac.uk:8443/dpm/hep.ucl.ac.uk/home/atlas/test
Storage Resource Manager (SRM) CP Client version 1.16
Copyright (c) 2002-2005 Fermi National Accelerator Laborarory
SRM Configuration:
debug=true
gsissl=true
help=false
pushmode=false
userproxy=true
buffer_size=131072
tcp_buffer_size=0
stream_num=10
config_file=/home/gs/.srmconfig/config.xml
glue_mapfile=/usr/local/lcg/d-cache/srm/conf/SRMServerV1.map
webservice_path=srm/managerv1.wsdl
webservice_protocol=https
gsiftpclinet=globus-url-copy
protocols_list=http,gsiftp
save_config_file=null
srmcphome=/usr/local/lcg/d-cache/srm
urlcopy=/usr/local/lcg/d-cache/srm/sbin/url-copy.sh
x509_user_cert=/home/gs/.globus/usercert.pem
x509_user_key=/home/gs/.globus/userkey.pem
x509_user_proxy=/tmp/x509up_u7819
x509_user_trusted_certificates=/usr/local/lcg/etc/grid-security/certificates
retry_num=20
retry_timeout=10000
wsdl_url=null
use_urlcopy_script=false
connect_to_wsdl=false
delegate=true
full_delegation=true
from[0]=file:////home/gs/MyLocalFile.txt
to=srm://pc55.hep.ucl.ac.uk:8443/dpm/hep.ucl.ac.uk/home/atlas/test
Thu Dec 08 12:36:11 GMT 2005: starting SRMPutClient
Thu Dec 08 12:36:11 GMT 2005: SRMClient(https,srm/managerv1.wsdl,true)
Thu Dec 08 12:36:11 GMT 2005: connecting to server
Thu Dec 08 12:36:11 GMT 2005: connected to server, obtaining proxy
SRMClientV1 : connecting to srm at httpg://pc55.hep.ucl.ac.uk:8443/srm/managerv1
Thu Dec 08 12:36:12 GMT 2005: got proxy of type class org.dcache.srm.client.SRMClientV1
doneAddingJobs is false
copy_jobs is empty
SRMClientV1 : put, sources[0]="/home/gs/MyLocalFile.txt"
SRMClientV1 : put, dests[0]="srm://pc55.hep.ucl.ac.uk:8443/dpm/hep.ucl.ac.uk/home/atlas/test"
SRMClientV1 : put, protocols[0]="http"
SRMClientV1 : put, protocols[1]="dcap"
SRMClientV1 : put, protocols[2]="gsiftp"
SRMClientV1 : put, contacting service httpg://pc55.hep.ucl.ac.uk:8443/srm/managerv1
Thu Dec 08 12:36:13 GMT 2005: srm returned requestId = 1019
Thu Dec 08 12:36:13 GMT 2005: sleeping 1 seconds ...
Thu Dec 08 12:36:15 GMT 2005: FileRequestStatus with SURL=srm://pc55.hep.ucl.ac.uk:8443/dpm/hep.ucl.ac.uk/home/atlas/test is Ready
Thu Dec 08 12:36:15 GMT 2005: received TURL=gsiftp://pc55.hep.ucl.ac.uk/pc55:/storage/lcgatlas/2005-12-08/test.1019.0
doneAddingJobs is false
copy_jobs is not empty
copying CopyJob, source = file:////home/gs/MyLocalFile.txt destination = gsiftp://pc55.hep.ucl.ac.uk/pc55:/storage/lcgatlas/2005-12-08/test.1019.0
GridftpClient: memory buffer size is set to 131072
GridftpClient: connecting to pc55.hep.ucl.ac.uk on port 2811
GridftpClient: gridFTPClient tcp buffer size is set to 0
GridftpClient: gridFTPWrite started, source file is java.io.RandomAccessFile@787c16 destination path is pc55:/storage/lcgatlas/2005-12-08/test.1019.0
GridftpClient: gridFTPWrite started, destination path is pc55:/storage/lcgatlas/2005-12-08/test.1019.0
GridftpClient: parallelism: 10
GridftpClient: adler 32 for file java.io.RandomAccessFile@787c16 is 3362333110
GridftpClient: could not set addler 32 org.globus.ftp.exception.UnexpectedReplyCodeException: Custom message: Unexpected reply: 500 'SITE CHKSUM c86921b6': command not
understood.
GridftpClient: waiting for completion of transfer
GridftpClient: gridFtpWrite: starting the transfer in emode to pc55:/storage/lcgatlas/2005-12-08/test.1019.0
GridftpClient: DiskDataSink.close() called
GridftpClient: gridFTPWrite() wrote 158bytes
GridftpClient: closing client : org.dcache.srm.util.GridftpClient$FnalGridFTPClient@7a4489
GridftpClient: closed client
execution of CopyJob, source = file:////home/gs/MyLocalFile.txt destination = gsiftp://pc55.hep.ucl.ac.uk/pc55:/storage/lcgatlas/2005-12-08/test.1019.0 completed
setting file request 0 status to Done
doneAddingJobs is true
copy_jobs is empty
stopping copier
gs> dpns-ls -l /dpm/hep.ucl.ac.uk/home/atlas/test
-rw-rw-r-- 1 10761 1307 158 Dec 08 12:36 /dpm/hep.ucl.ac.uk/home/atlas/test
gs> srmcp -debug=true srm://pc55.hep.ucl.ac.uk:8443/dpm/hep.ucl.ac.uk/home/atlas/test file:////tmp/MyLocalFile.txt
Storage Resource Manager (SRM) CP Client version 1.16
Copyright (c) 2002-2005 Fermi National Accelerator Laborarory
SRM Configuration:
debug=true
gsissl=true
help=false
pushmode=false
userproxy=true
buffer_size=131072
tcp_buffer_size=0
stream_num=10
config_file=/home/gs/.srmconfig/config.xml
glue_mapfile=/usr/local/lcg/d-cache/srm/conf/SRMServerV1.map
webservice_path=srm/managerv1.wsdl
webservice_protocol=https
gsiftpclinet=globus-url-copy
protocols_list=http,gsiftp
save_config_file=null
srmcphome=/usr/local/lcg/d-cache/srm
urlcopy=/usr/local/lcg/d-cache/srm/sbin/url-copy.sh
x509_user_cert=/home/gs/.globus/usercert.pem
x509_user_key=/home/gs/.globus/userkey.pem
x509_user_proxy=/tmp/x509up_u7819
x509_user_trusted_certificates=/usr/local/lcg/etc/grid-security/certificates
retry_num=20
retry_timeout=10000
wsdl_url=null
use_urlcopy_script=false
connect_to_wsdl=false
delegate=true
full_delegation=true
from[0]=srm://pc55.hep.ucl.ac.uk:8443/dpm/hep.ucl.ac.uk/home/atlas/test
to=file:////tmp/MyLocalFile.txt
Thu Dec 08 12:39:39 GMT 2005: starting SRMGetClient
Thu Dec 08 12:39:39 GMT 2005: SRMClient(https,srm/managerv1.wsdl,true)
Thu Dec 08 12:39:39 GMT 2005: connecting to server
Thu Dec 08 12:39:39 GMT 2005: connected to server, obtaining proxy
SRMClientV1 : connecting to srm at httpg://pc55.hep.ucl.ac.uk:8443/srm/managerv1
Thu Dec 08 12:39:40 GMT 2005: got proxy of type class org.dcache.srm.client.SRMClientV1
SRMClientV1 : get: surls[0]="srm://pc55.hep.ucl.ac.uk:8443/dpm/hep.ucl.ac.uk/home/atlas/test"
SRMClientV1 : get: protocols[0]="http"
SRMClientV1 : get: protocols[1]="dcap"
SRMClientV1 : get: protocols[2]="gsiftp"
SRMClientV1 : get, contacting service httpg://pc55.hep.ucl.ac.uk:8443/srm/managerv1
doneAddingJobs is false
copy_jobs is empty
Thu Dec 08 12:39:41 GMT 2005: srm returned requestId = 1020
Thu Dec 08 12:39:41 GMT 2005: sleeping 1 seconds ...
Thu Dec 08 12:39:43 GMT 2005: FileRequestStatus with SURL=srm://pc55.hep.ucl.ac.uk:8443/dpm/hep.ucl.ac.uk/home/atlas/test is Ready
Thu Dec 08 12:39:43 GMT 2005: received TURL=gsiftp://pc55.hep.ucl.ac.uk/pc55:/storage/lcgatlas/2005-12-08/test.1019.0
doneAddingJobs is false
Thu Dec 08 12:39:43 GMT 2005: fileIDs is empty, breaking the loop
copy_jobs is not empty
copying CopyJob, source = gsiftp://pc55.hep.ucl.ac.uk/pc55:/storage/lcgatlas/2005-12-08/test.1019.0 destination = file:////tmp/MyLocalFile.txt
GridftpClient: memory buffer size is set to 131072
GridftpClient: connecting to pc55.hep.ucl.ac.uk on port 2811
GridftpClient: gridFTPClient tcp buffer size is set to 0
GridftpClient: gridFTPRead started
GridftpClient: parallelism: 10
GridftpClient: waiting for completion of transfer
GridftpClient: gridFtpWrite: starting the transfer in emode from pc55:/storage/lcgatlas/2005-12-08/test.1019.0
org.globus.ftp.exception.ServerException: Server refused performing the request. Custom message: (error code 1) [Nested exception message: Custom message: Unexpected
reply: 425 Can't open data connection. data_connect_failed() failed: a system call failed (No route to host).]. Nested exception is
org.globus.ftp.exception.UnexpectedReplyCodeException: Custom message: Unexpected reply: 425 Can't open data connection. data_connect_failed() failed: a system call
failed (No route to host).
at org.globus.ftp.vanilla.TransferMonitor.run(TransferMonitor.java:167)
GridftpClient: transfer exception
org.globus.ftp.exception.ServerException: Server refused performing the request. Custom message: (error code 1) [Nested exception message: Custom message: Unexpected
reply: 425 Can't open data connection. data_connect_failed() failed: a system call failed (No route to host).]. Nested exception is
org.globus.ftp.exception.UnexpectedReplyCodeException: Custom message: Unexpected reply: 425 Can't open data connection. data_connect_failed() failed: a system call
failed (No route to host).
at org.globus.ftp.vanilla.TransferMonitor.run(TransferMonitor.java:167)
GridftpClient: closing client : org.dcache.srm.util.GridftpClient$FnalGridFTPClient@179953c
GridftpClient: closed client
copy failed with the error
org.globus.ftp.exception.ServerException: Server refused performing the request. Custom message: (error code 1) [Nested exception message: Custom message: Unexpected
reply: 425 Can't open data connection. data_connect_failed() failed: a system call failed (No route to host).]. Nested exception is
org.globus.ftp.exception.UnexpectedReplyCodeException: Custom message: Unexpected reply: 425 Can't open data connection. data_connect_failed() failed: a system call
failed (No route to host).
at org.globus.ftp.vanilla.TransferMonitor.run(TransferMonitor.java:167)
try again
sleeping for 10000 before retrying
setting file request 0 status to Done
java.lang.IllegalStateException: Shutdown in progress
at java.lang.Shutdown.add(Unknown Source)
at java.lang.Runtime.addShutdownHook(Unknown Source)
at gov.fnal.srm.util.Copier.run(Copier.java:236)
at java.lang.Thread.run(Unknown Source)
gs> ll /tmp/M*
-rw-r--r-- 1 gs man 0 Dec 8 12:39 /tmp/MyLocalFile.txt
Dec 8 12:36:15 pc55 gridftpd[27488]: importing <[log in to unmask]>
Dec 8 12:36:15 pc55 gridftpd[27488]: importing <[log in to unmask]>
Dec 8 12:36:15 pc55 gridftpd[27488]: Input ADAT token length is 64
Dec 8 12:36:15 pc55 gridftpd[27488]: Accepting GSS context
Dec 8 12:36:15 pc55 gridftpd[27488]: Sending reply token of length 6824
Dec 8 12:36:15 pc55 gridftpd[27488]: Continue needed...
Dec 8 12:36:15 pc55 gridftpd[27488]: Input ADAT token length is 2482
Dec 8 12:36:15 pc55 gridftpd[27488]: Accepting GSS context
Dec 8 12:36:15 pc55 gridftpd[27488]: Sending reply token of length 75
Dec 8 12:36:15 pc55 gridftpd[27488]: Continue needed...
Dec 8 12:36:15 pc55 gridftpd[27488]: Input ADAT token length is 29
Dec 8 12:36:15 pc55 gridftpd[27488]: Accepting GSS context
Dec 8 12:36:15 pc55 gridftpd[27488]: Sending reply token of length 301
Dec 8 12:36:15 pc55 gridftpd[27488]: Continue needed...
Dec 8 12:36:15 pc55 gridftpd[27488]: Input ADAT token length is 509
Dec 8 12:36:15 pc55 gridftpd[27488]: Accepting GSS context
Dec 8 12:36:15 pc55 gridftpd[27488]: GSSAPI authentication succeeed
Dec 8 12:36:15 pc55 gridftpd[27488]: Client identity is: /C=UK/O=eScience/OU=UCL/L=EISD/CN=francesco g sciacca
Dec 8 12:36:15 pc55 gridftpd[27488]: Globus user maps to local user atlas001
Dec 8 12:36:15 pc55 gridftpd[27488]: GSSAPI user "/C=UK/O=eScience/OU=UCL/L=EISD/CN=francesco g sciacca" is authorized as atlas001
Dec 8 12:36:15 pc55 gridftpd[27488]: USER :globus-mapping:
Dec 8 12:36:15 pc55 gridftpd[27488]: PASS password
Dec 8 12:36:16 pc55 gridftpd[27488]: TYPE Image
Dec 8 12:36:16 pc55 gridftpd[27488]: MODE 0
Dec 8 12:36:16 pc55 gridftpd[27488]: FEAT
Dec 8 12:36:16 pc55 gridftpd[27488]: DCAU
Dec 8 12:36:16 pc55 gridftpd[27488]: PASV
Dec 8 12:36:16 pc55 gridftpd[27488]: ESTO A 0 pc55:/storage/lcgatlas/2005-12-08/test.1019.0
Dec 8 12:36:16 pc55 gridftpd[27488]: ESTO command was not tested with CASTOR!
Dec 8 12:36:17 pc55 gridftpd[27488]: QUIT
Dec 8 12:36:17 pc55 gridftpd[27488]: lost connection to pc103.hep.ucl.ac.uk [128.40.4.203]
Dec 8 12:39:43 pc55 gridftpd[27579]: importing <[log in to unmask]>
Dec 8 12:39:43 pc55 gridftpd[27579]: importing <[log in to unmask]>
Dec 8 12:39:43 pc55 gridftpd[27579]: Input ADAT token length is 64
Dec 8 12:39:43 pc55 gridftpd[27579]: Accepting GSS context
Dec 8 12:39:43 pc55 gridftpd[27579]: Sending reply token of length 6824
Dec 8 12:39:43 pc55 gridftpd[27579]: Continue needed...
Dec 8 12:39:43 pc55 gridftpd[27579]: Input ADAT token length is 2482
Dec 8 12:39:43 pc55 gridftpd[27579]: Accepting GSS context
Dec 8 12:39:43 pc55 gridftpd[27579]: Sending reply token of length 75
Dec 8 12:39:43 pc55 gridftpd[27579]: Continue needed...
Dec 8 12:39:43 pc55 gridftpd[27579]: Input ADAT token length is 29
Dec 8 12:39:43 pc55 gridftpd[27579]: Accepting GSS context
Dec 8 12:39:43 pc55 gridftpd[27579]: Sending reply token of length 301
Dec 8 12:39:43 pc55 gridftpd[27579]: Continue needed...
Dec 8 12:39:43 pc55 gridftpd[27579]: Input ADAT token length is 509
Dec 8 12:39:43 pc55 gridftpd[27579]: Accepting GSS context
Dec 8 12:39:43 pc55 gridftpd[27579]: GSSAPI authentication succeeed
Dec 8 12:39:43 pc55 gridftpd[27579]: Client identity is: /C=UK/O=eScience/OU=UCL/L=EISD/CN=francesco g sciacca
Dec 8 12:39:43 pc55 gridftpd[27579]: Globus user maps to local user atlas001
Dec 8 12:39:43 pc55 gridftpd[27579]: GSSAPI user "/C=UK/O=eScience/OU=UCL/L=EISD/CN=francesco g sciacca" is authorized as atlas001
Dec 8 12:39:43 pc55 gridftpd[27579]: USER :globus-mapping:
Dec 8 12:39:43 pc55 gridftpd[27579]: PASS password
Dec 8 12:39:43 pc55 gridftpd[27579]: TYPE Image
Dec 8 12:39:44 pc55 gridftpd[27579]: MODE 0
Dec 8 12:39:44 pc55 gridftpd[27579]: FEAT
Dec 8 12:39:44 pc55 gridftpd[27579]: DCAU
Dec 8 12:39:44 pc55 gridftpd[27579]: SIZE pc55:/storage/lcgatlas/2005-12-08/test.1019.0
Dec 8 12:39:44 pc55 gridftpd[27579]: PORT
Dec 8 12:39:44 pc55 gridftpd[27579]: ERET P 0 158 pc55:/storage/lcgatlas/2005-12-08/test.1019.0
Dec 8 12:39:44 pc55 gridftpd[27579]: using rfio: file not local
Dec 8 12:39:44 pc55 gridftpd[27579]: Can't open data connection. data_connect_failed() failed: a system call failed (No route to host)
Dec 8 12:39:45 pc55 gridftpd[27579]: QUIT
Dec 8 12:39:45 pc55 gridftpd[27579]: lost connection to pc103.hep.ucl.ac.uk [128.40.4.203]
|