Print

Print


> Jamie, I can globus-url-copy your file from RAL's UI:
> 
> globus-url-copy gsiftp://dpm.epcc.ed.ac.uk/dpm:/sanstor/stor4/dpmmgr//dteam/2005-08-09/test29.txt.195.0
> file://`pwd`/foofoo
> 
> cat foofoo
> this is a test file
> 
> Then I tried with /opt/d-cache/srm/bin/gridftpcopy and it worked
> fine.  Odd, 'cos it does looks like a file transfer problem.  If
> you've set 
> 
> I tried srmcp'ing
> srm://dpm.epcc.ed.ac.uk:8443/dpm/epcc.ed.ac.uk/home/dteam/test29
> and got rs.error = "No such file or directory"

It looks like you missed out the /2005-08-09/ section could you try again 
with 
srm://dpm.epcc.ed.ac.uk:8443/dpm/epcc.ed.ac.uk/home/dteam/2005-08-09/test29

> 
> I tried dpns-ls'ing various parts of your path and couldn't get
> through.  But had probably expected that.

I'm surprised about that. I've been looking through dpm.epcc.ed.ac.uk's 
dpns from several locations. I take it you ran the commands 
# export DPNS_HOST=dpm.epcc.ed.ac.uk
# export dpns-ls /

The first command is vital, thereafter you can dpns the filesystem as 
though it were on your wn computer.

Cheers,
Jamie.

> -j
> 
> > -----Original Message-----
> > From: GRIDPP2: Deployment and support of SRM and local storage
> > management [mailto:[log in to unmask]]On Behalf Of Jamie
> > Kelvin Ferguson
> > Sent: 10 August 2005 15:28
> > To: [log in to unmask]
> > Subject: Re: srmcp out of dpm problem
> > 
> > 
> > Hi there,
> > 
> > Thanks for the response, I done as you suggested and in 
> > addition to the 
> > previous error message I get the following preceding it
> > 
> > Storage Resource Manager (SRM) CP Client version 1.16
> > Copyright (c) 2002-2005 Fermi National Accelerator Laborarory
> >  
> > SRM Configuration:
> >         debug=true
> >         gsissl=true
> >         help=false
> >         pushmode=false
> >         userproxy=true
> >         buffer_size=131072
> >         tcp_buffer_size=0
> >         stream_num=10
> >         config_file=/home/fergusjk/.srmconfig/config.xml
> >         glue_mapfile=/opt/d-cache/srm/conf/SRMServerV1.map
> >         webservice_path=srm/managerv1.wsdl
> >         webservice_protocol=https
> >         gsiftpclinet=globus-url-copy
> >         protocols_list=http,gsiftp
> >         save_config_file=null
> >         srmcphome=/opt/d-cache/srm
> >         urlcopy=/opt/d-cache/srm/sbin/url-copy.sh
> >         x509_user_cert=/home/fergusjk/.globus/usercert.pem
> >         x509_user_key=/home/fergusjk/.globus/userkey.pem
> >         x509_user_proxy=/tmp/x509up_u502
> >         x509_user_trusted_certificates=/etc/grid-security/certificates
> >         retry_num=20
> >         retry_timeout=10000
> >         wsdl_url=null
> >         use_urlcopy_script=false
> >         connect_to_wsdl=false
> >         delegate=true
> >         full_delegation=true
> >         
> > from[0]=srm://dpm.epcc.ed.ac.uk:8443/dpm/epcc.ed.ac.uk/home/dt
> > eam/test29 
> > .txt
> >         to=file:////home/fergusjk/test30Ret.txt
> >  
> > Wed Aug 10 15:21:55 BST 2005: starting SRMGetClient
> > Wed Aug 10 15:21:55 BST 2005: SRMClient(https,srm/managerv1.wsdl,true)
> > Wed Aug 10 15:21:55 BST 2005: connecting to server
> > Wed Aug 10 15:21:55 BST 2005: connected to server, obtaining proxy
> > SRMClientV1 : connecting to srm at 
> > httpg://dpm.epcc.ed.ac.uk:8443/srm/managerv1
> > Wed Aug 10 15:21:56 BST 2005: got proxy of type class 
> > org.dcache.srm.client.SRMC lientV1
> > SRMClientV1 :   get: 
> > surls[0]="srm://dpm.epcc.ed.ac.uk:8443/dpm/epcc.ed.ac.uk/ho 
> > me/dteam/test29.txt"
> > SRMClientV1 :   get: protocols[0]="http"
> > SRMClientV1 :   get: protocols[1]="dcap"
> > SRMClientV1 :   get: protocols[2]="gsiftp"
> > SRMClientV1 :  get, contacting service 
> > httpg://dpm.epcc.ed.ac.uk:8443/srm/manage rv1
> > doneAddingJobs is false
> > copy_jobs is empty
> > Wed Aug 10 15:21:59 BST 2005:  srm returned requestId = 219
> > Wed Aug 10 15:21:59 BST 2005: sleeping 1 seconds ...
> > Wed Aug 10 15:22:00 BST 2005: FileRequestStatus with 
> > SURL=srm://dpm.epcc.ed.ac.u 
> > k:8443/dpm/epcc.ed.ac.uk/home/dteam/test29.txt 
> > is Ready
> > Wed Aug 10 15:22:00 BST 2005:        received 
> > TURL=gsiftp://dpm.epcc.ed.ac.uk/dp 
> > m:/sanstor/stor4/dpmmgr//dteam/2005-08-09/test29.txt.195.0
> > doneAddingJobs is false
> > copy_jobs is not empty
> > copying CopyJob, source = 
> > gsiftp://dpm.epcc.ed.ac.uk/dpm:/sanstor/stor4/dpmmgr// 
> > dteam/2005-08-09/test29.txt.195.0 destination = 
> > file:////home/fergusjk/test30Ret .txt
> > GridftpClient: memory buffer size is set to 131072
> > GridftpClient: connecting to dpm.epcc.ed.ac.uk on port 2811
> > Wed Aug 10 15:22:00 BST 2005: fileIDs is empty, breaking the loop
> > GridftpClient: gridFTPClient tcp buffer size is set to 0
> > GridftpClient: gridFTPRead started
> > GridftpClient: parallelism: 10
> > GridftpClient: waiting for completion of transfer
> > GridftpClient: gridFtpWrite: starting the transfer in emode from 
> > dpm:/sanstor/st or4/dpmmgr//dteam/2005-08-09/test29.txt.195.0
> > 
> > Does anyone recognise anything erroneous? There is a 
> > reference to port 
> > 2811 but this is open on the ui and the dpm.
> > I would email the dpm guys at cern but they are all away on 
> > their hols. 
> > just now.
> > 
> > Jamie.
> > 
> > On Wed, 10 Aug 2005, Owen Synge wrote:
> > 
> > > Have a look at 
> > > 
> > > $cat .srmconfig/config.xml
> > > 
> > > and set the tag as bellow to make the ftp transfers passive.
> > > 
> > > <use_urlcopy_script> true </use_urlcopy_script>
> > > 
> > > Use this to copy the data (even if the true path is sbin not bin)
> > > 
> > > <!-- path to the urlcopy script -->
> > > <urlcopy> /opt/d-cache/srm/bin/url-copy.sh </urlcopy>
> > > 
> > > This most definitely looks like another FTP/firewall related issue.
> > > 
> > > Regards
> > > 
> > > Owen
> > > 
> > > 
> > > On Wed, 10 Aug 2005 14:30:29 +0100
> > > Jamie Kelvin Ferguson <[log in to unmask]> wrote:
> > > 
> > > > Hi there,
> > > > 
> > > > The srmcp command seems to have stopped working on our DPM.
> > > > 
> > > > I tried copying a file from our ui to our dpm here at 
> > Edinburgh (a command 
> > > > that used to work fine)
> > > > # /opt/d-cache/srm/bin/srmcp srm://dpm.epcc.ed.ac.uk:8443/ 
> > > > dpm/epcc.ed.ac.uk/home/dteam/test29.txt 
> > > > file:////home/fergusjk/test30Ret.txt
> > > > 
> > > > However I get the following error.
> > > > org.globus.ftp.exception.ServerException: Server refused 
> > performing the 
> > > > request. Custom message:  (error code 1) [Nested 
> > exception message:  
> > > > Custom message: Unexpected reply: 425 Can't open data connection. 
> > > > data_connect_failed() failed: a system call failed (No 
> > route to host).].  
> > > > Nested exception is 
> > org.globus.ftp.exception.UnexpectedReplyCodeException:  
> > > > Custom message: Unexpected reply: 425 Can't open data connection. 
> > > > data_connect_failed() failed: a system call failed (No 
> > route to host).
> > > >         at 
> > > > 
> > org.globus.ftp.vanilla.TransferMonitor.run(TransferMonitor.java:167)
> > > > GridftpClient:  transfer exception
> > > > org.globus.ftp.exception.ServerException: Server refused 
> > performing the 
> > > > request. Custom message:  (error code 1) [Nested 
> > exception message:  
> > > > Custom message: Unexpected reply: 425 Can't open data connection. 
> > > > data_connect_failed() failed: a system call failed (No 
> > route to host).].  
> > > > Nested exception is 
> > org.globus.ftp.exception.UnexpectedReplyCodeException:  
> > > > Custom message: Unexpected reply: 425 Can't open data connection. 
> > > > data_connect_failed() failed: a system call failed (No 
> > route to host).
> > > >         at 
> > > > 
> > org.globus.ftp.vanilla.TransferMonitor.run(TransferMonitor.java:167)
> > > > copy failed with the error
> > > > org.globus.ftp.exception.ServerException: Server refused 
> > performing the 
> > > > request. Custom message:  (error code 1) [Nested 
> > exception message:  
> > > > Custom message: Unexpected reply: 425 Can't open data connection. 
> > > > data_connect_failed() failed: a system call failed (No 
> > route to host).].  
> > > > Nested exception is 
> > org.globus.ftp.exception.UnexpectedReplyCodeException:  
> > > > Custom message: Unexpected reply: 425 Can't open data connection. 
> > > > data_connect_failed() failed: a system call failed (No 
> > route to host).
> > > >         at 
> > > > 
> > org.globus.ftp.vanilla.TransferMonitor.run(TransferMonitor.java:167)
> > > >  try again
> > > > sleeping for 10000 before retrying
> > > > 
> > > > I tried lowering the firewall on our UI and this allows 
> > the file transfer 
> > > > to take place.
> > > > srmcp in to dpm and globus url copies in & out all still 
> > work. I tried 
> > > > restarting daemons on dpm and I've ensured port 8443 is 
> > open on both the 
> > > > UI and dpm but to no avail. I also tried scp'ing the dpm 
> > iptables file 
> > > > over to ui and restarting the iptables service, again to no avail.
> > > > 
> > > > Anyone got any ideas how to discover which port the dpm 
> > --> ui srmcp is 
> > > > trying to use?
> > > > 
> > > > Cheers,
> > > > Jamie.
> > > 
> > 
>