On Wed, Nov 02, 2005 at 06:00:40PM +0000 or thereabouts, Greig A Cowan wrote:
> Hi Derek,
> 
> > Same srm copies get sneakily optimised by dCache into an internal dcap
> > transfer. Try copies between dcache-tape.gridpp and dcache.gridpp.
> 
> Thanks for that snippet of information, that helps to explain some of the 
> behviour I'm seeing. I just tried copies between dcache-tape.gridpp and 
> dcache.gridpp and it is working fine (although the transfer does have to 
> sleep for about 30 seconds before it is initiated).
>  
> > If a Tier 2 is failing as the source of an SRMcopy (in pull mode), it
> > should fail an SRMget for the same file - its the same parts being used;
> > unless there's a problem with the destination SRM in the SRMcopy or
> > possibly active/passive gftp issues.
> 
> I have also tried 3rd party transfers between dcache.gridpp and other 
> dCache instances at other institutes (ITEP, DESY, BARI...) and these are 
> failing with the same error as I was experiencing with the UK Tier-2's.
> 
> Could someone else try the following so that we can start pinning down 
> where the problem is:
> 
> $ srmcp -debug=true 
> srm://dcache.gridpp.rl.ac.uk:8443/pnfs/gridpp.rl.ac.uk/data/dteam/srm2-20051102_174628.txt 
> srm://pccms2.cmsfarm1.ba.infn.it:8443/pnfs/cmsfarm1.ba.infn.it/data/dteam/greig_`date 
> +%Y%m%d_%H%M%S`.txt

Hi,
    Works for me as below

    I've attached my .srmconfig/config.xml as well.

    $ srmcp srm://dcache.gridpp.rl.ac.uk:8443/pnfs/gridpp.rl.ac.uk/data/dteam/srm2-20051102_174628.txt srm://pccms2.cmsfarm1.ba.infn.it:8443/pnfs/cmsfarm1.ba.infn.it/data/dteam/sausage
Storage Resource Manager (SRM) CP Client version 1.17
Copyright (c) 2002-2005 Fermi National Accelerator Laborarory

SRM Configuration:
        debug=true
        gsissl=true
        help=false
        pushmode=false
        userproxy=true
        buffer_size=2048
        tcp_buffer_size=0
        stream_num=10
        config_file=/home/csf/traylens/.srmconfig/config.xml
        glue_mapfile=/opt/d-cache/srm/conf/SRMServerV1.map
        webservice_path=srm/managerv1.wsdl
        webservice_protocol=https
        gsiftpclinet=globus-url-copy
        protocols_list=http,gsiftp
        save_config_file=null
        srmcphome=/opt/d-cache/srm
        urlcopy=/opt/d-cache/srm/sbin/url-copy.sh
        x509_user_cert=/home/csf/traylens/.globus/usercert.pem
        x509_user_key=/home/csf/traylens/.globus/userkey.pem
        x509_user_proxy=/tmp/x509up_u27532
        x509_user_trusted_certificates=/etc/grid-security/certificates
        retry_num=20
        retry_timeout=10000
        wsdl_url=null
        use_urlcopy_script=true
        connect_to_wsdl=false
        delegate=true
        full_delegation=true
        from[0]=srm://dcache.gridpp.rl.ac.uk:8443/pnfs/gridpp.rl.ac.uk/data/dteam/srm2-20051102_174628.txt
        to=srm://pccms2.cmsfarm1.ba.infn.it:8443/pnfs/cmsfarm1.ba.infn.it/data/dteam/sausage

Thu Nov 03 10:00:07 GMT 2005: starting SRMCopyPullClient
Thu Nov 03 10:00:08 GMT 2005: SRMClient(https,srm/managerv1.wsdl,true)
Thu Nov 03 10:00:08 GMT 2005: connecting to server
Thu Nov 03 10:00:08 GMT 2005: connected to server, obtaining proxy
SRMClientV1 : connecting to srm at httpg://pccms2.cmsfarm1.ba.infn.it:8443/srm/managerv1
Thu Nov 03 10:00:12 GMT 2005: got proxy of type class org.dcache.srm.client.SRMClientV1
Thu Nov 03 10:00:12 GMT 2005: copying srm://dcache.gridpp.rl.ac.uk:8443/pnfs/gridpp.rl.ac.uk/data/dteam/srm2-20051102_174628.txt into srm://pccms2.cmsfarm1.ba.infn.it:8443/pnfs/cmsfarm1.ba.infn.it/data/dteam/sausage
SRMClientV1 :   copy, srcSURLS[0]="srm://dcache.gridpp.rl.ac.uk:8443/pnfs/gridpp.rl.ac.uk/data/dteam/srm2-20051102_174628.txt"
SRMClientV1 :   copy, destSURLS[0]="srm://pccms2.cmsfarm1.ba.infn.it:8443/pnfs/cmsfarm1.ba.infn.it/data/dteam/sausage"
SRMClientV1 :  copy, contacting service httpg://pccms2.cmsfarm1.ba.infn.it:8443/srm/managerv1
Thu Nov 03 10:00:21 GMT 2005:  srm returned requestId = -2147475799
Thu Nov 03 10:00:21 GMT 2005: sleeping 1 seconds ...
Thu Nov 03 10:00:23 GMT 2005: sleeping 4 seconds ...
Thu Nov 03 10:00:28 GMT 2005: sleeping 4 seconds ...
Thu Nov 03 10:00:34 GMT 2005: sleeping 4 seconds ...
Thu Nov 03 10:00:40 GMT 2005: FileRequestStatus fileID = -2147475798 is Done => copying of srm://dcache.gridpp.rl.ac.uk:8443/pnfs/gridpp.rl.ac.uk/data/dteam/srm2-20051102_174628.txt is complete



> 
> If you want I can also provide you with names of other sites with dCache 
> installations.



> 
> > A few suggestions:
> > 
> > - pnfs not mounted on pool node
> > - incorrect permissions in /pnfs/....
> > - dn to uid mappings incorrect
> 
> If someone else can test out some copies, then we might be able to narrow 
> down the problem.
> 
> Cheers,
> Greig
> 
> 
> -- 
> ========================================================================
> Dr Greig A Cowan                         http://www.ph.ed.ac.uk/~gcowan1
> School of Physics, University of Edinburgh, James Clerk Maxwell Building
> 
> TIER-2 STORAGE SUPPORT PAGES: http://wiki.gridpp.ac.uk/wiki/Grid_Storage
> ========================================================================

-- 
Steve Traylen
[log in to unmask]
http://www.gridpp.ac.uk/



<?xml version="1.0" encoding="UTF-8"?>
<srm-configuration>

	<!-- true or false-->
	<debug> true </debug>

	<!-- path to srmcp home directory -->
	<srmcphome> /opt/d-cache/srm </srmcphome>

	<!-- "globus-url-copy" or "kftp"-->
	<gsiftpclient> globus-url-copy </gsiftpclient>

	<!--true if use http over gsi over ssl for SOAP invocations 
	or false to use plain http (no authentication or encryption)-->
	<gsissl> true </gsissl>

	<!-- path to the "glue" mapfile-->
	<mapfile> /opt/d-cache/srm/conf/SRMServerV1.map </mapfile>

	<!-- path to the  in the srm webservices server,
	srm/managerv1.wsdl" in case of srm in dcache-->
	<webservice_path> srm/managerv1.wsdl </webservice_path>

	<!-- this could be http or https-->
	<webservice_protocol> https </webservice_protocol>

	<!-- if true, use urlcopy script,
	 otherwise use java native copiers-->
	<use_urlcopy_script> true </use_urlcopy_script>

	<!-- path to the urlcopy script -->
	<urlcopy> /opt/d-cache/srm/sbin/url-copy.sh </urlcopy>

	<!--nonnegative integer, 2048 by default-->
	<buffer_size> 2048 </buffer_size>

	<!--integer, 0 by default (which means do not set tcp_buffer_size at all)-->
	<tcp_buffer_size> 0 </tcp_buffer_size>

	<!-- comma separated list of protocol names, "http,gridftp" by default-->
	<protocols> http,gsiftp </protocols>

	<!-- true for pushmode and false for pullmode, false by default-->
	<pushmode> false </pushmode>

	<!-- true to use user proxy or false to use
	 certificates directly, true by default-->
	<useproxy> true </useproxy>

	<!--absolute path to user proxy-->
	<x509_user_proxy>/tmp/x509up_u27532</x509_user_proxy>

	<!--absolute path to user (or host) private key-->
	<x509_user_key> /home/csf/traylens/.globus/userkey.pem </x509_user_key>

	<!--absolute path to user (or host) certificate-->
	<x509_user_cert> /home/csf/traylens/.globus/usercert.pem </x509_user_cert>

	<!--absolute path to the trusted certificates directory-->
	<x509_user_trusted_certificates> /etc/grid-security/certificates </x509_user_trusted_certificates>
</srm-configuration>