Hi Wahid,
I've configured the Cambridge head node for the ATLAS xrootd
federation - you can make it active if you wish. I tried to use the
mechanism you advertised to make myself active, but the AGIS web site
gives me a redirection error.
Incidentally, WebDav should also work at Cambridge now.
Cheers,
John
On 29/01/2013 11:03, John Hill wrote:
> Hi Wahid,
> Please leave it disabled for the moment - I've installed the bits
> everywhere, but have only re-yaimed the pool nodes so far. I need to
> check the head node configuration before I re-yaim it (xrootd is running
> on the head node, but only in "trivial" mode).
> Cheers,
> John
>
> On 29/01/2013 10:57, Wahid Bhimji wrote:
>> John
>>
>> BTW - we noticed cambridge xrootd service pop up - so we added it to
>> the ATLAS AGIS System - however since I left it in the "disabled"
>> state as I hadn't heard from you if it was actually ready.
>> If you are ready, I can change it to "Active" - it won't do any harm -
>> just mean you will get some test jobs.)
>>
>> (but if it is only partially installed - or you don't want ATLAS to
>> ever use it then we shouldn't set it active)
>>
>> cheers
>>
>> Wahid
>>
>> On 28 Jan 2013, at 16:30, John Hill <[log in to unmask]> wrote:
>>
>>> It's already there -
>>> https://svnweb.cern.ch/trac/lcgdm/wiki/Dpm/Xroot/Setup#ATLASfederation tells
>>> you that you need to "yum install lfc-devel".
>>>
>>> John
>>>
>>> On 28/01/2013 16:27, Alessandra Forti wrote:
>>>> It should at least go in the documentation. liblfc.so is mentioned but
>>>> nowhere it is said that the rpm has to be manually installed.
>>>>
>>>> On 28/01/2013 16:17, Wahid Bhimji wrote:
>>>>> odd.
>>>>> it should be in /usr/lib64
>>>>> (I thought) it came from the standard DPM installation
>>>>>
>>>>> but for me:
>>>>> [root@srm ~]# ldd /usr/lib64/XrdOucName2NameLFC.so | grep lfc
>>>>> liblfc.so.1 => /usr/lib64/liblfc.so.1 (0x00002b5d08f5d000)
>>>>> [root@srm ~]# rpm -qf /usr/lib64/liblfc.so.1
>>>>> lfc-libs-1.8.4-1.el5.x86_64
>>>>> [root@srm ~]# rpm -q --whatrequires lfc-libs
>>>>> lfc-devel-1.8.4-1.el5.x86_64
>>>>> [root@srm ~]# rpm -q --whatrequires lfc-devel
>>>>> no package requires lfc-devel
>>>>>
>>>>> So I guess I might have installed it myself… or perhaps a previous
>>>>> version of dpm-xrootd had it as a dependency.
>>>>> Anyway
>>>>> yum install lfc-devel
>>>>> or lfc-libs should suffice
>>>>>
>>>>> (debateable whether it should be a dependency given only the ATLAS
>>>>> setup requires it - ideally that lib would be an rpm - I'll ask the
>>>>> fax guys about making it so (if thats the reason you don't have it))
>>>>>
>>>>> Wahid
>>>>>
>>>>>
>>>>> On 28 Jan 2013, at 16:06, Alessandra Forti <[log in to unmask]
>>>>> <mailto:[log in to unmask]>> wrote:
>>>>>
>>>>>> Hi Wahid,
>>>>>>
>>>>>> I downloaded and installed the library and created a link to match
>>>>>> the name in the configuration
>>>>>>
>>>>>> ls -l /usr/lib64/XrdOucName2NameLFC.so
>>>>>> lrwxrwxrwx 1 root root 32 Jan 28 15:53
>>>>>> /usr/lib64/XrdOucName2NameLFC.so -> XrdOucName2NameLFC-el6-x86_64.so
>>>>>>
>>>>>> but I still get an error pointing to another missing library
>>>>>>
>>>>>> 130128 16:00:03 22018 dpmfinder_getPlugin: Unable to open
>>>>>> XrdOucName2NameLFC.so liblfc.so: cannot open shared object file: No
>>>>>> such file or directory
>>>>>> 130128 16:00:03 22018 dpmfinder_Config: Problem configuring namelib
>>>>>>
>>>>>> where can I find liblfc.so ?
>>>>>>
>>>>>> cheers
>>>>>> alessandra
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 28/01/2013 14:38, Wahid Bhimji wrote:
>>>>>>>
>>>>>>> Hi .
>>>>>>>
>>>>>>> Yes, the intructions on the trac do say to download it - but its
>>>>>>> not very clear .
>>>>>>> There is a new version of the FAX twiki here:
>>>>>>> https://twiki.cern.ch/twiki/bin/view/Atlas/JoiningTheATLASFederation#Install_the_Name_to_Name_plugin
>>>>>>>
>>>>>>>
>>>>>>> You can download the pre-compiled but I recompiled it .
>>>>>>> It only needs to be on the head node (in /usr/lib64 by default - or
>>>>>>> you can change the yaim var/ config scripts to point elsewhere).
>>>>>>>
>>>>>>> Wahid
>>>>>>>
>>>>>>>
>>>>>>> On 28 Jan 2013, at 14:31, Alessandra Forti <[log in to unmask]
>>>>>>> <mailto:[log in to unmask]>> wrote:
>>>>>>>
>>>>>>>> Ok, I've found some additional info here
>>>>>>>>
>>>>>>>> https://twiki.cern.ch/twiki/bin/view/Atlas/AtlasXrootdSystems_Old#Additional_Instructions_for_Tier
>>>>>>>>
>>>>>>>>
>>>>>>>> do I have to compile it? and does it have to go only on the head
>>>>>>>> node or on any of the machines?
>>>>>>>>
>>>>>>>> cheers
>>>>>>>> alessandra
>>>>>>>>
>>>>>>>> On 28/01/2013 14:26, Alessandra Forti wrote:
>>>>>>>>> The configuration I added following the instructions is this.
>>>>>>>>>
>>>>>>>>> /# xrootd setup 23/01/2012//
>>>>>>>>> //DPM_XROOTD_SHAREDKEY="<loooooooooong-key>"//
>>>>>>>>> //# Atlas xrootd setup//
>>>>>>>>> //
>>>>>>>>> //DPM_XROOTD_FEDREDIRS="atlas-xrd-uk.cern.ch
>>>>>>>>> <http://atlas-xrd-uk.cern.ch/>:1094:1098,atlas,/atlas" //
>>>>>>>>> //DPM_XROOTD_FED_ATLAS_NAMELIBPFX="/dpm/${MY_DOMAIN}/home/atlas"//
>>>>>>>>> //DPM_XROOTD_FED_ATLAS_NAMELIB="XrdOucName2NameLFC.so
>>>>>>>>> root=/dpm/${MY_DOMAIN}/home/atlas
>>>>>>>>> match=bohr3226.tier2.hep.manchester.ac.uk
>>>>>>>>> <http://hep.manchester.ac.uk/>"//
>>>>>>>>> //DPM_XROOTD_FED_ATLAS_SETENV="LFC_HOST=prod-lfc-atlas-ro.cern.ch
>>>>>>>>> <http://prod-lfc-atlas-ro.cern.ch/> LFC_CONRETRY=0
>>>>>>>>> GLOBUS_THREAD_MODEL=pthread CSEC_MECH=ID"/
>>>>>>>>>
>>>>>>>>> I hadn't understood I had to download a library though. Where do I
>>>>>>>>> get it from?
>>>>>>>>>
>>>>>>>>> thanks
>>>>>>>>>
>>>>>>>>> cheers
>>>>>>>>> alessandra
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 28/01/2013 13:08, Wahid Bhimji wrote:
>>>>>>>>>> Hi
>>>>>>>>>>
>>>>>>>>>>> Shutting down xrootd (xrootd, fedredir_atlas): [FAILED]
>>>>>>>>>>> Starting xrootd (xrootd, fedredir_atlas): [FAILED]
>>>>>>>>>>>
>>>>>>>>>>> I guess this is a redirector configuration that shouldn't be on
>>>>>>>>>>> the head node and I don't have to worry about it. Is that
>>>>>>>>>>> correct?
>>>>>>>>>> No, sadly you do have to worry about it - that federated
>>>>>>>>>> redirector should be running on the head node.
>>>>>>>>>>
>>>>>>>>>> There might be something useful in the logs for that service.
>>>>>>>>>> I guess double check that you followed
>>>>>>>>>> https://svnweb.cern.ch/trac/lcgdm/wiki/Dpm/Xroot/Setup#ATLASfederation
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> (with the UK redirector for the var DPM_XROOTD_FEDREDIRS)
>>>>>>>>>> and that you downloaded the N2N library at
>>>>>>>>>> /usr/lib64/XrdOucName2NameLFC.so
>>>>>>>>>> and that the machine iteself can connect to the port that the
>>>>>>>>>> federated xrootd server is runing on 11000 by default I think.
>>>>>>>>>>
>>>>>>>>>> Wahid
>>>>>>>>>>
>>>>>>>>>> On 28 Jan 2013, at 12:57, Alessandra Forti
>>>>>>>>>> <[log in to unmask] <mailto:[log in to unmask]>>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Wahid,
>>>>>>>>>>>
>>>>>>>>>>> thanks, the testbed works. I've now reconfigured also the head
>>>>>>>>>>> node and will do the data servers one at the time.
>>>>>>>>>>>
>>>>>>>>>>> I get these as well from yaim
>>>>>>>>>>>
>>>>>>>>>>> Shutting down xrootd (xrootd, fedredir_atlas): [FAILED]
>>>>>>>>>>> Starting xrootd (xrootd, fedredir_atlas): [FAILED]
>>>>>>>>>>>
>>>>>>>>>>> I guess this is a redirector configuration that shouldn't be on
>>>>>>>>>>> the head node and I don't have to worry about it. Is that
>>>>>>>>>>> correct?
>>>>>>>>>>>
>>>>>>>>>>> cheers
>>>>>>>>>>> alessandra
>>>>>>>>>>>
>>>>>>>>>>> On 28/01/2013 10:42, Wahid Bhimji wrote:
>>>>>>>>>>>> Hi
>>>>>>>>>>>>
>>>>>>>>>>>> well it is just there on lxplus but on our local desktops we
>>>>>>>>>>>> get it with ATLAS_LOCAL_ROOT_BASE over cvmfs
>>>>>>>>>>>> ie.
>>>>>>>>>>>> export
>>>>>>>>>>>> ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase
>>>>>>>>>>>>
>>>>>>>>>>>> <http://atlas.cern.ch/repo/ATLASLocalRootBase>
>>>>>>>>>>>> source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh
>>>>>>>>>>>>
>>>>>>>>>>>> but then instead of localSetupGLite which has the rest of the
>>>>>>>>>>>> clients . xrdcp seems to come from
>>>>>>>>>>>> localSetupROOT
>>>>>>>>>>>>
>>>>>>>>>>>> Anyway if you prefer an rpm I think
>>>>>>>>>>>> xrootd-client-3.0.5-1.el5.x86_64.rpm
>>>>>>>>>>>>
>>>>>>>>>>>> is in EPEL
>>>>>>>>>>>>
>>>>>>>>>>>> Cheers
>>>>>>>>>>>>
>>>>>>>>>>>> Wahid
>>>>>>>>>>>>
>>>>>>>>>>>> On 28 Jan 2013, at 10:10, Alessandra Forti
>>>>>>>>>>>> <[log in to unmask] <mailto:[log in to unmask]>>
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>
>>>>>>>>>>>>> always on the testbed curl works. xrdcp I can't find. Is there
>>>>>>>>>>>>> an extra rpm for the clients?
>>>>>>>>>>>>>
>>>>>>>>>>>>> cheers
>>>>>>>>>>>>> alessandra
>>>>>>>>>>>>>
>>>>>>>>>>>>> On 23/01/2013 16:40, Wahid Bhimji wrote:
>>>>>>>>>>>>>> You can try copying a file:
>>>>>>>>>>>>>> For xrootd:
>>>>>>>>>>>>>> From the storage itself using the /dpm path like- testing
>>>>>>>>>>>>>> the
>>>>>>>>>>>>>> non-federated xrootd part
>>>>>>>>>>>>>> xrdcp -f -d 1 -v
>>>>>>>>>>>>>> root://fal-pygrid-30.lancs.ac.uk//dpm/lancs.ac.uk/home/atlas/wahidtest
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> /dev/null
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> then from the head node but using the /atlas path which
>>>>>>>>>>>>>> should test if the federated redirector is working as well
>>>>>>>>>>>>>> xrdcp -f -d 1 -v
>>>>>>>>>>>>>> root://srm.glite.ecdf.ed.ac.uk:1094//atlas/dq2/user/HironoriIto/user.HironoriIto.xrootd.uki-scotgrid-ecdf/user.HironoriIto.xrootd.uki-scotgrid-ecdf-1M
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> /dev/null
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> then also trying the UK redirector or another site for the
>>>>>>>>>>>>>> files at manchester
>>>>>>>>>>>>>> xrdcp -f -d 1 -v
>>>>>>>>>>>>>> root://atlas-xrd-uk.cern.ch:1094//atlas/dq2/user/HironoriIto/user.HironoriIto.xrootd.uki-scotgrid-ecdf/user.HironoriIto.xrootd.uki-scotgrid-ecdf-1M
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> /dev/null
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> there should already be a file as above placed at manchester
>>>>>>>>>>>>>> named with your site name . The debug -d flag can be ramped
>>>>>>>>>>>>>> up but is already quite verbose.
>>>>>>>>>>>>>> If that all works then it should work in the other atlas
>>>>>>>>>>>>>> automated tests so you may as well be added to those then.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> for Webdav you can use curl e.g.
>>>>>>>>>>>>>> curl -v -E $X509_USER_PROXY --capath $X509_CERT_DIR -L
>>>>>>>>>>>>>> https://gridpp09.ecdf.ed.ac.uk/dpm/ecdf.ed.ac.uk/home/atlas/group.test.hc.NTUP_SMWZ.root
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> -o bob.root
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> generally not as informative in its output (and puts the
>>>>>>>>>>>>>> error in the output file) .
>>>>>>>>>>>>>> You can also try mounting it in windows for fun.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> cheers
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> wahid
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On 23 Jan 2013, at 16:33, Alessandra Forti
>>>>>>>>>>>>>> <[log in to unmask] <mailto:[log in to unmask]>>
>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I'm adding the bits and pieces to YAIM.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Is there a way I can test if I've enabled xrootd and WEBdav
>>>>>>>>>>>>>>> correctly?
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> cheers
>>>>>>>>>>>>>>> alessandra
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>> Facts aren't facts if they come from the wrong people. (Paul
>>>>>>>>>>>>>>> Krugman)
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Facts aren't facts if they come from the wrong people. (Paul
>>>>>>>>>>>>> Krugman)
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Facts aren't facts if they come from the wrong people. (Paul
>>>>>>>>>>> Krugman)
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> The University of Edinburgh is a charitable body, registered in
>>>>>>>>>> Scotland, with registration number SC005336.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Facts aren't facts if they come from the wrong people. (Paul
>>>>>>>>> Krugman)
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Facts aren't facts if they come from the wrong people. (Paul
>>>>>>>> Krugman)
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> The University of Edinburgh is a charitable body, registered in
>>>>>>> Scotland, with registration number SC005336.
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Facts aren't facts if they come from the wrong people. (Paul Krugman)
>>>>>
>>>>>
>>>>>
>>>>> The University of Edinburgh is a charitable body, registered in
>>>>> Scotland, with registration number SC005336.
>>>>
>>>>
>>>> --
>>>> Facts aren't facts if they come from the wrong people. (Paul Krugman)
>>>>
>>>
>>
>>
|
