JISCMail - GRIDPP-STORAGE Archives

Email discussion lists for the UK Education and Research communities
Subscriber's Corner
Email Lists
GRIDPP-STORAGE Archives

GRIDPP-STORAGE@JISCMAIL.AC.UK

View:

Message:
[
First
Last
]
By Topic:
[
First
Last
]
By Author:
[
First
Last
]
Font:
Proportional Font
		LISTSERV Archives
		GRIDPP-STORAGE Home
		GRIDPP-STORAGE June 2005
Options

Subscribe or Unsubscribe
Get Password
Subject:
Re: New Edinburgh dCache install
From:
Owen Synge <[log in to unmask]>
Reply-To:
Owen Synge <[log in to unmask]>
Date:
Tue, 28 Jun 2005 18:39:48 +0100
Content-Type:
text/plain
Parts/Attachments:
text/plain (284 lines)
On Tue, 28 Jun 2005 18:30:23 +0100
Greig A Cowan <[log in to unmask]> wrote:

> Hi guys, 
> 
> The DCACHE_PORT_RANGE field in the site-info.def file is commented out. Is 
> this not the same for everyone? GLOBUS_TCP_PORT_RANGE was set to 
> the correct value though: "50000 52000"
> 
> Anyway, I've altered the dCacheSetup file as Derek suggested and 
> globus-url-copy now appears to be working for me using our relocatable UI. 
> Can someone else try out srmcp/globus-url-copy commands to and from our 
> dCache to test it?
> 
> srm://srm.epcc.ed.ac.uk:8443/pnfs/epcc.ed.ac.uk/data/dteam/
> gsiftp://srm.epcc.ed.ac.uk/pnfs/epcc.ed.ac.uk/data/dteam/
> 
> Thanks,
> Greig

I just tested and


/opt/d-cache/srm/bin/srm -copy -webservice_protocol=httpg -x509_user_proxy=/tmp/x509up_u27529 srm://se2-gla.scotgrid.ac.uk:8443/pnfs/ph.gla.ac.uk/data/dteam/file_test_synge.20050628183135.ph.gla.ac.uk file://///tmp//file_test_synge.20050628183135.ph.gla.ac.uk

was failing although it worked earlier today but the imortant news is

/opt/d-cache/srm/bin/srm -copy -webservice_protocol=httpg -x509_user_proxy=/tmp/x509up_u27529 file://///usr/lib/X11/rgb.txt srm://srm.epcc.ed.ac.uk:8443/pnfs/epcc.ed.ac.uk/data/dteam/file_test_synge.20050628183135.epcc.ed.ac.uk
transfer rc = 0
/opt/d-cache/srm/bin/srm -copy -webservice_protocol=httpg -x509_user_proxy=/tmp/x509up_u27529 srm://srm.epcc.ed.ac.uk:8443/pnfs/epcc.ed.ac.uk/data/dteam/file_test_synge.20050628183135.epcc.ed.ac.uk file://///tmp//file_test_synge.20050628183135.epcc.ed.ac.uk
md5sum match srm.epcc.ed.ac.uk


Which is WONDERFUL

thankyou so much for going through this process of instalation once more and finding the issues, I shall now repeat the test for ph.gla.ac.uk.

Regards

Owen Synge



> > Hi Grieg,
> > 
> > Check the /opt/d-cache/config/dCacheSetup file. Check that the java options near the top is using the right ports i.e.
> > 
> > java_options="-server -Xmx512m -XX:MaxDirectMemorySize=512m \
> >               -Dorg.globus.tcp.port.range=50000,52000"
> > 
> > 
> > Further down, there's also
> > 
> > clientDataPortRange=50000:52000
> > 
> > 
> > Derek
> > 
> > 
> > > -----Original Message-----
> > > From: GRIDPP2: Deployment and support of SRM and local storage
> > > management [mailto:[log in to unmask]]On Behalf Of Greig A
> > > Cowan
> > > Sent: 28 June 2005 17:53
> > > To: [log in to unmask]
> > > Subject: Re: New Edinburgh dCache install
> > > 
> > > 
> > > Hi Owen,
> > > 
> > > > > It failed with
> > > > > 
> > > > > 
> > > srm://srm.epcc.ed.ac.uk:8443/pnfs/epcc.ed.ac.uk/data/dteam/fil
> > > e_test_synge.20050628104900.epcc.ed.ac.uk
> > > > > 
> > > > > The responce is 
> > > > > 
> > > > > debug: response from 
> > > gsiftp://srm.epcc.ed.ac.uk:2811//pnfs/epcc.ed.ac.uk/data/dteam
> > > /file_test_synge.20050628104900.epcc.ed.ac.uk3:
> > > > > 150 Openning BINARY data connection for 
> > > /pnfs/epcc.ed.ac.uk/data/dteam/file_test_synge.20050628104900.
> > > epcc.ed.ac.uk3
> > > > > 
> > > > > debug: fault on connection to 
> > > gsiftp://srm.epcc.ed.ac.uk:2811//pnfs/epcc.ed.ac.uk/data/dteam
> > > /file_test_synge.20050628104900.epcc.ed.ac.uk3: Handle not in 
> > > the proper state
> > > > > debug: error reading response from 
> > > gsiftp://srm.epcc.ed.ac.uk:2811//pnfs/epcc.ed.ac.uk/data/dteam
> > > /file_test_synge.20050628104900.epcc.ed.ac.uk3: the handle 
> > > 0x806b22c was already registered for closing
> > > > > debug: data callback, no error, buffer 0x80703d8, length 
> > > 0, offset=0, eof=true
> > > > > debug: operation complete
> > > > > 
> > > > > 
> > > > > Which suggests a networking issue, does it work from the box?
> > > 
> > > Thanks to some help from Steve Thorn at NeSC, we may have 
> > > begun tracking
> > > down the problem. He has been able to perform 
> > > globus-url-copy's into our
> > > dCache from another ScotGrid machine 
> > > (glenmorangie.epcc.ed.ac.uk). This
> > > goes through a ScotGrid switch, not through the wider SRIF 
> > > network that
> > > traffic uses coming from outside of Edinburgh.
> > > 
> > > It looks like at least some of the middleware on our admin node
> > > (srm.epcc.ed.ac.uk) is using the default globus port range of 
> > > 20000-25000
> > > (see packet dump below). On the SRIF network these ports are 
> > > blocked as
> > > 50000-52000 is the allowed range. The globus config file
> > > /etc/sysconfig/globus contains the correct range, as does the
> > > GLOBUS_TCP_PORT_RANGE environment variable, but who can say what
> > > configuration files/hardcoding is used in the various srm doors.
> > > 
> > > To summarize: when not encumbered by firewalls it works consistently.
> > > srm.epcc is *not* using the port range defined in
> > > /etc/sysconfig/globus.
> > > 
> > > Is there any way of changing the default port range consistently?
> > > 
> > > Cheers,
> > > Greig
> > > 
> > > ===============================
> > > Packet dump. Irrelevant packets removed
> > > 
> > > 
> > > glenmorangie# tcpdump -q host srm.epcc.ed.ac.uk
> > > tcpdump: listening on eth0
> > > 16:11:35.312192 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 0 (DF)
> > > 16:11:35.312392 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 0 (DF)
> > > 16:11:35.312424 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 0 (DF)
> > > 16:11:35.319327 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 24 (DF)
> > > 16:11:35.319338 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 0 (DF)
> > > 16:11:35.319742 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 13 (DF)
> > > 16:11:35.319968 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 0 (DF)
> > > 16:11:35.364483 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 22 (DF)
> > > 16:11:35.383613 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 127 (DF)
> > > 16:11:35.383768 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 0 (DF)
> > > 16:11:35.459060 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 1448 (DF)
> > > 16:11:35.459068 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 1448 (DF)
> > > 16:11:35.459074 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 0 (DF)
> > > 16:11:35.459395 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 1448 (DF)
> > > 16:11:35.459404 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 1448 (DF)
> > > 16:11:35.459410 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 0 (DF)
> > > 16:11:35.459414 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 643 (DF)
> > > 16:11:35.491566 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 0 (DF)
> > > 16:11:35.500755 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 1448 (DF)
> > > 16:11:35.500772 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 1448 (DF)
> > > 16:11:35.500921 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 0 (DF)
> > > 16:11:35.500946 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 1448 (DF)
> > > 16:11:35.500952 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 479 (DF)
> > > 16:11:35.500957 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 0 (DF)
> > > 16:11:35.501111 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 0 (DF)
> > > 16:11:35.501119 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 0 (DF)
> > > 16:11:35.544562 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 111 (DF)
> > > 16:11:35.544688 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 0 (DF)
> > > 16:11:35.545911 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 47 (DF)
> > > 16:11:35.546096 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 0 (DF)
> > > 16:11:35.624240 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 467 (DF)
> > > 16:11:35.632006 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 707 (DF)
> > > 16:11:35.632284 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 0 (DF)
> > > 16:11:35.640070 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 8 (DF)
> > > 16:11:35.640349 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 78 (DF)
> > > 16:11:35.648938 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 90 (DF)
> > > 16:11:35.649278 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 58 (DF)
> > > 16:11:35.649973 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 78 (DF)
> > > 16:11:35.650311 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 58 (DF)
> > > 16:11:35.650918 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 130 (DF)
> > > 16:11:35.651256 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 58 (DF)
> > > 16:11:35.651881 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 66 (DF)
> > > 16:11:35.652171 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 58 (DF)
> > > 16:11:35.653098 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 90 (DF)
> > > 16:11:35.653555 glenmorangie.epcc.ed.ac.uk.50001 >
> > > srm.epcc.ed.ac.uk.20001: tcp 0 (DF)
> > > 16:11:35.653687 srm.epcc.ed.ac.uk.20001 >
> > > glenmorangie.epcc.ed.ac.uk.50001: tcp 0 (DF)
> > > 16:11:35.653705 glenmorangie.epcc.ed.ac.uk.50001 >
> > > srm.epcc.ed.ac.uk.20001: tcp 0 (DF)
> > > 16:11:35.654057 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 122 (DF)
> > > 16:11:35.686168 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 0 (DF)
> > > 16:11:35.968342 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 162 (DF)
> > > 16:11:35.968795 glenmorangie.epcc.ed.ac.uk.50001 >
> > > srm.epcc.ed.ac.uk.20001: tcp 6 (DF)
> > > 16:11:35.968968 srm.epcc.ed.ac.uk.20001 >
> > > glenmorangie.epcc.ed.ac.uk.50001: tcp 0 (DF)
> > > 16:11:35.969080 glenmorangie.epcc.ed.ac.uk.50001 >
> > > srm.epcc.ed.ac.uk.20001: tcp 0 (DF)
> > > 16:11:36.001600 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 0 (DF)
> > > 16:11:36.006172 srm.epcc.ed.ac.uk.20001 >
> > > glenmorangie.epcc.ed.ac.uk.50001: tcp 0 (DF)
> > > 16:11:36.048766 srm.epcc.ed.ac.uk.20001 >
> > > glenmorangie.epcc.ed.ac.uk.50001: tcp 0 (DF)
> > > 16:11:36.048781 glenmorangie.epcc.ed.ac.uk.50001 >
> > > srm.epcc.ed.ac.uk.20001: tcp 0 (DF)
> > > 16:11:36.272498 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 78 (DF)
> > > 16:11:36.272535 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 0 (DF)
> > > 16:11:36.273337 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 58 (DF)
> > > 16:11:36.273465 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 0 (DF)
> > > 16:11:36.273982 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 66 (DF)
> > > 16:11:36.274065 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 0 (DF)
> > > 16:11:36.274329 glenmorangie.epcc.ed.ac.uk.50000 >
> > > srm.epcc.ed.ac.uk.2811: tcp 0 (DF)
> > > 16:11:36.274479 srm.epcc.ed.ac.uk.2811 >
> > > glenmorangie.epcc.ed.ac.uk.50000: tcp 0 (DF)
> > >                                                               
> > >                                                               
> > >                                  
> > > 73 packets received by filter
> > > 0 packets dropped by kernel
> > > 
> > 
> 
> -- 
> =======================================================================
> Greig Cowan                          e: [log in to unmask]
> School of Physics                    t: +44 131 650 5300
> The University of Edinburgh          f: +44 131 650 7189
> James Clerk Maxwell Building         w: http://www.ph.ed.ac.uk/~gcowan1
> Mayfield Road
> Edinburgh
> EH9 3JZ, UK
> =======================================================================
Top of Message | Previous Page | Permalink
JiscMail Tools

Files Area | help
RSS Feeds and Sharing

Search Archives

Advanced Options