Hi,
Words written by `Graeme Stewart' on 24 May 2005 at 17:20:49 +0100 prompted:
> On Tuesday 24 May 2005 16:40, Jiri Mencak wrote:
>
> > > srm://se2-gla.scotgrid.ac.uk:8443/pnfs/ph.gla.ac.uk/data/dteam
> >
> > I've put the file in, couldn't get it back. Firewall issues?
>
> I can see the file you added:
>
> # ls -l /pnfs/ph.gla.ac.uk/data/dteam/20050524-163505.txt
> -rw-r--r-- 1 dteam001 dteam 713 May 24
> 16:35 /pnfs/ph.gla.ac.uk/data/dteam/20050524-163505.txt
>
> And _I_ can get it out too:
>
> $ /opt/d-cache/srm/bin/srm -copy -x509_user_proxy=/tmp/x509up_u1005
> srm://se2-gla.scotgrid.ac.uk:8443/pnfs/ph.gla.ac.uk/data/dteam/20050524-163505.txt
> file:////tmp/test
> grid05:~$ head /tmp/test
> root:x:0:root
> bin:x:1:root,bin,daemon
> daemon:x:2:root,bin,daemon
> sys:x:3:root,bin,adm
> adm:x:4:root,adm,daemon
> tty:x:5:
> disk:x:6:root
> lp:x:7:daemon,lp
> mem:x:8:
> kmem:x:9:
My srmcp attempts attached together with netstat output. It looks
promising from the start, then hangs forever. I've switched firewalls
from our boxes off (even though I shouldn't have to) but it didn't help.
> I'm not aware of any firewall issues at our end. Can you get the file with
> globus-url-copy?
Wow, got the file! Interesting...
> You did seem to provoke some interesting log messages in
> gridftpdoor.log:
>
> 05/24 16:35:23 Cell(GFTP-Unknown-108@gridftpdoorDomain) : FTPDoor : -encp-put
> not specified, use pnfs manager instead
> 05/24 16:35:26 Cell(GFTP-Unknown-108@gridftpdoorDomain) : EOF Exception in
> read line : java.net.SocketException: Socket closed
>
> (There was also an exception thrown for lack of a /tmp/dcache-ftp-tlog
> directory, which I have now created and it's logging some stuff.)
Yes, GridFTP transfers, I've discovered it too :) Also by chance like
this. Nice place to put logs in, isn't it...
> I see that "-encp-put" is commented out
> of /opt/d-cache/config/gridftpdoor.batch:
>
> # -encp-put=${scripts}/encp-put.sh \
>
> This is documented as being something to do with an HSM interface (and there's
> a /opt/d-cache/jobs/encp.sh script).
>
> I'm guessing this is not important?
No idea, sorry.
>
> > > One scenario which we'd like to test though is the removal of a pool
> > > node. I am imagining a machine has to come down for some reason and stop
> > > being a dCache pool. How do we tell dCache to:
> > >
> > > + Stop putting data onto that pool
> >
> > dCache is intelligent enough to cope with that. The admin node simply
> > won't use a pool that's down.
>
> I know how to disable a pool using the admin interface....
>
> >
> > > + To migrate existing data onto other pools
>
> ....but how does one get the data off it. Aye, there's the rub.
>
> Cheers for your help
>
> Graeme
>
> --
> --------------------------------------------------------------------
> Dr Graeme Stewart http://www.physics.gla.ac.uk/~graeme/
> Department of Physics and Astronomy, University of Glasgow, Scotland
PS: I won't be able to respond tomorrow. Taking a day off.
--
Jiri
++ basename dteam/20050524-163505.txt
+ /opt/d-cache/srm/bin/srmcp -debug=true -webservice_protocol=https -x509_user_proxy=/tmp/x509up_u33032 -gsissl=true srm://se2-gla.scotgrid.ac.uk:8443/pnfs/ph.gla.ac.uk/data/dteam/20050524-163505.txt file://./20050524-163505.txt
SRM Configuration:
debug=true
gsissl=true
help=false
pushmode=false
userproxy=true
buffer_size=2048
tcp_buffer_size=0
config_file=/home/mencak/.srmconfig/config.xml
glue_mapfile=/opt/d-cache/srm//conf/SRMServerV1.map
webservice_path=srm/managerv1.wsdl
webservice_protocol=https
gsiftpclinet=globus-url-copy
protocols_list=http,gsiftp
save_config_file=null
srmcphome=/opt/d-cache/srm/
urlcopy=/opt/d-cache/srm//bin/url-copy.sh
x509_user_cert=/root/jm/k5-ca-proxy.pem
x509_user_key=/root/jm/k5-ca-proxy.pem
x509_user_proxy=/tmp/x509up_u33032
x509_user_trusted_certificates=/root/jm/.globus/certificates
retry_num=20
retry_timeout=10000
wsdl_url=null
use_urlcopy_script=false
connect_to_wsdl=false
from[0]=srm://se2-gla.scotgrid.ac.uk:8443/pnfs/ph.gla.ac.uk/data/dteam/20050524-163505.txt
to=file://./20050524-163505.txt
Tue May 24 17:41:36 BST 2005: starting SRMGetClient
Tue May 24 17:41:36 BST 2005: SRMClient(https,srm/managerv1.wsdl,true)
Tue May 24 17:41:36 BST 2005: connecting to server
Tue May 24 17:41:36 BST 2005: connected to server, obtaining proxy
SRMClientV1 : connecting to srm at httpg://se2-gla.scotgrid.ac.uk:8443/srm/managerv1
Tue May 24 17:41:38 BST 2005: got proxy of type class org.dcache.srm.client.SRMClientV1
SRMClientV1 : get: surls[0]="srm://se2-gla.scotgrid.ac.uk:8443/pnfs/ph.gla.ac.uk/data/dteam/20050524-163505.txt"
SRMClientV1 : get: protocols[0]="http"
SRMClientV1 : get: protocols[1]="dcap"
SRMClientV1 : get: protocols[2]="gsiftp"
SRMClientV1 : get, contacting service httpg://se2-gla.scotgrid.ac.uk:8443/srm/managerv1
doneAddingJobs is false
copy_jobs is empty
Tue May 24 17:41:40 BST 2005: srm returned requestId = -2147483586
Tue May 24 17:41:40 BST 2005: sleeping 1 seconds ...
Tue May 24 17:41:42 BST 2005: FileRequestStatus with SURL=srm://se2-gla.scotgrid.ac.uk:8443/pnfs/ph.gla.ac.uk/data/dteam/20050524-163505.txt is Ready
Tue May 24 17:41:42 BST 2005: received TURL=gsiftp://se2-gla.scotgrid.ac.uk:2811//pnfs/ph.gla.ac.uk/data/dteam/20050524-163505.txt
doneAddingJobs is false
copy_jobs is not empty
copying CopyJob, source = gsiftp://se2-gla.scotgrid.ac.uk:2811//pnfs/ph.gla.ac.uk/data/dteam/20050524-163505.txt destination = file://./20050524-163505.txt
GridftpClient: connecting to se2-gla.scotgrid.ac.uk on port 2811
Tue May 24 17:41:42 BST 2005: fileIDs is empty, breaking the loop
GridftpClient: gridFTPClient tcp buffer size is set to 1048576
GridftpClient: gridFTPRead started
GridftpClient: parallelism: 10
GridftpClient: waiting for completion of transfer
GridftpClient: gridFtpWrite: starting the transfer in emode from /pnfs/ph.gla.ac.uk/data/dteam/20050524-163505.txt
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
tcp 0 0 *:38976 *:* LISTEN 16726/java
tcp 0 0 *:32768 *:* LISTEN 1955/rpc.statd
tcp 0 0 *:nrpe *:* LISTEN 2210/nrpe
tcp 0 0 *:38627 *:* LISTEN -
tcp 0 0 *:gmond *:* LISTEN 2144/gmond
tcp 0 0 *:sunrpc *:* LISTEN 1936/portmap
tcp 0 0 localhost.localdomain:32786 *:* LISTEN 2112/xinetd
tcp 0 0 *:ssh *:* LISTEN 2098/sshd
tcp 0 0 localhost.localdomain:ipp *:* LISTEN 26890/cupsd
tcp 0 0 *:31416 *:* LISTEN 2187/boinc
tcp 0 0 localhost.localdomain:smtp *:* LISTEN 2231/sendmail: acce
tcp 0 0 localhost.lo:x11-ssh-offset *:* LISTEN 25311/0
tcp 0 0 *:2811 *:* LISTEN 15579/java
tcp 0 0 localhost.localdomain:6012 *:* LISTEN 6078/4
tcp 0 0 localhost.localdomain:6013 *:* LISTEN 6187/6
tcp 0 0 localhost.localdomain:6014 *:* LISTEN 6297/7
tcp 0 0 localhost.localdomain:6015 *:* LISTEN 26892/1
tcp 0 0 dev02.gridpp.rl.ac.uk:38626 dev01.gridpp.rl.ac.uk:33239 ESTABLISHED 15579/java
tcp 0 0 dev02.gridpp.rl.ac.uk:38630 dev01.gridpp.rl.ac.uk:33239 ESTABLISHED 15772/java
tcp 0 0 dev02.gridpp.rl.ac.uk:38975 se2-gla.scotgrid.ac.uk:2811 ESTABLISHED 16726/java
tcp 64 0 dev02.gridpp.rl.ac.uk:32944 dev02.gridpp.rl.ac.uk:ssh ESTABLISHED 6296/ssh
tcp 0 0 dev02.gridpp.rl.ac.uk:ssh pcmencak.esc.rl.ac.uk:34715 ESTABLISHED 26892/1
tcp 0 0 localhost.localdomain:38972 localhost.localdomain:38971 TIME_WAIT -
tcp 0 0 localhost.localdomain:6013 localhost.localdomain:32946 ESTABLISHED 6187/6
tcp 0 0 localhost.localdomain:6014 localhost.localdomain:32945 ESTABLISHED 6297/7
tcp 0 0 dev02.gridpp.rl.ac.uk:ssh pcmencak.esc.rl.ac.uk:34734 ESTABLISHED 25309/sshd: mencak
tcp 0 0 localhost.localdomain:6015 localhost.localdomain:33853 ESTABLISHED 26892/1
tcp 0 288 dev02.gridpp.rl.ac.uk:ssh dev02.gridpp.rl.ac.uk:32944 ESTABLISHED 6297/7
tcp 0 0 localhost.localdomain:6012 localhost.localdomain:32942 ESTABLISHED 6078/4
tcp 0 0 localhost.localdomain:32940 localhost.lo:x11-ssh-offset ESTABLISHED 6011/mc
tcp 0 288 dev02.gridpp.rl.ac.uk:ssh pcmencak.esc.rl.ac.uk:48956 ESTABLISHED 6185/sshd: mencak [
tcp 0 0 localhost.lo:x11-ssh-offset localhost.localdomain:32940 ESTABLISHED 25311/0
tcp 0 0 localhost.localdomain:33853 localhost.localdomain:6015 ESTABLISHED 26962/mc
tcp 0 0 dev02.gridpp.rl.ac.uk:ssh pcmencak.esc.rl.ac.uk:48955 ESTABLISHED 6076/sshd: mencak [
tcp 0 0 localhost.localdomain:32942 localhost.localdomain:6012 ESTABLISHED 6137/mc
tcp 0 0 localhost.localdomain:32946 localhost.localdomain:6013 ESTABLISHED 6296/ssh
tcp 0 0 localhost.localdomain:32945 localhost.localdomain:6014 ESTABLISHED 6373/mc
|
