Hi Brian.

That's an interesting question.  In general, there is an
overhead for SRM, and then some for GridFTP (to do security and
the ctrl messages).

Now I don't know the internals of filetransfer.py but if you
run something like globus-url-copy with debug (-dbg switch) and
watch its output unbuffered, and look for

150 Opening BINARY mode data connection.

and

226 Transfer complete.

Then in theory the time between the two messages is the time
it took for the raw transfer - or at least as close as you can
get on the client side.  Of course you will then have to do that
for each file, but if you watch the output of g-u-c you can
at least see which ones failed.

Of course that only works for local transfers : where a file
is transferred to and from the client.  For the 3rd party
transfers, you are stuffed.  CERN and FNAL used to disagree
on the semantics of srmCopy: should it be "Done" when a transfer
is submitted, or when it has completed (successfully)?  I forgot
which one won but in either case it won't tell you the transfer
rate.

To get more useful data from 3rd party copying we need a way to
match the logs with the file, and to send this data back to the
transfer agent.

Cheers,
			--jens



-----Original Message-----
From: GRIDPP2: Deployment and support of SRM and local storage
management [mailto:[log in to unmask]]On Behalf Of brian
davies
Sent: 08 June 2006 14:41
To: [log in to unmask]
Subject: tranfer script


hi all, but really aimed at graeme but someone else may know...
using graeme's transfer script i get jobs running ( woo hoo!!) but it
then seems to hang with a couple of files in waiting mode. if i then
cancel the transfer the filetransfer.py executable then finishes and
gives me a transfer time. I noticed that the script gives times for
each file. is rate ( ie the Mbps ):
1) (SUM of file transfered)/ (difference in filetransfer.py start to end times)
or
2) SUM of ( (file size)/(difference in active and done times) ).

i think it is the first. Is it possible to get the second?
both would be useful as the second shows actual file transfer times
and the difference between the two is the overhead for the transfer.
cheers
brian