Chris , have a look at the talk from EGICF entitled "A gridified version of rsync"
https://indico.egi.eu/indico/materialDisplay.py?contribId=38&sessionId=17&materialId=slides&confId=1222
this was how they uploaded files to the grid, yours is just the reverse case?
Brian
-----Original Message-----
From: GRIDPP2: Deployment and support of SRM and local storage management [mailto:[log in to unmask]] On Behalf Of Christopher J. Walker
Sent: 20 April 2013 17:07
To: [log in to unmask]
Subject: mirroring a grid directory
One of the QMUL users wanted a local copy of files from the grid.
In the end, it was easiest for me to use rsync, but is there a simple way of doing:
lcg-cp srm://my.se/vo/path/to/directory /mymachine/path/localdirectory
Ideally multithreaded and only copying files if they don't already exist (probably checksumming to check they are the same)?
Ideally this would allow multiple files to download at once.
Assuming such a thing doesn't exist, would it be worth writing, or are we so near webdav access that rsync on a webdav mounted filesystem would be the way to go?
On which subject, is there a multistream rsync?
Chris
--
Scanned by iCritical.
|