Hi Brian,

I have tried to access the web site

https://lcgcadm04.gridpp.rl.ac.uk/castor/ads.rl.ac.uk/prod/vo.dirac.ac.uk/DiRAC/tape/durham.ac.uk/cosma5/data/jch/L800/Runs/KEEP/data/

but I get, permission denied.

This is my personal grid certificate, imported in the to browser.

Best wishes,
Lydia



On Tue, 23 Jun 2015, Brian Davies wrote:

> Hi Lydia,
> We have a test webdav endpoint so uyou can see which files are in castor.
> IF you point a browser with you certificate installed at
>
> https://lcgcadm04.gridpp.rl.ac.uk/castor/ads.rl.ac.uk/prod/vo.dirac.ac.uk/DiRAC/tape/durham.ac.uk/cosma5/data/jch/L800/Runs/KEEP/data/
>
>
>
> I have discovered that you are still using the hostname srm-alice.gridpp.rl.ac.uk
> Can you switch to srm-dirac.gridpp.rl.ac.uk please for future transfers. ( it doesn't affect the success of the transfers , but does mix up the monitoring pages of the FTS
>
> Currently your jobs log outputs can be seen here:
> https://lcgfts3.gridpp.rl.ac.uk:8449/fts3/ftsmon/#/?vo=&source_se=&dest_se=srm:%2F%2Fsrm-alice.gridpp.rl.ac.uk&time_window=24
>
> if you click on link in the Failed column; and then on a job id you will end up at a page like this:
> https://lcgfts3.gridpp.rl.ac.uk:8449/fts3/ftsmon/#/job/ffb79ee0-db4f-4ef1-9000-4533c5093365
>
> Where you can see which files form within a job succeeded or not.
>
> My suggestion is that when you have run through the campaign of transfers . I can provide you a dump of filenames and sizes of all the files you have copied as a check to see which need to be re-submitted
> Did you set a retry value to be greater than 0?
>
> Brian
>
>
> -----Original Message-----
> From: DiRAC Users [mailto:[log in to unmask]] On Behalf Of Dr Jens Jensen
> Sent: 22 June 2015 23:00
> To: [log in to unmask]
> Subject: Re: Tick tick...
>
> Great - let's keep it busy!
> ________________________________________
> From: DiRAC Users [[log in to unmask]] on behalf of Lydia Heck [[log in to unmask]]
> Sent: 22 June 2015 20:45
> To: [log in to unmask]
> Subject: Re: Tick tick...
>
> Hi all,
>
> I have submitted 4 more transfers, each with 1024 files and a total of ~16 TB.
>
> There are 11 more, but I will check tomorrow and do more.
>
> Lydia
>
>
> On Mon, 22 Jun 2015, Jensen, Jens (STFC,RAL,SC) wrote:
>
>> Hi Lydia, all,
>>
>> I know I suggested 1000 files but I think we should submit enough to
>> keep it ticking - let it run over night and see what happens. We are
>> currently coming up to 500 files and 2TB but as it seems to be working
>> I see no reason to stop...
>>
>> Lydia, before you leave, if you are generally happy could you please
>> (a) check that your proxy is sufficiently long lived to run till some
>> time tomorrow, and (b) submit sufficiently many thousand files that
>> FTS won't start twiddling its thumbs.
>>
>> Things to do:
>> 1. See if it speeds up if/when FTS autooptimises it (and in particular
>> whether we need to throttle it back at any point) 2. Figure out the
>> proxy renewal thing 3. At some point we should think about checksums -
>> FTS should compare source and destination 4. Figure out appropriate
>> retry settings
>>
>> Anything else?
>>
>> As I am in London tomorrow I shall happily leave those with Brian ;-P
>>
>> Cheers
>> --jens
>>
>