Hi John
The file I'm interested in on your SE is
srm://hepgrid11.ph.liv.ac.uk/dpm/ph.liv.ac.uk/home/dteam/generated/2014-07-12/filed455fa3f-ad81-44b9-8b4d-365a4929d260
I was concerned that there might be a bug in DPM which caused these files accidentally to be deleted.
Duncan
On 1 Oct 2014, at 22:13, John Bland wrote:
> Checking my logs, Alejandro's deletes are not a concern, as far as I can tell they are only for his gfal2 test files, they just happened to happen at a similar time and run periodically but with no issues.
>
> The problematic deletions happened on 18/09/2014 between 09:50 and 10:03 where it looks like many (if not every) file in /dpm/ph.liv.ac.uk/home/dteam was deleted, at roughly 2Hz. All the deletions were with the DN "/DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=icalv
> et/CN=704751/CN=Ivan Calvet".
>
> Some of the files included
>
> log-20140918.gz:09/17 09:50:06.114 7674,1 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/TCD-SC-50M
> log-20140918.gz:09/17 09:50:06.692 7674,3 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test.root
> log-20140918.gz:09/17 09:50:07.248 7674,1 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test2.root
> log-20140918.gz:09/17 09:50:07.743 7674,0 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test3.root
> log-20140918.gz:09/17 09:50:08.245 7674,1 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test4.root
> log-20140918.gz:09/17 09:50:08.694 7674,0 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test5.root
> log-20140918.gz:09/17 09:50:09.148 7674,0 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test6.root
> log-20140918.gz:09/17 09:50:09.628 7674,0 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test7.root
> log-20140918.gz:09/17 09:50:10.121 7674,1 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test8.root
> log-20140918.gz:09/17 09:50:10.825 7674,8 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/dpm-test-1410865310
> log-20140918.gz:09/17 09:50:17.557 7674,8 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/generated/2008-08-27/file98f58038-7f9a-4ed9-ae39-befce3f78f9e
> log-20140918.gz:09/17 09:50:20.512 7674,1 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/generated/2008-09-16/filede9a6e1a-b3ba-4bb3-84a5-a64263c8175f
>
> so a mix of names and paths.
>
> I put a file on a week ago and it's still there, and Steve Lloyd files are appearing without being deleted by Ivan, so it doesn't appear to still be doing it.
>
> John
>
> On 01/10/14 21:51, Jeremy Coles wrote:
>> For the specific case John mentioned I contacted Ivan and got the
>> response as below. Perhaps John you could respond with the specific
>> please; if it was his script then it looks like the other files were
>> deleted by mistake (Duncan’s point noted!).
>>
>> Thanks,
>> Jeremy
>>
>>
>>
>>
>> On 1 Oct 2014, at 21:15, Ivan Calvet <[log in to unmask]
>> <mailto:[log in to unmask]>> wrote:
>>
>>> Hi jeremy,
>>>
>>> I wrote recently a nagios probe which has the objective to test all
>>> the webdav endpoints of the grid. For this, I'm testing the writing of
>>> a file (called "test_webdav_acces.txt") and the deletion of this same
>>> file. The probe shouldn't delete any other file. Can you confirm me
>>> that other files than this one were deleted too? Can you give me the
>>> names of the affected sites? Do you have the date and hour of these
>>> deletions too? I ran my script on all the machines for the last time
>>> on friday around 10am.
>>> And I just retested my script on
>>> https://serv02.hep.phy.cam.ac.uk/dpm/hep.phy.cam.ac.uk/home/dteam/ it
>>> worked without deleting any other files.
>>> If there is a bug, I really need to discover this quickly as I
>>> understand it can causes many problems.
>>>
>>> Cheers,
>>> Ivan
>>
>>
>>
>>
>> On 1 Oct 2014, at 17:57, John Bland <[log in to unmask]
>> <mailto:[log in to unmask]>> wrote:
>>
>>> On 01/10/14 17:00, John Bland wrote:
>>>> On 01/10/14 16:14, Duncan Rand wrote:
>>>>> Hi
>>>>>
>>>>> Steve uses a number of files for his network tests, but some seem to
>>>>> have gone missing from some DPM sites. Does anyone know why this might
>>>>> be?
>>>>>
>>>>> cheers
>>>>> Duncan
>>>>
>>>> Maybe not related to this but I did notice a load of files (including my
>>>> own test files) were deleted from /dpm/ph.liv.ac.uk/home/dteam/
>>>> <http://ph.liv.ac.uk/home/dteam/> at
>>>> Liverpool a few weeks ago. Looks like it was someone at CERN,
>>>>
>>>> /DC=ch/DC=cern/OU=Organic
>>>> Units/OU=Users/CN=aalvarez/CN=678984/CN=Alejandro Alvarez Ayllon
>>>>
>>>> Possibly related to SAM testing or something similar. I haven't checked
>>>> if they did the same for Steve's files.
>>>>
>>>> I'm not sure if there's any obligation for long term storage under dteam?
>>>
>>> Someone else this time, but Steve's file was deleted with this
>>>
>>> 09/17 10:01:37.493 7674,0 Cns_srv_unlink: NS092 - unlink request by
>>> /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=icalvet/CN=704751/CN=Ivan
>>> Calvet (3440,111) from hepgrid11.ph.liv.ac.uk <http://ph.liv.ac.uk>
>>> 09/17 10:01:37.493 7674,0 Cns_srv_unlink: NS098 - unlink
>>> /dpm/ph.liv.ac.uk/home/dteam/generated/2014-07-12/filed455fa3f-ad81-44b9-8b4d-365a4929d260
>>> <http://ph.liv.ac.uk/home/dteam/generated/2014-07-12/filed455fa3f-ad81-44b9-8b4d-365a4929d260>
>>>
>>> This Ivan Calvet seems to have systematically removed a lot of
>>> generated files under dteam.
>>>
>>> John
>>>
>>> --
>>> John Bland [log in to unmask] <mailto:[log in to unmask]>
>>> System Administrator office: 220
>>> High Energy Physics Division tel (int): 42911
>>> Oliver Lodge Laboratory tel (ext): +44 (0)151 794 2911
>>> University of Liverpool http://www.liv.ac.uk/physics/hep/
>>> "I canna change the laws of physics, Captain!"
>>
>
>
> --
> John Bland [log in to unmask]
> System Administrator office: 220
> High Energy Physics Division tel (int): 42911
> Oliver Lodge Laboratory tel (ext): +44 (0)151 794 2911
> University of Liverpool http://www.liv.ac.uk/physics/hep/
> "I canna change the laws of physics, Captain!"
|