That's one of the files that was deleted in the incident below. No DPM
bugs as far as I can see.
John
On 01/10/14 22:52, Duncan Rand wrote:
> Hi John
>
> The file I'm interested in on your SE is
>
> srm://hepgrid11.ph.liv.ac.uk/dpm/ph.liv.ac.uk/home/dteam/generated/2014-07-12/filed455fa3f-ad81-44b9-8b4d-365a4929d260
>
> I was concerned that there might be a bug in DPM which caused these files accidentally to be deleted.
>
> Duncan
>
>
> On 1 Oct 2014, at 22:13, John Bland wrote:
>
>> Checking my logs, Alejandro's deletes are not a concern, as far as I can tell they are only for his gfal2 test files, they just happened to happen at a similar time and run periodically but with no issues.
>>
>> The problematic deletions happened on 18/09/2014 between 09:50 and 10:03 where it looks like many (if not every) file in /dpm/ph.liv.ac.uk/home/dteam was deleted, at roughly 2Hz. All the deletions were with the DN "/DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=icalv
>> et/CN=704751/CN=Ivan Calvet".
>>
>> Some of the files included
>>
>> log-20140918.gz:09/17 09:50:06.114 7674,1 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/TCD-SC-50M
>> log-20140918.gz:09/17 09:50:06.692 7674,3 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test.root
>> log-20140918.gz:09/17 09:50:07.248 7674,1 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test2.root
>> log-20140918.gz:09/17 09:50:07.743 7674,0 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test3.root
>> log-20140918.gz:09/17 09:50:08.245 7674,1 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test4.root
>> log-20140918.gz:09/17 09:50:08.694 7674,0 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test5.root
>> log-20140918.gz:09/17 09:50:09.148 7674,0 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test6.root
>> log-20140918.gz:09/17 09:50:09.628 7674,0 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test7.root
>> log-20140918.gz:09/17 09:50:10.121 7674,1 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/atlas-test8.root
>> log-20140918.gz:09/17 09:50:10.825 7674,8 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/dpm-test-1410865310
>> log-20140918.gz:09/17 09:50:17.557 7674,8 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/generated/2008-08-27/file98f58038-7f9a-4ed9-ae39-befce3f78f9e
>> log-20140918.gz:09/17 09:50:20.512 7674,1 Cns_srv_unlink: NS098 - unlink /dpm/ph.liv.ac.uk/home/dteam/generated/2008-09-16/filede9a6e1a-b3ba-4bb3-84a5-a64263c8175f
>>
>> so a mix of names and paths.
>>
>> I put a file on a week ago and it's still there, and Steve Lloyd files are appearing without being deleted by Ivan, so it doesn't appear to still be doing it.
>>
>> John
>>
>> On 01/10/14 21:51, Jeremy Coles wrote:
>>> For the specific case John mentioned I contacted Ivan and got the
>>> response as below. Perhaps John you could respond with the specific
>>> please; if it was his script then it looks like the other files were
>>> deleted by mistake (Duncan’s point noted!).
>>>
>>> Thanks,
>>> Jeremy
>>>
>>>
>>>
>>>
>>> On 1 Oct 2014, at 21:15, Ivan Calvet <[log in to unmask]
>>> <mailto:[log in to unmask]>> wrote:
>>>
>>>> Hi jeremy,
>>>>
>>>> I wrote recently a nagios probe which has the objective to test all
>>>> the webdav endpoints of the grid. For this, I'm testing the writing of
>>>> a file (called "test_webdav_acces.txt") and the deletion of this same
>>>> file. The probe shouldn't delete any other file. Can you confirm me
>>>> that other files than this one were deleted too? Can you give me the
>>>> names of the affected sites? Do you have the date and hour of these
>>>> deletions too? I ran my script on all the machines for the last time
>>>> on friday around 10am.
>>>> And I just retested my script on
>>>> https://serv02.hep.phy.cam.ac.uk/dpm/hep.phy.cam.ac.uk/home/dteam/ it
>>>> worked without deleting any other files.
>>>> If there is a bug, I really need to discover this quickly as I
>>>> understand it can causes many problems.
>>>>
>>>> Cheers,
>>>> Ivan
>>>
>>>
>>>
>>>
>>> On 1 Oct 2014, at 17:57, John Bland <[log in to unmask]
>>> <mailto:[log in to unmask]>> wrote:
>>>
>>>> On 01/10/14 17:00, John Bland wrote:
>>>>> On 01/10/14 16:14, Duncan Rand wrote:
>>>>>> Hi
>>>>>>
>>>>>> Steve uses a number of files for his network tests, but some seem to
>>>>>> have gone missing from some DPM sites. Does anyone know why this might
>>>>>> be?
>>>>>>
>>>>>> cheers
>>>>>> Duncan
>>>>>
>>>>> Maybe not related to this but I did notice a load of files (including my
>>>>> own test files) were deleted from /dpm/ph.liv.ac.uk/home/dteam/
>>>>> <http://ph.liv.ac.uk/home/dteam/> at
>>>>> Liverpool a few weeks ago. Looks like it was someone at CERN,
>>>>>
>>>>> /DC=ch/DC=cern/OU=Organic
>>>>> Units/OU=Users/CN=aalvarez/CN=678984/CN=Alejandro Alvarez Ayllon
>>>>>
>>>>> Possibly related to SAM testing or something similar. I haven't checked
>>>>> if they did the same for Steve's files.
>>>>>
>>>>> I'm not sure if there's any obligation for long term storage under dteam?
>>>>
>>>> Someone else this time, but Steve's file was deleted with this
>>>>
>>>> 09/17 10:01:37.493 7674,0 Cns_srv_unlink: NS092 - unlink request by
>>>> /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=icalvet/CN=704751/CN=Ivan
>>>> Calvet (3440,111) from hepgrid11.ph.liv.ac.uk <http://ph.liv.ac.uk>
>>>> 09/17 10:01:37.493 7674,0 Cns_srv_unlink: NS098 - unlink
>>>> /dpm/ph.liv.ac.uk/home/dteam/generated/2014-07-12/filed455fa3f-ad81-44b9-8b4d-365a4929d260
>>>> <http://ph.liv.ac.uk/home/dteam/generated/2014-07-12/filed455fa3f-ad81-44b9-8b4d-365a4929d260>
>>>>
>>>> This Ivan Calvet seems to have systematically removed a lot of
>>>> generated files under dteam.
>>>>
>>>> John
>>>>
>>>> --
>>>> John Bland [log in to unmask] <mailto:[log in to unmask]>
>>>> System Administrator office: 220
>>>> High Energy Physics Division tel (int): 42911
>>>> Oliver Lodge Laboratory tel (ext): +44 (0)151 794 2911
>>>> University of Liverpool http://www.liv.ac.uk/physics/hep/
>>>> "I canna change the laws of physics, Captain!"
>>>
>>
>>
>> --
>> John Bland [log in to unmask]
>> System Administrator office: 220
>> High Energy Physics Division tel (int): 42911
>> Oliver Lodge Laboratory tel (ext): +44 (0)151 794 2911
>> University of Liverpool http://www.liv.ac.uk/physics/hep/
>> "I canna change the laws of physics, Captain!"
>
--
John Bland [log in to unmask]
System Administrator office: 220
High Energy Physics Division tel (int): 42911
Oliver Lodge Laboratory tel (ext): +44 (0)151 794 2911
University of Liverpool http://www.liv.ac.uk/physics/hep/
"I canna change the laws of physics, Captain!"
|