Minutes of the ATLAS meeting
-------- Forwarded Message --------
Subject: Re: meeting on singularity tomorrow at 14:00
Date: Thu, 13 Jul 2017 11:01:30 +0200
From: Andrej Filipčič <[log in to unmask]>
To: Alessandra Forti <[log in to unmask]>, Rodney Walker
<[log in to unmask]>
CC: [log in to unmask]
<[log in to unmask]>, Alessandro De Salvo
<[log in to unmask]>
A brief summary:
- pilotcode supporting singularity is now in production, we start
testing targeted sites (RAL, Manchester, ...) with it
- singularity could also be started in the wrapper, but since we have
the pilotcode ready, we try to use that
- for now we continue to use catchall, when we get more experience with
site specifics, we think about what should be moved to site
configuration (singularity.conf), what in AGIS, and if we can simplify
things like using scratchdisk by relocating the bind mounts
- by September we should test most of T1s, some big T2s, so we have some
input for the containers task force
- testing the containers should be done in a similar way as it was done
with the new mover
- we follow up with hammercloud team to implement singularity HC testing
- for performance reasons, we should migrate to unpacked chroot. The img
and the dir should be kept in sync, we will need both (eg img for HPC)
- we should concentrate on centos7 sites. later on we should also test
the centos7 images.
- at pre-gdb, there was a discussion whether to go with non-suid
singularity deployment. We also need to evaluate if this is feasible for
ATLAS or not. Some sites might want to use it in the future. (it's not
even available at this point in centos7, maybe with RH7.4)
Cheers,
Andrej
On 13/07/2017 09:59, Andrej Filipčič wrote:
> a reminder, we start nowish on this morning vidyo:
> https://indico.cern.ch/event/176051/
>
> Cheers,
> Andrej
>
>
>
> On 11/07/2017 18:24, Andrej Filipčič wrote:
>>
>> actually, was on pre-gdb and forgot about gdb tomorrow. So, let's
>> make it Thursday after the morning meeting, let's say 10:00
>>
>> Cheers,
>> Andrej
>>
>> On 11/07/2017 17:12, Andrej Filipčič wrote:
>>> Hi,
>>>
>>> we should have a meeting tomorrow at 14:00 to followup today's task
>>> force meeting. We connect on ADC morning vidyo.
>>>
>>> Is it ok with everybody? We should make a plan before leaving for
>>> holiday...
>>>
>>> Cheers,
>>> Andrej
>>>
>>> On 11/07/2017 16:19, Alessandra Forti wrote:
>>>> It seems I didn't miss something. The mount points are still needed.
>>>>
>>>> On 11/07/2017 08:26, Alessandra Forti wrote:
>>>>> Unless I missed something and in C7 you don't need the directories
>>>>> anymore. When I tried on my C7 nodes few months ago it was still
>>>>> needed.
>>>>>
>>>>> On 11/07/2017 08:22, Alessandra Forti wrote:
>>>>>> Hi Andrej,
>>>>>>
>>>>>> On 11/07/2017 08:18, Andrej Filipčič wrote:
>>>>>>> On 11/07/2017 09:14, Alessandra Forti wrote:
>>>>>>>> Hi Andrej,
>>>>>>>>
>>>>>>>> the customization of the images with all the directories on a
>>>>>>>> per site basis, and maintenance of the description in AGIS is
>>>>>>>> going to be a pain.
>>>>>>> yes if we want to run it on SLC6 sites, but I guess only a
>>>>>>> limited subset of those can be handled. For the rest we should
>>>>>>> require cc7 and there are no issues with those.
>>>>>>>
>>>>>> I'm looking at it from the atlas point of view. It is going to be
>>>>>> a pain to customize on a per site basis.
>>>>>>
>>>>>> cheers
>>>>>> alessandra
>>>>>>> Cheers,
>>>>>>> Andrej
>>>>>>>>
>>>>>>>> cheers
>>>>>>>> alessandra
>>>>>>>>
>>>>>>>> On 11/07/2017 07:40, Andrej Filipčič wrote:
>>>>>>>>>
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> preliminary slides for today:
>>>>>>>>> https://docs.google.com/presentation/d/1UZJkxLSNijk_94nBMuUHSsGqZZMujjXRDIDIVeoknSo/edit#slide=id.g1d6c69e1dc_0_0
>>>>>>>>>
>>>>>>>>> please check,
>>>>>>>>>
>>>>>>>>> Andrej
>>>>>>>>>
>>>>>>>>> On 10/07/2017 12:14, Rodney Walker wrote:
>>>>>>>>>> They want to use the singularity feature to restrict some
>>>>>>>>>> images to some users. I don't know if this works for
>>>>>>>>>> directories too.
>>>>>>>>>>
>>>>>>>>>> OTOH don`t worry too much about LRZ - we will survive.
>>>>>>>>>>
>>>>>>>>>> Cheers,
>>>>>>>>>> Rod.
>>>>>>>>>>
>>>>>>>>>> On 10 July 2017 at 12:07, Alessandra Forti
>>>>>>>>>> <[log in to unmask] <mailto:[log in to unmask]>>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>> So even if the image is accessible as a directory they
>>>>>>>>>> want an image file?
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On 10/07/2017 10:40, Rodney Walker wrote:
>>>>>>>>>>> LRZ is special. They would download the image, even if
>>>>>>>>>>> on cvmfs, and then make it available to specific users.
>>>>>>>>>>>
>>>>>>>>>>> Cheers,
>>>>>>>>>>> Rod.
>>>>>>>>>>>
>>>>>>>>>>> On 10 July 2017 at 11:32, Alessandra Forti
>>>>>>>>>>> <[log in to unmask]
>>>>>>>>>>> <mailto:[log in to unmask]>> wrote:
>>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>>
>>>>>>>>>>> if we unpack the image in cvmfs as OSG suggested to
>>>>>>>>>>> avoid loading 2GB images is it still needed? It
>>>>>>>>>>> would be like other pieces of atlas software.
>>>>>>>>>>>
>>>>>>>>>>> cheers
>>>>>>>>>>> alessandra
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On 10/07/2017 10:15, Rodney Walker wrote:
>>>>>>>>>>>> Hi,
>>>>>>>>>>>> LRZ requested some checksum or other way to confirm
>>>>>>>>>>>> the image authenticity.
>>>>>>>>>>>>
>>>>>>>>>>>> Cheers,
>>>>>>>>>>>> Rod.
>>>>>>>>>>>>
>>>>>>>>>>>> On 10 July 2017 at 10:51, Andrej Filipčič
>>>>>>>>>>>> <[log in to unmask]
>>>>>>>>>>>> <mailto:[log in to unmask]>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> I will prepare the slides later today and
>>>>>>>>>>>> circulate. The meeting is tomorrow afternoon.
>>>>>>>>>>>>
>>>>>>>>>>>> Cheers,
>>>>>>>>>>>> Andrej
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On 10/07/2017 10:49, Alessandra Forti wrote:
>>>>>>>>>>>>> Hi Alessandro,
>>>>>>>>>>>>>
>>>>>>>>>>>>> we need to look into this if you haven't already.
>>>>>>>>>>>>>
>>>>>>>>>>>>> cheers
>>>>>>>>>>>>> alessandra
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> -------- Forwarded Message --------
>>>>>>>>>>>>> Subject: Singularity images / chroots
>>>>>>>>>>>>> Date: Wed, 5 Jul 2017 11:36:47 +0200
>>>>>>>>>>>>> From: Gavin McCance <[log in to unmask]>
>>>>>>>>>>>>> <mailto:[log in to unmask]>
>>>>>>>>>>>>> To: wlcg-containers (WLCG container working
>>>>>>>>>>>>> group) <[log in to unmask]>
>>>>>>>>>>>>> <mailto:[log in to unmask]>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> Hi all,
>>>>>>>>>>>>>
>>>>>>>>>>>>> In the experiment slides you give, can you each highlight the way in which you imagine (or do) distribute the images / chroots (via CVMFS or otherwise)?
>>>>>>>>>>>>>
>>>>>>>>>>>>> Ensuring that we end up with compatible approaches to this across the experiments I think is one of our main goals.
>>>>>>>>>>>>>
>>>>>>>>>>>>> cheers,
>>>>>>>>>>>>> gav
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> _____________________________________________________________
>>>>>>>>>>>> prof. dr. Andrej Filipcic, E-mail:[log in to unmask]
>>>>>>>>>>>> <mailto:[log in to unmask]>
>>>>>>>>>>>> Department of Experimental High Energy Physics - F9
>>>>>>>>>>>> Jozef Stefan Institute, Jamova 39, P.o.Box 3000
>>>>>>>>>>>> SI-1001 Ljubljana, Slovenia
>>>>>>>>>>>> Tel.:+386-1-477-3674 <tel:+386%201%20477%2036%2074> Fax:+386-1-477-3166 <tel:+386%201%20477%2031%2066>
>>>>>>>>>>>> -------------------------------------------------------------
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Respect is a rational process. \\//
>>>>>>>>>>> Fatti non foste a viver come bruti, ma per seguir virtute e canoscenza(Dante)
>>>>>>>>>>> For Ur-Fascism, disagreement is treason. (U. Eco)
>>>>>>>>>>> But but but her emails... covfefe!
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Respect is a rational process. \\//
>>>>>>>>>> Fatti non foste a viver come bruti, ma per seguir virtute e canoscenza(Dante)
>>>>>>>>>> For Ur-Fascism, disagreement is treason. (U. Eco)
>>>>>>>>>> But but but her emails... covfefe!
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> _____________________________________________________________
>>>>>>>>> prof. dr. Andrej Filipcic, E-mail:[log in to unmask]
>>>>>>>>> Department of Experimental High Energy Physics - F9
>>>>>>>>> Jozef Stefan Institute, Jamova 39, P.o.Box 3000
>>>>>>>>> SI-1001 Ljubljana, Slovenia
>>>>>>>>> Tel.: +386-1-477-3674 Fax: +386-1-477-3166
>>>>>>>>> -------------------------------------------------------------
>>>>>>>>
>>>>>>>> --
>>>>>>>> Respect is a rational process. \\//
>>>>>>>> Fatti non foste a viver come bruti, ma per seguir virtute e canoscenza(Dante)
>>>>>>>> For Ur-Fascism, disagreement is treason. (U. Eco)
>>>>>>>> But but but her emails... covfefe!
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> _____________________________________________________________
>>>>>>> prof. dr. Andrej Filipcic, E-mail:[log in to unmask]
>>>>>>> Department of Experimental High Energy Physics - F9
>>>>>>> Jozef Stefan Institute, Jamova 39, P.o.Box 3000
>>>>>>> SI-1001 Ljubljana, Slovenia
>>>>>>> Tel.: +386-1-477-3674 Fax: +386-1-477-3166
>>>>>>> -------------------------------------------------------------
>>>>>>
>>>>>> --
>>>>>> Respect is a rational process. \\//
>>>>>> Fatti non foste a viver come bruti, ma per seguir virtute e canoscenza(Dante)
>>>>>> For Ur-Fascism, disagreement is treason. (U. Eco)
>>>>>> But but but her emails... covfefe!
>>>>>
>>>>> --
>>>>> Respect is a rational process. \\//
>>>>> Fatti non foste a viver come bruti, ma per seguir virtute e canoscenza(Dante)
>>>>> For Ur-Fascism, disagreement is treason. (U. Eco)
>>>>> But but but her emails... covfefe!
>>>>
>>>> --
>>>> Respect is a rational process. \\//
>>>> Fatti non foste a viver come bruti, ma per seguir virtute e canoscenza(Dante)
>>>> For Ur-Fascism, disagreement is treason. (U. Eco)
>>>> But but but her emails... covfefe!
>>>
>>>
>>> --
>>> _____________________________________________________________
>>> prof. dr. Andrej Filipcic, E-mail:[log in to unmask]
>>> Department of Experimental High Energy Physics - F9
>>> Jozef Stefan Institute, Jamova 39, P.o.Box 3000
>>> SI-1001 Ljubljana, Slovenia
>>> Tel.: +386-1-477-3674 Fax: +386-1-477-3166
>>> -------------------------------------------------------------
>>
>>
>> --
>> _____________________________________________________________
>> prof. dr. Andrej Filipcic, E-mail:[log in to unmask]
>> Department of Experimental High Energy Physics - F9
>> Jozef Stefan Institute, Jamova 39, P.o.Box 3000
>> SI-1001 Ljubljana, Slovenia
>> Tel.: +386-1-477-3674 Fax: +386-1-477-3166
>> -------------------------------------------------------------
>
>
> --
> _____________________________________________________________
> prof. dr. Andrej Filipcic, E-mail:[log in to unmask]
> Department of Experimental High Energy Physics - F9
> Jozef Stefan Institute, Jamova 39, P.o.Box 3000
> SI-1001 Ljubljana, Slovenia
> Tel.: +386-1-477-3674 Fax: +386-1-477-3166
> -------------------------------------------------------------
--
_____________________________________________________________
prof. dr. Andrej Filipcic, E-mail:[log in to unmask]
Department of Experimental High Energy Physics - F9
Jozef Stefan Institute, Jamova 39, P.o.Box 3000
SI-1001 Ljubljana, Slovenia
Tel.: +386-1-477-3674 Fax: +386-1-477-3166
-------------------------------------------------------------
