Hi Luke,
If you search for Bosco and HTCondor you should find information about how this works. It doesn't require root access on the batch site or anything like that, or even HTCondor - it submits jobs to any batch system as a normal user via ssh, and it just happens that it's HTCondor doing the submission rather than a user.
Regards,
Andrew.
________________________________
From: Testbed Support for GridPP member institutes [[log in to unmask]] on behalf of L Kreczko [[log in to unmask]]
Sent: Tuesday, June 13, 2017 12:32 PM
To: [log in to unmask]
Subject: Re: Tier 2 Evolution - Hosted CEs
Hi Chris,
On 13 June 2017 at 12:06, Chris Brew <[log in to unmask]<mailto:[log in to unmask]>> wrote:
Hi Luke,
Sorry, should have been clearer but was rushing to get the HEPSysMan, the CentOS7+CVMFS+Singularity constraint is my first guess as what GridPP would need. Singularity for isolation, CVMFS for software, and CentOS7 for working Singularity.
Are more of your WNs going to move that way soon?
Only once the current set is fully tested & commissioned for both grid and local use.
It's probably enough for a test though. The one thing I'm not sure of is the HTCondor integration into WLCG for publishing and accounting.
It would be good to start a small scale test (i.e. limit the job submission). APEL seems to have an HTCondor parser ready and some docker images in testing - technically, this should be possible albeit time-intensive to set up the first instance.
On our side it would be interesting how the CE will submit. The slides mention SSH (as root, condor or other user?) but I thought it is easier to do this via HTCondor's shared port?
Overall this is not different to previous attempts: once you have a remote condor scheduler running (ssh/shared port), you can put any CE on top (ARC/HTCondor).
Cheers,
Luke
Yours,
Chris.
Sent from my iPad
On 13 Jun 2017, at 11:43, L Kreczko <[log in to unmask]<mailto:[log in to unmask]><mailto:[log in to unmask]<mailto:[log in to unmask]>>> wrote:
Hi Chris,
Seems I was a bit quick on pressing the send button. The slides you provide are indeed correct (mentioned in the slides I pointed to).
However, I cannot find the CentOS 7 constraint.
At Bristol we have 3 workers with CentOS 7, CVMFS and Singularity. I wonder if that's enough to start with (e.g restricting the CE submission to these nodes via a job router).
Cheers,
Luke
On 13 June 2017 at 11:04, L Kreczko <[log in to unmask]<mailto:[log in to unmask]><mailto:[log in to unmask]<mailto:[log in to unmask]>>> wrote:
Hi Chris,
Indeed, this is something I wanted to bring up at the next GridPP technical meeting.
BTW: Did you mean https://indico.cern.ch/event/611296/contributions/2608194/attachments/1472567/2279255/HTCondor-CE-Progress-Report.pdf (slide 6+)?
Cheers,
Luke
On 13 June 2017 at 10:20, Chris Brew <[log in to unmask]<mailto:[log in to unmask]><mailto:[log in to unmask]<mailto:[log in to unmask]>>> wrote:
Hi All,
On the topic of Tier 2 evolution, one interesting thing that I found out about at the European HTCondor workshop last week is that OSG offer a Hosted CE option to T3 sites with an existing batch farm.
It’s essentially a remote HTCondor-CE that has ssh (via keys) access to a submit machine. If anyone has a Local Cluster with CentOS7+CVMFS+Singularity, or is likely to in the near future then this looks like a very easy way to gridify it.
There’s a little bit about it here:
https://indico.fnal.gov/getFile.py/access?contribId=6&sessionId=12&resId=0&materialId=slides&confId=12973
Yours,
Chris.
--
Dr Chris Brew
Scientific Computing Manager
Particle Physics Department
STFC - Rutherford Appleton Laboratory
Harwell Oxford,
Didcot
OX11 0QX
+44 1235 446326<tel:%2B44%201235%20446326><tel:%2B44%201235%20446326>
--
*********************************************************
Dr Lukasz Kreczko
Research Associate
Department of Physics
Particle Physics Group
University of Bristol
HH Wills Physics Lab
University of Bristol
Tyndall Avenue
Bristol
BS8 1TL
+44 (0)117 928 8724<tel:%2B44%20%280%29117%20928%208724><tel:+44%20117%20928%208724>
[log in to unmask]<mailto:[log in to unmask]><mailto:[log in to unmask]<mailto:[log in to unmask]>>
A top 3 UK university with leading employers (2017)
A top 5 UK university for research (2014 REF)
A world top 50 university (QS Ranking 2016)
*********************************************************
--
*********************************************************
Dr Lukasz Kreczko
Research Associate
Department of Physics
Particle Physics Group
University of Bristol
HH Wills Physics Lab
University of Bristol
Tyndall Avenue
Bristol
BS8 1TL
+44 (0)117 928 8724<tel:+44%20117%20928%208724>
[log in to unmask]<mailto:[log in to unmask]><mailto:[log in to unmask]<mailto:[log in to unmask]>>
A top 3 UK university with leading employers (2017)
A top 5 UK university for research (2014 REF)
A world top 50 university (QS Ranking 2016)
*********************************************************
--
*********************************************************
Dr Lukasz Kreczko
Research Associate
Department of Physics
Particle Physics Group
University of Bristol
HH Wills Physics Lab
University of Bristol
Tyndall Avenue
Bristol
BS8 1TL
+44 (0)117 928 8724<tel:+44%20117%20928%208724>
[log in to unmask]<mailto:[log in to unmask]>
A top 3 UK university with leading employers (2017)
A top 5 UK university for research (2014 REF)
A world top 50 university (QS Ranking 2016)
*********************************************************
|