-------- Original Message --------
Subject: 	Re: ubuntu UI
Date: 	Mon, 24 Jun 2013 16:02:43 +0000
From: 	Matthew Mottram <[log in to unmask]>
To: 	Christopher J.Walker <[log in to unmask]>
CC: 	Emyr James <[log in to unmask]>



Hi again,

(still not accepted onto tb-support!) ... After a bit more playing
around today, I've gotten to the point that the cvmfs UI now allows me
to copy and register data to/from the grid.  This isn't a huge amount of
extra functionality, but still seems like a big step!  It seems that
glite-wms-xxx and quite alot of other macros, which were bundled in with
the old glite UI releases, are not bundled with EMI-2 or EMI-3.  I was
hoping that this wouldn't be the case, as we'd like to use these if
possible.  Chris, is there a reason that these binaries and libraries
are no longer packaged with the UI?

Cheers,
Matt

On 20 Jun 2013, at 10:41, Matthew Mottram wrote:

> Hi Chris,
>
> I getting closer, finally!  It turns out that alot of the problems I
> had were documented for the glite-UI by LOFAR, wish I'd seen that
> earlier!  Anyway, here's what I have so far for getting a UI setup on
> Ubuntu:
>
> lcg-infosites, lcg-info, voms are all installed directly with apt-get.
>  For lcg-utils I have:
>
>     * cvmfs installed and grid.cern.ch <http://grid.cern.ch/> mounted
>     * Set up paths:
>           o At first I sourced the grid_env.sh in
>             grid.cern.ch/3.2.11-1/etc/profile.d/grid-env.sh
>             <http://grid.cern.ch/3.2.11-1/etc/profile.d/grid-env.sh>
>              (assuming this is the correct env it should probably be
>             pointed at from the README or somewhere more obvious IMO)
>           o Realised this is an old UI (e.g lcg-ls -v lcg_util-1.11.16-3)
>           o Used /cvmfs/grid.cern.ch/emi-wn-2.6.0-1_v1, now there is
>             no obvious shell script to setup the correct environment,
>             I modified one we use at sussex to setup the appropriate
>             paths ...
>     * Added sym links for (these took trial and error, they're the
>       only libraries that lcg-utils seems to need that are *not*
>       available in the cvmfs UI but that require specific version
>       numbers to work which differ from the ones available through
>       apt-get, there are a couple of versions available with apt-get,
>       I think the libssl version in particular is important as others
>       cause errors):
>           o libcrypto.so.6 -> /lib/x86_64-linux-gnu/libcrypto.so.0.9.8
>           o libexpat.so.0 -> /lib/x86_64-linux-gnu/libexpat.so.1
>           o libldap-2.3.so.0 ->
>             /usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2.8.3
>           o libssl.so.6 -> /lib/x86_64-linux-gnu/libssl.so.0.9.8
>
>
> Now I tried lcg-ls:
>
> [LFC][lfc_startsess][] lfc.gridpp.rl.ac.uk: Could not secure the
> connection
> lfn:/grid/snoplus.snolab.ca: Communication error on send
>
> ... OK.  Not sure what to do now, but at least I'm no longer getting a
> segfault with no dumped information.  I'm hoping that it's something
> as simple as some further environment/network settings that I need,
> but google hasn't shed any light so far.
>
> Any help on this would be greatly appreciated!
>
> Cheers,
>
> Matt
>
> On 19 Jun 2013, at 16:55, Christopher J. Walker wrote:
>
>> On 19/06/13 15:14, Matthew Mottram wrote:
>>> Yep, I've already installed lcg-infosites, lcg-info, voms etc (and
>>> these aren't available in the cvmfs UI), what is missing is
>>> lcg-utils, which I'd really like to access storage so that people
>>> can use the LFC.  Also, we need glite for ganga jobs.
>>
>> Can we carry this discussion out  on either gridpp-storage or tb-support.
>>
>>
>> There will be more input from other people there.
>>
>> Chris
>>>
>>> On 19 Jun 2013, at 15:03, Christopher J. Walker wrote:
>>>
>>>> It was pointed out at the meeting this morning that ubuntu had
>>>> voms-proxy-init, and also gfal2.
>>>>
>>>> AIUI using gfal2, you can effectively mount storage. If that did what
>>>> you needed, that might be a way to go.
>>>>
>>>> Chris
>>>>
>>>>
>>>> On 19/06/13 15:01, Matthew Mottram wrote:
>>>>> OK, I now have the correct binaries available over cvmfs, but am
>>>>> having problems with library locations and clashes...
>>>>>
>>>>> On 19 Jun 2013, at 14:27, Emyr James wrote:
>>>>>
>>>>>> Hi,
>>>>>> Just cathing up on this now....been at lunch. I can give you the
>>>>>> details to connect to our squid proxy.
>>>>>> For those that don't have one, they can just install squid on
>>>>>> their own machine or on a machine at their site.
>>>>>> It's very easy to install and set-up. Much easier than cvmfs itself.
>>>>>> Emyr
>>>>>>
>>>>>> On 19/06/13 14:18, Matthew Mottram wrote:
>>>>>>> OK, but the real test is then what other sites (with no squid
>>>>>>> setup) use.  Can they just use DIRECT? (incidentally, it looks
>>>>>>> like following the OSX instructions from the manual is actually
>>>>>>> better than following the linux ones for setting this up!)
>>>>>>>
>>>>>>> On 19 Jun 2013, at 14:12, Christopher J. Walker wrote:
>>>>>>>
>>>>>>>> On 19/06/13 14:10, Matthew Mottram wrote:
>>>>>>>>> Sorry for the multiple emails on this - emailing as I go,
>>>>>>>>> which probably isn't the best way to do this; it turns out I
>>>>>>>>> was wrong and the blog Emyr sent a link to has been helpful so
>>>>>>>>> far!  However, I'm now getting a message that I need to:
>>>>>>>>> Error: required parameter CVMFS_HTTP_PROXY undefined for
>>>>>>>>> grid.cern.ch <http://grid.cern.ch/>
>>>>>>>>> I'm not sure what I can do with this though, are there default
>>>>>>>>> addresses I can use?
>>>>>>>>>
>>>>>>>> Sussex's squid proxy if they have one - which they must do for
>>>>>>>> the grid
>>>>>>>> worker nodes.
>>>>>>>>
>>>>>>>> Chris
>>>>>>>>
>>>>>>>>> On 19 Jun 2013, at 13:33, Matthew Mottram wrote:
>>>>>>>>>
>>>>>>>>>> I should add, I don't mean that the cernvm-installer was
>>>>>>>>>> compiled from source and installed, rather, I installed the
>>>>>>>>>> cvmfs source code from
>>>>>>>>>> https://ecsft.cern.ch/dist/cvmfs/cvmfs-2.1.5/cvmfs-2.1.5.tar.gz.
>>>>>>>>>>  Annoyingly, all of the up to date downloads linked from the
>>>>>>>>>> userguide require a cern account in order to install.
>>>>>>>>>>
>>>>>>>>>> On 19 Jun 2013, at 13:20, Matthew Mottram wrote:
>>>>>>>>>>
>>>>>>>>>>> Hmm, not going so well so far!  The guide Emyr points to
>>>>>>>>>>> seems to be configuring a client with cvmfs to mount a cvmfs
>>>>>>>>>>> repo that is hosted locally and does not appear to outline
>>>>>>>>>>> all the necessary steps to setup the Ubuntu machine to load
>>>>>>>>>>> repositories from the cern.ch <http://cern.ch/> cvmfs
>>>>>>>>>>> server.  I tried downloading and installing the .deb
>>>>>>>>>>> installer from
>>>>>>>>>>> http://cernvm.cern.ch/portal/cernvm-installer, but this
>>>>>>>>>>> failed with a load of errors.  I then tried downloading the
>>>>>>>>>>> source code and compiling, this installed fine.  I then
>>>>>>>>>>> followed instructions from the installation section of
>>>>>>>>>>> http://cernvm.cern.ch/portal/sites/cernvm.cern.ch/files/cvmfstech-2.1-4.pdf,
>>>>>>>>>>> I don't have anything for the local proxies though and
>>>>>>>>>>> running a "cvmfs_config probe" command returns an error on
>>>>>>>>>>> the grid.cern.ch <http://grid.cern.ch/> repository.
>>>>>>>>>>>
>>>>>>>>>>> On 18 Jun 2013, at 19:18, Christopher J. Walker wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Good luck. Do tell us how you get on... Chris
>>>>>>>>>>>>
>>>>>>>>>>>> Emyr James <[log in to unmask]
>>>>>>>>>>>> <mailto:[log in to unmask]>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> You could try this....
>>>>>>>>>>>>>
>>>>>>>>>>>>> * set up a base SL6 install
>>>>>>>>>>>>> * set up sleuth kit (http://www.sleuthkit.org/)
>>>>>>>>>>>>> * note the date & time
>>>>>>>>>>>>> * set up the UI on it.
>>>>>>>>>>>>> * get a list of all files created and modified since your
>>>>>>>>>>>>> noted time
>>>>>>>>>>>>> using the sleuth kit
>>>>>>>>>>>>> * prune the list to try to just get things relevant to
>>>>>>>>>>>>> setting up a ui,
>>>>>>>>>>>>> and removing things you can get from packages on ubuntu
>>>>>>>>>>>>> * Create a tar file of these rooted at /
>>>>>>>>>>>>> * on a suitably prepped ubuntu untar the tar file of the
>>>>>>>>>>>>> UI files
>>>>>>>>>>>>>
>>>>>>>>>>>>> You may need to modify the location some files, it may be
>>>>>>>>>>>>> a huge amount
>>>>>>>>>>>>> of work or it might not be that troublesome....
>>>>>>>>>>>>>
>>>>>>>>>>>>> On 18/06/13 15:46, Christopher J. Walker wrote:
>>>>>>>>>>>>>> I asked this morning at the ops meeting.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Firstly, do you mind me publishing the below e-mail
>>>>>>>>>>>>>> verbatim to tb-support?
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> AIUI, the UI has been cancelled, but some bits do exist.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> The easiest option is to ssh into an SL machine, or
>>>>>>>>>>>>>> provide a virtual
>>>>>>>>>>>>>> machine.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I was hoping to get some better instructions on providing
>>>>>>>>>>>>>> a generic VM
>>>>>>>>>>>>>> install - if you had time to have a go at this, I can
>>>>>>>>>>>>>> probably find a
>>>>>>>>>>>>>> bit of time to find some pointers.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Chris
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On 17/06/13 16:56, Matthew Mottram wrote:
>>>>>>>>>>>>>>> Hi Chris,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I'm trying to install a grid UI on an Ubuntu machine as
>>>>>>>>>>>>>>> a number of SNO+ collaborators run this instead of RHL.
>>>>>>>>>>>>>>>  From
>>>>>>>>>>>>>>> https://twiki.cern.ch/twiki/bin/view/EMI/GenericInstallationConfigurationEMI3
>>>>>>>>>>>>>>> and http://www.eu-emi.eu/emi-3-montebianco I see that
>>>>>>>>>>>>>>> there are some libraries available for Ubuntu, however,
>>>>>>>>>>>>>>> the table on the Cern Twiki shows that there isn't a
>>>>>>>>>>>>>>> nice single emi-ui repo which I can just grab for
>>>>>>>>>>>>>>> Ubuntu, like there is for RHL5/6.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> At the very least I'd like to have lcg-utils (for lcg-cr
>>>>>>>>>>>>>>> etc), glite-, voms- and myproxy.  I checked the list of
>>>>>>>>>>>>>>> repos available
>>>>>>>>>>>>>>> (http://emisoft.web.cern.ch/emisoft/index.html and also
>>>>>>>>>>>>>>> just running apt-cache searches) and have found lots,
>>>>>>>>>>>>>>> but was wondering if you knew of an easier way of
>>>>>>>>>>>>>>> installing the required stuff for a grid UI or a list of
>>>>>>>>>>>>>>> what I should install for a basic UI (or, in fact, if
>>>>>>>>>>>>>>> this is even possible!)?
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Cheers,
>>>>>>>>>>>>>>> Matt
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>