JiscMail Logo
Email discussion lists for the UK Education and Research communities

Help for GRIDPP-STORAGE Archives


GRIDPP-STORAGE Archives

GRIDPP-STORAGE Archives


GRIDPP-STORAGE@JISCMAIL.AC.UK


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

GRIDPP-STORAGE Home

GRIDPP-STORAGE Home

GRIDPP-STORAGE  December 2005

GRIDPP-STORAGE December 2005

Options

Subscribe or Unsubscribe

Subscribe or Unsubscribe

Log In

Log In

Get Password

Get Password

Subject:

Re: D-Cache yaim support

From:

Owen Synge <[log in to unmask]>

Reply-To:

Owen Synge <[log in to unmask]>

Date:

Wed, 14 Dec 2005 18:55:54 +0000

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (174 lines)

The first bug fix release has now been placed on our servers, install is
as in the previous release, but with 2 bug fixes,

2005-12-14 16:20  osynge

	* yaim/functions/config_sedcache: The gridmap generation system is
          needed to be run before the system works for GSI.

2005-12-14 14:50  osynge

	* yaim/functions/config_sedcache: Fixed small globus port range bug.

I also added a warning message to the impatient.

"D-cache takes some time to initialise"

Please note this yaim install WILL NOT upgrade your D-Cache install 
automatically and the system still work. Please do not install on a
production box without testing first. I probably will work on adding
this support into future versions, but for now this software is an 
installation system not an upgrade path as this is untested, backing 
up your configuration files and your PNFS databases is strongly 
recommended if you intend to use Yaim as an aid to upgrading, but some
by hand work will be needed particularly with respect to pnfs.

PNFS upgrading is a "by hand" task, and the D-Cache team strongly 
believe that PNFS upgrades should not be automated. 

At the moment D-Cache has documented the instructions for a by hand 
upgrade to the databases in the D_Cache book, and Greg Cowan has also
written notes about his experiences on the D-Cache pages of the GridPP
website. 

This version of Yaim upgrades just fine from the last release I made 
2 days ago, but people who installed that version should update the
system, set the environment variable and rerun YAIM as below

apt-get update
apt-get upgrade
export RESET_DCACHE_CONFIGURATION=yes
/opt/lcg/yaim/scripts/configure_node ${PATHTO}/site-info.def SE_dcache 

I shall be working closely with D-cache to improve the support for 
upgrading D-Cache automatically. We are hoping we can upgrade all 
sites automatically without upgrading PNFS. D-Cache feel that 
upgrading D-cache is a higher priority than upgrading PNFS, as very
few sites have hit the scalability issues that prompted D-Cache to
migrate pnfs to postgres. Once this is done we hope sites will be 
able to upgrade to the latest PNFS by hand.

The new GIP integration work should start early next week as the 
deployment of the D-Cache information provider is coming out in 
the next beta or production release.

Should people wish to use the untested D-Cache upgrade path please
remember that the following 3 environment variables are available.

# Set this to wipe the postgres databases
# Optional:RESET_DCACHE_RDBMS=yes
#
# Set this to reset the PNFS server
# Optional:RESET_DCACHE_PNFS=yes
#
# Set this to reset the D-cache configuration
# Optional:RESET_DCACHE_CONFIGURATION=yes

These options will override Yaims default behaviour for D-cache of not 
overwriting files all ready configured. These are often used for 
development so may work as expected so don't play with RESET_DCACHE_RDBMS
on production boxes,

Regards

Owen

PS 

CVS tag owen_test_release_2005_12_14 for this release





On Tue, 13 Dec 2005 14:11:28 +0000
Owen Synge <[log in to unmask]> wrote:

> I am pleased to announce D-Cache 1.6.6.2 support for YAIM, this
> version of YAIM does not support upgrades from previous releases but
> does support all of the functionality of previous YAIM releases for
> D-Cache.
> 
> Road map for YAIM D-Cache
> 
> The functionality seems to now match what was available before with
> YAIM but for the new stable release of D-cache, which was the main
> milestone for release version 1, I am going on to test with the beta
> release b3 of D-cache with YAIM, first priority will definitely be
> support of YAIM.
> 
> After the new releases of D-cache is installed I shall focus on the
> Glue schemer D-Cache integration, this has been made my second
> priority. This is a more universal than than DMZ's and D-Cache service
> node decomposition that is as yet unexplored and so not asked for by
> many tier 2's. 
> 
> DMZ support and decomposition of a D-Cache cluster is much less work 
> than the BDII integration and will consist of splitting not just pool 
> and admin nodes but also pnfs manager and door nodes from their
> default bindings to pool and admin nodes within YAIM format, I shall
> have to chat with Oliver for some style guidance before adding this.
> This code  is already implemented but the environment variables
> decoding is not implemented and so this functionality is not "switched
> on" or tested  as yet. I hope this allows users to see functionality
> in D-Cache they had not appreciated before such as the advantages of
> decomposing  services into DMZ's and better load balancing as node
> selection of the PNFS-manager will eventually be a YAIM environment
> variable so it can be  placed upon a separate host from the SRM node.
> 
> The code changes was implemented after studying the bash
> implementation of debconf, and should take very little code (And as
> usual a lot of testing) to insert the YAIM for D-cache into dpkg and
> debconf making  D-Cache native support for debian and also a highest
> common denominator for most config engines (Who knows EDG/EGEE seems
> to average 1-2 per year). All that is required to support debian
> nativity is to  isolate the environment parsing code and replace it
> with calls to  debconf or what ever higher level system is needed, the
> CVS tag of YAIM is called (owen_test_release_2005_12_12) and is ready
> for testing.
> 
> The apt repository preproduction has been prepared. Install is as in 
> 
> http://storage.esc.rl.ac.uk/documentation/html/D-Cache-Howto/ch02.html
> 
> and so essentially unchanged from previous versions but the section
> 
> "Create the relevant pointers to the rpm repositories"
> 
> should contain the revised content
> 
> echo 'rpm http://storage.esc.rl.ac.uk/ apt/datastore/sl3.0.4
> preproduction' \
>     > /etc/apt/sources.list.d/gpp_storage.list
> 
> echo 'rpm http://grid-deployment.web.cern.ch/grid-deployment/gis
> apt/LCG-2_6_0/sl3/en/i386  lcg_sl3 lcg_sl3.updates' \
>     > /etc/apt/sources.list.d/lcg.listhttps://savannah.cern.ch
> 
> echo 'rpm http://grid-deployment.web.cern.ch/grid-deployment/gis
> apt/LCG_CA/en/i386 lcg' \
>     > /etc/apt/sources.list.d/lcg-ca.list
> 
> note line 1 changes to have "stable obsolete" replaced  by 
> "preproduction" this is increase any tier 2 has left the stable
> version in their apt-sources by mistake and suddenly are faced with an
> unplanned  D-Cache upgrade.
> 
> Attached is a specimen site-info.def and a Dcache install log for a 
> pool node, I hope they help.
> 
> Some of the steps in the HOWTO are also obsolete and this will have to
> wait until I have time to document such things. (SRM wiki is to me a 
> higher priority as D-Cache is much better documented than SRM sad but 
> true).
> 
> Please send all bugs to "LCG Operations" and assign D-Cache related
> bugs to me
> 
> https://savannah.cern.ch
> 
> Regards to all 
> 
> Owen
> 

Top of Message | Previous Page | Permalink

JiscMail Tools


RSS Feeds and Sharing


Advanced Options


Archives

April 2024
March 2024
February 2024
January 2024
December 2023
November 2023
October 2023
September 2023
August 2023
July 2023
June 2023
May 2023
April 2023
March 2023
February 2023
January 2023
December 2022
November 2022
October 2022
September 2022
August 2022
July 2022
June 2022
May 2022
April 2022
March 2022
February 2022
January 2022
December 2021
November 2021
October 2021
September 2021
August 2021
July 2021
June 2021
May 2021
April 2021
March 2021
February 2021
January 2021
December 2020
November 2020
October 2020
September 2020
August 2020
July 2020
June 2020
May 2020
April 2020
March 2020
February 2020
January 2020
December 2019
November 2019
October 2019
September 2019
August 2019
July 2019
June 2019
May 2019
April 2019
March 2019
February 2019
January 2019
December 2018
November 2018
October 2018
September 2018
August 2018
July 2018
June 2018
May 2018
April 2018
March 2018
February 2018
January 2018
December 2017
November 2017
October 2017
September 2017
August 2017
July 2017
June 2017
May 2017
April 2017
March 2017
February 2017
January 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012
November 2012
October 2012
September 2012
August 2012
July 2012
June 2012
May 2012
April 2012
March 2012
February 2012
January 2012
December 2011
November 2011
October 2011
September 2011
August 2011
July 2011
June 2011
May 2011
April 2011
March 2011
February 2011
January 2011
December 2010
November 2010
October 2010
September 2010
August 2010
July 2010
June 2010
May 2010
April 2010
March 2010
February 2010
January 2010
December 2009
November 2009
October 2009
September 2009
August 2009
July 2009
June 2009
May 2009
April 2009
March 2009
February 2009
January 2009
December 2008
November 2008
October 2008
September 2008
August 2008
July 2008
June 2008
May 2008
April 2008
March 2008
February 2008
January 2008
December 2007
November 2007
October 2007
September 2007
August 2007
July 2007
June 2007
May 2007
April 2007
March 2007
February 2007
January 2007
December 2006
November 2006
October 2006
September 2006
August 2006
July 2006
June 2006
May 2006
April 2006
March 2006
February 2006
January 2006
December 2005
November 2005
October 2005
September 2005
August 2005
July 2005
June 2005
May 2005
April 2005
March 2005
February 2005
January 2005
December 2004
November 2004
October 2004
September 2004
August 2004
July 2004
June 2004


JiscMail is a Jisc service.

View our service policies at https://www.jiscmail.ac.uk/policyandsecurity/ and Jisc's privacy policy at https://www.jisc.ac.uk/website/privacy-notice

For help and support help@jisc.ac.uk

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager