JiscMail Logo
Email discussion lists for the UK Education and Research communities

Help for GRIDPP-STORAGE Archives


GRIDPP-STORAGE Archives

GRIDPP-STORAGE Archives


GRIDPP-STORAGE@JISCMAIL.AC.UK


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

GRIDPP-STORAGE Home

GRIDPP-STORAGE Home

GRIDPP-STORAGE  October 2006

GRIDPP-STORAGE October 2006

Options

Subscribe or Unsubscribe

Subscribe or Unsubscribe

Log In

Log In

Get Password

Get Password

Subject:

Re: NEW D-cache available

From:

[log in to unmask]

Reply-To:

[log in to unmask]

Date:

Tue, 17 Oct 2006 11:45:39 +0200

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (339 lines)

On Tue, 17 Oct 2006 10:36:54 +0100
Greig A Cowan <[log in to unmask]> wrote:

> I don't know why this mail hasn't come through yet on the list, I sent it
> half an hour ago. Probably because it was just CC'd. Anyway, the point of
> it is that you need to upgrade the "head" node first of all before
> upgrading the door nodes since the doors require gPlazma (i.e. VOMs) which
> runs as a domain on the head node.
> 
> Cheers,
> Greig


Thanks for the summary but the email came through to the list for me.

Regards

Owen

> 
> 
> ---------- Forwarded message ----------
> Date: Tue, 17 Oct 2006 10:10:23 +0100 (BST)
> From: Greig A Cowan <[log in to unmask]>
> To: [log in to unmask]
> Cc: [log in to unmask]
> Subject: Re: NEW D-cache available
> 
> 
> Hi everyone,
> 
> Below is some output that I got from upgrading one of my pool/door nodes 
> using YAIM. There are a couple of things to note:
> 
> * There are a lot of references to tomcat in the output. Is tomcat 
> required for the pool/door node? If so, what for?
> 
> * The configure script added a line to my /etc/fstab, such that I had:
> 
> srm.epcc.ed.ac.uk:/fs /pnfs/fs                  nfs 
> hard,intr,ro,bg,noac,auto 0 0
> 
> srm.epcc.ed.ac.uk:/pnfsdoors /pnfs/epcc.ed.ac.uk nfs 
> hard,intr,ro,bg,noac,auto 0 0
> 
> and also removed the link from /pnfs/epcc.ed.ac.uk -> fs/usr meaning that 
> the pnfs filesytem was no longer available under /pnfs/epcc.ed.ac.uk . I 
> decided to keep with the second line in /etc/fstab above (since it has 
> just been added) but this required that I make modifications to the 
> corresponding /pnfs/fs/admin/exports/<IP-address> file.
> 
> * Since I have only upgraded the pool/door software and not the head node,
> the gridftp door will not work as it tries to use gPlazma (basically VOMs)
> for authorisation. Since dCache 1.7.0 has not yet been installed on the
> head node then the relevant gPlazma domain cannot be found.
> 
> Here's the error from trying an srmcp:
> 
> error: the server sent an error response: 530 530 Authorization Service 
> failed: 
> diskCacheV111.services.authorization.AuthorizationServiceException: 
> authRequestID 497826706No Route to cell for packet 
> {uoid=<1161075609201:201>;path=[>gPlazma@local];msg=Tunnel cell 
> >gPlazma@local< not found at >dCacheDomain<}
> 
> Matt: this means that if you want to upgrade your door nodes to help with
> the CLOSE_WAIT problem then you will also have to upgrade the head node.
> 
> I'll let you know if I find anything else.
> 
> Cheers,
> Greig
> 
> 
> <configure_node output>
> 
> WARNING: Changed the file /etc/fstab
> mkdir: cannot create directory `/pnfs/epcc.ed.ac.uk': File exists
> WARNING: Please wait mounting /pnfs/epcc.ed.ac.uk
> mount: backgrounding "srm.epcc.ed.ac.uk:/pnfsdoors"
> WARNING: Finished mounting /pnfs/epcc.ed.ac.uk
> stop config_pnfs_install_mount
> end config_sedcache_pnfs
> start config_dcache_config_dcache_scripts
>  
>  Checking MasterSetup  ./config/dCacheSetup O.k.
>  
>    Sanning dCache batch files
>  
>     Processing adminDoor
>     Processing dCache
>     Processing dir
>     Processing door
>     Processing gPlazma
>     Processing gridftpdoor
>     Processing gsidcapdoor
>     Processing httpd
>     Processing infoProvider
>     Processing lm
>     Processing pnfs
>     Processing pool
>     Processing replica
>     Processing srm
>     Processing statistics
>     Processing utility
> mount: mount to NFS server 'srm.epcc.ed.ac.uk' failed: RPC Error: 
> Success(retrying).
>     Processing xrootdDoor
>  
>  
>  Checking Users database .... Ok
>  Checking Security       ....  Failed
>  
>   cd ../config
>   ssh-keygen -b  768 -f ./server_key -N ""
>   ssh-keygen -b 1024 -f ./host_key   -N ""
>  
>  Checking JVM ........ Ok
>  Checking Cells ...... Ok
>  dCacheVersion ....... Version production-1-7-0
>  
> AXIS_PATH=/opt/d-cache/libexec/axis-1_3
> TOMCAT_PATH=/opt/d-cache/libexec/jakarta-tomcat-4.1.31
> installing tomcat and axis ...Done
> rm 
> /opt/d-cache/libexec/jakarta-tomcat-4.1.31/webapps/srm/WEB-INF/lib/commons-logging*.jar
> copying jars ...Done
> modifying system CLASSPATH in 
> /opt/d-cache/libexec/jakarta-tomcat-4.1.31/bin/catalina.sh ...calling sed
> CATALINA_CP_ADD=\/opt\/d-cache\/libexec\/jakarta-tomcat-4.1.31\/server\/lib\/cells-protocols.jar:\/opt\/d-cache\/libexec\/jakarta-tomcat-4.1.31\/common\/lib\/cog-url.jar
> Done
> Starting up tomcat ...Using CATALINA_BASE:   
> /opt/d-cache/libexec/jakarta-tomcat-4.1.31
> Using CATALINA_HOME:   /opt/d-cache/libexec/jakarta-tomcat-4.1.31
> Using CATALINA_TMPDIR: /opt/d-cache/libexec/jakarta-tomcat-4.1.31/temp
> Using JAVA_HOME:       /usr/java/j2sdk1.4.2_12
> Done
> deployng srm v2 application using axis AdminClient ...
> - Unable to find required classes (javax.activation.DataHandler and 
> javax.mail.internet.MimeMultipart). Attachment support is disabled.
> Processing file /opt/d-cache/etc/srmv1-deploy.wsdd
> <Admin>Done processing</Admin>
> - Unable to find required classes (javax.activation.DataHandler and 
> javax.mail.internet.MimeMultipart). Attachment support is disabled.
> Processing file /opt/d-cache/etc/srmv2.2-deploy.wsdd
> <Admin>Done processing</Admin>
> Done
> creating config files and adding configuration info into 
> /opt/d-cache/libexec/jakarta-tomcat-4.1.31/webapps/srm/WEB-INF/web.xml 
> ...Done
> enabling GSI HTTP in tomcat by modifying 
> /opt/d-cache/libexec/jakarta-tomcat-4.1.31/conf/server.xml 
> ...tmp2:/tmp/tmp2Oct170933116107401110
> turning off sending of Multi Refs in 
> /opt/d-cache/libexec/jakarta-tomcat-4.1.31/webapps/srm/WEB-INF/server-config.wsdd
> Done
> shutdown Tomcat
> Using CATALINA_BASE:   /opt/d-cache/libexec/jakarta-tomcat-4.1.31
> Using CATALINA_HOME:   /opt/d-cache/libexec/jakarta-tomcat-4.1.31
> Using CATALINA_TMPDIR: /opt/d-cache/libexec/jakarta-tomcat-4.1.31/temp
> Using JAVA_HOME:       /usr/java/j2sdk1.4.2_12
> installing config for startup/shutdown script
> Installation complete
> please use /opt/d-cache/bin/dcache-srm start|stop|restart to startup, 
> shutdown or  restart srm server
>  
> [INFO]  Checking if /pnfs/epcc.ed.ac.uk mounted to the right export. ...
> [INFO]  Trying to remove symbolic link /pnfs/epcc.ed.ac.uk :
> [INFO]  'rm -f /pnfs/epcc.ed.ac.uk' went fine.
> [INFO]  Creating pnfs mount point (/pnfs/epcc.ed.ac.uk)
> [INFO]  Will be mounted to srm.epcc.ed.ac.uk:/pnfsdoors by dcache-core 
> start-up script.
>  
> [ERROR] Link /pnfs/ftpBase --> /pnfs/epcc.ed.ac.uk cannot be created. 
> Needed by the GridFTP door.
>         Please move /pnfs/ftpBase and run me again. Exiting.
> ERROR executing /opt/d-cache/install/install.sh failed (exit code 1) -- 
> abort
> [root@pool2 etc]# mount: srm.epcc.ed.ac.uk:/pnfsdoors failed, reason given 
> by server: Operation not permitted
> 
> 
> On Tue, 17 Oct 2006 [log in to unmask] wrote:
> 
> > On Mon, 16 Oct 2006 17:53:13 +0100 (BST)
> > Greig A Cowan <[log in to unmask]> wrote:
> > 
> > > 
> > > Hi Owen,
> > > 
> > > That's good to hear that the new version has been released. 
> > > 
> > > Is this the correct changelog to look at? 
> > > 
> > > http://www.dcache.org/manuals/Book/rf-changelog-1665-1681.shtml
> > > 
> > > I think this page has been online for a while; are there any additional
> > > changes/bug fixes that made it into the release? What about the
> > > non-blocking I/O that should fix the CLOSE_WAIT problem? 
> > 
> > It will fix it to a considerable degree, we found it occures to some degree in an old prerelease but no where near as much as before, we belive it shoudl be fixed now but only time in production will tell.
> > 
> >  
> > > Presumably you have tested the 1.6.6-5 -> 1.7.0-16 upgrade path. I ask
> > > because the link:
> > > 
> > > http://www.dcache.org/manuals/yaim-dcache-howto.shtml
> > > 
> > > states "For now this is only meant for installations from scratch". Were 
> > > there any other problems during upgrade, for example, the integration 
> > > of VOMs?
> > > 
> > > Cheers,
> > > Greig
> > 
> > Yes its straight forward and waiting for me to finish the instructions, Yaim users see what I wrote before as this is the prefured solution. Bellow is the cut n paste from my README file in the upgrade RPM
> > 
> > REgards
> > 
> > Owen
> > 
> > The procedure for upgrading dCache from 1.6 to 1.7
> > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> > 
> > Background
> > ~~~~~~~~~~
> > 
> > dCache has changed considerably between versions 1.6 and 1.7. Particularly with
> > respect to the SRM interface. Please see the change log in the dCache
> > documentation at dCache.org for details. These changes have inevitably led to
> > many additions to the dCache configuration. This RPM contains a simple script to
> > enable sites to easily upgrade thier version of dCache with the minimum effort.
> > 
> > Fortunately the databases of dCache have largely remained unchanged, and so pnfs
> > should can be upgraded with little to no effort. 
> > 
> > Recipe to upgrade
> > ~~~~~~~~~~~~~~~~~
> > 
> > The upgrade must run in three stages, preupgrade, then moving to more modern
> > RPM's and then a post upgrade stage.
> > 
> > Preupgrade recipe
> > ~~~~~~~~~~~~~~~~~
> > 
> > Run the following commands
> > 
> > /etc/init.d/dcache-pool stop 
> > /etc/init.d/dcache-core stop 
> > /etc/init.d/pnfs stop
> > dropdb -U srmdcache billing 
> > dropdb -U srmdcache dcache 
> > dropdb -U srmdcache replicas 
> > createdb -U srmdcache billing
> > createdb -U srmdcache dcache
> > createdb -U srmdcache replicas
> > psql -U srmdcache replicas -f /opt/d-cache/etc/psql_install_replicas.sql
> > 
> > 
> > Rpm Upgrade
> > ~~~~~~~~~~~
> > 
> > Now upgrade the RPM's to the 1.7 release of dCache. This may be done via rpm.
> > 
> > 
> > Postupgrade recipe
> > ~~~~~~~~~~~~~~~~~~
> > 
> > The system should now have the 1.7 release of dCache installed. We now need to
> > run the configuration upgrade script and start dCache. 
> > 
> > sh /opt/d-cache/install/dCacheUpgrade_1_6-1_7.sh
> > /etc/init.d/pnfs start
> > /opt/d-cache/install/install.sh 
> > /etc/init.d/dcache-core start 
> > /etc/init.d/dcache-pool start 
> > 
> > Conclusion
> > ~~~~~~~~~~
> > 
> > We should now have a fully upgraded dCache. As with previous releases wait a
> > 5-10 minutes before you send in any bug reports it may be initialising.
> > 
> > 
> > > 
> > > On Mon, 16 Oct 2006 [log in to unmask] wrote:
> > > 
> > > > We have the new stable version of D-cache available on the D-cache web
> > > > site, 
> > > > 
> > > > Installation instructions are here
> > > > 
> > > > http://www.dcache.org/manuals/yaim-dcache-howto.shtml
> > > > 
> > > > For a YAIM based site you should only need to change the site-info.def
> > > > to
> > > > 
> > > > RESET_DCACHE_CONFIGURATION=yes
> > > > 
> > > > While the other settings should be set as
> > > > 
> > > > RESET_DCACHE_PNFS=no
> > > > RESET_DCACHE_RDBMS=no
> > > > 
> > > > if you want to keep your data and I guess you do want to keep your data.
> > > > 
> > > > With regard to the apt repository we do not yet have it in stable, I am
> > > > giving you all 24 hours notice to check your setups and then I shall
> > > > migrate D-cache 1.7.0-16 to stable.
> > > > 
> > > > Non yaim sites should wait for a short time as I finish documenting the
> > > > upgrade procedure but its tested and working. I expect this RPM will be
> > > > released with instructions in the README at the same time as I release
> > > > D-cache 1.7.0-16 to stable in the apt repository.
> > > > 
> > > > D-cache 1.7.0-16 is currently available to YAIM users in the testing
> > > > section of the apt repository.
> > > > 
> > > > Regards
> > > > 
> > > > Owen
> > > > 
> > > 
> > > -- 
> > > ========================================================================
> > > Dr Greig A Cowan                         http://www.ph.ed.ac.uk/~gcowan1
> > > School of Physics, University of Edinburgh, James Clerk Maxwell Building
> > > 
> > > TIER-2 STORAGE SUPPORT PAGES: http://wiki.gridpp.ac.uk/wiki/Grid_Storage
> > > ========================================================================
> > 
> 
> -- 
> ========================================================================
> Dr Greig A Cowan                         http://www.ph.ed.ac.uk/~gcowan1
> School of Physics, University of Edinburgh, James Clerk Maxwell Building
> 
> TIER-2 STORAGE SUPPORT PAGES: http://wiki.gridpp.ac.uk/wiki/Grid_Storage
> ========================================================================

Top of Message | Previous Page | Permalink

JiscMail Tools


RSS Feeds and Sharing


Advanced Options


Archives

September 2018
August 2018
July 2018
June 2018
May 2018
April 2018
March 2018
February 2018
January 2018
December 2017
November 2017
October 2017
September 2017
August 2017
July 2017
June 2017
May 2017
April 2017
March 2017
February 2017
January 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012
November 2012
October 2012
September 2012
August 2012
July 2012
June 2012
May 2012
April 2012
March 2012
February 2012
January 2012
December 2011
November 2011
October 2011
September 2011
August 2011
July 2011
June 2011
May 2011
April 2011
March 2011
February 2011
January 2011
December 2010
November 2010
October 2010
September 2010
August 2010
July 2010
June 2010
May 2010
April 2010
March 2010
February 2010
January 2010
December 2009
November 2009
October 2009
September 2009
August 2009
July 2009
June 2009
May 2009
April 2009
March 2009
February 2009
January 2009
December 2008
November 2008
October 2008
September 2008
August 2008
July 2008
June 2008
May 2008
April 2008
March 2008
February 2008
January 2008
December 2007
November 2007
October 2007
September 2007
August 2007
July 2007
June 2007
May 2007
April 2007
March 2007
February 2007
January 2007
December 2006
November 2006
October 2006
September 2006
August 2006
July 2006
June 2006
May 2006
April 2006
March 2006
February 2006
January 2006
December 2005
November 2005
October 2005
September 2005
August 2005
July 2005
June 2005
May 2005
April 2005
March 2005
February 2005
January 2005
December 2004
November 2004
October 2004
September 2004
August 2004
July 2004
June 2004


JiscMail is a Jisc service.

View our service policies at https://www.jiscmail.ac.uk/policyandsecurity/ and Jisc's privacy policy at https://www.jisc.ac.uk/website/privacy-notice

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager