Hi Todd,
thank you for supplying the rest of the world with an VO=ops proxy which
is valid for yet another 20 hours or so, as well as a long-lived proxy
of your own grid certificate.
Now, what shall I do next today ;-) ?
regards,
JJK / Jan Just Keijser
Nikhef
Amsterdam
Todd Wu wrote:
> Hi, Alvise,
>
> Yes, there is a inconsistency between status and logging-info update
> that you reported is what I want to know. So far, there is only one
> creamce got this problem.
>
> I submit some jobs and attached logs.
>
> dteam-VO:
>
> *************************************************************
> BOOKKEEPING INFORMATION:
>
> Status info for the Job :
> https://roclb.grid.sinica.edu.tw:9000/gijrCxKPofGo71vYoyB82Q
> Current Status: Done (Success)
> Logged Reason(s):
> - job completed
> - Job Terminated Successfully
> Exit code: 0
> Status Reason: Job Terminated Successfully
> Destination: as-ce01.euasiagrid.org:8443/cream-pbs-dteam
> <http://as-ce01.euasiagrid.org:8443/cream-pbs-dteam>
> Submitted: Mon Sep 26 04:02:24 2011 UTC
> *************************************************************
>
>
> *************************************************************
> BOOKKEEPING INFORMATION:
>
> Status info for the Job :
> https://lb01.grid.sinica.edu.tw:9000/_-5MLKjjiFhyabAibXSBFg
> Current Status: Done (Success)
> Logged Reason(s):
> - job completed
> - Job Terminated Successfully
> Exit code: 0
> Status Reason: Job Terminated Successfully
> Destination: as-ce01.euasiagrid.org:8443/cream-pbs-dteam
> <http://as-ce01.euasiagrid.org:8443/cream-pbs-dteam>
> Submitted: Mon Sep 26 04:02:39 2011 UTC
> *************************************************************
>
>
> *************************************************************
> BOOKKEEPING INFORMATION:
>
> Status info for the Job :
> https://lb01.grid.sinica.edu.tw:9000/X4EOAL4cazUG7yPvZzB1Ew
> Current Status: Done (Success)
> Logged Reason(s):
> - job completed
> - Job Terminated Successfully
> Exit code: 0
> Status Reason: Job Terminated Successfully
> Destination: ce12.sdfarm.kr:8443/cream-pbs-dteam
> <http://ce12.sdfarm.kr:8443/cream-pbs-dteam>
> Submitted: Mon Sep 26 04:02:54 2011 UTC
> *************************************************************
>
>
> *************************************************************
> BOOKKEEPING INFORMATION:
>
> Status info for the Job :
> https://roclb.grid.sinica.edu.tw:9000/NUJkySg8y_06YllsxsGbaQ
> Current Status: Done (Success)
> Logged Reason(s):
> - job completed
> - Job Terminated Successfully
> Exit code: 0
> Status Reason: Job Terminated Successfully
> Destination: ce12.sdfarm.kr:8443/cream-pbs-dteam
> <http://ce12.sdfarm.kr:8443/cream-pbs-dteam>
> Submitted: Mon Sep 26 04:03:03 2011 UTC
> *************************************************************
>
> OPS-VO
>
> *************************************************************
> BOOKKEEPING INFORMATION:
>
> Status info for the Job :
> https://roclb.grid.sinica.edu.tw:9000/xkEDsVt6CQrqOoI9fBjmlQ
> Current Status: Running
> Status Reason: unavailable
> Destination: ce12.sdfarm.kr:8443/cream-pbs-ops
> <http://ce12.sdfarm.kr:8443/cream-pbs-ops>
> Submitted: Mon Sep 26 03:53:21 2011 UTC
> *************************************************************
>
>
> *************************************************************
> BOOKKEEPING INFORMATION:
>
> Status info for the Job :
> https://lb01.grid.sinica.edu.tw:9000/85PyczGPXYY_TwBhLAo8NA
> Current Status: Done (Success)
> Logged Reason(s):
> - job completed
> - Job Terminated Successfully
> Exit code: 0
> Status Reason: Job Terminated Successfully
> Destination: ce12.sdfarm.kr:8443/cream-pbs-ops
> <http://ce12.sdfarm.kr:8443/cream-pbs-ops>
> Submitted: Mon Sep 26 03:53:41 2011 UTC
> *************************************************************
>
>
> *************************************************************
> BOOKKEEPING INFORMATION:
>
> Status info for the Job :
> https://lb01.grid.sinica.edu.tw:9000/VrUrbxofxbUHxpfh9scjNg
> Current Status: Done (Success)
> Logged Reason(s):
> - job completed
> - Job Terminated Successfully
> Exit code: 0
> Status Reason: Job Terminated Successfully
> Destination: as-ce01.euasiagrid.org:8443/cream-pbs-ops
> <http://as-ce01.euasiagrid.org:8443/cream-pbs-ops>
> Submitted: Mon Sep 26 03:54:11 2011 UTC
> *************************************************************
>
>
> *************************************************************
> BOOKKEEPING INFORMATION:
>
> Status info for the Job :
> https://roclb.grid.sinica.edu.tw:9000/7Dw-clKidDsWbBhkHj3lJQ
> Current Status: Done (Success)
> Logged Reason(s):
> - job completed
> - Job Terminated Successfully
> Exit code: 0
> Status Reason: Job Terminated Successfully
> Destination: as-ce01.euasiagrid.org:8443/cream-pbs-ops
> <http://as-ce01.euasiagrid.org:8443/cream-pbs-ops>
> Submitted: Mon Sep 26 03:54:40 2011 UTC
> *************************************************************
>
>
> And you can see, only job submit to ce12.sdfarm.kr
> <http://ce12.sdfarm.kr> ops queue stays in running forever.
>
> Attached files containing:
> ice.log-wms03: wms03 ice log
> ice.log-rocwms: rocwms ice log(debug mod)
> glite-ce-cream.log-ce12.sdfarm.kr
> <http://glite-ce-cream.log-ce12.sdfarm.kr>: glite-ce-cream.log from
> ce12.sdfarm.kr <http://ce12.sdfarm.kr>
>
> I also generated long time proxy with ops vo for you if you need it
> for trouble shooting.
>
> Cheers,
> Todd
>
>
>
>
> 2011/9/22 Alvise Dorigo <[log in to unmask]
> <mailto:[log in to unmask]>>
>
> Also, could you please tell me the hostname where WMS is running
> on and the Job ID ? And also check if I can connect to that node
> through uberftp with dteam VO ?
> Or, alternatively, you should provide me the ICE logs.
>
> Alvise
>
>
> On Sep 22, 2011, at 3:48 PM, Alvise Dorigo wrote:
>
> > Hi Todd,
> > I'm not sure to understand completely the problem you described.
> > For certain, there is a inconsistency between status and
> logging-info update that you reported. Is this the primary problem
> that you observed ? and the only one ?
> >
> > Alvise
> >
> >>
> >> ---------- Forwarded message ----------
> >> Date: Thu, 22 Sep 2011 12:00:05 +0800
> >> From: Todd Wu <[log in to unmask] <mailto:[log in to unmask]>>
> >> Reply-To: LHC Computer Grid - Rollout
> <[log in to unmask] <mailto:[log in to unmask]>>
> >> To: [log in to unmask] <mailto:[log in to unmask]>
> >> Subject: [LCG-ROLLOUT] About wms3.1 communicate with cream-ce
> >>
> >> Dear list,
> >>
> >> The problem I am facing is:
> >> WMS communicate with one specified CREAMCE failed with jobs
> status update.
> >> When use
> >> # glite-wms-job-status, the job always show running,
> >> # glite-wms-job-logging-info, the job shows already done.
> >>
> >> I check the wms ice.log, the strange part is, with other
> working cremce, information can be
> >> found as follows:
> >> 2011-09-22 03:04:38,272 DEBUG - filelist_request_purger -
> removing request [ Arguments = [
> >> JobAd = [ requirements = ...
> >> 2011-09-22 03:05:03,991 DEBUG -
> iceCommandEventQuery::processEventsForJob() -
> >> TID=[145600776] Processing [3]...
> >> 2011-09-22 03:05:03,991 INFO - iceLBContext::setLoggingJob -
> Setting log job to
> >> jobid=[https://...
> >> 2011-09-22 03:05:03,992 INFO - iceLBLogger::logEvent() - Job
> Running Event....
> >> 2011-09-22 03:05:04,152 INFO - iceLBLogger::logEvent() - Job
> Really Running Event -...
> >> 2011-09-22 03:05:04,255 DEBUG -
> iceCommandEventQuery::processSingleEvent() - T...
> >> 2011-09-22 03:05:04,255 INFO - iceLBContext::setLoggingJob -
> Setting log job to jo....
> >> 2011-09-22 03:05:04,256 INFO - iceLBLogger::logEvent() - Job
> Done Ok Event, ExitC....
> >> 2011-09-22 03:05:04,375 INFO - Ice::deregister_proxy_renewal()
> - Unregistering....
> >> 011-09-22 03:05:04,407 DEBUG - Ice::resubmit_or_purge_job() -
> Removing purged job
> >> [gridJobID.....
> >>
> >>
> >> But for the creamce has problem,
> >> the information ended at
> >> 011-09-22 03:05:04,407 DEBUG - Ice::resubmit_or_purge_job() -
> Removing purged job
> >> [gridJobID..
> >>
> >> And there is no further information.
> >>
> >> I was thinking about is this wms or creamce's problem.
> >>
> >> but I tried with following paris, things working fine:
> >> 1. other wms with creamce has problem
> >> 2. my wms wiht other working creamce
> >>
> >> What could be the problem right now?
> >> Many thanks if any feed back.
> >>
> >> Cheers,
> >> Todd
> >>
>
>
|
