Your CEs broke:
ce03:
018 (12260740.010.000) 07/21 01:41:33 Globus job submission failed!
Reason: 22 the job manager failed to create an internal script argument file
You need to clean up (that is, remove empty directories) on
~/.globus/jobs/HOSTNAME in the pool account I run as, which is...
atlasprd, which means that you also have VOMS broken and the CE is
falling back to the grid-mapfile where I will map to production :-(
Then on ce01:
012 (12267445.000.000) 07/21 06:58:41 Job was held.
Globus error 7: an authorization operation failed
Code 2 Subcode 7
and I don't know what that is at all.
So, in summary, the pilots cannot get started and nothing will appear
on the test page until this is fixed.
And you thought you were out of the woods!
Cheers
Graeme
On Tue, Jul 21, 2009 at 13:38, Chris Curtis<[log in to unmask]> wrote:
>
> Hi -
>
> I can see a few (< 10) GraemeStewart pilot jobs on our clusters, but they're
> finishing quite quickly (~minutes). How long should they take to run? How
> long before they appear on the GangaRobot page?
>
> Cheers,
>
> Chris
>
>
> On Tue, 21 Jul 2009, Graeme Stewart wrote:
>
>> Hi Rob
>>
>> You are running jobs, but many failures with this error:
>>
>> Error details: pilot: wget command failed: 256, --12:10:00--
>> http://www.usatlas.bnl.gov/svn/panda/pathena/trf/runAthena-00-00-11 >
>> `runAthena-00-00-11' Resolving www.usatlas.bnl.gov... 130.199.54.3
>> Connecting to www.usatlas.bnl.gov|130.199.54.3|:80... failed
>>
>> See http://panda.cern.ch:25980/server/pandamon/query?dash=analysis,
>> open the UK tab and then click though to errors.
>>
>> Outbound access problems on heplnc machines?
>>
>>
>> http://panda.cern.ch:25980/server/pandamon/query?overview=wnlist&type=analysis&hours=24&site=ANALY_RALPP&reload=yes
>>
>> On the other point, you should certainly see pilots with my DN,
>>
>> "/C=UK/O=eScience/OU=Glasgow/L=Compserv/CN=graeme stewart"
>>
>> and perhaps ones from Peter Love.
>>
>> Cheers
>>
>> Graeme
>>
>> On Tue, Jul 21, 2009 at 12:56, Harper, RM (Rob)<[log in to unmask]>
>> wrote:
>>>
>>> Hi Sam,
>>>
>>> We're not seeing any jobs at RALPP though the web pages say we have a
>>> load queued.
>>>
>>> What DNs are the jobs being submitted as? We'd like to be able to check
>>> if we are getting any connections coming in...
>>>
>>> Cheers,
>>> Rob
>>>
>>>> -----Original Message-----
>>>> From: Testbed Support for GridPP member institutes
>>>> [mailto:[log in to unmask]] On Behalf Of Sam Skipsey
>>>> Sent: Tuesday, July 21, 2009 11:35 AM
>>>> To: [log in to unmask]
>>>> Subject: Re: Next week's HammerCloud test: Birmingham
>>>>
>>>> It means that 350 jobs have been submitted. Don't worry about
>>>> running out of jobs to process - Glasgow has around 1000 jobs
>>>> queued from the pilot factory, and are having no issues with
>>>> the stream of job we're getting.
>>>> The pilot jobs issues are probably related to RHUL's issues -
>>>> the pilot factories are being looked at, and there should be
>>>> pilots for you soon.
>>>>
>>>> Sam
>>>>
>>>> 2009/7/21 Chris Curtis <[log in to unmask]>:
>>>>>
>>>>> Hi -
>>>>>
>>>>> I've noticed on the hammercloud test site that Birmingham
>>>>
>>>> is down for
>>>>>
>>>>> ~350 ANALY_BHAM jobs per test. Does this figure mean that 350 have
>>>>> already been submitted to Panda destined for Birmingham, or is that
>>>>> the total number of jobs to be submitted over the two days?
>>>>>
>>>>> Either way I can't see any ATLAS pilot jobs here at
>>>>
>>>> Birmingham, and we
>>>>>
>>>>> have a relatively quiet cluster at the moment...
>>>>>
>>>>> Cheers,
>>>>>
>>>>> Chris
>>>>>
>>>>> --
>>>>> West 326
>>>>> Physics and Astronomy
>>>>> University of Birmingham
>>>>> Edgbaston
>>>>> Birmingham
>>>>> B15 2TT
>>>>>
>>>>> (Office) 0121 414 4700
>>>>> (Mobile) 0798 666 1959
>>>>>
>>>>
>>> --
>>> Scanned by iCritical.
>>>
>>
>>
>>
>>
>
> --
> West 326
> Physics and Astronomy
> University of Birmingham
> Edgbaston
> Birmingham
> B15 2TT
>
> (Office) 0121 414 4700
> (Mobile) 0798 666 1959
--
Dr Graeme Stewart http://www.physics.gla.ac.uk/~graeme/
Department of Physics and Astronomy, University of Glasgow, Scotland
DEATH TO MEETINGS!
|