Hi Massimo,
not yet, but our pbs experts are informed and checking this.
Just as info: we still using old blparser, and not the new one, if it
makes some difference for submission... We would inform you as soon as
we get any results.
Regards
Dimitri
On 12/01/2010 11:59 AM, Massimo Sgaravatto - INFN Padova wrote:
> Hi Dimitri
>
> Did you have the chance to perform that test ?
> If this is the problem (i.e. the new -W directive is not accepted by
> PBSPRO), you can at any rate keeps using the latest blah rpm (which
> includes several fixes) and you just have to simply patch the
> pbs_submit.sh script (we can provide the details).
>
> If this is the problem, in next CREAM CE version we can make optional
> which -W directive should be used
>
> At any rate having Torque and PBSPRO not fully compliant is a bit
> worrying
>
> Cheers, Massimo
>
>
> On Thu, 25 Nov 2010, Massimo Sgaravatto - INFN Padova wrote:
>
>> On Thu, 25 Nov 2010, Nilsen Dimitri wrote:
>>
>>> Hi,
>>>
>>> this error(pbs_reason=127;) was caused by
>>> glite-ce-blahp-1.14.4-3.sl5.x86_64 package.
>>> downgrading to glite-ce-blahp-1.14.2-7.sl5 solved the problem.
>>
>> ... which also means using the old -W directive
>>
>>
>>>
>>> We had no time yet to check this "-W" issue.. we will do this as
>>> soon as
>>> posible. Were there other cahnges in the newest version, that could
>>> cause this error?
>>
>>
>> There were other fixes in BLAH, but first of all I would first focus
>> on the -W change (so please try do that test).
>> I am having a look at the pbspro manual at
>> http://www.pbsworks.com/documentation/support/PBSProUserGuide10.4.pdf
>> which is not too clear but I see examples only wrt the old format
>>
>>
>> I hope I am wrong
>>
>> So far we assumed that torque and pbspro could be treated in the very
>> same way ...
>>
>>
>>
>>>
>>> Regards
>>> Dimitri
>>>
>>> On 11/24/2010 08:00 PM, Massimo Sgaravatto - INFN Padova wrote:
>>>> On Wed, 24 Nov 2010, Nilsen Dimitri wrote:
>>>>
>>>>> Hi Massino,
>>>>>
>>>>> where could I find this? In which script?
>>>>
>>>>
>>>> I mean, can you try to submit by hand a job in your pbspro cluster and
>>>> check if stagein directives such as:
>>>>
>>>> "-W stagein=file1@host:source1,stagein=file2@host:source2"
>>>>
>>>>
>>>> work ?
>>>>
>>>>
>>>> For sure a -W directive such as:
>>>>
>>>> -W stagein=file1@host:source1,file2@host:source2
>>>>
>>>> works, since in the previous installation you reported that everything
>>>> was ok
>>>>
>>>> Cheers, Massimo
>>>>
>>>>>
>>>>> Regards
>>>>> Dimitri
>>>>>
>>>>>
>>>>> On 11/24/2010 07:54 PM, Massimo Sgaravatto - INFN Padova wrote:
>>>>>> With fix:
>>>>>>
>>>>>> https://savannah.cern.ch/bugs/?70808
>>>>>>
>>>>>> BLAH now does:
>>>>>>
>>>>>>
>>>>>> "-W stagein=file1@host:source1,stagein=file2@host:source2"
>>>>>>
>>>>>> instead of:
>>>>>>
>>>>>> -W stagein=file1@host:source1,file2@host:source2
>>>>>>
>>>>>>
>>>>>> This was done to be able to use also newer Torque version where the
>>>>>> old behavior is not supported anymore.
>>>>>>
>>>>>>
>>>>>> Could you please check if PBSPRO supports directives such as:
>>>>>>
>>>>>> "-W stagein=file1@host:source1,stagein=file2@host:source2"
>>>>>>
>>>>>>
>>>>>> Cheers, Massimo
>>>>>>
>>>>>>
>>>>>> On Wed, 24 Nov 2010, Nilsen Dimitri wrote:
>>>>>>
>>>>>>> hi,
>>>>>>> we are using pbs-pro. Cream is configured with glite-TORQUE_utils.
>>>>>>>
>>>>>>> file is available:
>>>>>>>
>>>>>>> [root@cream-1-fzk ~]# ll
>>>>>>> /opt/glite/var/cream_sandbox/dteam/_O_GermanGrid_OU_FZK_CN_Dimitri_Nilsen_dteam_Role_NULL_Capability_NULL_dteam038/01/CREAM011085357/
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> total 28
>>>>>>> -rwx------ 1 dteam038 dteam 23013 Nov 24 14:35
>>>>>>> CREAM011085357_jobWrapper.sh
>>>>>>> drwx------ 2 dteam038 dteam 6 Nov 24 14:35 ISB
>>>>>>> drwx------ 2 dteam038 dteam 6 Nov 24 14:35 OSB
>>>>>>> -rw------- 1 dteam038 dteam 150 Nov 24 14:35 StandardError
>>>>>>> [root@cream-1-fzk ~]#
>>>>>>> [root@cream-1-fzk ~]#
>>>>>>> [root@cream-1-fzk ~]# cat
>>>>>>> /opt/glite/var/cream_sandbox/dteam/_O_GermanGrid_OU_FZK_CN_Dimitri_Nilsen_dteam_Role_NULL_Capability_NULL_dteam038/01/CREAM011085357/StandardError
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> /var/spool/PBS/mom_priv/jobs/736741.pbs3.SC: line 35:
>>>>>>> /tmp/home/dteam038/home_crem1_011085357/CREAM011085357_jobWrapper.sh:
>>>>>>>
>>>>>>> No
>>>>>>> such file or directory
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On 11/24/2010 03:58 PM, Massimo Sgaravatto - INFN Padova wrote:
>>>>>>>> It looks like the CREAMjw was not staged from the CE into the WN.
>>>>>>>>
>>>>>>>> Is that file available in the CE node (under
>>>>>>>> /opt/glite/var/cream_sandbox/...) ?
>>>>>>>>
>>>>>>>>
>>>>>>>> In the new CREAM CE a change on the staging directives was done to
>>>>>>>> address this problem:
>>>>>>>>
>>>>>>>> https://savannah.cern.ch/bugs/?70808
>>>>>>>>
>>>>>>>> Are you using Torque or some other pbs implementations ?
>>>>>>>>
>>>>>>>> Cheers, Massimo
>>>>>>>>
>>>>>>>>
>>>>>>>> On Wed, 24 Nov 2010, Nilsen Dimitri wrote:
>>>>>>>>
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> we reinstalled one of our CEs (currently -
>>>>>>>>> glite-CREAM-3.2.8-2.sl5
>>>>>>>>> ) and all jobs are failing with error message like:
>>>>>>>>> pbs_reason=127;
>>>>>>>>> /var/spool/PBS/mom_priv/jobs/737478.pbs3.SC: line 35:
>>>>>>>>> /tmp/home/dteam038/home_crem1_821693180/CREAM821693180_jobWrapper.sh:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> No such file or directory
>>>>>>>>>
>>>>>>>>> It seems like, that Cream is not able to copy files to the worker
>>>>>>>>> node. What could be a reason for that? The directly submission
>>>>>>>>> from
>>>>>>>>> user-account with qsub works fine.
>>>>>>>>>
>>>>>>>>> Regards Dimitri
>>>>>>>>>
>>>>>>>>> -- Dimitri Nilsen, Dipl.-Ing(FH)
>>>>>>>>>
>>>>>>>>> Karlsruhe Institute of Technology (KIT) Steinbuch Centre for
>>>>>>>>> Computing Postfach 3640 76344 Eggenstein-Leopoldshafen, Germany
>>>>>>>>>
>>>>>>>>> Tel.: +49 7247 82-8607 Fax.: +49 7247 82-4972 Email:
>>>>>>>>> [log in to unmask]
>>>>>>>>>
>>>>>>>>
>>>>>>>> \|||/ -----------0oo----( o o )----oo0------------------- (_) INFN
>>>>>>>> Sezione di Padova Via Marzolo, 8 35131 Padova - Italy E-mail:
>>>>>>>> massimo.sgaravatto [at] pd.infn.it Tel: ++39 0498275908 Skype:
>>>>>>>> massimo.sgaravatto Fax: ++39 0498275952
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Dimitri Nilsen, Dipl.-Ing(FH)
>>>>>>>
>>>>>>> Karlsruhe Institute of Technology (KIT)
>>>>>>> Steinbuch Centre for Computing
>>>>>>> Postfach 3640
>>>>>>> 76344 Eggenstein-Leopoldshafen, Germany
>>>>>>>
>>>>>>> Tel.: +49 7247 82-8607
>>>>>>> Fax.: +49 7247 82-4972
>>>>>>> Email: [log in to unmask]
>>>>>>>
>>>>>>
>>>>>> \|||/
>>>>>> -----------0oo----( o o )----oo0-------------------
>>>>>> (_)
>>>>>> INFN Sezione di Padova
>>>>>> Via Marzolo, 8
>>>>>> 35131 Padova - Italy E-mail: massimo.sgaravatto [at] pd.infn.it
>>>>>> Tel: ++39 0498275908 Skype: massimo.sgaravatto
>>>>>> Fax: ++39 0498275952
>>>>>
>>>>>
>>>>> --
>>>>> Dimitri Nilsen, Dipl.-Ing(FH)
>>>>>
>>>>> Karlsruhe Institute of Technology (KIT)
>>>>> Steinbuch Centre for Computing
>>>>> Postfach 3640
>>>>> 76344 Eggenstein-Leopoldshafen, Germany
>>>>>
>>>>> Tel.: +49 7247 82-8607
>>>>> Fax.: +49 7247 82-4972
>>>>> Email: [log in to unmask]
>>>>>
>>>>>
>>>>
>>>> \|||/
>>>> -----------0oo----( o o )----oo0-------------------
>>>> (_)
>>>> INFN Sezione di Padova
>>>> Via Marzolo, 8
>>>> 35131 Padova - Italy E-mail: massimo.sgaravatto [at] pd.infn.it
>>>> Tel: ++39 0498275908 Skype: massimo.sgaravatto
>>>> Fax: ++39 0498275952
>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Dimitri Nilsen, Dipl.-Ing(FH)
>>>
>>> Karlsruhe Institute of Technology (KIT)
>>> Steinbuch Centre for Computing
>>> Postfach 3640
>>> 76344 Eggenstein-Leopoldshafen, Germany
>>>
>>> Tel.: +49 7247 82-8607
>>> Fax.: +49 7247 82-4972
>>> Email: [log in to unmask]
>>>
>>>
>>
>> \|||/
>> -----------0oo----( o o )----oo0-------------------
>> (_)
>> INFN Sezione di Padova
>> Via Marzolo, 8
>> 35131 Padova - Italy E-mail: massimo.sgaravatto [at] pd.infn.it
>> Tel: ++39 0498275908 Skype: massimo.sgaravatto
>> Fax: ++39 0498275952
>>
>>
>>
>>
>
> \|||/
> -----------0oo----( o o )----oo0-------------------
> (_)
> INFN Sezione di Padova
> Via Marzolo, 8
> 35131 Padova - Italy E-mail: massimo.sgaravatto [at] pd.infn.it
> Tel: ++39 0498275908 Skype: massimo.sgaravatto
> Fax: ++39 0498275952
>
>
>
>
--
Dimitri Nilsen, Dipl.-Ing(FH)
Karlsruhe Institute of Technology (KIT)
Steinbuch Centre for Computing
Postfach 3640
76344 Eggenstein-Leopoldshafen, Germany
Tel.: +49 7247 82-8607
Fax.: +49 7247 82-4972
Email: [log in to unmask]
|