Hi Dimitri
Did you have the chance to perform that test ?
If this is the problem (i.e. the new -W directive is not accepted by
PBSPRO), you can at any rate keeps using the latest
blah rpm (which includes several fixes) and you just have to simply patch
the pbs_submit.sh script (we can provide the details).
If this is the problem, in next CREAM CE version we can make optional
which -W directive should be used
At any rate having Torque and PBSPRO not fully compliant is a bit worrying
Cheers, Massimo
On Thu, 25 Nov 2010, Massimo Sgaravatto - INFN Padova wrote:
> On Thu, 25 Nov 2010, Nilsen Dimitri wrote:
>
>> Hi,
>>
>> this error(pbs_reason=127;) was caused by
>> glite-ce-blahp-1.14.4-3.sl5.x86_64 package.
>> downgrading to glite-ce-blahp-1.14.2-7.sl5 solved the problem.
>
> ... which also means using the old -W directive
>
>
>>
>> We had no time yet to check this "-W" issue.. we will do this as soon as
>> posible. Were there other cahnges in the newest version, that could
>> cause this error?
>
>
> There were other fixes in BLAH, but first of all I would first focus on the
> -W change (so please try do that test).
> I am having a look at the pbspro manual at
> http://www.pbsworks.com/documentation/support/PBSProUserGuide10.4.pdf
> which is not too clear but I see examples only wrt the old format
>
>
> I hope I am wrong
>
> So far we assumed that torque and pbspro could be treated in the very same
> way ...
>
>
>
>>
>> Regards
>> Dimitri
>>
>> On 11/24/2010 08:00 PM, Massimo Sgaravatto - INFN Padova wrote:
>>> On Wed, 24 Nov 2010, Nilsen Dimitri wrote:
>>>
>>>> Hi Massino,
>>>>
>>>> where could I find this? In which script?
>>>
>>>
>>> I mean, can you try to submit by hand a job in your pbspro cluster and
>>> check if stagein directives such as:
>>>
>>> "-W stagein=file1@host:source1,stagein=file2@host:source2"
>>>
>>>
>>> work ?
>>>
>>>
>>> For sure a -W directive such as:
>>>
>>> -W stagein=file1@host:source1,file2@host:source2
>>>
>>> works, since in the previous installation you reported that everything
>>> was ok
>>>
>>> Cheers, Massimo
>>>
>>>>
>>>> Regards
>>>> Dimitri
>>>>
>>>>
>>>> On 11/24/2010 07:54 PM, Massimo Sgaravatto - INFN Padova wrote:
>>>>> With fix:
>>>>>
>>>>> https://savannah.cern.ch/bugs/?70808
>>>>>
>>>>> BLAH now does:
>>>>>
>>>>>
>>>>> "-W stagein=file1@host:source1,stagein=file2@host:source2"
>>>>>
>>>>> instead of:
>>>>>
>>>>> -W stagein=file1@host:source1,file2@host:source2
>>>>>
>>>>>
>>>>> This was done to be able to use also newer Torque version where the
>>>>> old behavior is not supported anymore.
>>>>>
>>>>>
>>>>> Could you please check if PBSPRO supports directives such as:
>>>>>
>>>>> "-W stagein=file1@host:source1,stagein=file2@host:source2"
>>>>>
>>>>>
>>>>> Cheers, Massimo
>>>>>
>>>>>
>>>>> On Wed, 24 Nov 2010, Nilsen Dimitri wrote:
>>>>>
>>>>>> hi,
>>>>>> we are using pbs-pro. Cream is configured with glite-TORQUE_utils.
>>>>>>
>>>>>> file is available:
>>>>>>
>>>>>> [root@cream-1-fzk ~]# ll
>>>>>> /opt/glite/var/cream_sandbox/dteam/_O_GermanGrid_OU_FZK_CN_Dimitri_Nilsen_dteam_Role_NULL_Capability_NULL_dteam038/01/CREAM011085357/
>>>>>>
>>>>>>
>>>>>> total 28
>>>>>> -rwx------ 1 dteam038 dteam 23013 Nov 24 14:35
>>>>>> CREAM011085357_jobWrapper.sh
>>>>>> drwx------ 2 dteam038 dteam 6 Nov 24 14:35 ISB
>>>>>> drwx------ 2 dteam038 dteam 6 Nov 24 14:35 OSB
>>>>>> -rw------- 1 dteam038 dteam 150 Nov 24 14:35 StandardError
>>>>>> [root@cream-1-fzk ~]#
>>>>>> [root@cream-1-fzk ~]#
>>>>>> [root@cream-1-fzk ~]# cat
>>>>>> /opt/glite/var/cream_sandbox/dteam/_O_GermanGrid_OU_FZK_CN_Dimitri_Nilsen_dteam_Role_NULL_Capability_NULL_dteam038/01/CREAM011085357/StandardError
>>>>>>
>>>>>>
>>>>>> /var/spool/PBS/mom_priv/jobs/736741.pbs3.SC: line 35:
>>>>>> /tmp/home/dteam038/home_crem1_011085357/CREAM011085357_jobWrapper.sh:
>>>>>> No
>>>>>> such file or directory
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 11/24/2010 03:58 PM, Massimo Sgaravatto - INFN Padova wrote:
>>>>>>> It looks like the CREAMjw was not staged from the CE into the WN.
>>>>>>>
>>>>>>> Is that file available in the CE node (under
>>>>>>> /opt/glite/var/cream_sandbox/...) ?
>>>>>>>
>>>>>>>
>>>>>>> In the new CREAM CE a change on the staging directives was done to
>>>>>>> address this problem:
>>>>>>>
>>>>>>> https://savannah.cern.ch/bugs/?70808
>>>>>>>
>>>>>>> Are you using Torque or some other pbs implementations ?
>>>>>>>
>>>>>>> Cheers, Massimo
>>>>>>>
>>>>>>>
>>>>>>> On Wed, 24 Nov 2010, Nilsen Dimitri wrote:
>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> we reinstalled one of our CEs (currently - glite-CREAM-3.2.8-2.sl5
>>>>>>>> ) and all jobs are failing with error message like: pbs_reason=127;
>>>>>>>> /var/spool/PBS/mom_priv/jobs/737478.pbs3.SC: line 35:
>>>>>>>> /tmp/home/dteam038/home_crem1_821693180/CREAM821693180_jobWrapper.sh:
>>>>>>>>
>>>>>>>> No such file or directory
>>>>>>>>
>>>>>>>> It seems like, that Cream is not able to copy files to the worker
>>>>>>>> node. What could be a reason for that? The directly submission from
>>>>>>>> user-account with qsub works fine.
>>>>>>>>
>>>>>>>> Regards Dimitri
>>>>>>>>
>>>>>>>> -- Dimitri Nilsen, Dipl.-Ing(FH)
>>>>>>>>
>>>>>>>> Karlsruhe Institute of Technology (KIT) Steinbuch Centre for
>>>>>>>> Computing Postfach 3640 76344 Eggenstein-Leopoldshafen, Germany
>>>>>>>>
>>>>>>>> Tel.: +49 7247 82-8607 Fax.: +49 7247 82-4972 Email:
>>>>>>>> [log in to unmask]
>>>>>>>>
>>>>>>>
>>>>>>> \|||/ -----------0oo----( o o )----oo0------------------- (_) INFN
>>>>>>> Sezione di Padova Via Marzolo, 8 35131 Padova - Italy E-mail:
>>>>>>> massimo.sgaravatto [at] pd.infn.it Tel: ++39 0498275908 Skype:
>>>>>>> massimo.sgaravatto Fax: ++39 0498275952
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Dimitri Nilsen, Dipl.-Ing(FH)
>>>>>>
>>>>>> Karlsruhe Institute of Technology (KIT)
>>>>>> Steinbuch Centre for Computing
>>>>>> Postfach 3640
>>>>>> 76344 Eggenstein-Leopoldshafen, Germany
>>>>>>
>>>>>> Tel.: +49 7247 82-8607
>>>>>> Fax.: +49 7247 82-4972
>>>>>> Email: [log in to unmask]
>>>>>>
>>>>>
>>>>> \|||/
>>>>> -----------0oo----( o o )----oo0-------------------
>>>>> (_)
>>>>> INFN Sezione di Padova
>>>>> Via Marzolo, 8
>>>>> 35131 Padova - Italy E-mail: massimo.sgaravatto [at] pd.infn.it
>>>>> Tel: ++39 0498275908 Skype: massimo.sgaravatto
>>>>> Fax: ++39 0498275952
>>>>
>>>>
>>>> --
>>>> Dimitri Nilsen, Dipl.-Ing(FH)
>>>>
>>>> Karlsruhe Institute of Technology (KIT)
>>>> Steinbuch Centre for Computing
>>>> Postfach 3640
>>>> 76344 Eggenstein-Leopoldshafen, Germany
>>>>
>>>> Tel.: +49 7247 82-8607
>>>> Fax.: +49 7247 82-4972
>>>> Email: [log in to unmask]
>>>>
>>>>
>>>
>>> \|||/
>>> -----------0oo----( o o )----oo0-------------------
>>> (_)
>>> INFN Sezione di Padova
>>> Via Marzolo, 8
>>> 35131 Padova - Italy E-mail: massimo.sgaravatto [at] pd.infn.it
>>> Tel: ++39 0498275908 Skype: massimo.sgaravatto
>>> Fax: ++39 0498275952
>>>
>>>
>>>
>>>
>>
>>
>> --
>> Dimitri Nilsen, Dipl.-Ing(FH)
>>
>> Karlsruhe Institute of Technology (KIT)
>> Steinbuch Centre for Computing
>> Postfach 3640
>> 76344 Eggenstein-Leopoldshafen, Germany
>>
>> Tel.: +49 7247 82-8607
>> Fax.: +49 7247 82-4972
>> Email: [log in to unmask]
>>
>>
>
> \|||/
> -----------0oo----( o o )----oo0-------------------
> (_)
> INFN Sezione di Padova
> Via Marzolo, 8
> 35131 Padova - Italy E-mail: massimo.sgaravatto [at] pd.infn.it
> Tel: ++39 0498275908 Skype: massimo.sgaravatto
> Fax: ++39 0498275952
>
>
>
>
\|||/
-----------0oo----( o o )----oo0-------------------
(_)
INFN Sezione di Padova
Via Marzolo, 8
35131 Padova - Italy E-mail: massimo.sgaravatto [at] pd.infn.it
Tel: ++39 0498275908 Skype: massimo.sgaravatto
Fax: ++39 0498275952
|