> it paused whilst doing the events and then ran out of memory
That'll be the JVM settings in /opt/glite/bin/apel-pbs-log-parser (or
sge equiv).
These settings work for me: -Xmx256m
If it's not enough, double it: -Xmx512m
Cheers,
Steve
:--- EXAMPLE ---
if [ -z $JAVA_HOME ]; then
java -Xmx256m -classpath $CP $LOG4J_PROPS
org.glite.apel.pbs.ApelLogParser "$@"
else
$JAVA_HOME/bin/java -Xmx256m -classpath $CP $LOG4J_PROPS
org.glite.apel.pbs.ApelLogParser "$@"
fi
On 10/30/2012 11:53 AM, emyr.james wrote:
> Hi,
>
> I set it to /cm/shared/apps/sge/current/default/common and it's
> running now....it paused whilst doing the events and then ran out of
> memory so I think we are almost there.
>
> I'll split that file up into smaller chunks and sort out log-rotation
> going forward, then I think this issue will be solved at least.
>
> Cheers,
> Emyr
>
>
> On 30/10/12 11:49, Sam Skipsey wrote:
>> On 30 October 2012 11:41, Daniela Bauer
>> <[log in to unmask]> wrote:
>>> Looking back, there are no accounting files in
>>> /cm/shared/apps/sge/current/default/
>>> which is where according to the log it's looking.
>>>
>>> The file ("accouting") is instead in
>>> /cm/shared/apps/sge/current/default/common
>> Yeah, that's the default path for an SGE accounting log, for the
>> "default" Cell.
>>
>>> (and logrotate doesn't seem to be enabled ? The file looks rather
>>> large to
>>> me - though I have a hard time counting digits sometimes ...) (This
>>> can make
>>> the accounting process run out of memory.
>>>
>> By default, I think SGE logs to a monthly-rotated file... (and yes,
>> this can break the APEL parser).
>>
>> Sam
>>
>>> On 30 October 2012 11:37, Stephen Jones<[log in to unmask]>
>>> wrote:
>>>> On 10/30/2012 11:33 AM, Stephen Jones wrote:
>>>>> On 10/30/2012 11:14 AM, emyr.james wrote:
>>>>>>
>>>>>> The question I'm asking is what do other SGE users have set for
>>>>>> BATCH_LOG_DIR relative to their SGE install dir ?
>>>>>>
>>>>> I know. Who uses SGE? I think Daniella does. What about Chris at
>>>>> QMUL?
>>>>>
>>>>> BTW: This link has some guff about this setting:
>>>>>
>>>>>
>>>>> https://documents.egi.eu/public/RetrieveFile?docid=993&version=1&filename=GE_Cookbook-v3-0.odt&ei=M7SPUJzGAqO10QWt7oCQBQ&usg=AFQjCNFU1cXi1XWZ7903vyhfOB4K6XaHiw&sig2=reT_cZp0cwctULFVeKLRrQ&cad=rja
>>>>>
>>>>>
>>>>>
>>>>> Steve
>>>>>
>>>> This rings a bell:/usr/local/ge2011.11/default/common/accounting
>>>>
>>>>
>>>> Steve
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Steve Jones [log in to unmask]
>>>> System Administrator office: 220
>>>> High Energy Physics Division tel (int): 42334
>>>> Oliver Lodge Laboratory tel (ext): +44 (0)151 794 2334
>>>> University of Liverpool
>>>> http://www.liv.ac.uk/physics/hep/
>>>
>>>
>>>
>>> --
>>> Sent from the pit of despair
>>>
>>> -----------------------------------------------------------
>>> [log in to unmask]
>>> HEP Group/Physics Dep
>>> Imperial College
>>> Tel: +44-(0)20-75947810
>>> http://www.hep.ph.ic.ac.uk/~dbauer/
--
Steve Jones [log in to unmask]
System Administrator office: 220
High Energy Physics Division tel (int): 42334
Oliver Lodge Laboratory tel (ext): +44 (0)151 794 2334
University of Liverpool http://www.liv.ac.uk/physics/hep/
|