hi yves
your tmp seems way too small.
what we do is just configure the cluster management sw
(we run cfengine) to clean /tmp regularly (removing data
older than X)
but you do need a bit of space on tmp for that. we have
a 150GB disk on the WNs, most of which is available...
cheers
peter
Yves Kemp wrote:
> Dear all,
>
> we have the following problems at DESY:
> - some users fail have a far too verbose output, and their stdout
> reaches the limit of the file system. The consequences are that the
> respective node turns into a black hole for other jobs.
> - some users write into /tmp (ignoring $SCRATCH_DIRECTORY, which points
> to somewhere else). Unfortunately, /tmp is only ~1 GB large, so it
> runs full...
>
> Already, we take nodes offline as soon as a filesystem is too full via
> Nagios, but we would rather have a mechanism that prevents this, and
> throws an error to the user much in advance.
>
> On the other side, people with legitime needs should not be hindered,
> and Atlas might want to have files with 5 GB size.
>
> ulimit seems to only allow a limit lower than 4 GB in SL4/32bit:
> root@grid-wn0125: [~] ulimit -f 4096000
> root@grid-wn0125: [~] ulimit
> 4096000
> root@grid-wn0125: [~] ulimit -f 5120000
> root@grid-wn0125: [~] ulimit
> unlimited
> - the same goes for /etc/security/limits.conf.
> Has anyone managed to setup ulimit in a better way?
>
> Is anyone running quota?
>
> Is there an "official policy" on how much local space a site has to
> offer a job? What filesize a site must guarantee the users? I have in
> mind 5 GB, but cannot find something official.
>
> Best
>
> Yves
>
> --------------------------------------------
> Yves Kemp
> [log in to unmask] Desy IT 2b/312
> Fon: +49-(0)40-8998-2318 Notkestr. 85
> Fax: +49-(0)40-8994-2318 D-22607 Hamburg
> --------------------------------------------
>
--
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
| Dr. Peter Kunszt
| Head of Distributed High Throughput Computing Unit
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
| /\ \ Swiss National Supercomputing Centre CSCS
| \/ / Via Cantonale - Galleria 2
| /\ \ /\ \ 6928 Manno
| \/ / \/ / Switzerland
| /\ \
| \/ / Tel. +41 91 610 8222 Fax. +41 91 610 8282
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
|