On 02/21/2017 04:28 PM, Andrew Lahiff wrote:
> We do the same and haven't had any problems.
>
> Regards,
> Andrew.
It worked here for years with one grid dir defined. The error only
showed up when we scrapped a CREAM/Torque system and moved the nodes
over. I opened up some of the max limits. I guess the extra files for
the extra nodes and the extra limits burst the seams, as it were.
Cheers,
Ste
> ________________________________________
> From: Testbed Support for GridPP member institutes [[log in to unmask]] on behalf of Chris Brew [[log in to unmask]]
> Sent: Tuesday, February 21, 2017 4:15 PM
> To: [log in to unmask]
> Subject: Re: ARC makes a lot of files and directories.
>
> Hi,
>
> I’m guessing it’s the sessiondir defined in the grid-manager section of the arc.conf file, that can be defined multiple times so we have /var/spool/arc/grid00 to grid11 define then the grid manager picks one at random for each job.
>
> Chris.
>
> On 21/02/2017, 16:08, "Testbed Support for GridPP member institutes on behalf of Daniela Bauer" <[log in to unmask]<mailto:[log in to unmask]> on behalf of [log in to unmask]<mailto:[log in to unmask]>> wrote:
>
> Hi Steve,
> What do you store in there ? We don't even have that directory.
> Cheers,
> Daniela
>
> On 21 February 2017 at 16:04, Stephen Jones <[log in to unmask]<mailto:[log in to unmask]>> wrote:
> Hi Peter, all,
>
> ARC certainly makes a lot of files and directories, under /var/spool/arc/grid
>
> So many, in fact, that is exceeded 31998, and after that ext3 (for that was the file system) could make no more. Hence a lot of trouble in the last few days.
>
> I've changed it to xfs. But it's something to watch out for. To check:
>
> # cd /var/spool/arc/grid
>
> [root@hepgrid2 grid]# ls -d */ | wc -l
> 32221
>
> With xfs, it's gone past the limit. We're back in business.
>
> Cheers,
>
>
> Ste
>
>
>
> --
> Steve Jones [log in to unmask]<mailto:[log in to unmask]>
> Grid System Administrator office: 220
> High Energy Physics Division tel (int): 43396
> Oliver Lodge Laboratory tel (ext): +44 (0)151 794 3396<tel:%2B44%20%280%29151%20794%203396>
> University of Liverpool http://www.liv.ac.uk/physics/hep/
>
>
>
> --
> Sent from the pit of despair
>
> -----------------------------------------------------------
> [log in to unmask]<mailto:[log in to unmask]>
> HEP Group/Physics Dep
> Imperial College
> London, SW7 2BW
> Tel: +44-(0)20-75947810
> http://www.hep.ph.ic.ac.uk/~dbauer/
--
Steve Jones [log in to unmask]
Grid System Administrator office: 220
High Energy Physics Division tel (int): 43396
Oliver Lodge Laboratory tel (ext): +44 (0)151 794 3396
University of Liverpool http://www.liv.ac.uk/physics/hep/
|