I just mean GC_START_THRESH and GC_STOP_THRESH . These are the thresholds
for garbage collection. If there is less than GC_START_THRESH% of storage
left, then the garbage collection will kick in and clear out any files
that are not regarded as precious or space that was reserved and then not
used to store a file. This will continue until there is GC_STOP_THRESH% of
space left on the pool.
Can you try copying a few files into the DPM and each time check the FREE
space to see if it has reduced by DEFSIZE or not?
Cheers,
Greig
On Fri, 20 Oct 2006, Gianfranco Sciacca wrote:
> Hi Greig,
>
> I have 1.5.10-1sec (which just came in a few days ago, I believe) and a
> DEFSIZE of 200 MB:
>
> [root@pc55 root]# dpm-qryconf
> POOL classicSE DEFSIZE 200.00M GC_START_THRESH 0 GC_STOP_THRESH 0
> DEFPINTIME 0 PUT_RETENP 86400 FSS_POLICY maxfreespa ce GC_POLICY lru
> RS_POLICY fifo GID 0 S_TYPE -
> CAPACITY 36.51G FREE 31.50G ( 86.3%)
> pc30.hep.ucl.ac.uk /storage CAPACITY 36.51G FREE 31.50G ( 86.3%)
>
> What do you mean by "garbage collection upper and lower bounds"?
>
> cheers,
> gianfranco
>
> Greig A Cowan wrote:
> > Gianfranco,
> >
> > What version of DPM are you running? What's the output of dpm-qryconf?
> >
> > For each pool in DPM you can define a minimum file size (i.e DEFSIZE
> > 1000.00M). This is the minimum file size that is reserved when a file is
> > stored in a pool. There was an issue with DPM a while ago where it would
> > use up the DEFSIZE no matter the file size, meaning that the space was
> > appeared as used. Of course, once the DPM garbage collection kicked in,
> > then this 'used' space was returned. You can set the garbage collection
> > upper and lower bounds using dpm-modifypool.
> >
> > I'm not saying this is the cause of the effect you are seeing, but it
> > could be related.
> >
> > Cheers,
> > Greig
> >
> > On Fri, 20 Oct 2006, Gianfranco Sciacca wrote:
> >
> >
> >> Dear all,
> >>
> >> I've just noticed that dpm-qryconf was reporting 12.88GB free on a pool,
> >> while the corresponding filesystem had 31.50GB free. I remembered having
> >> this problem once in the past and it was cured after re-running YAIM. I
> >> just re-ran YAIM and surely enough after this dpm-qryconf reports the
> >> correct value of free disk.
> >>
> >> Looking at the gStat plots at
> >> http://goc.grid.sinica.edu.tw/gstat/UKI-LT2-UCL-HEP/GIISQuery_Usage_store_.html
> >> one can see a gradual overall raise of the "used" level over several
> >> months, although it appears the real volume used is more or less
> >> constant, as files are created and subsequently removed. (this
> >> particular pool is for dteam and ops)
> >>
> >> Is this the correct way for DPM to work? Surely it can't be. What
> >> happens if DMP thinks there are only 12 GB free on a pool (even though
> >> over 30 GB are really free) and I try to copy 20 GB to it? Would this fail?
> >>
> >> Also: while YAIM is running I get this:
> >> Starting Globus MDS (gcc32dbgpthr) [ OK ]
> >>
> >> However, half of the times, Globus MDS is not running after YAIM has
> >> finished.
> >>
> >> cheers,
> >> gianfranco
> >>
> >>
> >
> >
>
>
>
--
=======================================================================
Dr Greig A Cowan http://www.ph.ed.ac.uk/~gcowan1
School of Physics, University of Edinburgh, James Clerk Maxwell Building
TIER-2 STORAGE SUPPORT PAGES: http://wiki.gridpp.ac.uk/wiki/Grid_Storage
=======================================================================
|