On Wed, Jul 27, 2005 at 06:07:07PM +0100, Greig A Cowan wrote:
> > I suspect (and might be wrong) that the kernel tuning Kostas has applied
> > to IC might be useful. I was waiting for him to say something more about
> > it. :)
>
> I was looking for more information from him aswell!
Well some questions first :)
Are the java processes really use that much memory or is it the buffer
cache? The kernel will try to cache as many files as possible so high
memory usage is normal (your ganglia page isn't visible from the outside
world)
What type of disks/controllers do you have? From what i've seen dcache
generates really bad IO patterns with parallel transfers, have you tried
running with only one stream and multiple files instead?
Cheers,
Kostas
|