On 08/05/12 12:27, Wahid Bhimji wrote:
> David
>
> Most of the SRM solutions used in WLCG (dCache, DPM , Castor, Storm atop Lustre or GPFS,(and even Bestman + EOS)) have proved themselves up to the few PB / few Gbps bandwidth ; few m files level.
> Perhaps it would be good if you gave some indication of the scalability you need. If the WLCG T1 level is good enough then it maybe that manageability, support , philosophy are bigger factors.
http://build.whamcloud.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.html#understandinglustre.whatislustre
Has a table of Lustre scalability - both expected limits, and production
systems.
Chris
>
> Cheers
>
> Wahid
>
> On 8 May 2012, at 12:04, Shaun De Witt wrote:
>
>> Hi David
>>
>> Our SRM installation will scale ad-nauseum. It only contains transient data. Its throughput is pretty good ATM (peaks about 100k transaction/hour/box), but I am working to improve this while also reducing CPU utilization.
>>
>> Shaun
>>
>> -----Original Message-----
>> From: GRIDPP2: Deployment and support of SRM and local storage management [mailto:[log in to unmask]] On Behalf Of Alex Martin
>> Sent: 08 May 2012 10:05
>> To: [log in to unmask]
>> Subject: Re: Scalability of Various SRM solutions
>>
>> Hi David,
>> We are fairly confident that our current Lustre/Storm
>> setup (which will shortly be ~1.8 PB) could be scaled a factor of ~10,
>> without big problems now that we upgraded our switches. We will probably be
>> able to quantify this a bit more when it is all fully working.
>>
>> cheers,
>> Alex
>>
>>
>> On Tuesday 08 May 2012 09:37:47 David Wallom wrote:
>>> Hi,
>>>
>>> Does anyone know of any work using the currently deployed SRM solutions on
>>> scalability both in terms of total volume stored in a single instance,
>>> input bandwidth and I/o rates? Just thinking about possible solutions for
>>> SKA.
>>>
>>> Cheers
>>>
>>> David
>>> --
>>> ++++++++++++++++++++++++++++++++++++++++
>>> Dr David Wallom
>>> Associate Director – Innovation, Oxford eResearch Centre
>>> Technical Director, UK NGS
>>> VP Communities, OGF
>>>
>>> Oxford eResearch Centre
>>> 7 Keble Road
>>> Oxford
>>> OX1 3QG
>>> UK
>>>
>>> Tel: +44 1865 610601
>>> ++++++++++++++++++++++++++++++++++++++++
>>
>> --
>> ------------------------------------------------------------------------------
>> | |
>> | Dr. Alex Martin |
>> | e-Mail: [log in to unmask] Queen Mary, University of London, |
>> | Phone : +44-(0)20-7882-5033 Mile End Road, |
>> | Fax : +44-(0)20-8981-9465 London, UK E1 4NS |
>> | |
>> ------------------------------------------------------------------------------
>
>
|