-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
On 05/11/13 14:15, Waugh, Ben wrote:
> I have only used Lustre as a user, not installed it myself, but
> unless it has changed drastically in the past year or two, it is
> not really suitable for a general-purpose filesystem. It is
> optimised for parallel access to large data files, and is REALLY
> sluggish if you are accessing larger numbers of small files, e.g.
> compiling and linking large applications or even listing
> directories.
>
> UCL's Legion cluster still uses it as a shared workspace for
> parallel jobs, but when they tried using it for home directories it
> was a major cause of downtime as the metadata (I think) kept
> getting corrupted.
>
I'm not sure Lustre should shoulder 100% of the blame. The disk array
for the metadata server was one that our supplier later felt obliged
to point out was rebadged and not part of their normal line. The
backup software (BRU) we were provided with appeared to be singularly
inappropriate for Lustre and we got much better performance when we
switched to TSM. We also had a lot of problems calibrating the HA
software to an appropriate level of sensitivity which was probably
exacerbated by BRU pounding on the servers. That said we got a
considerable stability improvement by upgrading Lustre.
William
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
iQIcBAEBAgAGBQJSegdOAAoJEKCzH4joEjNW2hoP/jA/V9G18HIOye9fbOvmBjfM
nCritRuoL+jstmttCPQO7SQ3kv5c5alVufeSVhwHWnkSIpXq/8A9HrOz4Vb6/Hyj
UAsxhH/++mzpmM0Zf0G+lEkSVCD7SbHq14jIjIrwsa3MntdvK39QqdlXCR+DlHTf
9hRMJRHFbzt/UzED6N7V5JmGPYMoTpRkB+vBZ906zjuT5kAQB6H76/vO0BzqP5JL
1phu34P9SDbGkhSRVRTbdJzNjt05Yk2EXxto8WBJO92VtlZGzpmkP8ZczaHBvbAR
Ue+qgZIst25+KpJat/KaeHFcClEzo5yZzEwAKqKAFBWdkWk4+E+JC+hbh9ZG8L9E
B2/U2R2dE/vW2gezTzbJV8rVr8WxSXE0yVUm8EImMEJZCwph6u75DULNXF3mbAhn
eDVgc1ysYivU16T8EJ+zP8o0dLEX3mebD078RVll3sAsVfcm05RIwfLX/RuX6ixT
eWm6HTae/wZTQGgxiJzpufuaaPQtXvRP65sceiEJhFo8HANwh3yeWhrl0nXz8mfP
Sr/pY4cydHXkfk7WGVk7A8r02G7dAt1tYLYleEtNxLXCUFJUbWyF/DIMzBkUuBiM
XwHb9bB5ZBa8BKLwG5HeKXbPXX3vDgqd0j11taL62lLpTiuv9qybMw5sk8va30/8
0AdO0C3wjDvSJvV5I/Ly
=TxC5
-----END PGP SIGNATURE-----
|