Hi Martin,
A useful set of resources in this area can be found in the Presto Centre website / resource library.
It may be overkill for your needs and may daunt as well as inform, but take a look:
https://www.prestocentre.org/library/resources
There are obvious specific challenges with moving image digital preservation, not least the file sizes and therefore the bandwidth implications for network-based file movement (there's still nothing that beats a hard drive on a van for bandwidth when transporting moving image files around), and some excellent recommendations below, but Presto Centre might give you some more ideas.
All the best
Stephen
Sent from my iPad
> On 13 Aug 2014, at 14:37, Giuseppe Sollazzo <[log in to unmask]> wrote:
>
> Hi Martin,
>
> just to add to Zak's (very useful!) reply, I'd probably mention that according to what budget you have you might follow very different options. Going by ear, I think that buying a couple of NAS<http://en.wikipedia.org/wiki/Network-attached_storage> units and placing them, as Zak says, in two different sites, could do. You would then have some cron job to synchronise the two.
>
> E-buyer and Amazon both sell 20TB units for about £2,000, but you could get something cheaper than that, or even an empty NAS for a tenth of that and allocate disks as it seems fit.
>
> If your budget is much larger than that, then a SAN<http://en.wikipedia.org/wiki/Storage_area_network>, but it might be overkill, and you will definitely need some on-site IT support.
>
> If you then want to have a further backup in the cloud, you could use, on a less frequent basis, something like Amazon Glacier<http://aws.amazon.com/glacier/pricing/> - basically they allow you to send DVDs/USB keys with the data and keep them for you, with high latency in case of data recovery (so it's "in the cloud" but less promptly accessible than, say EC2 or S3, and considerably cheaper).
>
> If you have an internal IT unit, though, it might also be worth investigating the purchase of a tape backup unit. The range of prices and service level here is high, but it could be cheaper in the medium term.
>
> If you need any specific detail, feel free to get in touch and I can explain how we run our backup strategy here at SGUL.
>
> Kind regards,
>
> --
> Giuseppe Sollazzo
> Senior System Analyst
>
> Member of the Open Data User Group (Cabinet Office)
> Member of the Health and Social Care Transparency Panel (Department of Health)
>
> Computing Services
> Information Services
> St George's, University of London
> Cranmer Terrace
> London SW17 0RE
>
> [log in to unmask]
> +44 20 8725 5160
> @sgulit
>
>
>
> St George’s, University of London is proud to be a Stonewall Diversity Champion: ‘people perform better when they can be themselves’.
>
>
>
>
> ________________________________________
> From: Museums Computer Group <[log in to unmask]> on behalf of Zak Mensah <[log in to unmask]>
> Sent: 13 August 2014 14:24
> To: [log in to unmask]
> Subject: Re: [MCG] Cloud storage for archiving film
>
> Hi Martin,
>
> There are several key factors which I'll highlight below BUT there is lots more detail elsewhere. Also I have never heard about files eating themselves.... maybe they are referring to the dangers of storing data in one place and are worried about this being corrupted... but eating sounds way more fun way to describe
>
> 1 - Total storage needed, for how long, will it need to be accessed during this period or is purely for backup?
> 2- Network capacity to upload and download the material, most networks will struggle on this point so you need to seek advice from your network provider
> 3- will you want to work 'live' on any of this material if so see point 2.
> 4- what security level do you require the data to be stored at?
>
> 8 TB is actually fairly small these days and an obvious solution I'd consider is....
>
> 1 - buy 10TB of external hard-drive in either 1 or 2TB chunks. Back up everything using a proper copying tool (which checks the data is there)
> 2 buy another 10TB and copy point 1 - this will be a backup in case any of '1' is destroyed or damaged (hard drives only last about 5 years as a rule of thumb). NEVER STORE both backups on the same site.
> 3 - if you have the budget then also store on a cloud provider. In the UK I would first pursue https://www.gov.uk/how-to-use-cloudstore and that store is great to get costings and see the key issues. Amazon cloud E2 may be an option also but you may need to use Europe only data centres
>
> Shout if I can be of any further help - I was looking into this last year for a similar project and also now looking at 1000TB options...
>
> As for the interviews then get them to send a hard drive...
>
>
> Yes there are tons of other smarter ways but the above has proven to work for me over the last 10 years without lots of bother and I know the risks of the above and weigh em up... Put the G-Cloud costings into the HLF bid as they accept this (if they didn't cost this into the budget then I'd suggest running and hiding ha)
>
> Zak Mensah
> Head of Digital
> Bristol Museums, Galleries & Archives
> [log in to unmask]
>
> -----Original Message-----
> From: Museums Computer Group [mailto:[log in to unmask]] On Behalf Of Martin Bazley
> Sent: 13 August 2014 14:07
> To: [log in to unmask]
> Subject: [MCG] Cloud storage for archiving film
>
> Dear all
>
> I am working on an HLF project and have been asked for advice about online storage for archive film clips and newly created films. I am aware of some cloud storage options but the issue in this case (see below) is the high volume of storage required, meaning that ongoing costs could be quite high. Does anyone have any suggestions?
>
> Martin
>
> PS I quite like the notion that digital files have to 'keep moving' otherwise they 'eat themselves' ...
>
>
> ---------
>
> Please could I ask you a couple of other questions about our film archive?
>
>
> · Firstly, I urgently need to back up all our High Res files. I've been advised that Cloud Storage may be the best solution for this because digital files need to 'keep moving' otherwise they 'eat themselves' and you lose all your data. This has somewhat frightened me so I'd like to get everything backed-up as soon as possible!! However, the total size of our High Res files is 8.13TB - so not a small task...
>
>
> · Secondly, the Regional Officers need to send me copies of their interviews so I can back them up here. One of these files alone could be 30GB so again, no small task.
>
> I have spoken to Dropbox for Business who can give us unlimited storage space but would not be a long term storage solution as too costly. Would be £431 for all our officers to access the dropbox until end of March 2015 so would only solve problem of transferring files.
>
> ---------
>
>
> ----------------------------------------------------
> Martin Bazley
> Digital heritage consultant
> Martin Bazley & Associates
> 15 Margin Drive
> Wimbledon
> SW19 5HA
> 0780 3580 727
> [log in to unmask]<mailto:[log in to unmask]>
> www.martinbazley.com<http://www.martinbazley.com/><http://www.martinbazley.com<http://www.martinbazley.com/>>;
>
>
>
>
> ****************************************************************
> website: http://museumscomputergroup.org.uk/
> Twitter: http://www.twitter.com/ukmcg
> Facebook: http://www.facebook.com/museumscomputergroup
> [un]subscribe: http://museumscomputergroup.org.uk/email-list/
> ****************************************************************
>
> ______________________________________________________________________
> Council services online: http://www.bristol.gov.uk/service
>
> Keep up to date with the latest council news and sign up to our monthly email newsletter: http://www.bristol.gov.uk/ournews
>
> Have your say on consultations and view our webcasts: http://www.bristol.gov.uk/consult
>
> ****************************************************************
> website: http://museumscomputergroup.org.uk/
> Twitter: http://www.twitter.com/ukmcg
> Facebook: http://www.facebook.com/museumscomputergroup
> [un]subscribe: http://museumscomputergroup.org.uk/email-list/
> ****************************************************************
>
> ****************************************************************
> website: http://museumscomputergroup.org.uk/
> Twitter: http://www.twitter.com/ukmcg
> Facebook: http://www.facebook.com/museumscomputergroup
> [un]subscribe: http://museumscomputergroup.org.uk/email-list/
> ****************************************************************
****************************************************************
website: http://museumscomputergroup.org.uk/
Twitter: http://www.twitter.com/ukmcg
Facebook: http://www.facebook.com/museumscomputergroup
[un]subscribe: http://museumscomputergroup.org.uk/email-list/
****************************************************************
|