Kia ora,
If there is no digital preservation system, I assume you are checking fixity across the folders?
There is 2 tools I am using for that
1. Mostly python script which could be looped for many folders and keep results in file or db.
def md5_check(filepath):
hash_md5 = hashlib.md5()
with open(filepath, "rb") as f:
for chunk in iter(lambda: f.read(4096), b""):
hash_md5.update(chunk)
return hash_md5.hexdigest()
2. Sometimes Double commander
https://doublecmd.sourceforge.io/
It can create .md5 files
Regards,
Svetlana
-----Original Message-----
From: Digital-Preservation Announcement and Information List <[log in to unmask]> On Behalf Of Kieran O'Leary
Sent: Tuesday, 3 November 2020 5:50 AM
To: [log in to unmask]
Subject: Re: [DIGITAL-PRESERVATION] Fixity checking tools
Hi Helen,
This is a really great question. It would help to know what types of checksum manifest you have. The reason I ask is that you mention two tools - Exactfile and Fixity and if you were creating checksums with different tools, the manifests may look different. For example, Exactfile adds some metadata to the top of the manifests with semicolons prefixing them.
So did Fixity successfully validate your manifests created with Exactfile, and vice-versa?
Anyhow, I think that the only thing that will do the trick here is the command line as I'm not sure of any recursive tools that use a Graphical User Interface . It should be possible to use a 'recursive' loop on the command line that will do the following:
* Find all manifests that end with .md5
* Perform a fixity check.
Once you get up and running with this, this could be automated by just double clicking a batch file, or by copy/pasting one line of a command into cmd. Please get in touch if you'd like any help with this, it's not as awful as it sounds.
I'm more familiar with doing this by creating a python script or by not using Windows, but assuming that ExactFile would normally have validated your manifests, something like this command would work in cmd, if you download the exf https://www.exactfile.com/exf/ command line tool:
for /r %i in (*.md5) do exf -c "%i"
Which then runs exactfile for each md5 file it finds. Here's me running it as a test - the first shows an error due to missing files, the last one shows a successful fixity check.
C:\Users\kieran\Desktop>exf -c "C:\Users\kieran\Desktop\moveit_manifests\old_manifests\New folder_manifest_2020_10_12T12_14_38.md5"
File does not exist: New folder/2020-10-08T12_09_32_aip_log.log
File does not exist: New folder/IMG_9913.jpg
2 errors.
C:\Users\kieran\Desktop>exf -c "C:\Users\kieran\Desktop\NAS\digital_objetcs\exactfile.md5"
No errors.
Best,
Kieran O'Leary
Digital Preservation Manager
National Library of Ireland
________________________________
From: Digital-Preservation Announcement and Information List <[log in to unmask]> on behalf of H Dafter <[log in to unmask]>
Sent: Monday 2 November 2020 15:59:51
To: [log in to unmask]
Subject: Fixity checking tools
Hi all,
I hope everyone is as well as possible today.
Another fixity checking question from me. At present we do not have a digital preservation system in place so I am trying to do the best I can to ensure digital records are preserved within the limited staff and budgetary resources we have.
At present we use Fixity AVP to monitor checksums on a monthly basis. However this have proved rather unreliable for running scheduled checks and has also crashed repeatedly when attempting to initiate the checks manually. I am therefore looking into alternatives.
I have used Exactfile previously but this manually triggering the verification process became too time consuming.
I've taken a look at the COPTR which has offered me some useful starting points but it would be really useful to hear from people with experience of using different tools.
Ideally what I'm looking for is a tool which is:
Free
Doesn't require extensive IT support (in particular not using Linux as we have limited Linux expertise in house) Has a facility to schedule checks to run automatically as manually triggering them is time consuming.
I appreciate that this combination may be a lot to ask but any pointers or suggestions would be much appreciated.
Regards
Helen Dafter
Archivist (Digital Preservation)
The Postal Museum
________________________________
To unsubscribe from the DIGITAL-PRESERVATION list, click the following link:
https://www.jiscmail.ac.uk/cgi-bin/WA-JISC.exe?SUBED1=DIGITAL-PRESERVATION&A=1
The contents of this e-mail (including attachments) are private and confidential and may also be subject to legal privilege. It is intended only for the use of the addressee. If you are not the addressee, or the person responsible for delivering it to the addressee, you may not copy or deliver this e-mail or any attachments to anyone else or make any use of its contents; you should not read any part of this e-mail or any attachments. Unauthorised disclosure or communication or other use of the contents of this e-mail or any part thereof may be prohibited by law and may constitute a criminal offence.
If you receive this e-mail by mistake please notify us at [log in to unmask]
This email has been scanned by a virus scanner and appears to be clean.
T? an r?omhphost seo (agus aon iat?n a ghabhann leis) pr?obh?ideach agus r?nda agus d\'fh?adadh s? a bheith ina chion coiri?il.
M? bhfuair t? an r?omhphost seo tr? earr?id, dean teagmh?il [log in to unmask]
T? an r?omhphost seo arna sheice?il ag scan?ir v?reas agus dealramh air go bhfuil s? glan.
########################################################################
To unsubscribe from the DIGITAL-PRESERVATION list, click the following link:
https://www.jiscmail.ac.uk/cgi-bin/WA-JISC.exe?SUBED1=DIGITAL-PRESERVATION&A=1
This message was issued to members of www.jiscmail.ac.uk/DIGITAL-PRESERVATION, a mailing list hosted by www.jiscmail.ac.uk, terms & conditions are available at https://www.jiscmail.ac.uk/policyandsecurity/
########################################################################
To unsubscribe from the DIGITAL-PRESERVATION list, click the following link:
https://www.jiscmail.ac.uk/cgi-bin/WA-JISC.exe?SUBED1=DIGITAL-PRESERVATION&A=1
This message was issued to members of www.jiscmail.ac.uk/DIGITAL-PRESERVATION, a mailing list hosted by www.jiscmail.ac.uk, terms & conditions are available at https://www.jiscmail.ac.uk/policyandsecurity/
|
