Apologies for this act of moderate thread hijack.. Has anyone used the LOD Refine build, which incorporates all the LOD extensions to Open Refine?
I'm struggling to get an API key from the known source, so any advice would be much appreciated.
Stephen, BFI
> On 30 Sep 2014, at 08:11, Owen Stephens <[log in to unmask]> wrote:
>
> If you do end up looking at Open Refine to tackle data inconsistencies (and I'd second Andrew's recommendation on this) I wrote some documentation for a course on OpenRefine I did for the British Library recently. The documentation is licensed as CC-BY and available from http://bit.ly/ZmLh6s, it covers the basics of using OpenRefine.
>
> I'd also recommend the materials on http://freeyourmetadata.org
>
> Owen
>
> Owen Stephens
> Owen Stephens Consulting
> Web: http://www.ostephens.com
> Email: [log in to unmask]
> Telephone: 0121 288 6936
>
>> On 30 Sep 2014, at 07:40, Andrew Lewis <[log in to unmask]> wrote:
>>
>> Hi Judy,
>>
>> First look at Collections Trust as this is their area. Loads of help or clues to help on their site...
>> e.g. this handy page http://www.collectionstrust.org.uk/useful-guidance
>>
>>
>> My twopennorth - I'm not sure about all the things you are trying to do or resources you have, but here's a few thoughts. Hope they help in some way!
>>
>> IMPROVING SEARCH -
>> - if this is internal staff search, i.e. an integral feature of the system, then presumably the support documentation has some clues about recommended best practise. It sounds like you just need the data to be more consistent though and thus make results less messy. (see thoughts below)
>> - If you are talking about how your data is searchable online it depends again on what you are doing with the data to get it into the public. Generally having decent descriptive text helps for getting picked up by search engines, with terminology that is likely to be understandable by your target audiences (even if that is general audience) If the stuff is specialist, the unusual terms will help specialist searchers. If you have a generally plain English description that might help pull up find-ability by less knowledgeable people. Worth noting that Google algorithms have moved towards natural language phrasing in recent years and just dumping in a load of terms that do not make typical sentences may not help as much as it did. (linked to rise of voice search I believe). There's a whole conversation about SEO this could tangent off into mind!
>>
>> CLEANING UP THE VARIATIONS IN RECORDS
>> Sounds like this is the biggest job.
>> - One thing to think about is resources - do you have access to existing staff time, in which case some initial time might be worth investing in getting a simplified process defined to start with that less familiar people can follow? If not, do you have budget. You might be able to find someone to do data cleansing (start with your supplier?)
>> - Then there are tools. If your system has de-duping tools, then yay!
>> - if not, then depending on how easy you can get sets of data in and out of the system, you can use things lie Open Refine (the software previously known as Google Refine). It's free and allows you to group similar messy terms and then do batch process merges (so you identify 4 phrase that are variants and choose the best and it finds and replaces them)
>> http://openrefine.org/download.html
>>
>> Go for it!
>>
>> Andrew
>>
>> Date: Mon, 29 Sep 2014 16:56:02 +0100
>> From: "Aitken, Judy" <[log in to unmask]>
>> Subject: data decisions help
>>
>> Dear colleagues,
>>
>>
>>
>> I am part way through a project to update our online collections resource and I am at the stage where I could do with a "mentor" or at least some advice/sanity check/help. This is not so much technical advice, although that of course is part of it, as making content decisions but I am starting with MCG in case data managers, curators and content developers can help here.
>>
>>
>>
>> The initial part of the work was to identify, eliminate or reduce real howlers and resolve basic problems.
>>
>>
>>
>> But now we are moving on to making decisions about what the data might need to improve our search functions in particular. Issues I am having difficulty tackling (mentally) include improving classifications and thesaurus terminologies and solving problems with subject fields and geographic fields. Over the years predecessors have, let's just say, allowed an element of "randomness" to stray into their cataloguing terms and we are trying to work out the best way to deal with that and make sensible choices that won't come back to haunt us later. The final part of the work will be to migrate over to a new version of our current online system.
>>
>>
>>
>> I would welcome a chat with anyone who has gone through a process of creating new content or trying to improve existing content for the collections section of their web presence or online catalogue and who is able to advise or pass on lessons learned.
>>
>>
>>
>> Thanks.
>>
>>
>>
>> Judy Aitken
>>
>> London Borough of Southwark (Cuming Museum)
>>
>>
>>
>>
>> See our collection at www.southwarkcollections.org.uk <blocked::http://www.southwarkcollections.org.uk/>
>>
>>
>>
>>
>>
>>
>>
>>
>> The email you received and any files transmitted with it are confidential, may be covered by legal and/or professional privilege and are intended solely for the use of the individual or entity to whom they are addressed.
>>
>> If you have received this in error please notify us immediately.
>>
>> If you are not the intended recipient of the email or the person responsible for delivering it to them you may not copy it, forward it or otherwise use it for any purpose or disclose its contents to any other person. To do so may be unlawful.
>>
>> Where opinions are expressed in the email they are not necessarily those of Southwark Council and Southwark Council is not responsible for any changes made to the message after it has been sent.
>>
>>
>> ****************************************************************
>> website: http://museumscomputergroup.org.uk/
>> Twitter: http://www.twitter.com/ukmcg
>> Facebook: http://www.facebook.com/museumscomputergroup
>> [un]subscribe: http://museumscomputergroup.org.uk/email-list/
>> ****************************************************************
>>
>> ------------------------------
>>
>> Date: Mon, 29 Sep 2014 18:37:00 +0200
>> From: Gertrude Nicole Friedman <[log in to unmask]>
>> Subject: Re: data decisions help
>>
>> Dear Judy,
>>
>> I have been working on a seemingly similar project (very large data "normalization" for our catalogs), though, for an archive. Feel free to send me an email -- I'm not sure how much help I will be, but will do my best!
>>
>> Best,
>>
>> Nicole
>>
>> On Mon, Sep 29, 2014 at 5:56 PM, Aitken, Judy <[log in to unmask]>
>> wrote:
>>
>>> Dear colleagues,
>>>
>>>
>>>
>>> I am part way through a project to update our online collections
>>> resource and I am at the stage where I could do with a "mentor" or at
>>> least some advice/sanity check/help. This is not so much technical
>>> advice, although that of course is part of it, as making content
>>> decisions but I am starting with MCG in case data managers, curators
>>> and content developers can help here.
>>>
>>>
>>>
>>> The initial part of the work was to identify, eliminate or reduce real
>>> howlers and resolve basic problems.
>>>
>>>
>>>
>>> But now we are moving on to making decisions about what the data might
>>> need to improve our search functions in particular. Issues I am having
>>> difficulty tackling (mentally) include improving classifications and
>>> thesaurus terminologies and solving problems with subject fields and
>>> geographic fields. Over the years predecessors have, let's just say,
>>> allowed an element of "randomness" to stray into their cataloguing
>>> terms and we are trying to work out the best way to deal with that and
>>> make sensible choices that won't come back to haunt us later. The
>>> final part of the work will be to migrate over to a new version of our
>>> current online system.
>>>
>>>
>>>
>>> I would welcome a chat with anyone who has gone through a process of
>>> creating new content or trying to improve existing content for the
>>> collections section of their web presence or online catalogue and who
>>> is able to advise or pass on lessons learned.
>>>
>>>
>>>
>>> Thanks.
>>>
>>>
>>>
>>> Judy Aitken
>>>
>>> London Borough of Southwark (Cuming Museum)
>>>
>>>
>>>
>>>
>>> See our collection at www.southwarkcollections.org.uk
>>> <blocked::http://www.southwarkcollections.org.uk/>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> The email you received and any files transmitted with it are
>>> confidential, may be covered by legal and/or professional privilege
>>> and are intended solely for the use of the individual or entity to whom they are addressed.
>>>
>>> If you have received this in error please notify us immediately.
>>>
>>> If you are not the intended recipient of the email or the person
>>> responsible for delivering it to them you may not copy it, forward it
>>> or otherwise use it for any purpose or disclose its contents to any
>>> other person. To do so may be unlawful.
>>>
>>> Where opinions are expressed in the email they are not necessarily
>>> those of Southwark Council and Southwark Council is not responsible
>>> for any changes made to the message after it has been sent.
>>>
>>>
>>> ****************************************************************
>>> website: http://museumscomputergroup.org.uk/
>>> Twitter: http://www.twitter.com/ukmcg
>>> Facebook: http://www.facebook.com/museumscomputergroup
>>> [un]subscribe: http://museumscomputergroup.org.uk/email-list/
>>> ****************************************************************
>>
>>
>>
>> --
>> Gertrude Nicole Friedman
>> [log in to unmask]
>> +36.30.720.7168 (Hungary)
>> +1 502.494.5807 (USA)
>>
>> ****************************************************************
>> website: http://museumscomputergroup.org.uk/
>> Twitter: http://www.twitter.com/ukmcg
>> Facebook: http://www.facebook.com/museumscomputergroup
>> [un]subscribe: http://museumscomputergroup.org.uk/email-list/
>> ****************************************************************
>>
>> ------------------------------
>>
>> End of MCG Digest - 26 Sep 2014 to 29 Sep 2014 (#2014-202)
>> **********************************************************
>> ________________________________
>> Constable: The Making of a Master
>> 20 September 2014 - 11 January 2015 at V&A South Kensington
>> Book now on www.vam.ac.uk/constable<http://www.vam.ac.uk/constable>
>> See the exhibition for free if you join as a V&A Member www.vam.ac.uk/members<http://www.vam.ac.uk/members>
>>
>> Day Dreams and Diaries, the Story of Jacqueline Wilson
>> 5 April – 2 November 2014 at V&A Museum of Childhood
>> Admission free
>>
>> Keep in touch
>> Sign up for V&A e-newsletters www.vam.ac.uk/signup<http://www.vam.ac.uk/signup/>
>> Become a fan on Facebook.com/VictoriaandAlbertMuseum<http://www.facebook.com/VictoriaandAlbertMuseum>
>> Follow us on Twitter.com/V_and_A<http://www.twitter.com/V_and_A>
>> ________________________________
>> This message is intended solely for the use of the individual or organisation to whom it is addressed. It may contain privileged or confidential information.
>> If you have received this message in error, please notify the originator immediately. If you are not the intended recipient, you should not use, copy, alter, or disclose the contents of this message.
>> All information or opinions expressed in this message and/or any attachments are those of the author and are not necessarily those of The Victoria and Albert Museum or its affiliates.
>> The Victoria and Albert Museum accepts no responsibility for loss or damage arising from its use, including damage from virus. Victoria & Albert Museum, Cromwell Road, London SW7 2RL, Tel: 0207 942 2000
>> ________________________________
>>
>> ****************************************************************
>> website: http://museumscomputergroup.org.uk/
>> Twitter: http://www.twitter.com/ukmcg
>> Facebook: http://www.facebook.com/museumscomputergroup
>> [un]subscribe: http://museumscomputergroup.org.uk/email-list/
>> ****************************************************************
>
>
> ****************************************************************
> website: http://museumscomputergroup.org.uk/
> Twitter: http://www.twitter.com/ukmcg
> Facebook: http://www.facebook.com/museumscomputergroup
> [un]subscribe: http://museumscomputergroup.org.uk/email-list/
> ****************************************************************
****************************************************************
website: http://museumscomputergroup.org.uk/
Twitter: http://www.twitter.com/ukmcg
Facebook: http://www.facebook.com/museumscomputergroup
[un]subscribe: http://museumscomputergroup.org.uk/email-list/
****************************************************************
