The ICO takes the view that system testing is a subsidiary purpose of a main purpose and therefore need neither be included in a notification nor brought to the attention of the data subject. [Source: BSi BIP0002]
Whilst the ICO has advised that the use of PD for systems testing should be avoided, properly anonymised data is not PD. By "properly anonymised" I mean that something like a randomised one-way trapdoor approach is used, so that it is not possible to derive the original data from the test data, not is it possible to repeat the transformation and derive the same test dataset from the original. [Albeit, the ICO included tests for the success of anonymisation within the COP.]
There are many instances where the creation of an 'original' test dataset can be riskier than anonymising an existing dataset. For example, a test dataset created out of (say) two billion original records is far more likely to really test the system than a test dataset created for the purpose of testing the system. For one, it eliminates human bias. I have seen too many system tests that were biased towards success, where the testers had removed tests or data that would more likely than not cause failures - which would highlight inadequate specification and/or poor coding, or had simply not thought of test cases - a not at all uncommon failing.
M
Grimbaldus Limited
> On 28 Sep 2014, at 21:28, Ian Griffiths <[log in to unmask]> wrote:
>
> Probably but I'd be curious why you want to start with real data - firstly you're probably not OK to process in this way even if the aim is only to produce a test set. Secondly, its probably easier and safer to create it from scratch.
>
> Ian
>
>
> ----- Original Message ----- From: "Mike Humphrey" <[log in to unmask]>
> To: <[log in to unmask]>
> Sent: Friday, September 26, 2014 12:43 PM
> Subject: [data-protection] Anonymising real data
>
>
> Dear All
>
> I am trying to identify if there are off the shelf applications that can take data containing personal data from a live database and anonymise it to produce something suitable for use as test data.
>
> Any recommendations?
>
> Mike Humphrey : Information Management Officer
> England and Wales Cricket Board : Lord's Cricket Ground, London, NW8 8QZ, England.
>
> Tel: +44(0)20 7432 1274 : Mobile: +44 (0) 7837 365507 : Switchboard: +44 (0)20 7432 1200
> Email: [log in to unmask] : Web: http://www.ecb.co.uk
>
>
> [cid:image001.jpg@01CFD987.79C5EB20]
>
>
>
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> All archives of messages are stored permanently and are
> available to the world wide web community at large at
> http://www.jiscmail.ac.uk/lists/data-protection.html
> If you wish to leave this list please send the command
> leave data-protection to [log in to unmask]
> All user commands can be found at http://www.jiscmail.ac.uk/help/commandref.htm
> Any queries about sending or receiving messages please send to the list owner
> [log in to unmask]
> Full help Desk - please email [log in to unmask] describing your needs
> To receive these emails in HTML format send the command:
> SET data-protection HTML to [log in to unmask]
> (all commands go to [log in to unmask] not the list please)
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> All archives of messages are stored permanently and are
> available to the world wide web community at large at
> http://www.jiscmail.ac.uk/lists/data-protection.html
> If you wish to leave this list please send the command
> leave data-protection to [log in to unmask]
> All user commands can be found at http://www.jiscmail.ac.uk/help/commandref.htm
> Any queries about sending or receiving messages please send to the list owner
> [log in to unmask]
> Full help Desk - please email [log in to unmask] describing your needs
> To receive these emails in HTML format send the command:
> SET data-protection HTML to [log in to unmask]
> (all commands go to [log in to unmask] not the list please)
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
All archives of messages are stored permanently and are
available to the world wide web community at large at
http://www.jiscmail.ac.uk/lists/data-protection.html
If you wish to leave this list please send the command
leave data-protection to [log in to unmask]
All user commands can be found at http://www.jiscmail.ac.uk/help/commandref.htm
Any queries about sending or receiving messages please send to the list owner
[log in to unmask]
Full help Desk - please email [log in to unmask] describing your needs
To receive these emails in HTML format send the command:
SET data-protection HTML to [log in to unmask]
(all commands go to [log in to unmask] not the list please)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|