This thread is interesting and relates to work I've been involved in in
Evidence, Impact, Metrics [1].
Over the past few years I've published several surveys on use of online
services, typically by Russell Group Universities, including use of
Facebook [2] [3] and Twitter [4] as well as surveys of links to Russell
Group Unis [5] and links to social media sites from Russell Group
university home pages [7].
As might be expected, when usage is growing, the institutions concerned
tend to regard this as evidence of adoption of appropriate solutions and
implementation of best practices. However when usage is decreasing, as
illustrated in a post which asked "Are University Web Sites in Decline?"
[8] the survey methodology must be flawed!
In order to try and have a more detached view of the evidence and the
subsequent processes of interpretting the evidence which may lead to
policy decisions as part of the JISC-funded Observatory project we have
been adopting more systematic processes for the stages of (1) gathering
information; (2) making sense of the evidence and (3) informing policy
and practice. Stage 1 include documenting the paradata [9] - the
information about the survey tools and approaches, which can help to
ensure findings are comparable and reproducible. The processes for
making sense of the data are to open up the discussions about the
findings, survey methodology and speculations for the reasons for the
findings in an open forum (as you are doing here on this list). That
will then lead to stage 3, which will be how should the open discussions
inform policy and practice.
Clearly usage statistics of electronic resources is very importance. I'm
wondering more rigorous and systematic approaches to these stages might
be valuable.
Thoughts?
thanks
Brian
References
1 Final Reports from UKOLN’s Evidence, Impact, Metrics Work, 21 Dec 2011,
http://ukwebfocus.wordpress.com/2011/12/21/final-reports-from-ukolns-evidence-impact-metrics-work/
2 Use of Facebook by Russell Group Universities, 18 Jan 2011,
http://ukwebfocus.wordpress.com/2011/01/18/use-of-facebook-by-russell-group-universities/
3 Is It Time To Ditch Facebook, When There’s Half a Million Fans Across
Russell Group Universities?, 26 Sept 2011.,
http://ukwebfocus.wordpress.com/2011/09/26/is-it-time-to-ditch-facebook-when-theres-half-a-million-fans-across-russell-group-universities/
4 Institutional Use of Twitter by Russell Group Universities, 14 Jan 2011,
http://ukwebfocus.wordpress.com/2011/01/14/institutional-use-of-twitter-by-russell-group-universities/
5 Analysis of Incoming Links to Russell Group University Home Pages, 1
Feb 2012,
http://ukwebfocus.wordpress.com/2012/02/01/analysis-of-incoming-links-to-russell-group-university-home-pages/
6 Links to Social Media Sites on Russell Group University Home Pages, 18
Jan 2012
http://ukwebfocus.wordpress.com/2012/01/18/social-media-links-on-russell-group-university-home-pages/
8 Are University Web Sites in Decline?, 20 Oct 2011,
http://ukwebfocus.wordpress.com/2011/10/20/are-university-web-sites-in-decline/
9 Paradata for Online Surveys, 29 Nov 2011,
http://ukwebfocus.wordpress.com/2011/11/29/paradata-for-online-surveys/
--
--------------------------------------------------------
Brian Kelly
UKOLN, University of Bath, Bath, UK, BA2 7AY
Email: [log in to unmask]
Blog: http://ukwebfocus.wordpress.com/
Twitter: http://twitter.com/briankelly
lis-e-resources is a UKSG list - http://www.uksg.org/serials
UKSG groups also available on Facebook and LinkedIn
|