===========================================================================================
The Living Labs for Information Retrieval (IR) Evaluation - Challenge Preparation Workshop

6 June, 2014, Amsterdam, The Netherlands
http://living-labs.net/llc/

[Challenge runs June 15 – August 15, as part of 2nd Living Labs for IR Workshop]

https://groups.google.com/forum/#!forum/living-labs

===========================================================================================

The basic idea of living labs for information retrieval (IR) is that rather than individual research groups independently developing experimental search infrastructures and gathering their own groups of test searchers for IR evaluations, a central and shared experimental environment is developed to facilitate the sharing of resources in a live setting (most important of all: users). See http://living-labs.net/ for details.

The aim of the Challenge Preparation Workshop is to test and further develop a living labs for IR evaluation methodology and a living labs for IR platform, which has been created as part of the CIKM'14 2nd Living Labs for IR Evaluation Workshop. This is to be initially used in a community challenge as part of CIKM'14 2nd Living Labs for IR Evaluation Workshop. The challenge at CIKM focuses on two use-cases: product search (on an e-commerce site) and local domain search (on a university’s website). During the first month of the challenge participants will have the opportunity to tune their system through the product and local domain search websites. The second month of the challenge will examine the performance of participants’ systems on these search websites.

The programme for the Challenge Preparation Workshop includes (1) invited talks and discussions with invited guests to learn from their knowledge in this space, and (2) a hackathon and system testing session with prospective participants for testing the challenge components.


-------------
Participation
-------------
The workshop is free and open to all interested participants, but registration is required.

Click here to register: https://docs.google.com/forms/d/1L3o_AWKNTXw8iFaK7_gGMFqmBhi4d_Sy-GFGoz_7KuI/viewform
Registration will close May 29.

We have a limited number of travel grants to cover travel and accommodation costs (reserved for those with academic affiliations and outside The Netherlands); enquiries can be sent to the workshop organisers.


---------------
Date & Location
---------------
July 6, 2014 - Living Labs Challenge Workshop, at the University of Amsterdam, The Netherlands

[Challenge runs June 15 – August 15]


-------------------
Further Information
-------------------
Further information is available on the workshop website (http://living-labs.net/llc/) or by emailing the workshop organisers.


-------------------
Workshop Organisers
-------------------
Krisztian Balog – University of Stavanger, Norway (krisztian.balog (at) uis.no)
Liadh Kelly – Dublin City University, Ireland (liadh.kelly (at) computing.dcu.ie)
Anne Schuth – University of Amsterdam, The Netherlands (anne.schuth (at) uva.nl)