INitiative for the Evaluation of XML retrieval (INEX)
Call for participation INEX 2008
REGISTRATION NOW OPEN AT http://www.inex.otago.ac.nz
OVERVIEW
INEX 2008 is examining focused (or sub-document) retrieval using the
Wikipedia Collection. For the main ad hoc retrieval track the collection
will be made available in Plain Text as well as XML so that also non-XML
based passage retrieval systems can be used. Other tracks are: Book
Searching (using a collection of full text books in XML), Efficiency, Entity
Ranking, Interactive (iTrack), Question Answering (QA@INEX), Link-the-Wiki,
and XML-Mining. All INEX Participants are expected to participate in topic
creation, and assessment.
TASKS AND TRACKS
* Ad hoc Track - The main track of INEX 2008 will investigate the
effectiveness of XML-IR and Passage Retrieval for three ad hoc retrieval
tasks (Focused, Relevant in Context, Best in Context).
* Book Searching Track -- Investigating information access to, and IR
techniques for searching full texts of digitized books.
* Efficiency Track - Investigating both the effectiveness and efficiency of
XML ranked retrieval approaches on real data and real queries.
* Entity Ranking Track - Investigating entity retrieval rather than text
retrieval: 1) Entity Ranking, 2) Entity List Completion.
* Interactive Track (iTrack) -- Investigating the behavior of users when
interacting with XML documents, as well as develop retrieval approaches
which are effective in user-based environments.
* Question Answering (QA@INEX) Track -- Investigating technology for
accessing semi-structured data can be used to address real-world focused
information needs formulated as natural language questions.
* Link-the-Wiki Track - Investigating link discovery between Wikipedia
documents, both at the file level and at the element level.
* XML-Mining Track - Investigating structured document mining, especially
the classification and clustering of semi-structured documents.
A detailed description of each of the tracks can be found at
http://www.inex.otago.ac.nz/.
IMPORTANT DATES
The schedule of the main ad hoc track is as follows:
1/04/2008 Registration deadline
28/04/2008 Release of Topic Creation Guidelines
12/05/2008 Submission deadline for candidate topics
2/06/2008 Release of final set of topics
2/06/2008 Release of Result Submission Specification
7/07/2008 Submission deadline for ad hoc search results
28/07/2008 Release of assessment pools
15/09/2008 Submission deadline for relevance assessments
3/11/2008 Release of ad hoc evaluation results
24/11/2008 Submission deadline for papers for pre-proceedings (all tracks)
8/12/2008 Release of workshop pre-proceedings
15-18/12/2008 INEX Workshop in Dagstuhl
Other tracks will follow variants of this schedule.
RELEVANCE ASSESSMENTS
Relevance assessments will be provided by the participating groups using the
INEX assessment system. Each participating organization will judge about 3
topics. Please note that the assessment of each topic may take one-person 1
to 2 days to complete!
WORKSHOP AND PROCEEDINGS
Participants will be able to present their approaches and the final results
at the INEX workshop to be held in December at Schloss Dagstuhl, Germany.
All participants will be able to publish their work in the workshop
pre-proceedings. Fully peer-reviewed and revised papers will be published
in the INEX post-workshop final proceedings. Since 2004 the final
proceedings have been published in the Springer's Lecture Notes in Computer
Science (LNCS) series, and we hope to continue that tradition.
|