***** FINAL CALL FOR PAPERS *****

The Third International Workshop on Evaluating Information Access
(EVIA 2010), a Satellite Workshop of NTCIR-8
http://research.nii.ac.jp/ntcir/ntcir-ws8/EVIA-2010/

June 15, 2010 at NII, Tokyo, Japan.
***************************************

Information Access technologies provide the interface between human 
information needs and digital information resources.  The reliable 
evaluation of these technologies has been recognized for decades as 
central to the advancement of the field.  As information retrieval 
becomes more pervasive, the forms of retrieval more diverse, and 
retrieval tools richer, the importance of effective, efficient, and 
innovative evaluation grows as well. In recognition of the need for a 
forum dedicated to the intensive discussion of evaluation issues, we 
have held two successful International Workshops on Evaluating 
Information Access (EVIA 2007 and 2008).  Proceedings and reports can be 
found below:

EVIA 2007 online proceedings: 
http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings6/EVIA/
EVIA 2008 online proceedings: 
http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings7/toc_evia.html

SIGIR Forum Report on EVIA 2007: 
http://sigir.org/forum/2007D/2007d_sigirforum_sanderson.pdf
SIGIR Forum Report on EVIA 2008: 
http://sigir.org/forum/2009J/2009j-sigirforum-sakai.pdf

Following these successes, we are happy to announce the Third 
International Workshop on Evaluating Information Access (EVIA 2010) on 
June 15, 2010 (coinciding with Day 1 of the NTCIR-8 Workshop Meeting) at 
the National Institute of Informatics (NII), Tokyo, Japan.  We invite 
papers addressing one or more of the following topics:

- Test collection formation, evaluation metrics, and evaluation environments
- Statistical issues in retrieval evaluation
- User studies and the evaluation of human-computer interaction in 
information retrieval (HCIR)
- Evaluation methods for multilingual, multimedia, or mobile information 
access
- Novel information access tasks and their evaluation
- Evaluation and assessment using implicit user feedback, crowdsourcing, 
living labs, or inferential methods
- Evaluation issues in industrial and enterprise retrieval systems

*** SUBMISSION INSTRUCTIONS ***

Submissions will be subject to double-blind reviewing.  Accepted papers 
will be included in the EVIA 2010 online proceedings, and summarized in 
a report to SIGIR Forum.

We invite submissions of regular papers (up to 9 pages) and short papers 
(up to 5 pages).
Submission upload page: http://www.easychair.org/conferences/?conf=evia2010

*** IMPORTANT DATES ***

- March 31, 2010    *submissions due*
- April 18, 2010        notification of acceptance
- May 10, 2010        final manuscripts due
- June 15, 2010        EVIA 2010@NII, Tokyo, Japan
- June 15-18, 2010   NTCIR-8@NII, Tokyo, Japan

*** EVIA 2010 PROGRAM COMMITTEE ***

Akiko Aizawa       NII                              Japan
Javed Aslam        Northeastern University          USA
Nicholas Belkin    Rutgers University               USA
Ben Carterette     University of Delaware           USA
Charlie Clarke     University of Waterloo           Canada
Georges Dupret     Yahoo! Research                  Chile
Norbert Fuhr       Universitaet Duisburg-Essen      Germany
Atsushi Fujii      Tokyo Institute of Technology    Japan
Donna Harman       NIST                             USA
Hideo Joho         University of Tsukuba            Japan
Gareth Jones       Dublin City University           Ireland
Noriko Kando       NII                              Japan
Evangelos Kanoulas University of Sheffield          UK
Jaana Kekalainen   University of Tampere            Finland
Mounia Lalmas      University of Glasgow            UK
Gary Geunbae Lee   POSTECH                          Korea
Mun-Kew Leong      National Library Board           Singapore
Jimmy Lin          University of Maryland           USA
Chin-Yew Lin       Microsoft Research Asia          China
Iadh Ounis         University of Glasgow            UK
Carol Peters       IEI-CNR                          Italy
Ian Ruthven        University of Strathclyde        UK
Tetsuya Sakai      Microsoft Research Asia          China
Mark Sanderson     University of Sheffield          UK
Falk Scholer       RMIT University                  Australia
Ian Soboroff       NIST                             USA
Paul Thomas        CSIRO                            Australia
William Webber     University of Melbourne          Australia
Emine Yilmaz       Microsoft Research Cambridge     UK

*** EVIA 2010 CO-CHAIRS ***

William Webber (University of Melbourne, Australia)
   [log in to unmask]
Mark Sanderson (University of Sheffield, UK)
   [log in to unmask]
Tetsuya Sakai (Microsoft Research Asia, China)
   [log in to unmask]