Conference and Labs of the Evaluation Forum

The Conference and Labs of the Evaluation Forum (formerly Cross-Language Evaluation Forum), or CLEF, is an organization promoting research in multilingual information access (currently focusing on European languages). Its specific functions are to maintain an underlying framework for testing information retrieval systems and to create repositories of data for researchers to use in developing comparable standards.[1] The organization holds a forum meeting every September in Europe. Prior to each forum, participants receive a set of challenge tasks. The tasks are designed to test various aspects of information retrieval systems and encourage their development. Groups of researchers propose and organize campaigns to satisfy those tasks. The results are used as benchmarks for the state of the art in the specific areas.,[2][3]

For example, the 2010 medical retrieval task focuses on retrieval of computed tomography, MRI, and radiographic images.[4]

References

  1. ↑ Peters, Carol; Braschler, Martin; Choukri, Khalid; Gonzalo, Julio; Kluck, Michael. The Future of Evaluation for Cross-Language Information Retrieval Systems. Second Workshop of the Cross-Language Evaluation Forum, CLEF 2001. CiteSeerX 10.1.1.109.7647 Freely accessible.
  2. ↑ "Special Issue on CLEF". Information Retrieval. 7 (1–2). 2004.
  3. ↑ Fredric C. Gey, Noriko Kando, and Carol Peters "Cross-Language Information Retrieval: the way ahead" in Information Processing & Management vol. 41, no. 3, p.415-431 May 2005, doi:10.1016/j.ipm.2004.06.006
  4. ↑ Mueller, Henning (20 May 2010). "Medical Retrieval Task". ImageCLEF - Cross-language image retrieval evaluations. Retrieved 27 May 2010.


This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.