DIRECTions: design and specification of an IR evaluation infrastructure

  title={DIRECTions: design and specification of an IR evaluation infrastructure},
  author={Maristella Agosti and Emanuele Di Buccio and Nicola Ferro and Ivano Masiero and Simone Peruzzo and Gianmaria Silvello},
Information Retrieval (IR) experimental evaluation is an essential part of the research on and development of information access methods and tools. Shared data sets and evaluation scenarios allow for comparing methods and systems, understanding their beahviour, and tracking performances and progress over the time. On the other hand, experimental evaluation is an expensive activity in terms of human effort, time, and costs required to carry it out. Software and hardware infrastructures that… CONTINUE READING
Highly Cited
This paper has 18 citations. REVIEW CITATIONS

From This Paper

Figures, tables, and topics from this paper.


Publications citing this paper.
Showing 1-10 of 14 extracted citations

Reproducibility Challenges in Information Retrieval Evaluation

J. Data and Information Quality • 2017
View 1 Excerpt


Publications referenced by this paper.
Showing 1-10 of 19 references

Information Retrieval Evaluation

Information Retrieval Evaluation • 2011
View 1 Excerpt

Visual Comparison of Ranked Result Cumulated Gains

N. Ferro, A. Sabetta, G. Santucci, G. Tino
In Miksch, S., Santucci, G., eds.: Proc. 2nd International Workshop on Visual Analytics (EuroVA 2011), Eurographics Association, Goslar, Germany • 2011
View 1 Excerpt

Economic Impact Assessment of NIST’s Text REtrieval Conference (TREC) Program

B. R. Rowe, D. W. Wood, A. L. Link, D. A. Simoni
RTI Project Number 0211875, RTI International, USA. impact.pdf • 2010
View 1 Excerpt

Riding the wave

European Union
How Europe can gain from the rising tide of scientific data. Printed by, Final report of the High level Expert Group on Scientific Data • 2010
View 1 Excerpt

Test Collection Based Evaluation of Information Retrieval Systems

M. Sanderson
Foundations and Trends in Information Retrieval (FnTIR) 4 • 2010
View 1 Excerpt