• Publications
  • Influence
Cumulated gain-based evaluation of IR techniques
TLDR
This article proposes several novel measures that compute the cumulative gain the user obtains by examining the retrieval result up to a given ranked position, and test results indicate that the proposed measures credit IR methods for their ability to retrieve highly relevant documents and allow testing of statistical significance of effectiveness differences. Expand
IR evaluation methods for retrieving highly relevant documents
TLDR
The novel evaluation methods and the case demonstrate that non-dichotomous relevance assessments are applicable in IR experiments, may reveal interesting phenomena, and allow harder testing of IR methods. Expand
The Turn - Integration of Information Seeking and Retrieval in Context
TLDR
The Turn represents a wide-ranging perspective of IS&R by providing a novel unique research framework, covering both individual and social aspects of information behavior, including the generation, searching, retrieval and use of information. Expand
Task complexity affects information seeking and use
TLDR
The relationships of task complexity, necessary information types, information channels, and sources are analyzed at the task level on the basis of a qualitative investigation using diaries, questionnaires, and questionnaires. Expand
IR evaluation methods for retrieving highly relevant documents
TLDR
The novel evaluation methods and the case demonstrate that non-dichotomous relevance assessments are applicable in IR experiments, may reveal interesting phenomena, and allow harder testing of IR methods. Expand
Evaluation
  • K. Järvelin
  • Computer Science
  • Interactive Information Seeking, Behaviour and…
  • 1 January 2008
Task Complexity Affects Information Seeking and Use
TLDR
The relationships of task complexity, necessary information types, information channels and sources are analyzed at the task level on the basis of a qualitative investigation using diaries, questionnaires and questionnaires to indicate systematic and logical relationships. Expand
Collaborative Information Retrieval in an information-intensive domain
TLDR
Empirical results are presented, showing that the patent task performance process involves highly collaborative aspects throughout the stages of the information seeking and retrieval process and proposes a refined IR framework involving collaborative aspects. Expand
Using graded relevance assessments in IR evaluation
TLDR
It is argued that evaluation methods should credit IR methods for their ability to retrieve highly relevant documents, and a novel application of P-R curves and average precision computations based on separate recall bases for documents of different degrees of relevance is proposed. Expand
Discounted Cumulated Gain Based Evaluation of Multiple-Query IR Sessions
TLDR
This work proposes an extension to the Discounted Cumulated Gain metric, the Session-based DCG (sDCG) metric, for evaluation scenarios involving multiple query sessions, graded relevance assessments, and open-ended user effort including decisions to stop searching. Expand
...
1
2
3
4
5
...