Automating the assignment of submitted manuscripts to reviewers

@inproceedings{Dumais1992AutomatingTA,
  title={Automating the assignment of submitted manuscripts to reviewers},
  author={Susan T. Dumais and Jakob Nielsen},
  booktitle={SIGIR '92},
  year={1992}
}
The 117 manuscripts submitted for the Hypertext '91 conference were assigned to members of the review committee, using a variety of automated methods based on information retrieval principles and Latent Semantic Indexing. Fifteen reviewers provided exhaustive ratings for the submitted abstracts, indicating how well each abstract matched their interests. The automated methods do a fairly good job of assigning relevant papers for review, but they are still somewhat poorer than assignments made… Expand

Figures, Tables, and Topics from this paper

Recommending Papers by Mining the Web
The problem of assigning conference paper submissions to suitable reviewers can be viewed as a variant of the general problem of technical paper recommendation. In both cases one would ideally likeExpand
Expertise modeling for matching papers with reviewers
TLDR
This work evaluates several measures of the association between an author in an existing collection of research papers and a previously unseen document using a novel topic model, Author-Persona-Topic (APT), and finds that the APT topic model outperforms the other models. Expand
Additional Reviewer Assignment by Means of Weighted Association Rules
TLDR
An association rule-based methodology to recommend additional external reviewers external to the program committee is proposed and Weighted Association Rules, which represent strong associations between paper co-authors, are first extracted from a benchmark publication dataset. Expand
A New Approach for Computing the Matching Degree in the Paper-to-Reviewer Assignment Problem
TLDR
This paper proposes to build the reviewers profiles on the basis of both pedagogical and research documents, then a formula that takes into account both topics similarity and common references is proposed and shows a good performance. Expand
Weighted Coverage based Reviewer Assignment
TLDR
A generalized framework for fair reviewer assignment is proposed, which first extracts the domain knowledge from the reviewers' published papers and model this knowledge as a set of topics, and proposes a greedy algorithm that achieves a 1/2-approximation ratio compared to the exact solution. Expand
Automatic Paper-to-reviewer Assignment, based on the Matching Degree of the Reviewers
TLDR
This paper proposes a method to model the reviewers, based on the matching degree between the reviewers and the papers by combining a preference- based approach and a topic-based approach. Expand
Designing of Fair and Accurate Reviewer Assignment in Peer Review
One of the normal issues looked in allocating recommendations submitted to the conferences, journal publications and so forth is the assignment of the proposition to the suitable reviewers. This isExpand
Paper-to-reviewer assignment, based on expertise degree of reviewers and relevance degree between reviewers and papers
TLDR
This paper addresses the issue of paper-to-reviewer assignment and proposes a method to model reviewers, based on the matching degree between reviewers and papers by combining preference- based approach and topic-based approach. Expand
PRIMA-Towards an Automatic Review/Paper Matching Score Calculation
Programme chairs of scientific conferences face a tremendous time pressure. One of the most time-consuming steps during the conference workflow is assigning members of the international programmeExpand
Summarizing Review Scores of "Unequal" Reviewers
TLDR
This paper addresses the score summarization sub-problem for the scenario where a small number of reviewers evaluate each object and proposes the notion of “leniency” to model this difference of reviewers. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 18 REFERENCES
Relevance assessments and retrieval system evaluation
TLDR
It is found that large scale differences in the relevance assessments do not produce significant variations in average recall and precision, and it thus appears that properly computed recall and Precision data may represent effectiveness indicators which are generally valid for many distinct user classes. Expand
Improving the retrieval of information from external sources
TLDR
A statistical method is described called latent semantic indexing, which models the implicit higher order structure in the association of words and objects and improves retrieval performance by up to 30%. Expand
Indexing by Latent Semantic Analysis
A new method for automatic indexing and retrieval is described. The approach is to take advantage of implicit higher-order structure in the association of terms with documents (“semantic structure”)Expand
Automatic text structuring and retrieval-experiments in automatic encyclopedia searching
TLDR
An alternative text manipulation system is outlined useful for the retrieval of large heterogeneous texts, and for the recognition of content similarities between text excerpts, based on flexible text matching procedures carried out in several contexts of different scope. Expand
Information Retrieval using a Singular Value Decomposition Model of Latent Semantic Structure
In a new method for automatic indexing and retrieval, implicit higher-order structure in the association of terms with documents is modeled to improve estimates of term-document association, andExpand
The HCI bibliography project
TLDR
The HCI Bibliography project has just released its first collections of a free-access online extended bibliography on Human-Computer Interaction, and the first release contains the complete contents of all the ACM CHI conference, the complete journal HCI, and several other important sources. Expand
The HCI Bibliography project
TLDR
The HCI Bibliography project has just released its first collections of a free-access online extended bibliography on Human-Computer Interaction, and the first release contains the complete contents of all the ACM CHI conference, the complete journal HCI, and several other important sources. Expand
Information retrieval by constrained spreading activation in semantic networks
TLDR
The architecture of grant and the impact of the search method are described, and its performance is evaluated. Expand
Hypertext: from Text to Expertext
Text principles reading model writing model systems text structure reading tools writing tools epilogue exercises small volume history 1960s 1970s principles database network interface systemsExpand
Introduction to Modern Information Retrieval
TLDR
Reading is a need and a hobby at once and this condition is the on that will make you feel that you must read. Expand
...
1
2
...