Automating the assignment of submitted manuscripts to reviewers

  title={Automating the assignment of submitted manuscripts to reviewers},
  author={Susan T. Dumais and Jakob Nielsen},
  booktitle={SIGIR '92},
The 117 manuscripts submitted for the Hypertext '91 conference were assigned to members of the review committee, using a variety of automated methods based on information retrieval principles and Latent Semantic Indexing. Fifteen reviewers provided exhaustive ratings for the submitted abstracts, indicating how well each abstract matched their interests. The automated methods do a fairly good job of assigning relevant papers for review, but they are still somewhat poorer than assignments made… 

Figures and Tables from this paper

Recommending Papers by Mining the Web
This paper proposes an automated method for recommending small focused sets of papers to reviewers and shows how intelligent paper recommendation can be performed by combining techniques from information retrieval and database technology, and by mining multiple information sources from the Web.
Expertise modeling for matching papers with reviewers
This work evaluates several measures of the association between an author in an existing collection of research papers and a previously unseen document using a novel topic model, Author-Persona-Topic (APT), and finds that the APT topic model outperforms the other models.
Additional Reviewer Assignment by Means of Weighted Association Rules
An association rule-based methodology to recommend additional external reviewers external to the program committee is proposed and Weighted Association Rules, which represent strong associations between paper co-authors, are first extracted from a benchmark publication dataset.
A New Approach for Computing the Matching Degree in the Paper-to-Reviewer Assignment Problem
This paper proposes to build the reviewers profiles on the basis of both pedagogical and research documents, then a formula that takes into account both topics similarity and common references is proposed and shows a good performance.
Weighted Coverage based Reviewer Assignment
A generalized framework for fair reviewer assignment is proposed, which first extracts the domain knowledge from the reviewers' published papers and model this knowledge as a set of topics, and proposes a greedy algorithm that achieves a 1/2-approximation ratio compared to the exact solution.
Designing of Fair and Accurate Reviewer Assignment in Peer Review
One of the normal issues looked in allocating recommendations submitted to the conferences, journal publications and so forth is the assignment of the proposition to the suitable reviewers. This is
Paper-to-reviewer assignment, based on expertise degree of reviewers and relevance degree between reviewers and papers
This paper addresses the issue of paper-to-reviewer assignment and proposes a method to model reviewers, based on the matching degree between reviewers and papers by combining preference- based approach and topic-based approach.
PRIMA-Towards an Automatic Review/Paper Matching Score Calculation
This paper introduces the Paper Rating and IPC Matching Tool (PRIMA), which reduces the workload for both IPC members and chairs to support and improve the assignment process.
One of the normal issues looked in allocating recommendations submitted to the conferences, journal publications and so forth is the assignment of the proposition to the suitable reviewers. This is


Relevance assessments and retrieval system evaluation
Improving the retrieval of information from external sources
A statistical method is described called latent semantic indexing, which models the implicit higher order structure in the association of words and objects and improves retrieval performance by up to 30%.
Indexing by Latent Semantic Analysis
A new method for automatic indexing and retrieval to take advantage of implicit higher-order structure in the association of terms with documents (“semantic structure”) in order to improve the detection of relevant documents on the basis of terms found in queries.
Automatic text structuring and retrieval-experiments in automatic encyclopedia searching
An alternative text manipulation system is outlined useful for the retrieval of large heterogeneous texts, and for the recognition of content similarities between text excerpts, based on flexible text matching procedures carried out in several contexts of different scope.
The HCI bibliography project
The HCI Bibliography project has just released its first collections of a free-access online extended bibliography on Human-Computer Interaction, and the first release contains the complete contents of all the ACM CHI conference, the complete journal HCI, and several other important sources.
Information retrieval by constrained spreading activation in semantic networks
Hypertext: from Text to Expertext
Text principles reading model writing model systems text structure reading tools writing tools epilogue exercises small volume history 1960s 1970s principles database network interface systems
Introduction to Modern Information Retrieval
Reading is a need and a hobby at once and this condition is the on that will make you feel that you must read.
Maximum matching and a polyhedron with 0,1-vertices
The emphasis in this paper is on relating the matching problem to the theory of continuous linear programming, and the algorithm described does not involve any "blind-alley programming" -which, essentially, amounts to testing a great many combinations.
Hypertext and hypermedia
A comprehensive, clearly written overview of hypertext, this book gives broad coverage of different hypertext systems, as well as their features and applications using many concrete examples and