An algorithm to determine peer-reviewers

@inproceedings{Rodriguez2008AnAT,
  title={An algorithm to determine peer-reviewers},
  author={Michael A. Rodriguez and Johan Bollen},
  booktitle={CIKM '08},
  year={2008}
}
The peer-review process is the most widely accepted certification mechanism for officially accepting the written results of researchers within the scientific community. An essential component of peer-review is the identification of competent referees to review a submitted manuscript. This article presents an algorithm to automatically determine the most appropriate reviewers for a manuscript by way of a co-authorship network data structure and a relative-rank particle-swarm algorithm. This… 

Figures and Tables from this paper

Expert team finding for review assignment
TLDR
A novel and unified framework that takes importance, diversity and expertise coverage of a group of reviewers into account for reviewer assignment and shows that the approach is very effective in finding panels of relevant, authoritative and diverse reviewers for given submissions to review.
An algorithm for automatic assignment of reviewers to papers
TLDR
A heuristic algorithm for automatic assignment of reviewers to papers that achieves accuracy of about 98–99% in comparison to the maximum-weighted matching algorithms, but has better time complexity of Θ(n2).
K-Loop Free Assignment in Conference Review Systems
TLDR
Two algorithms are proposed for a k-loop free assignment, which ensures the loop length is no less than k and assigns reviewers to maximize the summation of suitability scores, temporarily ignoring the k- loop free constraint.
PeerReview4All: Fair and Accurate Reviewer Assignment in Peer Review
TLDR
A fairness objective is to maximize the review quality of the most disadvantaged paper, in contrast to the commonly used objective of maximizing the total quality over all papers, and an assignment algorithm based on an incremental max-flow procedure is designed that is near-optimally fair.
On Good and Fair Paper-Reviewer Assignment
TLDR
This paper performs a detailed study on conflict-of-interest (COI) types and discusses several issues related to using COI, which, it is hoped, can raise some open discussions among researchers on the COI study.
A robust model for paper reviewer assignment
TLDR
The proposed automatic paper-reviewer recommendation system obtains performance gains over state-of-the-art reviewer recommendation systems in terms of expertise, authority, diversity, and, most importantly, relevance as judged by human experts.
The Toronto Paper Matching System: An automated paper-reviewer assignment system
TLDR
An overview of the system, a summary of learning models and methods of evaluation that the team has been using, as well as some of the recent progress and open issues are provided.
A System for Mapping Text to Specific Reviewers
TLDR
An overview of the web interface Reviewer Mapping System (RMS) developed by the author is provided, which features include modifying the set of reviewers in the system (adding and deleting reviewers), providing the suggested URLs of a reviewer’s pages, and matching the abstracts of submitted papers to the appropriate reviewers.
...
...

References

SHOWING 1-10 OF 28 REFERENCES
Mapping the Bid Behavior of Conference Referees
Conference Paper Assignment Using a Combined Greedy/Evolutionary Algorithm
TLDR
This paper presents a method that combines a greedy and an evolutionary algorithm to assign papers submitted to a conference to reviewers, and yielded a good match between reviewers and papers assigned to them, better than a greedy algorithm.
The convergence of digital libraries and the peer-review process
TLDR
The contributions set forth by this paper emphasize a deconstructed publication model in which the peer-review process is mediated by an Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) peer- Review service, and suggest a set of peer- review specific metadata tags that can accompany a pre-print's existing metadata record.
Automating the assignment of submitted manuscripts to reviewers
TLDR
A new automated assignment method called “n of 2n” achieves better performance than human experts by sending reviewers more papers than they actually have to review and then allowing them to choose part of their review load themselves.
Technical Paper Recommendation: A Study in Combining Multiple Information Sources
TLDR
This work uses WHIRL - an information integration system - to implement different recommendation algorithms derived from information retrieval principles, and uses a novel autonomous procedure for gathering reviewer interest information from the Web.
Taking the load off the conference chairs-towards a digital paper-routing assistant
TLDR
A system for the automatic routing of submitted papers to reviewers and area committees is described and evaluated, without the need for any human annotation from the reviewers or the program chair, and achieves system accuracy approaching that of several human judges on the same task.
Simulating Network Influence Algorithms Using Particle-Swarms: PageRank and PageRank-Priors
TLDR
This paper will describe a particular implementation of a particle-swarm that can simulate the behavior of the popular PageRank algorithm in both its global-rank and relative-rank incarnations.
Co-authorship networks in the digital library research community
Grammar-based random walkers in semantic networks
The largest scholarly semantic network...ever.
TLDR
The MESUR project's data aggregation and processing techniques including the OWL scholarly ontology that was developed to model the scholarly communication process are described to be the largest scholarly semantic network ever created.
...
...