MESUR: usage-based metrics of scholarly impact

  title={MESUR: usage-based metrics of scholarly impact},
  author={Johan Bollen and Michael A. Rodriguez and Herbert Van de Sompel},
  booktitle={JCDL '07},
The evaluation of scholarly communication items is now largely a matter of expert opinion or metrics derived from citation data. Both approaches can fail to take into account the myriad of factors that shape scholarly impact. Usage data has emerged as a promising complement to existing methods o fassessment but the formal groundwork to reliably and validly apply usage-based metrics of schlolarly impact is lacking. The Andrew W. Mellon Foundation funded MESUR project constitutes a systematic… 

Figures and Tables from this paper

De Profundis: A Decade of Bibliometric Services Under Scrutiny

The lessons learned after having provided bibliometric services at the University of Vienna for more than a decade are presented and based on the comparison of their own insights with current practices, declarations and manifestos, new recommendations and guidelines are come up with.

Item-level usage statistics: A review of current practices and recommendations for normalization and exchange

How the JISC Usage Statistics Review Project aims to formulate a fundamental scheme for recording usage data and to propose a standard for its aggregation to provide meaningful and comparable item‐level usage statistics for electronic documents such as, for example, research papers and scientific resources is presented.

Towards a Scientific Impact Measuring Framework for Large Computing Facilities - a Case Study on XSEDE

This work carries out an extensive statistical analysis correlating XSEDE allocation size to the impact metrics aggregated by project and field of science, and provides insight regarding maximizing the return on investment in terms of allocation by taking into account the field ofScience or project based impact metrics.

Evaluating the Scientific Impact of XSEDE

The dataset and data soruces involved and how the same approaches could be used to evaluate publications from a similar organization or institute are explained, to demonstrate the general applicability of the present evaluation approach providing impact even beyond XSEDE.

Enhancing Citation Context based Information Services through Sentence Context Identification

An annotation scheme that defines context types for sentences in scientific articles and developed a contextual model of sentence context types in scientific article, and developed various applications for providing citation context based information services.

#Psychology: a bibliometric analysis of psychological literature in the online media

The relationship between traditional metrics and alternative metrics for psychological research in the years from 2010 to 2012 are explored and a new metric, the Score Factor, is proposed as a useful alternative metric to assess a journal’s impact in the online media.

Faculty Performance Evaluation Using Citation Analysis

This article provides a citation analysis for faculty from Association of Collegiate Schools of Planning (ACSP) member schools. The article argues that Google Scholar data is a particularly valuable

An informetrics study of the cited references in archival research in sub-Saharan Africa: A measure of the archival researchers' preferences?

The purpose of this paper was to investigate the application of informetrics to determine authors' preferences for specific sources of information when conducting their research, as well as to find

Harnessing user library statistics for research evaluation and knowledge domain visualization

It is found that there is a significant relationship between the impact factor and the occurrence of references in libraries and a knowledge domain visualization based on co-occurrence measures is able to identify two areas of topics within the emerging field of technology-enhanced learning.



Usage Impact Factor: the effects of sample characteristics on usage-based impact metrics

It is observed that as the number of graduate students and faculty increases in a particular discipline, Usage Impact Factor rankings will converge more strongly with the ISI Impact Factor.

Mapping the structure of science through usage

Results indicate that meaningful maps of the interests of a local scientific community can be derived from usage data, and a comparison to maps resulting from the analysis of 2003 Thomson ISI Journal Citation Report data reveals interesting differences between the features of local usage and global citation data.

Journal status

The Y-factor is introduced which is a simple combination of both the ISI IF and the weighted PageRank, and it is found that the resulting journal rankings correspond well to a general understanding of journal status.

A practical ontology for the large-scale modeling of scholarly artifacts and their usage

This article presents a scholarly ontology that was engineered to represent those classes for which large-scale bibliographic and usage data exists, supports usage research, and whose instantiation is scalable to the order of 50 million articles along with their associated artifacts.

An architecture for the aggregation and analysis of scholarly usage data

  • J. BollenH. V. D. Sompel
  • Computer Science
    Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '06)
  • 2006
A technical, standards-based architecture for sharing usage information is presented, made OAI-PMH harvestable so that usage information exposed by many linking servers can be aggregated to facilitate the creation of value-added services with a reach beyond that of a single community or a single information service.

Can scientific journals be classified in terms of aggregated journal-journal citation relations using the Journal Citation Reports?

The factor-analytic solutions allow us to test classifications against the structures contained in the database; in this article the process will be demonstrated for the delineation of a set of biochemistry journals.

Earlier Web Usage Statistics as Predictors of Later Citation Impact

This paper analyses how short-term Web usage impact predicts medium-term citation impact and uses the physics e-print archive -- -- to test this.

Reading factor: a new bibliometric criterion for managing digital libraries.

A way to measure the electronic consultation rate, termed the reading factor (RF), in direct correlation to the impact factor, is described, a direct measurement of journal use that is related to both clinical medicine and library or information science.

The bibliometric properties of article readership information: Research Articles

The age biases of both reads and cites are shown and two new bibliometric measures are developed which have substantially less age bias than citations: SumProd, a weighted sum of total citations and the readership rate, intended to show the total productivity of an individual; and Read10, the Readership rate for articles published in the last 10 years, intended for an individual's current productivity.