Towards usage-based impact metrics: first results from the mesur project.

@article{Bollen2008TowardsUI,
  title={Towards usage-based impact metrics: first results from the mesur project.},
  author={Johan Bollen and Herbert Van de Sompel and Michael A. Rodriguez},
  journal={ArXiv},
  year={2008},
  volume={abs/0804.3791}
}
Scholarly usage data holds the potential to be used as a tool to study the dynamics of scholarship in real time, and to form the basis for the definition of novel metrics of scholarly impact. However, the formal groundwork to reliably and validly exploit usage data is lacking, and the exact nature, meaning and applicability of usage-based metrics is poorly understood. The MESUR project funded by the Andrew W. Mellon Foundation constitutes a systematic effort to define, validate and cross… 

Figures and Tables from this paper

Item-level usage statistics: A review of current practices and recommendations for normalization and exchange
TLDR
How the JISC Usage Statistics Review Project aims to formulate a fundamental scheme for recording usage data and to propose a standard for its aggregation to provide meaningful and comparable item‐level usage statistics for electronic documents such as, for example, research papers and scientific resources is presented.
Towards a Scientific Impact Measuring Framework for Large Computing Facilities - a Case Study on XSEDE
TLDR
This work carries out an extensive statistical analysis correlating XSEDE allocation size to the impact metrics aggregated by project and field of science, and provides insight regarding maximizing the return on investment in terms of allocation by taking into account the field ofScience or project based impact metrics.
How well developed are altmetrics? A cross-disciplinary analysis of the presence of ‘alternative metrics’ in scientific publications
TLDR
The main result of the study is that the altmetrics source that provides the most metrics is Mendeley, with metrics on readerships for 62.6 % of all the publications studied, other sources only provide marginal information.
A Principal Component Analysis of 39 Scientific Impact Measures
TLDR
The results indicate that the notion of scientific impact is a multi-dimensional construct that can not be adequately measured by any single indicator, although some measures are more suitable than others.
How to assess the impact of an electronic document? And what does impact mean anyway?: Reliable usage statistics in heterogeneous repository communities
TLDR
A range of impact measures, especially usage‐based metrics, are discussed, and an interest in the social aspects of science is indicated, like visualizations of social graphs both for persons and their publications.
Using the Co-Citation Network to Indicate Article Impact
TLDR
This work presents an investigation into new metrics which utilize the co-citation network in order to rate a publications impact, and finds a good correlation between download metrics and subsequent impact by citation.
Identifiers in Scholarly Repositories
TLDR
Preliminary work at arXiv to implement public author identifiers, services based on them, and plans to make this information useful beyond the boundaries of arXIV are described.
Proposal : Author Identifiers in Scholarly Repositories
TLDR
This work describes work at arXiv to implement public author identifiers, services based on them both locally and through a Facebook application, and plans to make this information useful beyond the boundaries of arXIV.
Hybrid Standard Platform for E-Journal Usage Statistics Management
TLDR
An automatic collection and visualization system of e-journal usage statistics is implemented so that librarians can focus on more specific and concrete usage data of their institution.
User-defined valued metrics for electronic journals
TLDR
Collection management librarians and library users can benefit from a viable, more accurate metric for use and value of library resources than cost-per-download, which would ensure that the most needed/valued resources are available to further research and learning.
...
...

References

SHOWING 1-10 OF 23 REFERENCES
Usage Impact Factor: the effects of sample characteristics on usage-based impact metrics
TLDR
It is observed that as the number of graduate students and faculty increases in a particular discipline, Usage Impact Factor rankings will converge more strongly with the ISI Impact Factor.
The feasibility of developing and implementing journal usage factors: a research project sponsored by UKSG
ISI’s journal impact factors (IFs), based on citation data, have become generally accepted as a valid measure of the quality of scholarly journals, and are widely used by publishers, authors, funding
Advantages and limitations in the use of impact factor measures for the assessment of research performance
TLDR
The usefulness of the impact factor measures in macro, meso and micro analyses is displayed and the main advantages, such as the great accessibility of impact factor and its ready-to-use nature are pointed out.
An architecture for the aggregation and analysis of scholarly usage data
  • J. Bollen, H. V. D. Sompel
  • Computer Science
    Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '06)
  • 2006
TLDR
A technical, standards-based architecture for sharing usage information is presented, made OAI-PMH harvestable so that usage information exposed by many linking servers can be aggregated to facilitate the creation of value-added services with a reach beyond that of a single community or a single information service.
A practical ontology for the large-scale modeling of scholarly artifacts and their usage
TLDR
This article presents a scholarly ontology that was engineered to represent those classes for which large-scale bibliographic and usage data exists, supports usage research, and whose instantiation is scalable to the order of 50 million articles along with their associated artifacts.
Earlier Web Usage Statistics as Predictors of Later Citation Impact
TLDR
This paper analyses how short-term Web usage impact predicts medium-term citation impact and uses the physics e-print archive -- arXiv.org -- to test this.
The bibliometric properties of article readership information: Research Articles
TLDR
The age biases of both reads and cites are shown and two new bibliometric measures are developed which have substantially less age bias than citations: SumProd, a weighted sum of total citations and the readership rate, intended to show the total productivity of an individual; and Read10, the Readership rate for articles published in the last 10 years, intended for an individual's current productivity.
Sense and nonsense about the impact factor.
  • T. Opthof
  • Education
    Cardiovascular research
  • 1997
The bibliometric properties of article readership information
TLDR
The read–cite diagram is introduced to provide a two-dimensional view of an individual's scientific productivity and it is found that the citation function is proportional to the sum of two of the components of the readership function, proving that the normative theory of citation is true in the mean.
...
...