MESUR: usage-based metrics of scholarly impact

@inproceedings{Bollen2007MESURUM,
  title={MESUR: usage-based metrics of scholarly impact},
  author={Johan Bollen and Michael A. Rodriguez and Herbert Van de Sompel},
  booktitle={JCDL '07},
  year={2007}
}
The evaluation of scholarly communication items is now largely a matter of expert opinion or metrics derived from citation data. Both approaches can fail to take into account the myriad of factors that shape scholarly impact. Usage data has emerged as a promising complement to existing methods o fassessment but the formal groundwork to reliably and validly apply usage-based metrics of schlolarly impact is lacking. The Andrew W. Mellon Foundation funded MESUR project constitutes a systematic… Expand

Figures, Tables, and Topics from this paper

De Profundis: A Decade of Bibliometric Services Under Scrutiny
Giving kudos to bibliometric legend Henk Moed is most appropriately achieved by putting his evaluative concepts and approaches into action. The Department for Bibliometrics and Publication StrategiesExpand
Item-level usage statistics: A review of current practices and recommendations for normalization and exchange
TLDR
How the JISC Usage Statistics Review Project aims to formulate a fundamental scheme for recording usage data and to propose a standard for its aggregation to provide meaningful and comparable item‐level usage statistics for electronic documents such as, for example, research papers and scientific resources is presented. Expand
Towards a Scientific Impact Measuring Framework for Large Computing Facilities - a Case Study on XSEDE
TLDR
This work carries out an extensive statistical analysis correlating XSEDE allocation size to the impact metrics aggregated by project and field of science, and provides insight regarding maximizing the return on investment in terms of allocation by taking into account the field ofScience or project based impact metrics. Expand
Evaluating the Scientific Impact of XSEDE
TLDR
The dataset and data soruces involved and how the same approaches could be used to evaluate publications from a similar organization or institute are explained, to demonstrate the general applicability of the present evaluation approach providing impact even beyond XSEDE. Expand
Enhancing Citation Context based Information Services through Sentence Context Identification
TLDR
An annotation scheme that defines context types for sentences in scientific articles and developed a contextual model of sentence context types in scientific article, and developed various applications for providing citation context based information services. Expand
#Psychology: a bibliometric analysis of psychological literature in the online media
TLDR
The relationship between traditional metrics and alternative metrics for psychological research in the years from 2010 to 2012 are explored and a new metric, the Score Factor, is proposed as a useful alternative metric to assess a journal’s impact in the online media. Expand
Faculty Performance Evaluation Using Citation Analysis
This article provides a citation analysis for faculty from Association of Collegiate Schools of Planning (ACSP) member schools. The article argues that Google Scholar data is a particularly valuableExpand
Visualization of Co-Readership Patterns from an Online Reference Management System
TLDR
The adequacy and applicability of readership statistics recorded in social reference management systems for creating knowledge domain visualizations, and co-readership patterns to map the field of educational technology, are analyzed. Expand
An informetrics study of the cited references in archival research in sub-Saharan Africa: A measure of the archival researchers' preferences?
The purpose of this paper was to investigate the application of informetrics to determine authors' preferences for specific sources of information when conducting their research, as well as to findExpand
Harnessing user library statistics for research evaluation and knowledge domain visualization
TLDR
It is found that there is a significant relationship between the impact factor and the occurrence of references in libraries and a knowledge domain visualization based on co-occurrence measures is able to identify two areas of topics within the emerging field of technology-enhanced learning. Expand
...
1
2
3
4
...

References

SHOWING 1-10 OF 49 REFERENCES
Usage Impact Factor: the effects of sample characteristics on usage-based impact metrics
TLDR
This work defines a journal Usage Impact Factor which mimics the definition of the Thomson Scientific's ISI Impact Factor and results indicate that impact as derived from California State University usage reflects the particular scientific and demographic characteristics of its communities. Expand
Mapping the structure of science through usage
TLDR
Results indicate that meaningful maps of the interests of a local scientific community can be derived from usage data, and a comparison to maps resulting from the analysis of 2003 Thomson ISI Journal Citation Report data reveals interesting differences between the features of local usage and global citation data. Expand
Journal status
TLDR
The Y-factor is introduced which is a simple combination of both the ISI IF and the weighted PageRank, and it is found that the resulting journal rankings correspond well to a general understanding of journal status. Expand
A practical ontology for the large-scale modeling of scholarly artifacts and their usage
TLDR
This article presents a scholarly ontology that was engineered to represent those classes for which large-scale bibliographic and usage data exists, supports usage research, and whose instantiation is scalable to the order of 50 million articles along with their associated artifacts. Expand
Toward alternative metrics of journal impact: A comparison of download and citation data
TLDR
Although social network metrics and ISI IF rankings deviate moderately for citation-based journal networks, they differ considerably for journal networks derived from download data, which raises questions regarding the validity of the ISI IF as the sole assessment of journal impact. Expand
An architecture for the aggregation and analysis of scholarly usage data
  • J. Bollen, H. V. D. Sompel
  • Computer Science
  • Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '06)
  • 2006
TLDR
A technical, standards-based architecture for sharing usage information is presented, made OAI-PMH harvestable so that usage information exposed by many linking servers can be aggregated to facilitate the creation of value-added services with a reach beyond that of a single community or a single information service. Expand
Advantages and limitations in the use of impact factor measures for the assessment of research performance
TLDR
The usefulness of the impact factor measures in macro, meso and micro analyses is displayed and the main advantages, such as the great accessibility of impact factor and its ready-to-use nature are pointed out. Expand
Can scientific journals be classified in terms of aggregated journal-journal citation relations using the Journal Citation Reports?
  • L. Leydesdorff
  • Computer Science, Physics
  • J. Assoc. Inf. Sci. Technol.
  • 2006
TLDR
The aggregated citation relations among journals included in the Science Citation Index provide us with a huge matrix which can be analyzed in various ways and the factor-analytic solutions allow us to test classifications against the structures contained in the database. Expand
Earlier Web Usage Statistics as Predictors of Later Citation Impact
TLDR
This paper analyses how short-term Web usage impact predicts medium-term citation impact and uses the physics e-print archive -- arXiv.org -- to test this. Expand
Reading factor: a new bibliometric criterion for managing digital libraries.
TLDR
A way to measure the electronic consultation rate, termed the reading factor (RF), in direct correlation to the impact factor, is described, a direct measurement of journal use that is related to both clinical medicine and library or information science. Expand
...
1
2
3
4
5
...