A Principal Component Analysis of 39 Scientific Impact Measures

@article{Bollen2009APC,
  title={A Principal Component Analysis of 39 Scientific Impact Measures},
  author={Johan Bollen and Herbert Van de Sompel and Aric A. Hagberg and Ryan Chute},
  journal={PLoS ONE},
  year={2009},
  volume={4}
}
Background The impact of scientific publications has traditionally been expressed in terms of citation counts. However, scientific activity has moved online over the past decade. To better capture scientific impact in the digital era, a variety of new impact measures has been proposed on the basis of social network analysis and usage log data. Here we investigate how these new measures relate to each other, and how accurately and completely they express scientific impact. Methodology We… 
View on PubMed
journals.plos.org
501 Citations
Highly Influential Citations
27
Background Citations
177
Methods Citations
45
Results Citations
12

Figures and Tables from this paper

501 Citations

The Citation Wake of Publications Detects Nobel Laureates' Papers
TLDR
A simple measure based on the shortest-paths in the paper's in-component or, simply speaking, on the shape and size of the wake of a paper within the citation network to detect seminal articles which have introduced concepts of obvious importance to the further development of physics.
The Individual Impact Index ($i^3$) Statistic: A Novel Article-Level Citation Metric
TLDR
The 'Individual Impact Index Statistic', or $i^3$ for short, is a weighted algorithm that takes advantage of the peer-review process, and considers a number of characteristics of individual scientific publications in order to yield a standardized and readily comparable measure of impact and dissemination.
Scientific Literature and Evaluation Metrics: Impact Factor, Usage Metrics, and Altmetrics
  • M. Kavic, R. Satava
  • Education
    JSLS : Journal of the Society of Laparoendoscopic Surgeons
  • 2021
Evaluating the quality of a scientific article has proven to be an elusive task. The most widely used bibliometric value currently used for this purpose, the journal impact factor, was not originally…
Scholarly impact assessment: a survey of citation weighting solutions
TLDR
This paper summarizes the existing classical indicators and weighting methods used in measuring scholarly impact from the perspectives of articles, authors and journals and discusses the open issues to try to discover the hidden trends of citation weighting.
Bibliometric indices for the assessment of the citation curve tail
TLDR
A correlation analysis is carried out to reveal which metrics are describing the 'influentials vs. mass producers' phenomenon in a similar way and, thus, retain the most descriptive features.
Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level
TLDR
An improved method is described that makes novel use of the co-citation network of each article to field-normalize the number of citations it has received, and provides an alternative to the invalid practice of using Journal Impact Factors to identify influential papers.
The Journal Impact Factor: Moving Toward an Alternative and Combined Scientometric Approach
TLDR
Scopus-based publication activity on the Journal Impact Factor is analyzed and some of the numerous misuses of the JIF are overviewed, global initiatives to overcome the ‘obsession’ with impact factors, and emerging strategies to revise the concept of the scholarly impact are suggested.
Measuring researcher independence using bibliometric data: A proposal for a new performance indicator
TLDR
This work proposes indicators to measure different aspects of independence: two assessing whether a researcher has developed an own collaboration network and two others assessing the level of thematic independence, taken together they form an independence indicator.
Large-scale assessment of research outputs through a weighted combination of bibliometric indicators
TLDR
A method to combine the information on the number of citations and the relevance of the publishing journal (as measured by the Impact Factor or similar impact indicators) of a publication to rank it with respect to the world scientific production in the specific subfield is described.
Measuring academic influence: Not all citations are equal
TLDR
The hip‐index, a model for predicting academic influence that achieves good performance on this data set using only four features, was found, among those evaluated, those based on the number of times a reference is mentioned in the body of a citing paper.
...
...

References

SHOWING 1-10 OF 44 REFERENCES
Usage Impact Factor: the effects of sample characteristics on usage-based impact metrics
TLDR
It is observed that as the number of graduate students and faculty increases in a particular discipline, Usage Impact Factor rankings will converge more strongly with the ISI Impact Factor.
Visualization of the citation impact environments of scientific journals: An online mapping exercise
TLDR
Aggregated journal–journal citation networks based on the Journal Citation Reports 2004 of the Science Citation Index and the Social science Citation Index are made accessible from the perspective of any of these journals.
Mathematical relations between impact factors and average number of citations
  • L. Egghe
  • Mathematics
    Inf. Process. Manag.
  • 1988
Why the impact factor of journals should not be used for evaluating research
TLDR
Alternative methods for evaluating research are being sought, such as citation rates and journal impact factors, which seem to be quantitative and objective indicators directly related to published science.
Advantages and limitations in the use of impact factor measures for the assessment of research performance
TLDR
The usefulness of the impact factor measures in macro, meso and micro analyses is displayed and the main advantages, such as the great accessibility of impact factor and its ready-to-use nature are pointed out.
ISI's Impact Factor as Misnomer: A Proposed New Measure to Assess Journal Impact
The purpose of this communication is to discuss a widely used measure of journal impact that is defined by the Institute of Scientific Information (ISI) and available for thousands of journals in the…
The feasibility of developing and implementing journal usage factors: a research project sponsored by UKSG
ISI’s journal impact factors (IFs), based on citation data, have become generally accepted as a valid measure of the quality of scholarly journals, and are widely used by publishers, authors, funding…
Earlier Web Usage Statistics as Predictors of Later Citation Impact
TLDR
This paper analyses how short-term Web usage impact predicts medium-term citation impact and uses the physics e-print archive -- arXiv.org -- to test this.
Sense and nonsense about the impact factor.
  • T. Opthof
  • Education
    Cardiovascular research
  • 1997
Journal status
TLDR
The Y-factor is introduced which is a simple combination of both the ISI IF and the weighted PageRank, and it is found that the resulting journal rankings correspond well to a general understanding of journal status.
...
...