The weakening relationship between the impact factor and papers' citations in the digital age

@article{Lozano2012TheWR,
  title={The weakening relationship between the impact factor and papers' citations in the digital age},
  author={George A. Lozano and Vincent Larivi{\`e}re and Yves Gingras},
  journal={ArXiv},
  year={2012},
  volume={abs/1205.4328}
}
Historically, papers have been physically bound to the journal in which they were published; but in the digital age papers are available individually, no longer tied to their respective journals. Hence, papers now can be read and cited based on their own merits, independently of the journal's physical availability, reputation, or impact factor (IF). We compare the strength of the relationship between journals' IFs and the actual citations received by their respective papers from 1902 to 2009… 

Figures from this paper

Is the Relationship between the Impact Factor and Papers' Citations Really Weakening?
TLDR
The results show that either from the overall or research field perspective, there is no obvious clue to indicate the weakening relationship between IF and papers’ citations.
Are elite journals declining?
TLDR
This article examines citation patterns during the past 40 years of seven long‐standing traditionally elite journals and six journals that have been increasing in importanceDuring the past 20 years, whether this diversification has also affected the handful of elite journals that are traditionally considered to be the best.
Scientific journals still matter in the era of academic search engines and preprint archives
TLDR
It is shown that prior estimates of the effect of journal reputation on an individual article's impact are likely inflated, and an innovative proxy for individual article quality is presented: the number of citations to preprints posted on arXiv.org.
Decision letter for "Inferring the causal effect of journals on citations"
Articles in high-impact journals are by definition more highly cited on average. But are they cited more often because the articles are somehow “better”? Or are they cited more often simply because
Inferring the causal effect of journals on citations
  • V. Traag
  • Business
    Quantitative Science Studies
  • 2021
TLDR
This work compares citations of preprints to citations of the published version to infer the causal effect of journals on citations, and finds that high-impact journals select articles that tend to attract more citations and augment the citation rate of published articles.
The Scientific Impact of Nations: Journal Placement and Citation Performance
TLDR
An extreme asymmetry between the opinions of a few reviewers and the degree to which paper acceptance and citation rates influence career advancement is revealed, meaning that, in most cases, citation proportion can be predicted by Journal Placement alone.
Success factors of academic journals in the digital age
Since the early 1990s, when digitalisation began to open new opportunities for disseminating information, many academic journals started to introduce online services. However, while some studies
Weak Relations among the Impact Factors, Number of Citations, References and Authors
TLDR
Relations among impact factors, references, citations and authors are studied based on the data collected in the field of field mechanics and it has been observed that the strength of the relations between references and citations, and impact factors and citations are very weak.
...
...

References

SHOWING 1-10 OF 21 REFERENCES
The impact factor's Matthew Effect: A natural experiment in bibliometrics
TLDR
This paper shows that the journal in which papers are published have a strong influence on their citation rates, as duplicate papers published in high impact journals obtain, on average, twice as much citations as their identical counterparts published in journals with lower impact factors.
The decline in the concentration of citations, 1900-2007
TLDR
Changes in the concentration of citations received by papers published between 1900 and 2005 are analyzed and show that, contrary to what was reported by Evans, the dispersion of citations is actually increasing.
Improving the accuracy of Institute for Scientific Information's journal impact factors
TLDR
Evidence is presented that for a considerable number of journals the values of the impact factors published in ISI's Journal Citation Reports (JCR) are inaccurate, particularly for several journals having a high impact factor.
Measuring contextual citation impact of scientific journals
  • H. Moed
  • Computer Science
    J. Informetrics
  • 2010
Citation rates and impact factors: should they matter?
  • G. Whitehouse
  • Computer Science
    The British journal of radiology
  • 2001
TLDR
While the intent was to provide an objective method for quantifying published research output, the intent of citation rates and journal impact factors has not always been understood, and reactions range from over-reliance to cynical distrust.
CHARACTERISTICS OF HIGHLY CITED PAPERS
TLDR
The findings can be explained by introducing a conceptual distinction between quality dynamics and visibility dynamics, and different types of citation curves can be identified, reflecting possible differences in the cognitive function of the articles.
Integrated Impact Indicators (I3) compared with Impact Factors (IFs): An alternative research design with policy implications
TLDR
I3 is compared with IFs for the journals in two Institute for Scientific Information subject categories (“Information Science & Library Science” and “Multidisciplinary Sciences”), and the library and information science set is additionally decomposed in terms of nations.
Lifting the crown - citation z-score
Why the impact factor of journals should not be used for evaluating research
TLDR
Alternative methods for evaluating research are being sought, such as citation rates and journal impact factors, which seem to be quantitative and objective indicators directly related to published science.
Revisiting the Journal Impact Factor
In 1955, Eugene Garfield proposed “a bibliographic system for science literature that can eliminate the uncritical citation of fraudulent, incomplete, or obsolete data by making it possible for the
...
...