The h-index is no longer an effective correlate of scientific reputation

@article{Koltun2021TheHI,
  title={The h-index is no longer an effective correlate of scientific reputation},
  author={Vladlen Koltun and David Hafner},
  journal={PLoS ONE},
  year={2021},
  volume={16}
}
The impact of individual scientists is commonly quantified using citation-based measures. The most common such measure is the h-index. A scientist’s h-index affects hiring, promotion, and funding decisions, and thus shapes the progress of science. Here we report a large-scale study of scientometric measures, analyzing millions of articles and hundreds of millions of citations across four scientific fields and two data platforms. We find that the correlation of the h-index with awards that… 

Figures from this paper

A Measure of Research Taste

TLDR
The presented measure, CAP, balances the impact of publications and their quantity, thus incentivizing researchers to consider whether a publication is a useful addition to the literature, and is simple, interpretable, and parameter-free.

The u-index: a simple metric to objectively measure academic impact of individual researchers

This short paper introduces the u-index (“unique-index”), a simple but robust metric to evaluate the impact and relevance of academic research output, as a possible alternative to common metrics such

Metrics and methods in the evaluation of prestige bias in peer review: A case study in computer systems conferences

The integrity of peer review is essential for modern science. Numerous studies have therefore focused on identifying, quantifying, and mitigating biases in peer review. One of these better-known

Measuring the impact of co-author count on citation count of research publications

Practically, co-authored research work reaches higher visibility and impact as compared to the individual published work. The objective of this study is to analyze the correlation between the number

Metrics to evaluate implementation scientists in the USA: what matters most?

Implementation science has grown rapidly as a discipline over the past two decades. An examination of how publication patterns and other scholarly activities of implementation scientists are weighted

Fractal dimension analogous scale-invariant derivative of Hirsch’s index

TLDR
This work applied a scale-invariant derivative of the h- index as “ h -dimension” to data of 134 Japanese national universities and research institutes, and found well-performing medium-sized research institute, where they identified multiple organizations related to natural disasters.

Acta Physiologica, member of the top 5% club

All in science agree that the impact factor was designed for librarians to narrow down the plethora of journals to those most important.1 The impact factor says next to nothing about individual

The link between countries’ economic and scientific wealth has a complex dependence on technological activity and research policy

TLDR
It is discussed how technological activity may decrease the P top 10% /P ratio while only slightly affecting the capacity to create fundamental new knowledge; in such countries, many papers may report incremental innovations that do not drive the advancement of knowledge.

Evaluation of Issues Affecting Time Between Study Completion, Manuscript Submission, Acceptance, and Publication in Medical Journals

TLDR
Though PubMed indexed journals with a greater number of editors and high fees are slower to publish articles but they are a safe option for researchers, the impact factor does not effect the speed of publication for non-predatory journals.

The Author-Level Metrics Study: An Analysis of the Traditional and Alternative Metrics of Scholarly Impact for Neurosurgical Authors

TLDR
A composite author-level matrix with AHi, RG score, Research Interest score, and the number of RG followers could be used to generate an "Impact Matrix" to describe the scholarly and real-world impact of a clinician’s work.

References

SHOWING 1-10 OF 62 REFERENCES

Analysis of bibliometric indicators for individual scholars in a large data set

TLDR
This work analyzes the scientific profile of more than 30,000 researchers, and finds that the h-index of a scientist is strongly correlated with the number of citations that she/he has received so that theNumber of citations can be effectively be used as a proxy of theh-index.

The w-index: A measure to assess scientific impact by focusing on widely cited papers

  • Qiang Wu
  • Physics
    J. Assoc. Inf. Sci. Technol.
  • 2010
TLDR
The results demonstrate that there are noticeable differences between the w-index and the h-index, which can be measured by comparing the ranks of 20 astrophysicists, a few famous physical scientists, and 16 Price medalists.

The stability of the h-index

TLDR
It is shown that although the ranking of the h-index is stable under most of these changes, it is unstable when different databases are used and comparisons should only be trusted when the rankings of multiple citation databases agree.

Comparison of researchers’ impact indices

TLDR
Results show that there is a low correlation of these indices with h-index, and in identifying exceptional performers of a field these indices perform better than h- index.

Multiple Citation Indicators and Their Composite across Scientific Disciplines

TLDR
Multiple citation indicators that address total impact, co-authorship adjustment, and author order may give a more comprehensive picture of impact, although no citation indicator, single or composite, can be expected to select all the best scientists.

The measure of research merit

TLDR
Current assessment is largely based on counting publications, counting citations, taking note of the impact factor of the journals where researchers publish, and derivatives of these such as the h-index, but it is time to develop more appropriate measures and to use the scientific method itself to help in this endeavor.

The influence of self‐citation corrections and the fractionalised counting of multi‐authored manuscripts on the Hirsch index

The Hirsch index or h‐index is widely used to quantify the impact of an individual's scientific research output, determining the highest number h of a scientist's papers that received at least h

Is it possible to compare researchers with different scientific interests?

TLDR
This work has obtained the rank plots of h and h I for four Brazilian scientific communities and found the h I index rank plots collapse into a single curve allowing comparison among different research areas.

Universality of citation distributions: Toward an objective measure of scientific impact

TLDR
It is shown that the probability that an article is cited c times has large variations between different disciplines, but all distributions are rescaled on a universal curve when the relative indicator cf = c/c0 is considered, where c0 is the average number of citations per article for the discipline.

A new Hirsch-type index saves time and works equally well as the original h-index

TLDR
The h- index is more suitable for assessment of mature scientists who have published at least 50 papers and have h-indexes of at least 10, and a new Hirsch-type index saves time and works equally well as the original h index.
...