Analysis of bibliometric indicators for individual scholars in a large data set

@article{Radicchi2013AnalysisOB,
  title={Analysis of bibliometric indicators for individual scholars in a large data set},
  author={Filippo Radicchi and Claudio Castellano},
  journal={Scientometrics},
  year={2013},
  volume={97},
  pages={627-637}
}
Citation numbers and other quantities derived from bibliographic databases are becoming standard tools for the assessment of productivity and impact of research activities. Though widely used, still their statistical properties have not been well established so far. This is especially true in the case of bibliometric indicators aimed at the evaluation of individual scholars, because large-scale data sets are typically difficult to be retrieved. Here, we take advantage of a recently introduced… Expand

Figures and Topics from this paper

A two-dimensional bibliometric index reflecting both quality and quantity
TLDR
A comprehensive empirical analysis of this two-dimensional bibliometric index is presented, which captures both aspects of a researcher’s output on two datasets: a large set of Google Scholar profiles (representing “typical” researchers) and a small set of Nobel prize winners. Expand
The h-index is no longer an effective correlate of scientific reputation
TLDR
A large-scale study of scientometric measures, analyzing millions of articles and hundreds of millions of citations across four scientific fields and two data platforms, finds that the correlation of the h-index with awards that indicate recognition by the scientific community has substantially declined. Expand
Quality versus quantity in scientific impact
TLDR
It is shown that the method proposed can capture the quality of the work of Nobel laureates irrespective of number of publications, academic age, and discipline, even when traditional metrics indicate low impact in absolute terms. Expand
On the evolution and utility of annual citation indices
TLDR
The newly introduced annual citation rate factor helps in understanding the effect of scaling the number of citation by the total number of publications, and has an universal feature - it shows a maximum at the rate scaled by half the average. Expand
Big data and false discovery: analyses of bibliometric indicators from large data sets
To the Editor, In their recent paper, Radicchi and Castellano (2013) analyze the scientific profile of more than 30,000 researchers from a large bibliographic data set, namely Google ScholarExpand
A novel bibliometric index with a simple geometric interpretation
TLDR
A comprehensive empirical comparison between the χ-index and other bibliometric indices, focusing on a comparison with the h-index, is presented by analysing two datasets—a large set of Google Scholar profiles and a small set of Nobel prize winners. Expand
Predicting the age of researchers using bibliometric data
TLDR
The year of first publication proves to be the best linear predictor for the age of researchers, and the average models perform significantly better than the models using individual observations, but the high variability of data and the uncertainty inherited by the models advice to caution when using linear regression models. Expand
Multiple Citation Indicators and Their Composite across Scientific Disciplines
TLDR
Multiple citation indicators that address total impact, co-authorship adjustment, and author order may give a more comprehensive picture of impact, although no citation indicator, single or composite, can be expected to select all the best scientists. Expand
The Z-index: A geometric representation of productivity and impact which accounts for information in the entire rank-citation profile
TLDR
It is argued that Z is better suited for ranking comparisons in academic decision-making scenarios comprising a large number of scientists, because Z incorporates information from the entire publication profile while being more robust to local perturbations. Expand
Exploiting citation networks for large-scale author name disambiguation
TLDR
An h-index distribution model is developed, confirming that the prediction is in excellent agreement with the empirical data, and yielding insight into the utility of the h- index in real academic ranking scenarios. Expand
...
1
2
3
4
...

References

SHOWING 1-10 OF 64 REFERENCES
Google Scholar as a new source for citation analysis
TLDR
It is argued that these metrics provide additional advantages over the JIF and that the free availability of GS allows for a democratization of citation analysis as it provides every academic access to citation data regardless of their institution's financial means. Expand
A Reverse Engineering Approach to the Suppression of Citation Biases Reveals Universal Properties of Citation Distributions
TLDR
An exhaustive study of the citation patterns of millions of papers is performed, and it is found that a simple transformation of citation counts able to suppress the disproportionate citation counts among scientific domains is derived. Expand
Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups
  • A. Raan
  • Computer Science, Physics
  • Scientometrics
  • 2013
TLDR
Characteristics of the statistical correlation between the Hirsch (h-) index and several standard bibliometric indicators are presented, as well as with the results of peer review judgment, which show that the h-index and the bibliometry ‘crown indicator’ both relate in a quite comparable way with peer judgments. Expand
Statistical analysis of the Hirsch Index
TLDR
This work provides general properties for the empirical h-index under the small- and large- sample settings and introduces consistent non-parametric variance estimation, which allows for the implementation of large-sample set estimation for the theoretical h- index. Expand
Impact of data sources on citation counts and rankings of LIS faculty: Web of science versus scopus and google scholar
TLDR
Results show that Scopus significantly alters the relative ranking of those scholars that appear in the middle of the rankings and that GS stands out in its coverage of conference proceedings as well as international, non-English language journals. Expand
The meaning of the h-index
The h-index originates from the assumption that the number of citations received by a scientist is a better indicator of the relevance of his or her work than the number of papers he or she publishesExpand
Effectiveness of Journal Ranking Schemes as a Tool for Locating Information
TLDR
This work systematically evaluates the effectiveness of journals, through the work of editors and reviewers, at evaluating unpublished research, and develops a model for the asymptotic number of citations accrued by papers published in a journal that closely matches the data. Expand
Methods for measuring the citations and productivity of scientists across time and discipline.
TLDR
Normalize publication metrics in order to achieve a universal framework for analyzing and comparing scientific achievement across both time and discipline, and uncovers quantifiable statistical regularity in the probability density function of scientific achievement in all journals analyzed. Expand
Statistical regularities in the rank-citation profile of scientists
TLDR
The results demonstrate the utility of the βi scaling parameter in conjunction with hi for quantifying individual publication impact and show that the total number of citations Ci tallied from a scientist's Ni papers scales as . Expand
Statistical validation of a global model for the distribution of the ultimate number of citations accrued by papers published in a scientific journal
TLDR
A large-scale empirical analysis of journals from every field in Thomson Reuters' Web of Science database suggests that the discrete lognormal distribution is a globally accurate model for the distribution of “eventual impact” of scientific papers published in single-discipline journal in a single year that is removed sufficiently from the present date. Expand
...
1
2
3
4
5
...