• Corpus ID: 30629487

Citation analysis cannot legitimate the strategic selection of excellence

  title={Citation analysis cannot legitimate the strategic selection of excellence},
  author={Tobias Opthof and Loet Leydesdorff},
In reaction to a previous critique(Opthof & Leydesdorff, 2010), the Center for Science and Technology Studies (CWTS) in Leiden proposed to change their old "crown" indicator in citation analysis into a new one. Waltman et al. (2011)argue that this change does not affect rankings at various aggregated levels. However, CWTS data is not publicly available for testing and criticism. In this correspondence, we use previously published data of Van Raan (2006) to address the pivotal issue of how the… 

Tables from this paper

Turning the tables on citation analysis one more time: Principles for comparing sets of documents
New citation impact indicators based not on arithmetic averages of citations but on percentile ranks are submitted, demonstrating that the proposed family indicators are an improvement on averages-based indicators because one can account for the shape of the distributions of citations over papers.
On the correlation between bibliometric indicators and peer review: reply to Opthof and Leydesdorff
Using a larger amount of data and a more appropriate statistical methodology, a significant correlation between the CPP/FCSm indicator and peer judgment is found.
Differences in citation frequency of clinical and basic science papers in cardiovascular research
  • T. Opthof
  • Physics
    Medical & Biological Engineering & Computing
  • 2011
A critical analysis is performed on differences in citation frequency of basic and clinical cardiovascular papers and it is concluded that none of the existing citation indicators appreciates these differences.
Activités de recherche scientifique et développement économique des territoires.Le cas des sciences de la mer en Bretagne Occidentale : le cas des sciences de la mer en Bretagne Occidentale
La place des activites de recherche scientifique dans les dynamiques economiques, et en particulier leurs liens avec les entreprises et les territoires, ont fait l’objet de nombreuses etudes depuis


Towards a new crown indicator: an empirical analysis
An empirical comparison between two normalization mechanisms for citation-based indicators of research performance aims to normalize citation counts for the field and the year in which a publication was published finds that at high aggregation levels, such as at the level of large research institutions or at thelevel of countries, the differences between the two mechanisms are very small.
Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups
Characteristics of the statistical correlation between the Hirsch (h-) index and several standard bibliometric indicators are presented, as well as with the results of peer review judgment, which show that the h-index and the bibliometry ‘crown indicator’ both relate in a quite comparable way with peer judgments.
Caveats for the Use of Citation Indicators in Research and Journal Evaluations
The assumption that citation and publication practices are homogenous within specialties and fields of science is invalid and the delineation of fields and among specialties is fuzzy.
Informed peer review and uninformed bibliometrics
Recent literature on issues relevant to bibliometric indicator relations and peer review discusses whether bibliometric indicators can predict the success of research grant applications. For example,
Past performance, peer review and project selection: a case study in the social and behavioral sciences
If research councils are not able to select the ‘best’ researchers, perhaps they should reconsider their mission, and the role of research councils in the science system in terms of variation, innovation and quality control is discussed.
Another test of the normative theory of citing
The normative theory of citing predicts that authors should not cite preferentially, that is, while it is clear that authors do not cite all of their influences, it is possible that in the aggregate they cite proportional to use.
Towards a new crown indicator: Some theoretical considerations
Normalization at the field level: fractional counting of citations