on the use and abuse of bibliometric performance indicators: a critique of Hix's ‘global ranking of political science departments’

  title={on the use and abuse of bibliometric performance indicators: a critique of Hix's ‘global ranking of political science departments’},
  author={Roland Erne},
  journal={European Political Science},
  • R. Erne
  • Published 2 August 2007
  • Education
  • European Political Science
Bibliometric measures, as provided by the Social Science Citation Index of the Institute for Scientific Information, certainly represent a useful tool for librarians and researchers. However, although librarian scientists have shown that the use of journal impact factors to evaluate the performance of academics is misleading, some authors continue to promote bibliometric metrics to assess the productivity of academic departments and even the entire European academic community. Taking an… 
Publishing in Public Administration: Issues with Defining, Comparing, and Ranking the Output of Universities
ABSTRACT The measurement and comparison of the public administration output of universities is an important means for mapping the state of the field. However, such exercises are very sensitive to
Publishing in Public Administration: Issues with Defining, Comparing and Ranking the Output of Universities
ABSTRACTThe measurement and comparison of the public administration output of universities is an important means for mapping the state of the field. However, such exercises are very sensitive to
On the Use of Bibliometrics for Domain Analysis : A study of the Academic Field of Political Science in Europe
The academic field of political science in Europe is studied in this thesis which examines the application of bibliometrics for domain analysis. It takes its point of departure in the domain analytic
Global Disciplinary Rankings and Images of Quality: The Case of Political Science
In his book Academic Tribes and Territories, Tony Becher describes how one of the continuing features of academic life is that almost everything is graded in more or less subtle ways. Scholars are
Journal Publications from Politics Departments in Ireland 2003–2007: An Update Using the Hix Method
This article uses the method devised by Simon Hix to rank the research performance of political science departments on the basis of publications in high-quality journals. We replicate Hix's
A scientometric assessment of the Southern Africa Development Community: science in the tip of Africa
It is expressed concern that the current research infrastructures are inadequate to assist in reaching the objectives developed in the Regional Indicative Strategic Development Plan of the Community.
Evaluation complacency or evaluation inertia? A study of evaluative metrics and research practices in Irish universities
Evaluative metrics have been used for research assessment in most universities and funding agencies with the assumption that more publications and higher citation counts imply increased
The Strange Case of Matthew Effect and Beauty Contest: Research Evaluation and Specialisation in the Italian Universities
The paper aims to examine whether the distribution of funds that prizes relatively more the most performing institutions has the effect of replicating the Matthew effect within them in terms of
Research emphasis and collaboration in Africa
It is indicated that the continent’s research emphasises medical and natural resources disciplines to the detriment of disciplines supporting knowledge based economies and societies and the scientific disciplines emphasised.


Trends in the Usage of ISI Bibliometric Data: Uses, Abuses, and Implications
The history of the development of impact factors is highlighted, the limitations in their use are described, and a critique of the usage ofimpact factors in academic settings is provided.
A Global Ranking of Political Science Departments
Rankings of academic institutions are key information tools for universities, funding agencies, students and faculty. The main method for ranking departments in political science, through peer
Why the impact factor of journals should not be used for evaluating research
Alternative methods for evaluating research are being sought, such as citation rates and journal impact factors, which seem to be quantitative and objective indicators directly related to published science.
The use and misuse of citation analysis in research evaluation
The present paper examines different facets of citations and citation analysis, and discusses the validity of citation analysis as a useful measure of research impact/quality.
european universities in a global ranking of political science departments: a reply to bull and espíndola
I would like to thank Markus Haverland, Martin Bull and Roberto Espindola as well as the numerous other people who have corresponded with me about my recent article in European Political Science and
Researchers" and users" perceptions of the relative standing of biomedical papers in different journals
Journal citation impact factors, which are frequently used as a surrogate measure of research quality, do not correlate well with UK researchers" subjective views of the relative importance of
Doing institutional analysis: implications for the study of innovations
The study of institutions and innovativeness is presently high on the agenda of the social sciences. There is increasing concern with how a society's innovativeness is associated with its
Neo-Liberalism and Marketisation: The Implications for Higher Education
This article is based on a keynote paper presented to the European Conference on Educational Research (ECER), University College Dublin, 5–9 September 2005. The massification of education in European
Benchmarking in universities: league tables revisited
This paper examines the practice of benchmarking universities using a ‘league table’ approach. Taking the example of the Sunday Times University League Table, the author re‐analyses the descriptive