Corpus ID: 17133537

Challenges in Ranking of Universities

@inproceedings{Raan2005ChallengesIR,
  title={Challenges in Ranking of Universities},
  author={A. Raan and S. Mossa and M. Barthelemy and H. Stanley and L. Amaral},
  year={2005}
}
In this paper we discuss recent developments in rankings of universities and the impact of these rankings on academia in the context of international benchmarking and evaluation. We focus on technical and methodological problems behind these rankings, particularly those based on bibliometric methods, with special attention to the social sciences and humanities. We criticize the recent expert-based rankings by showing that the correlation of expert score and bibliometric outcomes is practically… Expand

Figures from this paper

Transparency of University Rankings in the Effective Management of University
University rankings are extremely important not only for future student, but also for universities themselves. They have a large impact on the institutions of higher education. A lot of universitiesExpand
Global University Ranking System: A New Approach by Combining Academic Performance and Web-Based Indicators using Clustering
TLDR
A combined academic and web performance evaluation and global ranking system has been developed and implemented using data mining based on data from non-subjective, reliable and universally accepted online sources. Expand
Asian top universities in six world university ranking systems
TLDR
The similarities and status of top Asian universities in the list of top 200 universities by these world ranking systems are studied, and some suggestions are made to improve the benefits of the ranking systems in order to promote the situation of higher education in the world. Expand
Should you believe in the Shanghai ranking?
TLDR
The view is that the Shanghai ranking, in spite of the media coverage it receives, does not qualify as a useful and pertinent tool to discuss the “quality” of academic institutions, let alone to guide the choice of students and family or to promote reforms of higher education systems. Expand
Benchmarking Jiangsu University to Improve Its Academic Ranking
This paper collates research on global ranking through U.S.News.com in relation to Jiangsu University’s non-appearance in global ranking of higher education institutions. The author critiques theExpand
Uncovering Excellence in Academic Rankings A case study on the Shanghai Ranking ∗
In this paper we examine whether the quality of academic research can be accurately captured by a single aggregated measure such as a ranking. With Shanghai University’s Academic Ranking of WorldExpand
Should you believe in the Shanghai ranking? An NCDM view
This paper proposes a critical analysis of the “Academic Ranking of World Universities”, published every year by the Institute of Higher Education of the Jiao Tong University in Shanghai and moreExpand
What do global university rankings really measure? The search for the X factor and the X entity
TLDR
Results support the existence of an underlying entity profile, characterized by institutions normally from the US that enjoy a high reputation in the ARWU and Times Higher Education rankings, and support the idea that rankings lack the capacity to assess university quality in all its complexity. Expand
Higher education rankings : robustness issues and critical assessment : how much confidence can we have in higher education rankings?
University rankings are very appealing, in that they provide one with a single number that allows one, at a glance, to situate a given university in the worldwide context. However, this veryExpand
ickety numbers : Volatility of university rankings and policy implications
The most popular world university rankings are routinely taken at face value by media and social actors. While these rankings are politically influential, they are sensitive to both the conceptualExpand
...
1
2
3
4
...

References

SHOWING 1-10 OF 59 REFERENCES
Impact of bibliometrics upon the science system: Inadvertent consequences?
  • P. Weingart
  • Sociology, Computer Science
  • Scientometrics
  • 2005
TLDR
The core of the problem lies not necessarily at the side of the data producer, but part of the broader problem of the application of insufficiently developed bibliometric indicators used by persons who do not have clear competence and experience in the field of quantitative studies of science. Expand
Advanced bibliometric methods as quantitative core of peer review based evaluation and foresight exercises
  • A. Raan
  • Computer Science
  • Scientometrics
  • 2005
TLDR
An overview of the potentials and limitations of bibliometric methods for the assessment of strengths and weaknesses in research performance, and for monitoring scientific developments, and how both approaches can be combined to a broader and powerful methodology to observe scientific advancement and the role of actors. Expand
Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference?
TLDR
A citation-based "systems approach" for analyzing the various institutional and cognitive dimensions of scientific excellence within national research systems, focusing on the most highly cited research papers in the international journal literature, indicates that these high performance papers provide a useful analytical framework. Expand
COMPARATIVE ANALYSIS OF A SET OF BIBLIOMETRIC INDICATORS AND CENTRAL PEER REVIEW CRITERIA. EVALUATION OF CONDENSED MATTER PHYSICS IN THE NETHERLANDS
Abstract In this paper first results are presented of a study on the correlation between bibliometric indicators and the outcomes of peer judgements made by expert committees of physics in theExpand
THE VALIDITY AND RELIABILITY OF EVALUATION OF SCHOLARLY PERFORMANCE
Summary A survey is given of the merits of the contributions of peer review and bibliometric methods to evaluation in science. First, the role of evaluation in the scientific process is outlined,Expand
Publication ratings versus peer ratings of universities
TLDR
It is shown that the ratings of departments within a university are not independent, and that these dependencies are associated with the bibliometric size of the university, as well as the extent to which a university's prestige in one department correlates with the assessment of other departments within that university. Expand
Measuring Science: Capita Selecta of Current Main Issues
After a review of developments in the quantitative study of science, particularly since the early 1970s, I focus on two current main lines of 'measuring science' based on bibliometric analysis. WithExpand
Statistical properties of bibliometric indicators: Research group indicator distributions and correlations
  • A. Raan
  • Computer Science
  • J. Assoc. Inf. Sci. Technol.
  • 2006
TLDR
An empirical approach to the study of the statistical properties of bibliometric indicators on a very relevant but not simply ‘available’ aggregation level: the research group finds that at the level of research groups the distribution functions of the main indicators, particularly the journal- normalized and the field-normalized indicators are approaching normal distributions. Expand
International alignment and scientific regard as macro-indicators for international comparisons of publications
TLDR
Time series of these indicators for the nineties show a considerable impact of the German unification with a recent trend towards an adaptation of publication behaviour in East Germany towards the Western patterns. Expand
Language biases in the coverage of the Science Citation Index and its consequencesfor international comparisons of national research performance
TLDR
The authors conclude that the value of impact indicators of research activities at the level of an institution or a country strongly depend upon whether one includes research publications in SCI covered journals written in other languages than in English. Expand
...
1
2
3
4
5
...