On using the Shanghai ranking to assess the research performance of university systems

@article{Docampo2010OnUT,
  title={On using the Shanghai ranking to assess the research performance of university systems},
  author={D. Docampo},
  journal={Scientometrics},
  year={2010},
  volume={86},
  pages={77-92}
}
  • D. Docampo
  • Published 2010
  • Computer Science
  • Scientometrics
We take a new look at the Shanghai Jiao Tong Academic Ranking of World Universities to evaluate the performance of whole university systems. We deal with system aggregates by means of averaging scores taken over a number of institutions from each higher education system according to the Gross Domestic Product of its country. We treat the set of indicators (measures) at the country level as a scale, and investigate its reliability and dimensionality using appropriate statistical tools. After a… Expand
On the internal dynamics of the Shanghai ranking
TLDR
It is proposed that the utility and usability of the ARWU could be greatly improved by replacing the unwanted dynamical effects of the annual re-scaling based on raw scores of the best performers. Expand
Adjusted sum of institutional scores as an indicator of the presence of university systems in the ARWU ranking
  • D. Docampo
  • Economics, Computer Science
  • Scientometrics
  • 2011
TLDR
A new indicator that measures the presence of a higher education system in the Shanghai Jiao Tong Academic Ranking of World Universities (ARWU) is introduced and the benefits and drawbacks associated with the possible choices of the indicator are discussed. Expand
On the effects of institutional size in university classifications: the case of the Shanghai ranking
TLDR
Primary components analysis of data from the Shanghai ranking (2013 edition) is used to explore factors that contribute to the variation of the total score and concludes that around 30 % of the variation in the ARWU indicators can be attributed to variation in size. Expand
Is measuring the knowledge creation of universities possible?: A review of university rankings
University ranking indexes are considered very useful benchmarking tools in comparing the performance of universities around the world. Being placed in these prestigious indexes provides a strongExpand
What do global university rankings really measure? The search for the X factor and the X entity
TLDR
Results support the existence of an underlying entity profile, characterized by institutions normally from the US that enjoy a high reputation in the ARWU and Times Higher Education rankings, and support the idea that rankings lack the capacity to assess university quality in all its complexity. Expand
Asian top universities in six world university ranking systems
TLDR
The similarities and status of top Asian universities in the list of top 200 universities by these world ranking systems are studied, and some suggestions are made to improve the benefits of the ranking systems in order to promote the situation of higher education in the world. Expand
Asian top universities in six world university rankings
There are a variety of ranking systems for universities throughout the different continents of the world. The majority of the world ranking systems have paid special attention toward evaluation ofExpand
Does a Country/Region’s Economic Status Affect Its Universities’ Presence in International Rankings?
Abstract Purpose Study how economic parameters affect positions in the Academic Ranking of World Universities’ top 500 published by the Shanghai Jiao Tong University Graduate School of Education inExpand
A longitudinal analysis of university rankings
TLDR
The study provides evidence of the ambiguous nature of university rankings quantification of university performance, and indicates that the variables used by the rankings might not capture the concepts they claim to measure. Expand
The role of national university rankings in an international context: the case of the I-UGR Rankings of Spanish universities
TLDR
This paper describes the Spanish university system as a study case presenting the I-UGR Rankings for Spanish universities by fields and subfields and concludes that it is advisable to use national rankings in order to complement international rankings, however this must be done with certain caution. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 30 REFERENCES
Should you believe in the Shanghai ranking?
TLDR
The view is that the Shanghai ranking, in spite of the media coverage it receives, does not qualify as a useful and pertinent tool to discuss the “quality” of academic institutions, let alone to guide the choice of students and family or to promote reforms of higher education systems. Expand
Rankings internacionales y calidad de los sistemas universitarios1 International rankings and quality of the university systems
This paper analyzes the position of the European universities, in particular the Spanish academic institutions, in the international context. The analysis is based on the only truly internationalExpand
Uncovering excellence in academic rankings: a closer look at the Shanghai ranking
TLDR
Evidence is found that, for the majority of these institutions, the Shanghai rankings reflect not one but in fact two different and uncorrelated aspects of academic research: overall research output and top-notch researchers. Expand
Irreproducibility of the results of the Shanghai academic ranking of world universities
  • R. Florian
  • Mathematics, Computer Science
  • Scientometrics
  • 2007
TLDR
In the Shanghai ranking, the dependence between the score for the SCI indicator and the weighted number of considered articles obeys a power law, instead of the proportional dependence that is suggested by the official methodology of the ranking. Expand
The Academic Ranking of World Universities.
Shanghai Jiao Tong University1 has published on the Internet an Academic Ranking of World Universities that has attracted worldwide attention. Institutions are ranked according to academic orExpand
1 Academic Ranking of World Universities - Methodologies and Problems
The Institute of Higher Education, Shanghai Jiao Tong University has published on the web the Academic Ranking of World Universities that has attracted wide attentions worldwide. Institutions areExpand
The world-class university and ranking : aiming beyond status
The authors of more than twenty essays, themselves academic leaders and internationally acclaimed researchers on higher education, provide readers with diverse perspectives on the conceptualExpand
Scale Development: Theory and Applications
TLDR
Measurement in the Broader Research Context Before the Scale Development After the Scale Administration Final Thoughts References Index about the Author. Expand
A User's Guide to Principal Components
Applied Multivariate Statistics for the Social Sciences
Nelder 1989 and Dobson 1990), this book presents two speciŽ c generalized linear models before its general discussion of the family of generalized linear models. I wish the authors would give someExpand
...
1
2
3
...