Reproducibility of the Shanghai academic ranking of world universities results

@article{Docampo2012ReproducibilityOT,
  title={Reproducibility of the Shanghai academic ranking of world universities results},
  author={Domingo Docampo},
  journal={Scientometrics},
  year={2012},
  volume={94},
  pages={567-587}
}
  • D. Docampo
  • Published 1 February 2013
  • Education
  • Scientometrics
This paper discusses and copes with the difficulties that arise when trying to reproduce the results of the Shanghai academic ranking of world universities. In spite of the ambiguity of the methodology of the ranking with regard to the computation of the scores on its six indicators, the paper presents a set of straightforward procedures to estimate raw results and final relative scores. Discrepancies between estimated scores and the results of the ranking are mostly associated with the… 
Questioning the Shanghai Ranking methodology as a tool for the evaluation of universities: an integrative review
This integrative review reports on methodological questions about the Shanghai Ranking as a tool for the evaluation of universities, questions that are extensible to other rankings. The paper
Modelo de estimación de los indicadores del Academic Ranking of World Universities (Shanghai Ranking)
The interest in global university rankings has grown significantly in the last 10 years. The use of just a handful of indicators, the ease of interpretation of the information they contain and the
An anatomy of the academic ranking of world universities (Shanghai ranking)
International academic rankings of research universities are widely applied and heavily criticised. Amongst the many international rankings, the Shanghai ranking has been particularly influential.
Reputation and rankings
Over the last decade global rankings of universities have begun to grow in importance allowing national and international comparison of higher education institutions. In fact, they are already at the
On the internal dynamics of the Shanghai ranking
TLDR
It is proposed that the utility and usability of the ARWU could be greatly improved by replacing the unwanted dynamical effects of the annual re-scaling based on raw scores of the best performers.
The effect of university mergers on the Shanghai ranking
TLDR
This paper exhibits the response of the ARWU indicators and rankings to institutional mergers in general, and specifically analyses the universities of France that are engaged in a major amalgamation process motivated in part by a desire for higher international rankings.
Ranking institutions within a university based on their scientific performance: A percentile-based approach
Over the recent years, the subject of university rankings has attracted a significant amount of attention and sparked a scientific debate. However, few studies on this topic focus on elaborating the
Ranking the Performance of Universities: The Role of Sustainability
University rankings assess the performance of universities in various fields and aggregate that performance into a single value. In this way, the aggregate performance of universities can be easily
On the effects of institutional size in university classifications: the case of the Shanghai ranking
TLDR
Primary components analysis of data from the Shanghai ranking (2013 edition) is used to explore factors that contribute to the variation of the total score and concludes that around 30 % of the variation in the ARWU indicators can be attributed to variation in size.
Proportion of Collaborative Publications as an Ultimate Indicator of Leiden 2013 World Best Universities Rankings
An increasing number of methodologies for ranking higher education institutions (HEI) has attracted many different stakeholders, especially students. Consequently, those rankings are quite often used
...
...

References

SHOWING 1-10 OF 45 REFERENCES
Irreproducibility of the results of the Shanghai academic ranking of world universities
TLDR
In the Shanghai ranking, the dependence between the score for the SCI indicator and the weighted number of considered articles obeys a power law, instead of the proportional dependence that is suggested by the official methodology of the ranking.
Uncovering excellence in academic rankings: a closer look at the Shanghai ranking
TLDR
Evidence is found that, for the majority of these institutions, the Shanghai rankings reflect not one but in fact two different and uncorrelated aspects of academic research: overall research output and top-notch researchers.
Academic ranking of world universities using scientometrics  - A comment to the “Fatal Attraction”
SummaryThe Institute of Higher Education, Shanghai Jiao Tong University published on the web the Academic Ranking of World Universities and attracted wide attentions worldwide. 60% of their criteria
The Academic Ranking of World Universities.
Shanghai Jiao Tong University1 has published on the Internet an Academic Ranking of World Universities that has attracted worldwide attention. Institutions are ranked according to academic or
On using the Shanghai ranking to assess the research performance of university systems
TLDR
A new look at the Shanghai Jiao Tong Academic Ranking of World Universities to evaluate the performance of whole university systems is taken, with a clear picture emerges: at the aggregate level ARWU seems to be a very reliable one-dimensional scale.
World-wide university rankings: A Scandinavian approach
TLDR
By resampling and reanalyzing the ARWU data, the paper proposes an input-output analysis for measuring universities’ scientific productivity with special emphasis on those universities which meet the productivity threshold in a certain group of universities.
Should you believe in the Shanghai ranking?
TLDR
The view is that the Shanghai ranking, in spite of the media coverage it receives, does not qualify as a useful and pertinent tool to discuss the “quality” of academic institutions, let alone to guide the choice of students and family or to promote reforms of higher education systems.
Rankings internacionales y calidad de los sistemas universitarios1 International rankings and quality of the university systems
This paper analyzes the position of the European universities, in particular the Spanish academic institutions, in the international context. The analysis is based on the only truly international
1 Academic Ranking of World Universities - Methodologies and Problems
The Institute of Higher Education, Shanghai Jiao Tong University has published on the web the Academic Ranking of World Universities that has attracted wide attentions worldwide. Institutions are
Should you believe in the Shanghai ranking? An NCDM view
This paper proposes a critical analysis of the “Academic Ranking of World Universities”, published every year by the Institute of Higher Education of the Jiao Tong University in Shanghai and more
...
...