Везде
The Impact of Changes in the World Ranking Methodologies on University Positions
Table of contents
Annotation Estimate Publication content
References Comments
Share
QR
Metrics
The Impact of Changes in the World Ranking Methodologies on University Positions
Annotation
PII
S013216250001960-9-1
DOI
10.31857/S013216250001960-9
Publication type
Article
Status
Published
Authors
Irina B. Trostyanskaya 
Occupation: Head of Research and Analytical Department
Affiliation: Sociological Research Center
Address: Russian Federation, Moscow
Nadezhda A. Polikhina
Occupation: Acting Director
Affiliation: Sociological Research Center
Address: Russian Federation, Moscow
Edition
Issue 9
Pages
71-79
Abstract

The article considers the main changes in the methodologies of world’s renowned rankings, their impact on university positions and comparability of ranking results over time. The QS and THE rankings’ methodological changes come under special scrutiny. The ARWU ranking is regarded as having an unchanged methodology. The subject of the research consists of universities entering the top 300 groups in the QS, THE and ARWU rankings, as they form an extended pool of leading universities in the international market. The article analyzes how the changes in methodology impact the positions of universities in the top 100, top 200 and top 300 groups from 2015 till 2017, as well as their relative positioning in the above-mentioned groups measured by correlation coefficients. Besides, the authors study how many universities maintain their positions in the top 100, top 200 and top 300 groups over two consecutive years (2015/2016 and 2016/2017), as well as their correlation coefficient. The research shows that the changes in the world ranking methodologies either do not impact, or exert a minor influence on university positions in the top 300 group of the above mentioned rankings. All the rankings under consideration demonstrate a high degree of continuity. These findings confirm that the ranking agencies take a careful approach towards methodological changes in order to ensure data comparability across time and enable the advancement of universities in the rankings (provided that universities make deliberate efforts to increase their competitiveness).

Keywords
higher education, university, competitiveness, World Universities Rankings, Project 5–100, change of methodology
Received
26.10.2018
Date of publication
09.11.2018
Number of purchasers
10
Views
546
Readers community rating
0.0 (0 votes)
Cite   Download pdf

References

1. Aguillo Isidro F., Bar-Ilan Judit, Levene Mark, Ortega Jose' Luis. (2010) Comparing university rankings. Scientometrics. 85: 243–256. DOI 10.1007/s11192-010-0190-z

2. Balatsky E. V., Ekimova N. A. (2011) The Comparative Reliability of the Global University Rankings. The Journal of the New Economic Association. No. 11: 127–140. (In Russ.)

3. Balatsky E. V., Ekimova N. A. (2011) The State University of Management, Moscow The International Rankings of Universities: Practice of drawing up and using. The Journal of the New Economic Association. No. 9: 150–172. (In Russ.)

4. Bar-Ilan Judit, Levene Mark, Lin Ayelet (2007) Some measures for comparing citation databases. Journal of Informetrics. No. 1: 26–34.

5. Fagin Ronald, Kumar Ravi, Sivakumar D. (2003) Comparing top k lists. SIAM Journal on Discrete Mathematics. No. 17(1): 134–160.

6. Kehm B. M. (2016) Global University Rankings – Impacts and Unintended Side Effects. Sotciologicheskie Issledovaniya [Sociological Studies]. No. 8: 71–80. (In Russ.)

7. Kincharova A. (2013) World University Rankings: methodology, effects and critics. URL: http://past-centre.ru/wp-content/uploads/2013/04/Metodologiya_mirovyh_reitingov_universitetov.pdf (accessed 16.02.2018) (In Russ.)

8. Neudachin I. G. (2017) Comparison of World University Rankings. Actual Problems of Humanities and Natural Science. No. 9(1): 5–8. (In Russ.)

9. Polikhina N. A., Trostyanskaya I. B. (2018) University Rankings: Trends, Methodology, Changes / The Ministry of Education and Science of the Russian Federation. Moscow: State autonomous Sociological Research Center. (In Russ.)

10. Salmi Jamil, Alenoush Saroyan (2007) League tables as policy instruments: Uses and misuses. In: Higher Education Management and Policy: 31–68.

11. Salmi Jamil (2009) The Challenge of Establishing the World Class Universities. Moscow: Ves' Mir. (In Russ.)

Comments

No posts found

Write a review
Translate