Journal of Information and Knowledge (Formerly SRELS Journal of Information Management)

Open Access Open Access  Restricted Access Subscription Access
Open Access Open Access Open Access  Restricted Access Restricted Access Subscription Access

A Comparison of Six Global Ranking Systems Considering Weight Distribution and Indicator Types by Correlation Analysis


Affiliations
1 Department of Library and Information Science, RKDF University, Ranchi – 834004, Jharkhand, India
     

   Subscribe/Renew Journal


The study examines and compares the indicators used by the six global ranking systems, as well as the weights assigned to the indicators used by each ranking system. In the comparison process, the inter-ranking correlation between the ranking systems is determined by Spearman’s rank correlation method to understand primarily the similarities between different ranking systems based on rank or positions held by different institutions. The study frames all the indicators, considering various ranking systems, in a common ranking framework for establishing the co-relation matrix. The framing of seven distinct ranking characteristics or indications aids in understanding the weighting scheme used by the six ranking methods. The work then further investigates the reasons for differing Spearman’s ranking correlation values by exploring different ways of calculating the ranking indices adopted by different ranking agencies. The weight distribution across the indicators is another factor which is required to be taken into consideration while observing the correlation between the two ranking systems. Karl Pearson’s statistical measure is applied to find the similarities of the weights associated with each indicator in different raking systems. The outcome of this research provides a comprehensive view of countries like India which are participating in different international ranking systems to improve their ranking while taking part in various ranking systems. Different test cases and in-depth analyses show that it is not an easy task for the institutes to perform better in all the ranking systems.

Keywords

Confidence Level, Higher Education Institutions, Karl Pearson’s Statistical Measure, Mapping of the Indicators, Ranking Systems, Spearman’s Rank Correlation Method.
User
About The Authors

Sumita Ghose
Department of Library and Information Science, RKDF University, Ranchi – 834004, Jharkhand
India

Md. Yeosuf Akhtar
Department of Library and Information Science, RKDF University, Ranchi – 834004, Jharkhand
India


Notifications

  • Aguillo, I. F., Bar-Ilan, J., Levene, M., and Ortega, J. L. (2010). Comparing university rankings. Scientometrics, 85(1), 243-256.

  • Allam, M. (2019). International rankings and Indian institutions of higher education: An analysis. Universal Review, 10(7), 45-60.

  • Atanbiyi, G., Aribisala, B., Nyaaku, O., and Olabanjo, O. (2020). Development of objective ranking system for tertiary institutions in developing nations. Journal of Research and Review in Science, 7, 39-53. https://doi.org/10.36108/ jrrslasu/0202.70.0170

  • Bar-Ilan, J., Levene, M., and Lin, A. (2007). Some measures for comparing citation databases. Journal of Informetrics, 1(1), 26-34.

  • Bandyopadhyay, S., and Sharma, A. (2020). Ranking frameworks and quality of higher educational institutions: Some missing links. https://doi.org/10.2139/ssrn.3835899

  • Chen, K., and Liao, P. (2012). A comparative study on world university rankings: A bibliometric survey. Scientometrics, 92(1), 89-103. https://doi.org/10.1007/s11192-012-0724-7

  • Cakir, M. P., Acarturk, C., Alasehir, O., and Cilingir, C. (2015). A comparative analysis of global and national university ranking systems. Scientometrics, 103, 813-848. https://doi. org/10.1007/s11192-015-1586-6

  • Hou,Y., and Jacob, W. J. (2017). What contributes more to the ranking of higher education institutions? A comparison of three world university rankings. The International Education Journal: Comparative Perspectives, 16(4), 29-46.

  • https://openjournals.library.sydney.edu.au/index.php/IEJ Joorel, J. P. S., Kumar, A., Solanki, H., Raja, V., Shah, D., Pradhan, P., Trivedi, K., and Singh. (2021). Five years of India rankings (2016–2020): An evolutionary study. DESIDOC Journal of Library & Information Technology, 41(1), 42-48. https://doi.org/10.14429/djlit.41.1.16671

  • Kumar, A., Singh, K., and Siwach, A. K. (2021), NIRF India rankings 2020: Analyzing the ranking parameters and score of top 100 universities. DESIDOC Journal of Library and Information Technology, 41(5), 385-390. https://doi. org/10.14429/djlit.41.5.16452

  • Lukman, R., Krajnc, D., and Glavic, P. (2010). University ranking using research, educational and environmental indicators. Journal of Cleaner Production, 18(7), 619-628. https://doi.org/10.1016/j.jclepro.2009.09.015

  • McCormick, A. C. (2013). Classifying higher education institutions: Lessons from the Carnegie Classification. Center for Postsecondary Research, Indiana University Bloomington, USA, 50(1), 65-75. https://doi.org/10.7764/PEL.50.1.2013.6

  • Nassa, A. K. and Arora, J. (2021). Ranking of Institutions of higher education. DESIDOC Journal of Library and Information Technology, 1(1), 3-4. https://doi. org/10.14429/djlit.41.1.16757

  • Obasi, I. N. (2016). World university rankings in a marketdriven knowledge society. Implications for African Universities. University of Botswana, Botswana.

  • Salmi, J., and Saroyan, A. (2007). League tables as policy instruments: Uses and misuses. Journal of Higher Education Policy and Management, 19(2), 1-38. ttps://doi. org/10.1057/palgrave.hep.8300154

  • Sayed, O. H. (2019). Critical treatise on university ranking systems. Open Journal of Social Sciences, 7, 39-51. https:// doi.org/10.4236/jss.2019.712004

  • Shehatt, I. and Mahmood, K.(2016). Correlation among top 100 universities in the major six global rankings: Policy implications. Scientometrics, 109, 1231-1254. https://doi. org/10.1007/s11192-016-2065-4

  • Singh, P., Joorel, J. P. S., Solanki, H., Kumar, A., and Trivedi, K. (2021), Ranking of Indian research-intensive higher education institutions using Multiple ranking methodologies: A correlation analysis. DESIDOC Journal of Library and Information Technology, 41(1), 49-53. https://doi.org/10.14429/djlit.41.1.16683

  • Pitman, T., Edwards, D., Liang-Cheng, Z., Paul, K., and Julie, M. (2020). Constructing a ranking of higher education institutions based on equity: Is it possible or desirable? Higher Education. https://doi.org/10.1007/s10734-019-00487-0

  • Webster, D. S. (1992). Reputational rankings of colleges, universities, and individual disciplines and fields of study, from their beginnings to the present. (J. C. Smart (Ed.)). Higher Education: Handbook of Theory and Research, New York, Agathon Press, pp. 234-304.


Abstract Views: 158

PDF Views: 2




  • A Comparison of Six Global Ranking Systems Considering Weight Distribution and Indicator Types by Correlation Analysis

Abstract Views: 158  |  PDF Views: 2

Authors

Sumita Ghose
Department of Library and Information Science, RKDF University, Ranchi – 834004, Jharkhand, India
Md. Yeosuf Akhtar
Department of Library and Information Science, RKDF University, Ranchi – 834004, Jharkhand, India

Abstract


The study examines and compares the indicators used by the six global ranking systems, as well as the weights assigned to the indicators used by each ranking system. In the comparison process, the inter-ranking correlation between the ranking systems is determined by Spearman’s rank correlation method to understand primarily the similarities between different ranking systems based on rank or positions held by different institutions. The study frames all the indicators, considering various ranking systems, in a common ranking framework for establishing the co-relation matrix. The framing of seven distinct ranking characteristics or indications aids in understanding the weighting scheme used by the six ranking methods. The work then further investigates the reasons for differing Spearman’s ranking correlation values by exploring different ways of calculating the ranking indices adopted by different ranking agencies. The weight distribution across the indicators is another factor which is required to be taken into consideration while observing the correlation between the two ranking systems. Karl Pearson’s statistical measure is applied to find the similarities of the weights associated with each indicator in different raking systems. The outcome of this research provides a comprehensive view of countries like India which are participating in different international ranking systems to improve their ranking while taking part in various ranking systems. Different test cases and in-depth analyses show that it is not an easy task for the institutes to perform better in all the ranking systems.

Keywords


Confidence Level, Higher Education Institutions, Karl Pearson’s Statistical Measure, Mapping of the Indicators, Ranking Systems, Spearman’s Rank Correlation Method.

References





DOI: https://doi.org/10.17821/srels%2F2023%2Fv60i5%2F171125