QS World University Rankings

QS World University Rankings
Editor Danny Byrne
Categories Higher education
Frequency Annual
Publisher QS Quacquarelli Symonds Limited
Country United Kingdom
Language English
Website QS World University Rankings

QS World University Rankings is an annual publication of university rankings by British Quacquarelli Symonds (QS) company. Previously collaborated with Times Higher Education (THE) to publish THE-QS World University Rankings, the publisher has released its own league tables since 2010 using the pre-existing methodology while THE has adopted a new one with Thomson Reuters as Times Higher Education World University Rankings.[1] QS World University Rankings now comprises the global overall and subject rankings, along with three independent regional tables (Asia, Latin America, and BRICS) generated by different methodologies. It is regarded as one of the three most influential and widely observed university measures, together with Academic Ranking of World Universities and Times Higher Education World University Rankings,[2][3][4][5] while, however, criticized for giving undue weight to subjective indicators and being commercialized.[6][7][8][9]

History

The need for an international ranking of universities was highlighted in December 2003 in Richard Lambert’s review of university-industry collaboration in Britain[10] for HM Treasury, the finance ministry of the United Kingdom. Amongst its recommendations were world university rankings, which Lambert said would help the UK to gauge the global standing of its universities.

The idea for the rankings was credited in Ben Wildavsky's book, The Great Brain Race: How Global Universities are Reshaping the World,[11] to then-editor of Times Higher Education (THE), John O'Leary. THE chose to partner with educational and careers advice company Quacquarelli Symonds (QS) to supply the data, appointing Martin Ince,[12] formerly deputy editor and later a contractor to THE, to manage the project.

Between 2004 and 2009, QS produced the rankings in partnership with THE. In 2009, THE announced they would produce their own rankings, the Times Higher Education World University Rankings, in partnership with Thomson Reuters. THE cited a weakness in the methodology of the original rankings,[13] as well as a perceived favoritism in the existing methodology for science over the humanities,[14] as one of the key reasons for the decision to split with QS.

QS retained the intellectual property in the Rankings and the methodology used to compile them and continues to produce the rankings, now called the QS World University Rankings.[15] THE created a new methodology with Thomson Reuters, published as the Times Higher Education World University Rankings in September 2010.

Global rankings

Overall

Methodology

Methodology of QS World University Rankings[16]
Indicator Weighting Elaboration
Academic peer review
  • 40%
Based on an internal global academic survey
Faculty/Student ratio
  • 20%
A measurement of teaching commitment
Citations per faculty
  • 20%
A measurement of research impact
Employer reputation
  • 10%
Based on a survey on graduate employers
International student ratio
  • 5%
A measurement of the diversity of the student community
International staff ratio
  • 5%
A measurement of the diversity of the academic staff

Reception

Several universities in the UK and the Asia-Pacific region have commented on the rankings positively. Vice-Chancellor of New Zealand's Massey University, Professor Judith Kinnear, says that the Times Higher Education-QS ranking is a "wonderful external acknowledgement of several University attributes, including the quality of its research, research training, teaching and employability." She said the rankings are a true measure of a university's ability to fly high internationally: "The Times Higher Education ranking provides a rather more and more sophisticated, robust and well rounded measure of international and national ranking than either New Zealand's Performance Based Research Fund (PBRF) measure or the Shanghai rankings."[17] In September 2012 the British newspaper The Independent described the QS World University Rankings as being "widely recognised throughout higher education as the most trusted international tables".[18]

Martin Ince,[19] chair of the Advisory Board for the Rankings, points out that their volatility has been reduced since 2007 by the introduction of the Z-score calculation method and that over time, the quality of QS's data gathering has improved to reduce anomalies. In addition, the academic and employer review are now so big that even modestly ranked universities receive a statistically valid number of votes. QS has published extensive data [20] on who the respondents are, where they are, and the subjects and industries to which the academicians and employers respectively belong.

Criticisms

Many are concerned with the use or misuse of survey data.

Since the split from Times Higher Education, further concerns about the methodology QS uses for its rankings have been brought up by several experts. Simon Marginson, professor of higher education at University of Melbourne and a member of the THE editorial board, in the article "Improving Latin American universities' global ranking" for University World News on 10 June 2012, said: "I will not discuss the QS ranking because the methodology is not sufficiently robust to provide data valid as social science." [21]

In an article for the New Statesman entitled "The QS World University Rankings are a load of old baloney", David Blanchflower, a leading labour economist, said: "This ranking is complete rubbish and nobody should place any credence in it. The results are based on an entirely flawed methodology that underweights the quality of research and overweights fluff... The QS is a flawed index and should be ignored." [22]

In an article titled The Globalisation of College and University Rankings and appearing in the January/February 2012 issue of Change magazine, Philip Altbach, professor of higher education at Boston College and also a member of the THE editorial board, said: “The QS World University Rankings are the most problematical. From the beginning, the QS has relied on reputational indicators for half of its analysis … it probably accounts for the significant variability in the QS rankings over the years. In addition, QS queries employers, introducing even more variability and unreliability into the mix. Whether the QS rankings should be taken seriously by the higher education community is questionable."[23]

The QS World University Rankings have been criticised by many for placing too much emphasis on peer review, which receives 40 percent of the overall score. Some people have expressed concern about the manner in which the peer review has been carried out.[6] In a report,[24] Peter Wills from the University of Auckland, New Zealand wrote of the Times Higher Education-QS World University Rankings:

But we note also that this survey establishes its rankings by appealing to university staff, even offering financial enticements to participate (see Appendix II). Staff are likely to feel it is in their greatest interest to rank their own institution more highly than others. This means the results of the survey and any apparent change in ranking are highly questionable, and that a high ranking has no real intrinsic value in any case. We are vehemently opposed to the evaluation of the University according to the outcome of such PR competitions.

QS points out that no survey participant, academic or employer, has been offered a financial incentive to respondents. And academics cannot vote for their own institution.

THES-QS introduced several changes in methodology in 2007 which were aimed at addressing these criticisms,[25] the ranking has continued to attract criticisms. In an article[26] in the peer-reviewed BMC Medicine authored by several scientists from the US and Greece, it was pointed out:

If properly performed, most scientists would consider peer review to have very good construct validity; many may even consider it the gold standard for appraising excellence. However, even peers need some standardized input data to peer review. The Times simply asks each

expert to list the 30 universities they regard as top institutions of their area without offering input data on any performance indicators. Research products may occasionally be more visible to outsiders, but it is unlikely that any expert possesses a global view of the inner workings of teaching at institutions worldwide. Moreover, the expert selection process of The Times is entirely unclear. The survey response rate among the selected experts was only <1% in 2006 (1,600 of 190,000 contacted). In the absence of any guarantee for protection from selection biases, measurement validity can be very problematic.

Alex Usher, vice president of Higher Education Strategy Associates in Canada, commented:

Most people in the rankings business think that the main problem with The Times is the opaque way it constructs its sample for its reputational rankings - a not-unimportant question given that reputation makes up 50% of the sample. Moreover, this year's switch from using raw reputation scores to using normalized Z-scores has really shaken things up at the top-end of the rankings by reducing the advantage held by really top universities - University of British Columbia (UBC) for instance, is now functionally equivalent to Harvard in the Peer Review score, which, no disrespect to UBC, is ludicrous. I'll be honest and say that at the moment the THES Rankings are an inferior product to the Shanghai Jiao Tong’s Academic Ranking of World Universities.

Academicians have also been critical of the use of the citation database, arguing that it undervalues institutions which excel in the social sciences. Ian Diamond, former chief executive of the Economic and Social Research Council and now vice-chancellor of the University of Aberdeen and a member of the THE editorial board, wrote to Times Higher Education in 2007, saying:[27]

The use of a citation database must have an impact because such databases do not have as wide a cover of the social sciences (or arts and humanities) as the natural sciences. Hence the low position of the London School of Economics, caused primarily by its citations score, is a result not of the output of an outstanding institution but the database and the fact that the LSE does not have the counterweight of a large natural science base.

The most recent criticism of the old system came from Fred L. Bookstein, Horst Seidler, Martin Fieder and Georg Winckler in the journal Scientomentrics for the unreliability of QS's methods:

Several individual indicators from the Times Higher Education Survey (THES) data base the overall score, the reported staff-to-student ratio, and the peer ratings—demonstrate unacceptably high fluctuation from year to year. The inappropriateness of the summary tabulations for assessing the majority of the “top 200” universities would be apparent purely for reason of this obvious statistical instability regardless of other grounds of criticism. There are far too many anomalies in the change scores of the various indices for them to be of use in the course of university management.[28]

The QS subject rankings have been dismissed as unreliable by some critics, including most notably Brian Leiter, who points out that programmes which are known to be high quality, and which rank highly in the Blackwell rankings (e.g., the University of Pittsburgh) fare poorly in the QS ranking for reasons that are not at all clear.[29]

Results

QS World University Rankings—Top 50
2014/15[30] 2013/14[31] 2012/13[32]2011/12[33]2010/11[34]InstitutionRegion
11135 Massachusetts Institute of Technology United States
23211University of Cambridge United Kingdom
25667Imperial College London United Kingdom
42322Harvard University United States
56556 University of Oxford United Kingdom
54474 University College London United Kingdom
77151113Stanford University United States
81010129California Institute of Technology United States
91091310Princeton University United States
108743Yale University  United States
119888University of Chicago United States
1212131818Swiss Federal Institute of Technology in Zurich (ETH Zurich)  Switzerland
131312912University of Pennsylvania United States
1414111011Columbia University United States
1416161617Johns Hopkins University United States
1619262721King's College London United Kingdom
1717212022University of Edinburgh United Kingdom
1719293532Swiss Federal Institute of Technology in Lausanne (EPFL)  Switzerland
1915141516Cornell University United States
2017192329University of Toronto Canada
2121181719McGill University Canada
2224252831National University of Singapore Singapore
2322171415University of Michigan United States
2428343333Ecole Normale Supérieure France
2527242620Australian National University Australia
2523201914Duke University United States
2725222128University of California, Berkeley United States
2826232223The University of Hong Kong Hong Kong
2930283027University of Bristol United Kingdom
3033322930The University of Manchester United Kingdom
3132302524The University of Tokyo Japan
3135374250Seoul National University South Korea
3331363138The University of Melbourne Australia
3429272426Northwestern University United States
3541413636Ecole Polytechnique France
3635353225Kyoto University Japan
3740313435University of California, Los Angeles United States
3738393837The University of Sydney Australia
3941475874Nanyang Technological University Singapore
4034334040The Hong Kong University of Science and Technology Hong Kong
4144434441New York University United States
4137384148University of Wisconsin-Madison United States
4349455144University of British Columbia Canada
4343464843The University of Queensland Australia
4539403742The Chinese University of Hong Kong Hong Kong
4645515245University of Copenhagen Denmark
4748484754Tsinghua University China
4852523939University of New South Wales Australia
4950555351Ruprecht-Karls-Universität Heidelberg Germany
5058626349University of Amsterdam Netherlands
QS also releases a list of QS Top 50 under 50 annually to rank those universities which have established for not more than 50 years. This league table is based on their position in the QS World University Rankings of the previous year.[35]

Faculties and subjects

QS also ranks universities by academic discipline organized into 5 faculties, namely Arts & Humanities, Engineering & Technology, Life Sciences& Medicine, Natural Sciences and Social Sciences & Management. These annual rankings are drawn up on the basis of academic opinion, recruiter opinion and citations.

Categories of QS World University Rankings by Faculty and Subject[36]
Art & Humanities Engineering & Technology Life Sciences & Medicine Natural Sciences [note 1] Social Sciences
Arts & Design Architecture Agriculture & Forestry Physics & Astronomy Accounting & Finance
English language & literature Chemical Engineering Biological Sciences Mathematics Business & Management
History Civil & Structural Engineering Dentistry Environmental Sciences Communication & Media Studies
Linguistics Computer Science Medicine Earth & Marine Sciences Development Studies
Modern languages Electrical & Electronic engineering Pharmacy & Pharmacology Chemistry Economics & Econometrics
Philosophy Mechanical, Aeronautical & Manufacturing Psychology Materials Sciences Education
Veterinary Science Geography Law
Politics & International Studies
Sociology
Statistics

Regional rankings

Asia

In 2009, QS launched the QS Asian University Rankings or QS University Rankings: Asia in partnership with The Chosun Ilbo newspaper in Korea to rank universities in Asia independently.

These rankings use some of the same criteria as the world rankings, but there are changed weightings and new criteria. One addition is the criterion of incoming and outgoing exchange students. Accordingly, the QS World University Rankings and the QS Asian University Rankings released in the same academic year are different from each other.[1] For example, The University of Hong Kong being 22nd and 23rd worldwide was regarded as the best Asian institution by the QS World University Rankings (2011 and 2012),[32][33] while The Hong Kong University of Science and Technology had topped the tables of the QS Asian University Rankings simultaneously.[37][38]

QS Asian University Rankings — Top 50
2014[39]2013[40]2012[37]2011[38]2010[41]2009[42]InstitutionRegion
1223310National University of Singapore Singapore
26711137Korea Advanced Institute of Science and Technology South Korea
323211The University of Hong Kong Hong Kong
444668Seoul National University South Korea
511124The Hong Kong University of Science and Technology Hong Kong
675542The Chinese University of Hong Kong Hong Kong
71017171814Nanyang Technological University Singapore
856131210Peking University  China
979121417Pohang University of Science and Technology South Korea
1098453The University of Tokyo Japan

Latin America

The QS Latin American University Rankings or QS University Rankings: Latin America were launched in 2011. They use academic opinion (30%), employer opinion (20%), publications per faculty member, citations per paper, academic staff with a PhD, faculty/student ratio and web visibility (10 per cent each) as measures.[43]

BRICS

QS collaborates with the Russian News to launch the third regional rankings regarding the BRICS countries (Brazil, Russia, India, China and South Africa), known as the QS University Rankings: BRICS. This ranking adopts 8 indicators, which are derived from but different in weightings to those of the world rankings, to select the top 100 higher learning institutions in these regions. The BRICS ranking only takes mainland China's universities into account, excluding other Greater China places' such as those in Hong Kong and Taiwan.[44]

QS University Rankings: BRICS — Top 50[44]
2013InstitutionRegion
1 Tsinghua University  China
2 Peking University  China
3 Lomonosov Moscow State University  Russia
4 Fudan University  China
5 Nanjing University  China
6 University of Science and Technology of China  China
6 Shanghai Jiao Tong University  China
8 Universidade de São Paulo  Brazil
9 Zhejiang University  China
10 Universidade Estadual de Campinas  Brazil

QS Stars

QS also offers universities a way of seeing their own strengths and weaknesses in depth. Called QS Stars, this service is separate from the QS World University Rankings. It involves a detailed look at a range of functions which mark out a modern university. Universities can get from one star to five, or Five Star Plus for the truly exceptional.

QS Stars ratings are derived from scores on eight criteria. They are:

Stars is an evaluation system, not a ranking. About 100 institutions had opted for the Stars evaluation as of early 2013. In 2012, fees to participate in this program were $9850 for the initial audit and an annual license fee of $6850.[45]

Notes

  1. The term "Natural Sciences" here actually refers to physical sciences since life sciences are also a branch of natural sciences.

References

  1. 1.0 1.1 "Asian University Rankings - QS Asian University Rankings vs. QS World University Rankings™". The methodology differs somewhat from that used for the QS World University Rankings...
  2. "University rankings: which world university rankings should we trust?". The Telegraph. 2015. Retrieved 27 January 2015. It is a remarkably stable list, relying on long-term factors such as the number of Nobel Prize-winners a university has produced, and number of articles pubished in Nature and Science journals. But with this narrow focus comes drawbacks. China's priority was for its universities to “catch up” on hard scientific research. So if you’re looking for raw research power, it's the list for you. If you're a humanities student, or more interested in teaching quality? Not so much.
  3. Ariel Zirulnick. "New world university ranking puts Harvard back on top". The Christian Science Monitor. Those two, as well as Shanghai Jiao Tong University, produce the most influential international university rankings out there
  4. Indira Samarasekera & Carl Amrhein. "Top schools don't always get top marks". The Edmonton Journal. There are currently three major international rankings that receive widespread commentary: The Academic World Ranking of Universities, the QS World University Rankings and the Times Higher Education Rankings.
  5. Philip G. Altbach (11 November 2010). "The State of the Rankings". Inside Higher Ed. Retrieved 27 January 2015. The major international rankings have appeared in recent months — the Academic Ranking of World Universities, the QS World University Rankings, and the Times Higher Education World University Rankings (THE).
  6. 6.0 6.1 Holmes, Richard (2006-09-05). "So That's how They Did It". Rankingwatch.blogspot.com. Retrieved 2010-09-16.
  7. "泰晤士報大學排名 調查方式不周延 (THE Rankings with an inappropriate methodology)" (in Chinese). 《聯合報. Retrieved 2 October 2014.
  8. "世界大学主要排名机构介绍 (Introduction of major global university rankings)" (in Chinese). 新浪公司. Retrieved 2 October 2014.
  9. "指大學排名榜涉商業 恒管校長質疑非可信 (Dean of Hang Seng Management College: University rankings that are commercialized)" (in Chinese). 《明報. Retrieved 2 October 2014.
  10. Lambert Review of Business-University Collaboration
  11. Princeton University Press, 2010
  12. Martin Ince Communications
  13. Mroz, Ann. "Leader: Only the best for the best". Times Higher Education. Retrieved 2010-09-16.
  14. Baty, Phil (2010-09-10). "Views: Ranking Confession". Inside Higher Ed. Retrieved 2010-09-16.
  15. Labi, Aisha (2010-09-15). "Times Higher Education Releases New Rankings, but Will They Appease Skeptics?". The Chronicle of Higher Education (London, UK). Retrieved 2010-09-16.
  16. "QS World University Rankings: Methodology". QS (Quacquarelli Symonds). 2014. Retrieved 29 April 2015.
  17. Flying high internationally
  18. "Cambridge loses top spot to Massachusetts Institute of Technology". The Independent. 11 September 2012. Retrieved 11 September 2012.
  19. Martin Ince Communications Limited
  20. QS World University Rankings | QS Intelligence Unit
  21. Improving Latin American universities' global ranking - University World News
  22. The QS World University Rankings are a load of old baloney
  23. Change Magazine - January-February 2012
  24. Response to Review of Strategic Plan by Peter Wills
  25. Sowter, Ben (1 November 2007). THES – QS World University Rankings 2007 - Basic explanation of key enhancements in methodology for 2007"
  26. "1741-7015-5-30.fm" (PDF). Retrieved 2010-09-16.
  27. "Social sciences lose 1". Timeshighereducation.co.uk. 2007-11-16. Retrieved 2010-09-16.
  28. "Scientometrics, Volume 85, Number 1". SpringerLink. Retrieved 2010-09-16.
  29. Leiter Reports: A Philosophy Blog: Guardian and "QS Rankings" Definitively Prove the Existence of the "Halo Effect". Leiterreports.typepad.com (2011-06-05). Retrieved on 2013-08-12.
  30. "QS World University Rankings (2014)".
  31. "QS World University Rankings (2013)".
  32. 32.0 32.1 "QS World University Rankings (2012)".
  33. 33.0 33.1 "QS World University Rankings (2011)" (PDF).
  34. "QS World University Rankings (2010)".
  35. "QS Top 50 under 50". Quacquarelli Symonds. Retrieved 2013-07-07.
  36. "QS World University Rankings by Subject 2015". Quacquarelli Symonds (QS). Retrieved 12 August 2014.
  37. 37.0 37.1 "QS Asian University Rankings (2012)".
  38. 38.0 38.1 "QS Asian University Rankings (2011)".
  39. "QS Asian University Rankings (2014)".
  40. "QS Asian University Rankings (2013)".
  41. "QS Asian University Rankings (2010)".
  42. "QS Asian University Rankings (2009)".
  43. "Methodology (QS University Rankings – Latin America)". Quacquarelli Symonds. Retrieved 12 August 2014.
  44. 44.0 44.1 "QS University Rankings: BRICS". Quacquarelli Symonds. 2013-12-17. Retrieved 2013-12-17.
  45. "Ratings at a Price for Smaller Universities". The New York Times. 30 December 2012. Retrieved 10 September 2013.

External links