US News & World Report just issued their latest round of college rankings, and, as expected, they’re getting wide coverage. The annual rating of American colleges and universities are used by many students and their parents to formulate a list of schools to which to apply.
But what exactly are these rankings, and how are they determined? US News stresses that it relies on “quantitative measures that education experts have proposed as reliable indicators of academic quality, and [the rankings are] based on our nonpartisan view of what matters in education.” In other words, they write a survey and send it to over 4000 institutions of higher learning.
What they don’t tell you (at least not on the first methodology page) is that 25% of the score used to calculate the rankings comes from one section of the survey called “peer-assessment.” In it, the college presidents, provosts, and deans charged with filling out the survey are asked to evaluate other schools’ performance and strengths. Statistically, the assessment is the highest weighted portion of the survey.
Understandably, there is a reluctance to rate other schools, and university cooperation is on the decline. In 2007, 58% of the 4,089 presidents, provosts and deans of admissions responded to the peer assessment. This year, it dropped to 48% (US News’ spin: “an increase from 46% in 2008”!)
So what else are they judging if so many decline to respond the highest weighted question? Alumni giving is important. That means schools with a predominantly lower-income student body will fare poorly, while those with huge endowments who can hire fundraisers to get their alumni to cough up sizeable sums through telemarketing and fancy mail campaigns dominate.
And the rankings are big business. The New York Times reported this week that “Yes, they Matter.” Read only the headline and you’d miss the point: rankings matter not for students trying to figure out where to apply, but to the colleges themselves. Moving up from slot 26 to 25 (which means appearing on page one instead of page two) translates to more applications, more revenue, and higher selectivity.
This kind of “mattering” has a downside, though. An Inside Higher Education article, “Manipulating, er, Influencing US News” reports on the strenuous, and successful, efforts of Clemson University to boost its rating. It doesn’t, however, mention the widely reported story last fall that Baylor University was paying its freshman to retake the SAT. Why would a university ask students to take the test when they were already enrolled in college? The school denied that it was an effort to boost their median SAT score (another ranking criteria), but the outcry from faculty, students, and the press was so great the school dropped the program.
What it all boils down to is that the rankings, while having the appearance of being scientific, are based on highly subjective variables. It might make sense to give a quick look to check, for example, acceptance rates and prices. But using the rankings to compile a list of schools to apply to isn’t a great idea. In fact, many schools are boycotting or talking about boycotting the survey altogether. Take them for what they’re worth—an incredible money maker for US News & World Report, and a questionable tool for students and their families.
Comments
All of these college rating surveys should come with an in-depth interpretive. Parents and students do have to start somewhere and often rely on these "Top 100 colleges" surveys. But they need to know what is really important. You have begun here. There is so much more to look at. How about a series from you? I remember one question someone suggested as to how many graduates go on for and receive advanced degrees from this college?
I went to Sarah Lawrence College, and we lost major ranking when we stopped using SAT scores in admissions, because we don't believe that tests are the best indicator of intelligence or success at the school (particularly because we write papers more often than we take tests). In order to calculate the ranking, US News gave us the national average SAT score. While still using SAT scores, our average was higher, so our placing fell on the list. The list is important in reaching prospective students at the beginning of their search, and as more and more schools view SATs as optional rather than required material, the list is going to be more and more misleading.
If these survey questions yield such misleading results, why are the best schools consistently in the top 50 every year? U.S. News & World Report didn't start its college ranking system until 1983. The schools that are rated best year after year are the same schools that were considered the best prior to 1983. The process may seem subjective. But if the results consistently prove objectively true, perhaps the process is merited.
Thanks, Lauren, for putting the rankings in perspective. While some of the data can be useful, let's appreciate the rankings for what they really are, a pandering to our society's need to quantify what's best, and a huge "cash cow" for U.S. News. Families would do well to first determine their financial strategy regarding what's affordable, then find the college that's the best fit for the student both academically and socially. A high ranking does not necessarily translate into the "best" school for a student who has invested the time into researching colleges which fit his/her criteria.
Lauren: You are spot on, again. Thanks you for your fantastic work. You're keeping me very level-headed on this whole subject. Is it possible to get in touch with you for private consultation?
To answer the question of your headline—rankings are more misleading hype than a useful tool for most students and families. Additionally, I wouldn’t even argue the validity of the methodology as much as I would encourage college-seeking families to think about selecting a college or university in the context of what is right for the student academically, socially, and financially. Rankings are intimidating families into thinking that only a top tier school is good enough for them to consider. Students and their parents need information and guidance that increase their confidence and chances of success in identifying their own top choice schools based on criteria that are important to them. My advice—look for resources that offer you comprehensive, objective data about colleges and universities with the expert guidance that make college planning an exhilarating, not an intimidating, experience.
Over the past two years, I have visited 12-15 colleges with my two teens. I think that every single one of them had some sort of "US NEWS" award that they hung on the wall in the admissions office. Whether it's "Top 50 small colleges in The Midwest" or "best dorm rooms," every school uses this as a marketing tool. In addition, it's good marketing for the magazine, to have their name out there and to have the parents and students reading these reports. They are fun to read but very little weight should be given to them.
Got something to say?
Examiner.com is looking for writers, photographers, and videographers to join the fastest growing group of local insiders. If you are interested in growing your online rep apply to be an Examiner today!