Just about everyone is having issues with the NCAA's new RPI replacement
Cheers rang out in August when the NCAA announced it had finally found its replacement for the much-maligned RPI metric used by the tournament committee.
The new metric, known as the NCAA Evaluation Tool (NET), promised to usher in an era of statistically comprehensive rankings, or at least take something as simple as margin of victory into account. Per the NCAA’s release, NET relies on the statistical smorgasbord of game results, strength of schedule, game location, scoring margin, net offensive and defensive efficiency, and the quality of wins and losses.
Something that takes all of those things into account has to be accurate, right? Right?
[Rivals annual subscription deal: Sign up now and get $99 worth of free team gear]
Well, the first edition of NET rankings came out on Monday and, well … here they are.
The first ever NCAA Evaluation Tool rankings
🚨 FIRST EVER NET RANKINGS 🚨
1. Ohio State
2. Virginia
3. Texas Tech
4. Michigan
5. Gonzaga
6. Duke
7. Michigan State
8. Wisconsin
9. Virginia Tech
10. Loyola MarymountFULL Rankings 1-353:
👉 https://t.co/sx7FOdytf5 pic.twitter.com/XQtckLdtCi— NCAA March Madness (@marchmadness) November 26, 2018
So that’s Ohio State, which ranks 16th in the AP Poll and does not have a win over a currently ranked team, at No. 1. Later, there’s known juggernaut Duke at No. 6, and the team that beat said juggernaut in Gonzaga at No. 5. And the top 10 is rounded out by Loyola Marymount, which ranks 122nd in the current KenPom rankings.
Kansas is No. 11. Belmont is No. 12. UNC is No. 21. Kentucky is No. 61 between Liberty and Saint Louis. A polite word for all of that would be “puzzling.”
College basketball world reacts to NET rankings
As you can imagine, some people disagreed with the rankings, which were met with a mixture of confusion, mockery and scorn by the college basketball world.
I’m sure everything will be (mostly) fine in time. But this is a pretty embarrassing debut for the NCAA’s NET rankings. It looks like the computer is broken or something. It doesn’t reflect what it’s supposed to reflect. https://t.co/6TQDhGJ3ST
— Gary Parrish (@GaryParrishCBS) November 26, 2018
Interesting…..? https://t.co/BalQ0vMpE0
— Dana O'Neil (@DanaONeilWriter) November 26, 2018
Off to a roaring start. https://t.co/bkWWkXkBwC
— Jeff Borzello (@jeffborzello) November 26, 2018
YOU HAD A GOOD RUN AP POLL, BUT IT'S TIME TO GTFO BECAUSE A FAR SUPERIOR RANKING SYSTEM IS HERE, HELL YEAH @OhioStateHoops https://t.co/LKHeCnbrbz
— Mark Titus (@clubtrillion) November 26, 2018
Oh no … https://t.co/zfg8Gd0P67
— Mike Rutherford (@CardChronicle) November 26, 2018
The first NET rankings have … Ohio State at No. 1 and … LOYOLA MARYMOUNT at No. 10. https://t.co/AWmxb8i1OI
— Jeff Goodman (@GoodmanHoops) November 26, 2018
Multiple voices speculated that we might just be seeing a too-early version of the rankings, and it could take a while for the metric to come more in-line with what we expect. After all, most teams have only played as many as seven games.
That is a very limited sample to work with, even if you are taking a plethora of factors into account. The NCAA might have simply erred in choosing to release the first run of the rankings in November.
The lesson here with this jumbled mess of a debut edition of the NET rankings: Don't release them until January. Wait until there's a large enough sample size.
— Jeff Eisenberg (@JeffEisenberg) November 26, 2018
Let the debate rage on. Very interesting numbers. But remember, this is one computer snapshot in time. https://t.co/bmOHtIv9Ny
— Andy Katz (@TheAndyKatz) November 26, 2018
What does this mean in November. Nothing. Starting point. Why do people lose their minds on something that will change for the next 17 weeks, one day at a time. Why because everyone is a guru. Relax. https://t.co/sKMJ725utI
— Seth Greenberg (@SethOnHoops) November 26, 2018
Statistical maven Nate Silver wasn’t quite as generous, calling the rankings the worst he has seen in any sport and saying that the NCAA needs to totally overhaul its shiny new metric.
These are the worst rankings I've ever seen in any sport, ever. NCAA needs to go completely back to the drawing board. https://t.co/UXKbrGyuP8
— Nate Silver (@NateSilver538) November 26, 2018
In a subsequent tweet, Silver said he believes that NET “suffers from a ‘throw a bunch of metrics at the wall and see what sticks’ problem,” which is often characteristic of unthoughtful algorithm design.” That might not bode well for future versions of the NET rankings.
There are some other reasons to be skeptical of NET’s current composition, as ESPN notes, like how the metric caps credit for margin of victory at just 10 points, taking the air out of some major victories like Duke’s massacre of Kentucky, and doesn’t consider strength of opponent in its offensive and defensive efficiency rankings.
All of that is obviously less than ideal, but there is still plenty of time for the NET rankings to breathe and for the NCAA to tweak the metric behind closed doors if they fail to correct to expectations. If not, Selection Sunday figures to be a hoot.
More from Yahoo Sports:
• Report: QB Smith’s career may be over after broken leg
• NFL’s worst rule rears its ugly head in Steelers game
• Rookie QB has no time for former coach after win
• NFL Winners and Losers: Browns actually look pretty good