Colley Matrix

Last updated
Colley Matrix logo.png

The Colley Matrix is a computer-generated sports rating system designed by Dr. Wesley Colley. It is one of more than 40 polls, rankings, and formulas recognized by the NCAA in its list of national champion selectors in college football. [1]

Contents

Methodology

In his initial paper at Princeton University, Colley states, "The method is based on very simple statistical principles, and uses only Div. I-A [a] wins and losses as input — margin of victory does not matter. The scheme adjusts effectively for strength of schedule, in a way that is free of bias toward conference, tradition, or region." [2] Colley claims that his method is bias free for estimating the ranking of a team given a particular schedule. [2] The resulting values for each team are identified as a ranking, thus being a realization of Pierre-Simon Laplace’s Rule of Succession. [3]

The formula was adjusted in 2007 to account for games against FCS teams. [4]

Colley Matrix is a special case of the Generalized row sum method, a parametric family of ranking methods developed by P. Yu. Chebotarev (1989). [5] :4

National champions

As an NCAA-designated major selector, the NCAA regards the following teams as Colley's national champion selection, however these selections are listed under the "Final National Poll Leaders" section of the NCAA's record book rather than the "National Champions" section. [6] Unlike most of the NCAA's major selectors, the Colley Matrix does not award a trophy to its national champion.

In four years (2011, 2012, 2016, 2017) the Colley Matrix selected a national champion that did not win the BCS or CFP national championship game. In each of the years, the Colley Matrix was the only NCAA-designated "major selector" to select that champion. [7] :117–118

"2017 National Champions" signage at the home stadium of the UCF Knights football program; Colley Matrix ranked UCF first for the 2017 NCAA Division I FBS football season Spectrum Stadium Press Box (30961498998).jpg
"2017 National Champions" signage at the home stadium of the UCF Knights football program; Colley Matrix ranked UCF first for the 2017 NCAA Division I FBS football season
SeasonChampionRecordRef.
1998 Tennessee 13–0 [8]
1999 Florida State 12–0 [9]
2000 Oklahoma 13–0 [10]
2001 Miami (FL) 12–0 [11]
2002 Ohio State 14–0 [12]
2003 LSU 13–1 [13]
2004 USC 13–0 [b] [14]
2005 Texas 13–0 [15]
2006 Florida 13–1 [16]
2007 LSU 12–2 [17]
2008 Florida 13–1 [18]
2009 Alabama 14–0 [19]
2010 Auburn 14–0 [20]
2011 † Oklahoma State 12–1 [21]
2012 † Notre Dame 12–1 [22]
2013 Florida State 14–0 [23]
2014 Ohio State 14–1 [24]
2015 Alabama 14–1 [25]
2016 † Alabama 14–1 [26]
2017 † UCF 13–0 [27]
2018 Clemson 15–0 [28]
2019 LSU 15–0 [29]
2020 Alabama 13–0 [30]
2021 Georgia 14–1 [31]
2022 Georgia 15–0 [32]
2023 Michigan 15–0 [33]
2024 Ohio State 14–2

† Years in which Colley Matrix selection did not win BCS or CFP national championship game.

History

The NCAA records book indicates that the Colley Matrix has been active since 1992, however this appears to be an error and no Colley selections are listed for 1992–1997. [7] :112 The season rankings on Colley's own website begin in 1998. [34] The Colley Matrix was one of the computer rankings used during Bowl Championship Series (BCS) system of determining national championship game participants starting in the 2001 season. The Peter Wolfe and Wes Colley/ Atlanta Journal-Constitution computer rankings were used in place of The New York Times and Dunkel rankings. The change was made because the BCS wanted computer rankings that did not depend heavily on margin of victory. [35]

The Colley Matrix has chosen a different national champion from the Bowl Championship Series or College Football Playoff champion four times: [7] :117–118

In each of the above instances, the Colley Matrix was the only NCAA recognized selector to choose a champion other than the BCS or CFP winner. [7] :117–118

Criticism and controversies

The methodology of the rankings have been questioned by others on the grounds of subjectivity and specifics of the statistical math. [3] [39] It has also been criticized for placing too much weight on a team's win-loss record and not correctly emphasizing a team's strength of schedule, margin of victory, and head-to-head results, as well as for problems with the formula used for the calculation. [3] Dr. Ed Feng, a mathematician at Stanford University, criticized the system because it does not consider specific game results, stating that "[t]he method does not care who a team loses to in ranking them. It considers the win loss record of each team and the number of games played between each pair of teams. However, the specifics of who won each game are not an input to Colley’s method". [40]

In the final BCS rankings for the 2010 season, LSU was incorrectly ranked ahead of Boise State, at No. 10 instead of No. 11. The error was a result of Colley failing to input an FCS playoff game (Appalachian State vs. Western Illinois) correctly, a mistake that affected an order that helped determine bowl pairings that season. [41]

The ranking system was widely criticized after ranking Notre Dame ahead of Alabama following the 2012 BCS National Championship Game, in which Alabama defeated Notre Dame 42–14. [37] [42] [43]

The Colley Matrix is most well known for ranking Central Florida ahead of Alabama in 2017 despite Alabama's victory in the 2017 College Football Playoff. [44] [45] Central Florida later proclaimed themselves as co-national champions because of the ranking, becoming the only school to claim a national championship based solely on the Colley Matrix. [46] [47] [48]

In 2018, the Mountain West Conference moved away from using four polls, one being Colley Matrix, to determine the host site for its conference championship game in football, due to "a shift to place a priority on head-to-head competition." [49]

Since its creation, the four instances in which the Colley Matrix has chosen a different national champion from the BCS/CFP winner are the most of any NCAA recognized selector in that timeframe. [7] :117–118 Colley Matrix is also the only NCAA recognized selector to ever choose a different champion than the CFP (in use since the 2014 season), which it has done twice. [7] :117–118

Notes

  1. Division I-A is now known as the NCAA Division I Football Bowl Subdivision (FBS).
  2. USC's record listed for 2004 includes two wins later vacated by the NCAA.

Related Research Articles

<span class="mw-page-title-main">Peach Bowl</span> Annual American college football postseason game

The Peach Bowl is an annual college football bowl game played annually in Atlanta, Georgia, since December 30, 1968.

<span class="mw-page-title-main">Bowl Championship Series</span> American college football playoff series

The Bowl Championship Series (BCS) was a college football post-season selection system that created four or five bowl game match-ups involving eight or ten of the top ranked teams in the NCAA Division I Football Bowl Subdivision (FBS) of American college football, including an opportunity for the top two teams to compete in a national championship game. The system was in place from the 1998 season to the 2013 season and was replaced in 2014 by the College Football Playoff (CFP).

<span class="mw-page-title-main">BCS National Championship Game</span> American football game

The BCS National Championship Game, or BCS National Championship, was a postseason college football bowl game, used to determine a national champion of the NCAA Division I Football Bowl Subdivision (FBS), first played in the 1998 college football season as one of four designated bowl games, and beginning in the 2006 season as a standalone event rotated among the host sites of the aforementioned bowls.

<span class="mw-page-title-main">Auburn Tigers football</span> Football program

The Auburn Tigers football program represents Auburn University in the sport of American college football. Auburn competes in the Football Bowl Subdivision (FBS) of the National Collegiate Athletic Association (NCAA) and the Western Division of the Southeastern Conference (SEC).

In American college sports, the Associated Press poll provides weekly rankings of the top 25 NCAA teams in one of three Division I sports: football, men's basketball and women's basketball. The rankings are compiled by polling 62 sportswriters and broadcasters from across the nation. Each voter provides their own ranking of the top 25 teams, and the individual rankings are then combined to produce the national ranking by giving a team 25 points for a first place vote, 24 for a second place vote, and so on down to 1 point for a twenty-fifth place vote. Ballots of the voting members in the AP poll are publicized.

Mid-major conferences in American college sports at the NCAA Division I level are athletic conferences that are not among the power conferences. The grouping is most commonly used in men's college basketball to describe conferences outside of the Big Ten, Big 12, Big East, SEC, and ACC, which have also been referred to as "high majors".

<span class="mw-page-title-main">UCF Knights football</span> Football team representing the University of Central Florida

The UCF Knights football team represents the University of Central Florida in the sport of American football. The Knights compete in the Division I Football Bowl Subdivision (FBS) of the National Collegiate Athletic Association (NCAA) and are a member of the Big 12 Conference. The Knights play their home games at the 45,301-seat FBC Mortgage Stadium, which is located on UCF's main campus in Orlando, Florida, United States.

<span class="mw-page-title-main">Power conferences</span> Group of top-level American college football conferences

The power conferences are the most prominent athletic conferences in college football in the United States. They are part of the Football Bowl Subdivision (FBS) of the National Collegiate Athletic Association's Division I, the highest level of collegiate football in the nation, and are considered the most elite conferences within that tier. Power conferences have provided most of the participants in the College Football Playoff (CFP) and its predecessors, and generally have larger revenue, budgets, and television viewership than other college athletic programs. The Atlantic Coast Conference (ACC), Big Ten Conference, Big 12 Conference, and Southeastern Conference (SEC) are currently recognised as power conferences.

<span class="mw-page-title-main">SEC Championship Game</span> Annual American football game

The SEC Championship Game is an annual American football game that has determined the Southeastern Conference's season champion since 1992. For its first 32 seasons, the championship game pitted the Eastern Division regular season champion against the Western Division regular season champion. With the SEC eliminating football divisions after the 2023 season, the game now features the top two teams in the conference standings. The game is regularly played on the first Saturday of December, and has been held in Atlanta since 1994, first at the Georgia Dome, and at Mercedes-Benz Stadium since 2017.

In the United States, the Coaches Poll is a weekly ranking of the top 25 NCAA Division I Football Bowl Subdivision (FBS) college football, Division I college basketball, and Division I college baseball teams. The football version of the poll has been known officially as the US LBM Coaches Poll since 2023.

<span class="mw-page-title-main">Alabama Crimson Tide football</span> University of Alabama Football Team

The Alabama Crimson Tide football program represents the University of Alabama in the sport of American football. The team competes in the Football Bowl Subdivision (FBS) of the National Collegiate Athletic Association (NCAA) and the Southeastern Conference (SEC). The team is currently led by Kalen DeBoer. The Crimson Tide is among the most storied and decorated football programs in NCAA history. Since beginning play in 1892, the program claims 18 national championships, including 13 wire-service national titles in the poll-era, and five other titles before the poll-era. From 1958 to 1982, the team was led by Hall of Fame coach Paul "Bear" Bryant, who won six national titles with the program. Alabama then had a dominant run under head coach Nick Saban between 2007 and 2023, resulting in six further national titles. The team's rallying cry is "Roll Tide!".

<span class="mw-page-title-main">UCF Knights</span> Athletic program of the University of Central Florida

The UCF Knights are the athletic teams that represent the University of Central Florida in unincorporated Orange County, Florida near Orlando. The Knights participate in the National Collegiate Athletic Association's (NCAA) Division I as a member of the Big 12 Conference. Since men's soccer is not sponsored by the Big 12, they play in the Sun Belt Conference.

<span class="mw-page-title-main">College football national championships in NCAA Division I FBS</span> Annual selection of best U.S. team

A national championship in the highest level of college football in the United States, currently the NCAA Division I Football Bowl Subdivision (FBS), is a designation awarded annually by various organizations to their selection of the best college football team. Division I FBS football is the only National Collegiate Athletic Association (NCAA) sport for which the NCAA does not host a yearly championship event. As such, it is sometimes referred to as a "mythical national championship".

The Legends Poll was a poll that rated the Top 25 teams weekly during the college football season. Its aim was to identify the two best teams in its opinion by the end of the season who should compete in a national championship game. The voters were a group of retired coaches, most of whom were in the College Football Hall of Fame. The Legends Poll was founded by Andy Curtin in 2005 as the Master Coaches Survey, but changed its name in 2008 to better reflect the make-up of its voting members. Curtin and his partner, Pete Wolek implemented the original plan and operated the Legends Poll since its inception. The Legends Poll was published by ESPN and the Sporting News.

David Rothman was an American statistician, public policy advisor, and the creator of a computerized college football ranking system.

<span class="mw-page-title-main">College Football Playoff</span> Postseason tournament in American college football

The College Football Playoff (CFP) is an annual postseason knockout invitational tournament to determine a national champion for the National Collegiate Athletic Association (NCAA) Division I Football Bowl Subdivision (FBS), the highest level of college football competition in the United States. It culminates in the College Football Playoff National Championship game. The inaugural tournament was held at the end of the 2014 NCAA Division I FBS football season under a four-team format. The CFP Board of Managers voted in 2023 to expand the playoff to twelve teams beginning in 2024, an arrangement that will last at least through the end of the 2025 season. After 2025, the current contract between all major entities expires and a new contract will be drawn up, with indications that additional expansion to a 14-team playoff or larger may take place at that time.

Daniel J. White is an American university sports administrator. He is the athletic director for the Tennessee Volunteers. White held the same position at the University at Buffalo from 2012 to 2015 and the University of Central Florida from 2015 to 2021. Prior to his tenure at Buffalo, he was the senior associate athletic director for Ole Miss.

<span class="mw-page-title-main">2017 UCF Knights football team</span> American college football season

The 2017 UCF Knights football team represented the University of Central Florida in the 2017 NCAA Division I FBS football season. The Knights played their home games at the newly renamed Spectrum Stadium in Orlando, Florida, and competed in the East Division of the American Athletic Conference. They were led by second year head coach Scott Frost.

<span class="mw-page-title-main">New Year's Six</span> Term for NCAA Division I Football Bowl games played on or around New Years Day

The New Year's Six, sometimes abbreviated as NY6, are the following NCAA Division I Football Bowl Subdivision (FBS) bowl games: the Rose Bowl, Sugar Bowl, Orange Bowl, Cotton Bowl, Peach Bowl, and Fiesta Bowl. These games are traditionally played annually on or around New Year's Day and represent six of the ten oldest bowl games played at the FBS level.

<span class="mw-page-title-main">2023 College Football Playoff National Championship</span> Postseason college football bowl game

The 2023 College Football Playoff National Championship was a college football bowl game that was played on January 9, 2023, at SoFi Stadium in Inglewood, California. The ninth College Football Playoff National Championship, the game determined the national champion of the NCAA Division I Football Bowl Subdivision (FBS) for the 2022 season. It was the final game of the 2022–23 College Football Playoff (CFP) and, aside from any all-star games following after, was the culminating game of the 2022–23 bowl season. The game began at approximately 4:45 p.m. PST and was televised by ESPN.

References

  1. 1 2 "National champions: UCF Knights finish season ranked No. 1 in Colley Matrix" Orlando Sentinel. Retrieved 2018-09-01.
  2. 1 2 "Colley’s Bias Free College Football Ranking Method: The Colley Matrix Explained" ColleyRankings.com. Retrieved 2018-09-01.
  3. 1 2 3 "The problem with RPI, Elo, and the Colley Matrix" Jelly Juke. Retrieved 2018-09-01.
  4. "FCS Grouping System". colleyrankings.com. Retrieved 2021-10-13.
  5. Csató, L. On the ranking of a Swiss system chess team tournament, Annals of Operations Research254, 17-36 (2017). https://arxiv.org/abs/1507.05045v5.
  6. "National Champion Major Selections (1896 to Present)". 2022 NCAA Football Bowl Subdivision Records (PDF). Indianapolis: The National Collegiate Athletic Association. July 2022. pp. 112–114. Retrieved January 4, 2023. The criteria for being included in this historical list of poll selectors is that the poll be national in scope, either through distribution in newspaper, television, radio and/or computer online. The list includes both former selectors, who were instrumental in the sport of college football, and selectors who were among the Bowl Championship Series (BCS) selectors.
  7. 1 2 3 4 5 6 Football Bowl Subdivision Records (PDF). National Collegiate Athletic Association. 2021. Retrieved November 19, 2021 via NCAA.org.
  8. "Colley's Bias Free College Football Rankings: 1998 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  9. "Colley's Bias Free College Football Rankings: 1999 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  10. "Colley's Bias Free College Football Rankings: 2000 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  11. "Colley's Bias Free College Football Rankings: 2001 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  12. "Colley's Bias Free College Football Rankings: 2002 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  13. "Colley's Bias Free College Football Rankings: 2003 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  14. "Colley's Bias Free College Football Rankings: 2004 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  15. "Colley's Bias Free College Football Rankings: 2005 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  16. "Colley's Bias Free College Football Rankings: 2006 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  17. "Colley's Bias Free College Football Rankings:2007 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  18. "Colley's Bias Free College Football Rankings: 2008 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  19. "Colley's Bias Free College Football Rankings: 2009 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  20. "Colley's Bias Free College Football Rankings: 2010 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  21. "Colley's Bias Free College Football Rankings: 2011 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  22. "Colley's Bias Free College Football Rankings: 2012 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  23. "Colley's Bias Free College Football Rankings: 2013 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  24. "Colley's Bias Free College Football Rankings: 2014 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  25. "Colley's Bias Free College Football Rankings: 2015 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  26. "Colley's Bias Free College Football Rankings: 2016 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  27. "Colley's Bias Free College Football Rankings: 2017 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  28. "Colley's Bias Free College Football Rankings: 2018 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  29. "Colley's Bias Free College Football Rankings: 2019 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  30. "Colley's Bias Free College Football Rankings: 2020 Rankings". colleyrankings.com. Retrieved November 19, 2021.
  31. "Colley's Bias Free College Football Rankings: Current Rankings". colleyrankings.com. Retrieved November 19, 2021.
  32. "Colley's Bias Free College Football Rankings: 2022 Rankings". colleyrankings.com. Retrieved November 12, 2023.
  33. "Colley's Bias Free College Football Rankings: 2023 Rankings". colleyrankings.com. Retrieved January 8, 2024.
  34. "Previous Seasons Football Rankings". colleyrankings.com. Retrieved May 23, 2023.
  35. "BCS formula still subject of debate". ESPN.com. September 16, 2002. Archived from the original on October 18, 2015. Retrieved May 1, 2009.
  36. CincyJoe (January 10, 2012). "Oklahoma State Football: 2011 National Champions". cowboysrideforfree.com. Retrieved November 18, 2021.
  37. 1 2 "Notre Dame is still No. 1, according to one BCS computer" USA Today. Retrieved 2018-09-01.
  38. Connelly, Bill (2017-11-03). "A new, improved CFB strength of schedule measurement". SBNation.com. Retrieved 2022-08-08.
  39. "Statistics of Colley’s Ranking Methodology" Squared Statistics. Retrieved 2018-09-01.
  40. "The Shocking Truth About The Colley Matrix BCS Computer Poll". thepowerrank.com. Retrieved 2024-12-20.
  41. Niesen, Joan (2018-07-11). "The Computer Poll Uprising: Creators of the BCS's Most Controversial Component Look Back". SI.com. Retrieved 2024-12-01.
  42. "BCS Computer Still Has Notre Dame Ranked No. 1 Over Alabama". FanSided. 2013-01-11. Retrieved 2024-12-20.
  43. "Your 2012 national champ: Notre Dame Fighting Irish". San Diego Union-Tribune. 2013-01-11. Retrieved 2024-12-20.
  44. JeffSharon (2018-01-09). "NATIONAL CHAMPIONS! UCF Finishes #1 in Colley Matrix, Solidifying Title Claim". Black & Gold Banneret. Retrieved 2024-12-20.
  45. "UCF unveils title banner as players get rings". ESPN.com. 2018-04-21. Retrieved 2024-12-20.
  46. Schroeder, George. "Alabama coach Nick Saban praises UCF but says that 'self-proclaimed is not the same'". USA TODAY. Retrieved 2024-12-20.
  47. Schroeder, George. "Did Central Florida go too far with its national championship celebration?". USA TODAY. Retrieved 2024-12-20.
  48. "National Champs: UCF selling gear celebrating hypothetical title - UPI.com". UPI. Retrieved 2024-12-20.
  49. "Mountain West announces new host procedure for conference football championship game" San Diego Union-Tribune. Retrieved 2018-09-01.