|
POLLSPEAKPollspeak is a watchdog organization dedicated to keeping college sports polls (and computer-rankings) honest, or at least questioning those that seem to be flawed, uneducated or have an unreasonable bias. Why? Because polls affect teams' TV exposure, finances, recruiting and national championship hopes. Voters and pollsters must be held accountable.
Advertisement
       |
Pre-Season
There is a brewing controversy surrounding preseason
college football polls – mainly because where a team starts often determines how
high it can finish. Just ask Imagine if your favorite conference always had at least one team finish the year ranked in the top fifteen – but that top fifteen ranking was never extended to any of your conference’s teams in the preseason. Imagine if year after year the top teams in your conference had to fight their way up from a 20-25 preseason ranking – waiting, praying for the teams above them to lose so that they might have a shot at glory. Then, after they proved themselves one year, these programs were still ignored in the next year’s preseason polls. It sounds ridiculous, but for fans of non-BCS programs, this sad story is reality during the BCS era. For non-BCS teams, the preseason polls can be especially brutal. In examining the AP and Coaches’ Polls over the BCS era
(1998-Present) there is a clear bias against non-BCS teams in the preseason.
Looking at the ’08 poll – where the AP ranks only one non-BCS team, BYU
at #16, and the Coaches’ add Let’s look at some of the facts about the AP Poll for the 1998-2007 seasons. For simplicity, we’ll focus on the AP Poll, but the general trends in the AP Poll are very closely mirrored in the Coaches’ poll. We will still point out some relevant examples from the Coaches. However, please keep in mind that when we discuss team rankings, you can almost always exchange “AP” for “Coaches” without any significant difference. Harris Interactive doesn’t release a preseason poll. The AP has never ranked a non-BCS team higher than #15 in
the preseason poll during the BCS era. This is despite the fact that only once,
in 2001, has a non-BCS team failed to finish the year in the top 15 of the final
AP Poll (but Non-BCS teams collectively get 508.6 poll points per year in the preseason AP Poll compared to 1,782 for the final poll; that’s an average increase of roughly 250% from the beginning of the year until the end! Imagine if the SEC was disrespected like that! The average number of preseason poll points going to the highest ranked non-BCS team was 335.4 (usually putting them in the 20-25 range). But the top non-BCS teams receive, on average, 968.5 points in the final poll (equivalent, roughly, to a top ten ranking). Average points going to the second ranked non-BCS team in the preseason poll was 154.5 compared to 568.1 in the final poll. Even worse, the average points going to the third ranked non-BCS team in the preseason poll was 18.7 compared to 181.3 in the final poll. So the gap between perception and reality widens once you look beyond that year’s anointed “non-BCS team-du-jour.” The preseason AP (and Coaches’) Poll has ranked three or
more non-BCS teams just once (in 2007: TCU, The highest ranking a non-BCS team has ever gotten in the
preseason AP Poll was CSU at #15 in 1998 (the first year of the
BCS). Second highest was The highest ranking a non-BCS team has ever gotten in the
final poll was Every single year the AP poll ranks a non-BCS team higher in the final poll than it ranked any non-BCS team in the preseason poll – and it’s usually much higher. For example: In 2006 the preseason poll ranked one non-BCS team, TCU, at #22. But the final AP Poll in 2006 saw three ranked non-BCS teams; Boise St. at #5, BYU at #16 and TCU at #22. 2005 was the only year that only one non-BCS team made the
final ballot – TCU at #11 – but this ranking was still much
higher than the Clearly poll voters are using different criteria for ranking programs outside the big six conferences. They certainly aren’t ranking them based on where they finished the year before… or even where they have been finishing historically. Instead, it appears that the AP is forcing these teams to complete a grueling climb up the rankings each and every year without exception. Why does this obvious and egregious bias exist? Why has it gone relatively unnoticed or at least without much fanfare? The obvious answer is that the voters don't know enough
about the non-BCS schools. These
teams aren’t on national television as often, and they aren’t discussed as
national championship contenders during the offseason. While this might be okay
for the average football fan, it should not be acceptable for a BCS or AP voter.
It should be the responsibility of the voter to be more informed than the
average fan. Now that Another possible explanation involves simple geography:
73% of the non-BCS teams that have been
ranked in the preseason poll are located west of the For those still unconvinced, let’s focus on the non-BCS
teams that are considered the elite -- teams that should be getting respect from
voters on their preseason ballots -- Boise State, BYU,
Utah, and TCU; all four hail from the west
(and all but TCU are located in the sparsely populated Mountain
time zone) away from the concentration of eastern poll voters.
Now these teams don’t have nearly the consistency of say a modern
USC or
So comparing the four non-BCS teams to the three Big 12
teams, you can see the discrepancy.
The non-BCS teams have had similar or better consistency over the same period
(all of them at least having back-to-back final rankings).
Yet, in the 2008 preseason polls, all three Big 12 teams have been ranked
higher than any non-BCS team has EVER been ranked in a preseason poll.
Yes, In the past six years Whatever the reasons, the consequences of this biased voting behavior are devastating to non-BCS schools. Until voters adjust their bias we will never see a non-BCS team win a national championship in the BCS era (like BYU did in 1984). In fact, we probably won’t see them make a BCS bowl game without going undefeated. To make one of the BCS bowls, non-BCS teams must climb from the bottom of the preseason rankings. A single loss dooms any chance they have at a big bowl and a big payday. The pollsters need to recognize that their voters rank BCS teams differently than they do teams from non-BCS conferences and help educate them. Until that happens, it appears that college football is stuck in a caste-like structure with no end in sight. In the meantime, Pollspeak will continue doing what it can to help the education process.
|
|
POLL |
Rank |
|
Harris |
1 |
|
AP |
2 |
|
Coaches |
3 |
Choosing the Voters:
AP – The bureau chief, many in conjunction
with the sports writer, select the voter(s) from their state/region. Some rotate
the vote every year to give different members a chance, some don't.
About half of the writers/broadcasters let the local sports writer or
bureau manager know he/she is interested in voting; we also seek out
writers/broadcasters. Usually
we contact the individual directly.
Coaches – All 119 Division
I-A coaches are eligible, though some decline to participate because of the time
commitment necessary for voters to fulfill their weekly obligations. We contact
the prospective voters (coaches, not universities) and ask if they are willing
to take part and meet the requirements that have been outlined.
Representatives of the USA Today and AFCA meet to review the proposed
list.
Harris
--
Panelists are randomly selected from among more than 300 nominations submitted
by the conference offices and the independent institutions. On behalf of the
Bowl Championship Series (BCS), Harris Interactive constructs a panel of former
players, coaches, administrators and current and former media who are committed
to ranking the college teams each week during the college football season.
Pollspeak’s Take
– The Coaches’ and
Harris Interactive polls have a more structured approach to choosing voters at
the national level whereas the AP delegates choices to the state level.
This means different states can handle things differently in the AP.
Some states might be constantly changing their voters while others never
change. This inconsistency drops the
AP to third. Harris edges out the
Coaches’ simply because it has a MUCH larger pool of candidates to draw from.
|
POLL |
Rank |
|
Harris |
1 |
|
Coaches |
2 |
|
AP |
3 |
Voter Qualifications:
AP – They have to be involved in college football coverage locally,
regionally or nationally.
Coaches – Most coaches have a lot of experience in the game, so we look for
reliability and adherence to the basic guidelines.
Harris
--
Panelists must be former players, coaches, administrators or current/former
media who are committed to ranking the college teams each week during the
college football season.
Pollspeak’s Take –
All of these are pretty much equal responses – beyond the need to
belong to the proper organization, they only need to have a pulse and know how
to work a phone. We would have given
the edge to anyone who mentioned a certain level of experience, a requirement to
watch a voter training video or watch a certain number of games each week.
We’ll call this a tie for third, since a tie for first would imply
they’re all doing great.
|
POLL |
Rank |
|
AP |
3 |
|
Coaches |
3 |
|
Harris |
3 |
Turning Down Voters:
AP – We turned down a voter who was also involved in Harris Interactive
or whatever it was called before.
Coaches – When reviewing the list of possible voters, over the years we have
steered away from one or two who might have been shown a pattern for being late
with their ballot. No more than one or two have not been invited back because of
questionable selections.
Harris
--
Harris Interactive communicates a set of principles with panelists which they
are expected to adhere to. One
principle is that they receive permission from their employer, if such
permission is required. Many media
outlets preclude their employees from participating in the Harris Interactive
College Football Poll.
Pollspeak’s Take – OK, once again we’ve got a tie for third.
These are all logistical reasons (or don't pertain to new voters).
We were hoping for answers like, “yes, we turned down
somebody who wrote in his bio that one of his all time favorite sports moments
was ‘Every time Tennessee and Auburn lose a football game.’”
or “We avoided a coach who let his Director of Player Development vote
his own team #1 instead of Texas as they had planned.”
etc.
|
POLL |
Rank |
|
AP |
3 |
|
Coaches |
3 |
|
Harris |
3 |
Voter Guidelines:
These are
the instructions each poll sends to the voters:
AP –
·
Base your vote on
performance, not reputation or preseason speculation.
·
Avoid regional bias,
for or against. Your local team does not deserve any special handling when it
comes to your ballot.
·
Pay attention to
head-to-head results and
·
Don’t hesitate to
make significant changes in your ballot from week to week. There’s no rule
against jumping the 16th-ranked team over the eighth-ranked team, if No. 16 is
coming off a big victory and No. 8 just lost 52-6 to a so-so team.
·
Teams on NCAA
probation ARE eligible for the AP poll.
Some ethics guidelines:
·
Voters should have
no professional or booster connection to the schools they cover. This could pose
a conflict of interest.
·
Voters cannot write
for team media guides or even independent fan magazines associated with certain
schools. This has the potential of compromising a reporter’s objectivity.
·
Adhere to APME and
APSE standards of conduct: We do not accept free tickets, deals, discounts or
gifts, etc.
·
Please be advised: "Homerism"
will be challenged and could lead to dismissal from the poll board.
Also noted, “We vote for schools on probation.”
Coaches –
Before the
preseason poll is conducted, all voters receive a letter from AFCA executive
director Grant Teaff reminding them of what he and the newspaper expect each
week. Basically, it's a ballot that's cast without fear or favor and delivered
on time. It must be personally drawn up by the coach and preferably phoned in by
him as well, though it is acceptable to have a staff member call if necessary.
Failure to adhere to these guidelines can result in removal from the board of
voters. The AFCA also reviews the guidelines in a letter sent out before the
final regular-season poll:
·
The coaches are told
they can vote for any eligible Division I-A team. They are told that any team on
major NCAA or conference probation is not eligible (if a team's status should
change during the season, we do notify them).
·
They are asked to
keep their votes thoughtful, reasoned, consistent and fair throughout the
season.
·
They are reminded
that no abstentions are permitted. If you commit to the poll, you commit to it
for every week of the season.
·
They also are
reminded that, for the post-bowls poll, that the AFCA recognizes the winner of
the BCS title game as the No. 1 team.
Harris –
·
Panelists receive
permission from their employer, if such permission is required.
·
Each panelist agrees
that ranking teams is a time-consuming process each week.
·
Panelists agree that
rankings must be based on their personal observations and analysis of team
performance.
Pollspeak’s Take – Harris is basically saying that a well-prepared voter is one who knows
how to use a remote control for long periods of time without complaining about
carpal tunnel. The AP wins out over
the Coaches’ poll because they give specific and useful advice and spell out the
penalty for bias. The Coaches’
Poll is at a disadvantage here since everyone who votes in their poll is a
school employee with an inherent bias.
|
POLL |
Rank |
|
AP |
1 |
|
Coaches |
2 |
|
Harris |
3 |
Monitoring and Replacing
Voters During the Season:
AP – We monitor ballots on a weekly basis.
They can call, fax or e-mail, and there's a human on the phone.
Other than not following the guidelines, a voter may be replaced for “repeatedly failing to call in a vote promptly,” or for a “conflict
of interest,” or “refusing to vote for a team on probation.”
(Also) we evaluate all voters every year.
Coaches – - Votes are called in by phone and recorded. One of our college desk
staffers then enters them into a computer. He follows up on any ballots that
might be questionable. (This individual has been doing it for more than 10
years.)
We closely
examine each ballot every Sunday. If we see something that seems the least bit
out of whack, we contact the coach, with whom we can usually resolve the issue.
Most of the time, it's over an inadvertent omission. If it cannot be resolved
there, we will bring an AFCA representative into the discussion.
The only
voters who have been replaced during the season have been a few who were
dismissed from their coaching position and opted not to continue to participate
in the voting. Our preference is that they stay on through the bowl games, and
most have agreed to do so. Those who have declined have been succeeded by the
coach who replaced them.
Harris -- Each week, Harris Interactive has rigorous processes in place to
ensure that each panelist’s rankings reflect their intent.
We utilize three methods for voting, including phone (live interviewer),
fax, and online. (Also) if those
members of the media who are panelists change employers either before or during
the season, they may become ineligible for the HICFP.
Pollspeak’s Take
– The AP earns top
spot for taking action during the season for the way a person has voted.
Coaches’ come second for at least replacing missing voters.
Harris comes in third since it seems that clerical issues are the main
concern. See last year’s
Pollspeak Report to Harris Interactive - College Football 2007
which shows that Harris Interactive actually allows missing ballots
during the season, seemingly without penalty to the voter during that season.
|
POLL |
Rank |
|
AP |
1 |
|
Coaches |
2 |
|
Harris |
3 |
Accessibility:
AP – The AP was completely open and very
responsive. The people
directly in charge of the poll were kind enough to answer quickly even from
Beijing.
Coaches – The USA Today
ranks right up there with the AP.
Again, the right people answered quickly even while in Beijing.
However, the AFCA was completely unresponsive.
Like a 1-star recruit, they dragged down the Coaches’ Poll class ranking.
Harris
– A very
nice PR person acted as a liaison but no direct access to those in charge of the
poll. Also, response time wasn’t as
good as the AP or USA Today…and they lose a spot for not being in Beijing.
Pollspeak’s Take
– We would like to
thank all of the organizations (except the AFCA) for taking the time to answer
our questions.
|
POLL |
Rank |
|
AP |
1 |
|
Coaches |
2 |
|
Harris |
3 |
Secret Ballots:
AP – Has no secret ballots.
Every ballot is posted for every voter every week.
This allows football fans to
BROWSE them or
analyze them in-depth using
POLLSTALKER.
Coaches – “We are satisfied the current process provides the soundest football
rankings.”
Harris – “The BCS has set the guideline that the final rankings will be made
public.”
Pollspeak’s Take
– Secret Ballots are
like the bowl game of our questions.
Both the Coaches’ Poll and Harris Interactive are satisfied with keeping ballots
secret because they aren’t forced to do otherwise (other than the last poll of
the regular season). We asked them
if there was some advantage to this method, but never received a proper
response. The AP is the only
major poll to have every ballot public and is therefore the only poll to receive
points in this category. Why aren’t
the other two tied for second?
Because we have declared them ineligible for post-season play and forbid our
voters from ranking them. How do you
like them apples?
|
POLL |
Rank |
|
AP |
1 |
|
Coaches |
- |
|
Harris |
- |
The Final Tally:
Score is determined in the standard way. Every first place vote is worth 3 points, second place is 2 points, and third place is 1 point. So the final scores are:
|
POLL |
Rank |
Points |
|
AP |
1 |
17 |
|
Coaches |
2t |
11 |
|
Harris |
2t |
11 |
Congratulations to the AP for being ranked pre-season #1! The poll isn’t perfect, but it is the best we have. Keep in mind that these are just pre-season rankings. If the polls keep fighting each week to improve and provide us with timely and accurate information, they may jump in our future rankings.
First
Harris Interactive Poll - Sept. 28th (posted
8/26/08)
Here's a quick update direct from Harris Interactive: "The first Harris Interactive College Football Poll (HICFP) results are slated to be released on September 28, 2008."
So a full month of games will be played before we see their first rankings, and, yes, the ballots will once again be secret except the last poll of the season. If you want to see public ballots in the future, which would allow Pollstalker to work with the Harris Interactive and Coaches' polls, please sign the PETITION.
AP
Poll: Does It Need More Voters? Also, Herbstreit: A National
Fugitive Hiding Somewhere in Ohio? (posted
8/24/08)
Today we turn to the AP Poll in part two of our series covering voter changes and demographics in the polls. See Pollspeak’s previous article on the Coaches’ Poll below. It’s more difficult to spot regional bias in the AP Poll than in the Coaches’ Poll. We’re not saying that bias doesn’t exist, but the potential for it is just much less transparent.
Coaches are often rewarded by their schools based on how well their team does and how well other teams in their conference perform -- even if the reward is indirect. For example, many conferences share bowl money between schools. So if more teams from a conference go to more or bigger bowls, there is more money for everyone. So the potential for bias by coaches, who are school employees, is inherent in their vote… especially when the ballots are secret. This doesn’t mean all coaches will vote with overt bias, but the potential is obvious. See Pollspeak’s article on the 2007 Coaches’ Poll for many examples. Also note that Pollspeak sponsors a PETITION to remove secret ballots from the Coaches’ and Harris Interactive Polls.
There is no definitive link between AP voters and the
schools on which they vote. In fact,
the AP forbids a business relationship.
This is of course a good thing for reducing the potential for bias, but
it does make bias harder to spot.
(That’s why
POLLSTALKER was invented.) Even
when a writer works in a college football city, there isn’t necessarily a bias
towards the team in that city. Just
look at
Taylor Zarour’s pre-season ballot as an example.
He works in a cradle of ACC football,
Click here for a full list of the 2007 & 2008 AP voter changes. In short, the AP made far more changes than the Coaches’ poll, replacing 28 voters, or about 43% of the 65 total voters.
Looking at this breakdown of AP voters per state, there was no major geographical shifting of voters. Each state has the same number of voters in 2008 as 2007. However, there definitely were some shifts within each state.
It’s probably time to give the state of
Speaking of
|
|
Home
Teams |
|
|
UTEP |
|
|
Rice, Houston |
|
|
TCU, SMU (Dallas),
North Texas (Denton), Baylor (Waco), which is
closest to Fort Worth (85 miles), but in between FW, Houston and Austin |
|
|
|
As a major football school, Texas A&M
doesn’t really fit nicely into any of these areas.
Also left out in the cold is Texas Tech in
|
|
Home
Teams |
|
|
UCLA, USC |
|
|
|
For the sake of simplicity, we’re considering San Francisco/San Jose and LA/Riverside to be the same geographical areas.
This leaves
Technically, there is one state with even more than 4
votes, and that’s
A quick note on Herbstreit -- we’re not sure why he was
lumped into “
There are other examples of the AP re-aligning voters to
cities along school ties, like in
We can’t be sure if the AP will eventually try to realign
all votes towards major school cities or if it will just be constantly changing.
There are still plenty of examples to the contrary.
For example,
Of course, the AP can’t completely control voter locations. Voters have to be willing to do the job, and they have to be eligible (no conflict of interests, school booster, etc.) So there may be some smaller cities that don’t have willing or eligible voters. Since the AP also allows radio and TV personalities, you would think the odds are good, though. On that note, here’s a breakdown of voters by medium:
|
Medium |
# of
Voters |
|
Print* |
56 |
|
TV |
6 |
|
Radio** |
3 |
* Includes Steward Mandel of SI.com
** Includes Kirk Herbstreit of ESPN TV
In practice, we don’t know if increasing the number of voters would reduce bias. Especially since we know that beat writers don’t necessarily vote along geographic lines. The AP currently instructs voters to vote without bias, but if that is sufficient, why are they shifting votes to school cities? If the AP did put a voter in every school city, they could say that potential bias would be cancelled out. So if they are going to shift votes to school cities, they should be consistent to prevent the potential for even more uneven bias. Either way, the AP should continue to forbid biased voting…as long as they are diligent in looking for it. Pollspeak is here to help, and POLLSTALKER is the tool for the job.
Big
10 Has The Edge In Coaches' Poll (posted
8/22/08)
As part of our preseason analysis of the polls, we look at who's doing the voting. We compare the voters from last year to this year and point out who's left and who's new. We’ll also look at potential regional or conference biases. We’ll begin the series with the USA Today Coaches’ Poll.
11 coaches from 2007 no longer have a vote in 2008. Obviously some of them are not coaching this year, but some are. Also two coaches have transferred schools and taken their votes with them. Art Briles, formerly of Houston, now coaching Baylor, retained a vote. Also, Rich Rodriguez, formerly of West Virginia, now coaching Michigan, retained his vote. The Coaches’ Poll actually added one more voter in 2008. So there are now 61 voters, whereas in 2007, there were 60. That means 12 coaches are voting this year that didn’t have a vote last year.
You can see the full list of coaching changes here; however, below is a summary of who’s in and out:
|
New in 2008 |
Removed since 2007 |
|
Bo Pelini, Nebraska |
Bill Callahan, Nebraska |
|
Butch Jones, Central Michigan |
Bill Cubit, Western Michigan |
|
Gary Pinkel, Missouri |
Bill Doba, Washington State |
|
Gene Chizik, Iowa State |
Bob Stoops, Oklahoma |
|
Jim Leavitt, South Florida |
Dennis Franchione, Texas A&M |
|
Kyle Whittingham, Utah |
Houston Nutt, Arkansas |
|
Mike Price, Texas-El Paso |
Jeff Bower, Southern Mississippi |
|
Rick Neuheisel, UCLA |
Joe Novak, Northern Illinois |
|
Todd Dodge, North Texas |
Larry Blakeney, Troy |
|
Todd Graham, Tulsa |
Lloyd Carr, Michigan |
|
Turner Gill, Buffalo |
Sonny Lubick, Colorado State |
|
Urban Meyer, Florida |
|
We could look at which teams lost or gained a vote. For example, Nebraska and Michigan retained votes even though their coaches were replaced. However, more interesting is how many votes each conference is getting:
