|
POLLSPEAKPollspeak is a watchdog organization dedicated to keeping college sports polls (and computer-rankings) honest, or at least questioning those that seem to be flawed, uneducated or have an unreasonable bias. Why? Because polls affect teams' TV exposure, finances, recruiting and national championship hopes. Voters and pollsters must be held accountable.
Advertisement
       |
College Football HomeCheck here each week for the latest articles during football season. Past weeks' football articles can be found using the "Week" menu on the bar above. The awards are defined on the Awards page.
|
|
POLL |
Rank |
|
Harris |
1 |
|
AP |
2 |
|
Coaches |
3 |
Choosing the Voters:
AP – The bureau chief, many in conjunction
with the sports writer, select the voter(s) from their state/region. Some rotate
the vote every year to give different members a chance, some don't.
About half of the writers/broadcasters let the local sports writer or
bureau manager know he/she is interested in voting; we also seek out
writers/broadcasters. Usually
we contact the individual directly.
Coaches – All 119 Division
I-A coaches are eligible, though some decline to participate because of the time
commitment necessary for voters to fulfill their weekly obligations. We contact
the prospective voters (coaches, not universities) and ask if they are willing
to take part and meet the requirements that have been outlined.
Representatives of the USA Today and AFCA meet to review the proposed
list.
Harris
--
Panelists are randomly selected from among more than 300 nominations submitted
by the conference offices and the independent institutions. On behalf of the
Bowl Championship Series (BCS), Harris Interactive constructs a panel of former
players, coaches, administrators and current and former media who are committed
to ranking the college teams each week during the college football season.
Pollspeak’s Take
– The Coaches’ and
Harris Interactive polls have a more structured approach to choosing voters at
the national level whereas the AP delegates choices to the state level.
This means different states can handle things differently in the AP.
Some states might be constantly changing their voters while others never
change. This inconsistency drops the
AP to third. Harris edges out the
Coaches’ simply because it has a MUCH larger pool of candidates to draw from.
|
POLL |
Rank |
|
Harris |
1 |
|
Coaches |
2 |
|
AP |
3 |
Voter Qualifications:
AP – They have to be involved in college football coverage locally,
regionally or nationally.
Coaches – Most coaches have a lot of experience in the game, so we look for
reliability and adherence to the basic guidelines.
Harris
--
Panelists must be former players, coaches, administrators or current/former
media who are committed to ranking the college teams each week during the
college football season.
Pollspeak’s Take –
All of these are pretty much equal responses – beyond the need to
belong to the proper organization, they only need to have a pulse and know how
to work a phone. We would have given
the edge to anyone who mentioned a certain level of experience, a requirement to
watch a voter training video or watch a certain number of games each week.
We’ll call this a tie for third, since a tie for first would imply
they’re all doing great.
|
POLL |
Rank |
|
AP |
3 |
|
Coaches |
3 |
|
Harris |
3 |
Turning Down Voters:
AP – We turned down a voter who was also involved in Harris Interactive
or whatever it was called before.
Coaches – When reviewing the list of possible voters, over the years we have
steered away from one or two who might have been shown a pattern for being late
with their ballot. No more than one or two have not been invited back because of
questionable selections.
Harris
--
Harris Interactive communicates a set of principles with panelists which they
are expected to adhere to. One
principle is that they receive permission from their employer, if such
permission is required. Many media
outlets preclude their employees from participating in the Harris Interactive
College Football Poll.
Pollspeak’s Take – OK, once again we’ve got a tie for third.
These are all logistical reasons (or don't pertain to new voters).
We were hoping for answers like, “yes, we turned down
somebody who wrote in his bio that one of his all time favorite sports moments
was ‘Every time Tennessee and Auburn lose a football game.’”
or “We avoided a coach who let his Director of Player Development vote
his own team #1 instead of Texas as they had planned.”
etc.
|
POLL |
Rank |
|
AP |
3 |
|
Coaches |
3 |
|
Harris |
3 |
Voter Guidelines:
These are
the instructions each poll sends to the voters:
AP –
·
Base your vote on
performance, not reputation or preseason speculation.
·
Avoid regional bias,
for or against. Your local team does not deserve any special handling when it
comes to your ballot.
·
Pay attention to
head-to-head results and
·
Don’t hesitate to
make significant changes in your ballot from week to week. There’s no rule
against jumping the 16th-ranked team over the eighth-ranked team, if No. 16 is
coming off a big victory and No. 8 just lost 52-6 to a so-so team.
·
Teams on NCAA
probation ARE eligible for the AP poll.
Some ethics guidelines:
·
Voters should have
no professional or booster connection to the schools they cover. This could pose
a conflict of interest.
·
Voters cannot write
for team media guides or even independent fan magazines associated with certain
schools. This has the potential of compromising a reporter’s objectivity.
·
Adhere to APME and
APSE standards of conduct: We do not accept free tickets, deals, discounts or
gifts, etc.
·
Please be advised: "Homerism"
will be challenged and could lead to dismissal from the poll board.
Also noted, “We vote for schools on probation.”
Coaches –
Before the
preseason poll is conducted, all voters receive a letter from AFCA executive
director Grant Teaff reminding them of what he and the newspaper expect each
week. Basically, it's a ballot that's cast without fear or favor and delivered
on time. It must be personally drawn up by the coach and preferably phoned in by
him as well, though it is acceptable to have a staff member call if necessary.
Failure to adhere to these guidelines can result in removal from the board of
voters. The AFCA also reviews the guidelines in a letter sent out before the
final regular-season poll:
·
The coaches are told
they can vote for any eligible Division I-A team. They are told that any team on
major NCAA or conference probation is not eligible (if a team's status should
change during the season, we do notify them).
·
They are asked to
keep their votes thoughtful, reasoned, consistent and fair throughout the
season.
·
They are reminded
that no abstentions are permitted. If you commit to the poll, you commit to it
for every week of the season.
·
They also are
reminded that, for the post-bowls poll, that the AFCA recognizes the winner of
the BCS title game as the No. 1 team.
Harris –
·
Panelists receive
permission from their employer, if such permission is required.
·
Each panelist agrees
that ranking teams is a time-consuming process each week.
·
Panelists agree that
rankings must be based on their personal observations and analysis of team
performance.
Pollspeak’s Take – Harris is basically saying that a well-prepared voter is one who knows
how to use a remote control for long periods of time without complaining about
carpal tunnel. The AP wins out over
the Coaches’ poll because they give specific and useful advice and spell out the
penalty for bias. The Coaches’
Poll is at a disadvantage here since everyone who votes in their poll is a
school employee with an inherent bias.
|
POLL |
Rank |
|
AP |
1 |
|
Coaches |
2 |
|
Harris |
3 |
Monitoring and Replacing
Voters During the Season:
AP – We monitor ballots on a weekly basis.
They can call, fax or e-mail, and there's a human on the phone.
Other than not following the guidelines, a voter may be replaced for “repeatedly failing to call in a vote promptly,” or for a “conflict
of interest,” or “refusing to vote for a team on probation.”
(Also) we evaluate all voters every year.
Coaches – - Votes are called in by phone and recorded. One of our college desk
staffers then enters them into a computer. He follows up on any ballots that
might be questionable. (This individual has been doing it for more than 10
years.)
We closely
examine each ballot every Sunday. If we see something that seems the least bit
out of whack, we contact the coach, with whom we can usually resolve the issue.
Most of the time, it's over an inadvertent omission. If it cannot be resolved
there, we will bring an AFCA representative into the discussion.
The only
voters who have been replaced during the season have been a few who were
dismissed from their coaching position and opted not to continue to participate
in the voting. Our preference is that they stay on through the bowl games, and
most have agreed to do so. Those who have declined have been succeeded by the
coach who replaced them.
Harris -- Each week, Harris Interactive has rigorous processes in place to
ensure that each panelist’s rankings reflect their intent.
We utilize three methods for voting, including phone (live interviewer),
fax, and online. (Also) if those
members of the media who are panelists change employers either before or during
the season, they may become ineligible for the HICFP.
Pollspeak’s Take
– The AP earns top
spot for taking action during the season for the way a person has voted.
Coaches’ come second for at least replacing missing voters.
Harris comes in third since it seems that clerical issues are the main
concern. See last year’s
Pollspeak Report to Harris Interactive - College Football 2007
which shows that Harris Interactive actually allows missing ballots
during the season, seemingly without penalty to the voter during that season.
|
POLL |
Rank |
|
AP |
1 |
|
Coaches |
2 |
|
Harris |
3 |
Accessibility:
AP – The AP was completely open and very
responsive. The people
directly in charge of the poll were kind enough to answer quickly even from
Beijing.
Coaches – The USA Today
ranks right up there with the AP.
Again, the right people answered quickly even while in Beijing.
However, the AFCA was completely unresponsive.
Like a 1-star recruit, they dragged down the Coaches’ Poll class ranking.
Harris
–
A very
nice PR person acted as a liaison but no direct access to those in charge of the
poll. Also, response time wasn’t as
good as the AP or USA Today…and they lose a spot for not being in Beijing.
Pollspeak’s Take
– We would like to
thank all of the organizations (except the AFCA) for taking the time to answer
our questions.
|
POLL |
Rank |
|
AP |
1 |
|
Coaches |
2 |
|
Harris |
3 |
Secret Ballots:
AP – Has no secret ballots.
Every ballot is posted for every voter every week.
This allows football fans to
BROWSE them or
analyze them in-depth using
POLLSTALKER.
Coaches – “We are satisfied the current process provides the soundest football
rankings.”
Harris – “The BCS has set the guideline that the final rankings will be made
public.”
Pollspeak’s Take
– Secret Ballots are
like the bowl game of our questions.
Both the Coaches’ Poll and Harris Interactive are satisfied with keeping ballots
secret because they aren’t forced to do otherwise (other than the last poll of
the regular season). We asked them
if there was some advantage to this method, but never received a proper
response. The AP is the only
major poll to have every ballot public and is therefore the only poll to receive
points in this category. Why aren’t
the other two tied for second?
Because we have declared them ineligible for post-season play and forbid our
voters from ranking them. How do you
like them apples?
|
POLL |
Rank |
|
AP |
1 |
|
Coaches |
- |
|
Harris |
- |
The Final Tally:
Score is determined in the standard way. Every first place vote is worth 3 points, second place is 2 points, and third place is 1 point. So the final scores are:
|
POLL |
Rank |
Points |
|
AP |
1 |
17 |
|
Coaches |
2t |
11 |
|
Harris |
2t |
11 |
Congratulations to the AP for being ranked pre-season #1! The poll isn’t perfect, but it is the best we have. Keep in mind that these are just pre-season rankings. If the polls keep fighting each week to improve and provide us with timely and accurate information, they may jump in our future rankings.
First
Harris Interactive Poll - Sept. 28th (posted
8/26/08)
Here's a quick update direct from Harris Interactive: "The first Harris Interactive College Football Poll (HICFP) results are slated to be released on September 28, 2008."
So a full month of games will be played before we see their first rankings, and, yes, the ballots will once again be secret except the last poll of the season. If you want to see public ballots in the future, which would allow Pollstalker to work with the Harris Interactive and Coaches' polls, please sign the PETITION.
AP
Poll: Does It Need More Voters? Also, Herbstreit: A National
Fugitive Hiding Somewhere in Ohio? (posted
8/24/08)
Today we turn to the AP Poll in part two of our series covering voter changes and demographics in the polls. See Pollspeak’s previous article on the Coaches’ Poll below. It’s more difficult to spot regional bias in the AP Poll than in the Coaches’ Poll. We’re not saying that bias doesn’t exist, but the potential for it is just much less transparent.
Coaches are often rewarded by their schools based on how well their team does and how well other teams in their conference perform -- even if the reward is indirect. For example, many conferences share bowl money between schools. So if more teams from a conference go to more or bigger bowls, there is more money for everyone. So the potential for bias by coaches, who are school employees, is inherent in their vote… especially when the ballots are secret. This doesn’t mean all coaches will vote with overt bias, but the potential is obvious. See Pollspeak’s article on the 2007 Coaches’ Poll for many examples. Also note that Pollspeak sponsors a PETITION to remove secret ballots from the Coaches’ and Harris Interactive Polls.
There is no definitive link between AP voters and the
schools on which they vote. In fact,
the AP forbids a business relationship.
This is of course a good thing for reducing the potential for bias, but
it does make bias harder to spot.
(That’s why
POLLSTALKER was invented.) Even
when a writer works in a college football city, there isn’t necessarily a bias
towards the team in that city. Just
look at
Taylor Zarour’s pre-season ballot as an example.
He works in a cradle of ACC football,
Click here for a full list of the 2007 & 2008 AP voter changes. In short, the AP made far more changes than the Coaches’ poll, replacing 28 voters, or about 43% of the 65 total voters.
Looking at this breakdown of AP voters per state, there was no major geographical shifting of voters. Each state has the same number of voters in 2008 as 2007. However, there definitely were some shifts within each state.
It’s probably time to give the state of
Speaking of
|
|
Home
Teams |
|
|
UTEP |
|
|
Rice, Houston |
|
|
TCU, SMU (Dallas),
North Texas (Denton), Baylor (Waco), which is
closest to Fort Worth (85 miles), but in between FW, Houston and Austin |
|
|
|
As a major football school, Texas A&M
doesn’t really fit nicely into any of these areas.
Also left out in the cold is Texas Tech in
|
|
Home
Teams |
|
|
UCLA, USC |
|
|
|
For the sake of simplicity, we’re considering San Francisco/San Jose and LA/Riverside to be the same geographical areas.
This leaves
Technically, there is one state with even more than 4
votes, and that’s
A quick note on Herbstreit -- we’re not sure why he was
lumped into “
There are other examples of the AP re-aligning voters to
cities along school ties, like in
We can’t be sure if the AP will eventually try to realign
all votes towards major school cities or if it will just be constantly changing.
There are still plenty of examples to the contrary.
For example,
Of course, the AP can’t completely control voter locations. Voters have to be willing to do the job, and they have to be eligible (no conflict of interests, school booster, etc.) So there may be some smaller cities that don’t have willing or eligible voters. Since the AP also allows radio and TV personalities, you would think the odds are good, though. On that note, here’s a breakdown of voters by medium:
|
Medium |
# of
Voters |
|
Print* |
56 |
|
TV |
6 |
|
Radio** |
3 |
* Includes Steward Mandel of SI.com
** Includes Kirk Herbstreit of ESPN TV
In practice, we don’t know if increasing the number of voters would reduce bias. Especially since we know that beat writers don’t necessarily vote along geographic lines. The AP currently instructs voters to vote without bias, but if that is sufficient, why are they shifting votes to school cities? If the AP did put a voter in every school city, they could say that potential bias would be cancelled out. So if they are going to shift votes to school cities, they should be consistent to prevent the potential for even more uneven bias. Either way, the AP should continue to forbid biased voting…as long as they are diligent in looking for it. Pollspeak is here to help, and POLLSTALKER is the tool for the job.
Big
10 Has The Edge In Coaches' Poll (posted
8/22/08)
As part of our preseason analysis of the polls, we look at who's doing the voting. We compare the voters from last year to this year and point out who's left and who's new. We’ll also look at potential regional or conference biases. We’ll begin the series with the USA Today Coaches’ Poll.
11 coaches from 2007 no longer have a vote in 2008. Obviously some of them are not coaching this year, but some are. Also two coaches have transferred schools and taken their votes with them. Art Briles, formerly of Houston, now coaching Baylor, retained a vote. Also, Rich Rodriguez, formerly of West Virginia, now coaching Michigan, retained his vote. The Coaches’ Poll actually added one more voter in 2008. So there are now 61 voters, whereas in 2007, there were 60. That means 12 coaches are voting this year that didn’t have a vote last year.
You can see the full list of coaching changes here; however, below is a summary of who’s in and out:
|
New in 2008 |
Removed since 2007 |
|
Bo Pelini, Nebraska |
Bill Callahan, Nebraska |
|
Butch Jones, Central Michigan |
Bill Cubit, Western Michigan |
|
Gary Pinkel, Missouri |
Bill Doba, Washington State |
|
Gene Chizik, Iowa State |
Bob Stoops, Oklahoma |
|
Jim Leavitt, South Florida |
Dennis Franchione, Texas A&M |
|
Kyle Whittingham, Utah |
Houston Nutt, Arkansas |
|
Mike Price, Texas-El Paso |
Jeff Bower, Southern Mississippi |
|
Rick Neuheisel, UCLA |
Joe Novak, Northern Illinois |
|
Todd Dodge, North Texas |
Larry Blakeney, Troy |
|
Todd Graham, Tulsa |
Lloyd Carr, Michigan |
|
Turner Gill, Buffalo |
Sonny Lubick, Colorado State |
|
Urban Meyer, Florida |
|
We could look at which teams lost or gained a vote. For example, Nebraska and Michigan retained votes even though their coaches were replaced. However, more interesting is how many votes each conference is getting:
|
2007 |
ACC |
Big 10 |
Big 12 |
Big
East |
C-USA |
MAC |
M-West |
Pac-10 |
SEC |
Sun
Belt |
WAC |
IND |
|
60 |
6 |
7 |
6 |
4 |
6 |
6 |
4 |
5 |
7 |
4 |
4 |
1 |
|
2008 |
ACC |
Big 10 |
Big 12 |
Big
East |
C-USA |
MAC |
M-West |
Pac-10 |
SEC |
Sun
Belt |
WAC |
IND |
|
61 |
6 |
7 |
7 |
4 |
6 |
6 |
4 |
5 |
7 |
4 |
4 |
1 |
So there is one extra voter in 2008, and that vote went to the Big 12. However, more important is how the votes are distributed by conference. Of course, Notre Dame has a vote, but we’ll overlook them as they are independent.
|
# of
Votes (2008) |
Conference Names |
|
7 |
Big 10, Big 12, SEC |
|
6 |
ACC, C-USA, MAC |
|
5 |
Pac 10 |
|
4 |
Big East, M-West, Sun Belt, WAC |
Upon first glance, the most striking thing is that the Big East is lumped in with non-traditional BCS conferences getting only 4 votes. While other non-traditional BCS conferences like C-USA and the MAC get 6 votes (1 more than the Pac 10 even). However, here is another way to look at the breakdown that might help:
|
2008 |
ACC |
Big 10 |
Big 12 |
Big
East |
C-USA |
MAC |
M-West |
Pac-10 |
SEC |
Sun
Belt |
WAC |
|
# of votes |
6 |
7 |
7 |
4 |
6 |
6 |
4 |
5 |
7 |
4 |
4 |
|
# of Teams |
12 |
11 |
12 |
8 |
12 |
13 |
9 |
10 |
12 |
8 |
9 |
|
% of teams with vote |
50% |
~64% |
~58% |
50% |
50% |
Special(ly
Long) Report: Ranking The Polls