College Football

 

3 Sports Image


POLLSPEAK

Pollspeak is a watchdog organization dedicated to keeping college sports polls (and computer-rankings) honest, or at least questioning those that seem to be flawed, uneducated or have an unreasonable bias.  Why?  Because polls affect teams' TV exposure, finances, recruiting and national championship hopes. 

Voters and pollsters must be held accountable.

 

Advertisement

        


 

College Football Home

Check here each week for the latest articles during football season.  Past weeks' football articles can be found using the "Week" menu on the bar above.  The awards are defined on the Awards page.

3 Polls LogoSpecial(ly Long) Report:  Ranking The Polls  (posted 8/28/08)

Ever wonder how voters are chosen and what they’re instructed to do?  Here is your chance to find out.  We contacted officials at the Associated Press (AP), USA Today, American Football Coaches Association (AFCA) and Harris Interactive to find out how they conduct their polls and compare them to each other.  In typical Pollspeak fashion, we even rank their answers in each category.  Let’s see how they like it! 

Conference or Geographical Quotas:

AP  – Votes are based on how many FBS (Football Bowl Subdivision) schools are in a state -- 1 - 3 schools equals one vote, 4 - 6 equals two, etc.

Coaches – Slots are apportioned by conference, with a slight edge in representation given to those conferences that were most successful during the previous season. Independents are also in the mix.  How is success determined?  Mel Pulliam at the AFCA uses a formula that generally reflects how conferences were represented in the final poll. It's not a major factor but it usually means there may be one more voter in the Big Ten than in the WAC, for example.

Harris -- Panelist slots are filled by conference, each represented equally and all randomly selected to be invited to participate from among its list of nominees.  Eleven conferences each have 10 panelists and the independent institutions comprise the remaining 4, for a total of 114.

Pollspeak’s Take The AP is straying from its own formula.  Texas has 10 FBS schools and has 4 votes.  California has 7 FBS schools and has 4 votes  (so we can assume 7 – 10 schools = 4 votes).  Florida has 7 FBS schools but only has 3 votes.   Ohio has 8 FBS schools (6 in the MAC alone) and only has 3 votes (one of which is Kirk Herbstreit, who should be listed under National.).  Illinois has 3 FBS schools but still gets 2 votes.  There are more examples, but the AP needs to rework or stick to its own formula. 

With Harris every conference has the same representation (although we’ll need to verify this after they announce the voters).  The Coaches’ Poll has a more complicated formula, and they haven’t shared the details.  The AFCA has not responded for comment (although the USA today has been very helpful).  So we can’t verify if they’re following their own formula.  However, we do know that the conferences are currently unbalanced.   See our article on the Coaches’ Poll below.  We also know that the intent is to give an extra reward to the conferences that do best in the polls.  This means that if votes are unfairly balanced in the first place, this system will reward those already at an advantage.  Basically, the rich are getting richer.  While the AP may have made mistakes, at least the overall concept is fair.

POLL

Rank

Harris

1

AP

2

Coaches

3

Choosing the Voters:

AP – The bureau chief, many in conjunction with the sports writer, select the voter(s) from their state/region. Some rotate the vote every year to give different members a chance, some don't.  About half of the writers/broadcasters let the local sports writer or bureau manager know he/she is interested in voting; we also seek out writers/broadcasters.   Usually we contact the individual directly.

Coaches – All 119 Division I-A coaches are eligible, though some decline to participate because of the time commitment necessary for voters to fulfill their weekly obligations. We contact the prospective voters (coaches, not universities) and ask if they are willing to take part and meet the requirements that have been outlined.  Representatives of the USA Today and AFCA meet to review the proposed list.      

Harris -- Panelists are randomly selected from among more than 300 nominations submitted by the conference offices and the independent institutions. On behalf of the Bowl Championship Series (BCS), Harris Interactive constructs a panel of former players, coaches, administrators and current and former media who are committed to ranking the college teams each week during the college football season.

Pollspeak’s Take – The Coaches’ and Harris Interactive polls have a more structured approach to choosing voters at the national level whereas the AP delegates choices to the state level.  This means different states can handle things differently in the AP.  Some states might be constantly changing their voters while others never change.  This inconsistency drops the AP to third.  Harris edges out the Coaches’ simply because it has a MUCH larger pool of candidates to draw from.

POLL

Rank

Harris

1

Coaches

2

AP

3

Voter Qualifications:

AP – They have to be involved in college football coverage locally, regionally or nationally. 

Coaches – Most coaches have a lot of experience in the game, so we look for reliability and adherence to the basic guidelines.

Harris -- Panelists must be former players, coaches, administrators or current/former media who are committed to ranking the college teams each week during the college football season.

Pollspeak’s Take All of these are pretty much equal responses – beyond the need to belong to the proper organization, they only need to have a pulse and know how to work a phone.  We would have given the edge to anyone who mentioned a certain level of experience, a requirement to watch a voter training video or watch a certain number of games each week.  We’ll call this a tie for third, since a tie for first would imply they’re all doing great.

POLL

Rank

AP

3

Coaches

3

Harris

3

Turning Down Voters:

AP – We turned down a voter who was also involved in Harris Interactive or whatever it was called before.

Coaches – When reviewing the list of possible voters, over the years we have steered away from one or two who might have been shown a pattern for being late with their ballot. No more than one or two have not been invited back because of questionable selections.

Harris -- Harris Interactive communicates a set of principles with panelists which they are expected to adhere to.  One principle is that they receive permission from their employer, if such permission is required.  Many media outlets preclude their employees from participating in the Harris Interactive College Football Poll.

Pollspeak’s Take – OK, once again we’ve got a tie for third.  These are all logistical reasons (or don't pertain to new voters).  We were hoping for answers like, “yes, we turned down somebody who wrote in his bio that one of his all time favorite sports moments was ‘Every time Tennessee and Auburn lose a football game.’”  or “We avoided a coach who let his Director of Player Development vote his own team #1 instead of Texas as they had planned.”  etc.

POLL

Rank

AP

3

Coaches

3

Harris

3

Voter Guidelines:

These are the instructions each poll sends to the voters:

AP 

·         Base your vote on performance, not reputation or preseason speculation.

·         Avoid regional bias, for or against. Your local team does not deserve any special handling when it comes to your ballot.

·         Pay attention to head-to-head results and

·         Don’t hesitate to make significant changes in your ballot from week to week. There’s no rule against jumping the 16th-ranked team over the eighth-ranked team, if No. 16 is coming off a big victory and No. 8 just lost 52-6 to a so-so team.

·         Teams on NCAA probation ARE eligible for the AP poll.

Some ethics guidelines:

·         Voters should have no professional or booster connection to the schools they cover. This could pose a conflict of interest.

·         Voters cannot write for team media guides or even independent fan magazines associated with certain schools. This has the potential of compromising a reporter’s objectivity.

·         Adhere to APME and APSE standards of conduct: We do not accept free tickets, deals, discounts or gifts, etc.

·         Please be advised: "Homerism" will be challenged and could lead to dismissal from the poll board.

Also noted, “We vote for schools on probation.”

Coaches

Before the preseason poll is conducted, all voters receive a letter from AFCA executive director Grant Teaff reminding them of what he and the newspaper expect each week. Basically, it's a ballot that's cast without fear or favor and delivered on time. It must be personally drawn up by the coach and preferably phoned in by him as well, though it is acceptable to have a staff member call if necessary. Failure to adhere to these guidelines can result in removal from the board of voters. The AFCA also reviews the guidelines in a letter sent out before the final regular-season poll:

·         The coaches are told they can vote for any eligible Division I-A team. They are told that any team on major NCAA or conference probation is not eligible (if a team's status should change during the season, we do notify them).

·         They are asked to keep their votes thoughtful, reasoned, consistent and fair throughout the season.

·         They are reminded that no abstentions are permitted. If you commit to the poll, you commit to it for every week of the season.

·         They also are reminded that, for the post-bowls poll, that the AFCA recognizes the winner of the BCS title game as the No. 1 team.

Harris

·         Panelists receive permission from their employer, if such permission is required.

·         Each panelist agrees that ranking teams is a time-consuming process each week.

·         Panelists agree that rankings must be based on their personal observations and analysis of team performance.

Pollspeak’s Take Harris is basically saying that a well-prepared voter is one who knows how to use a remote control for long periods of time without complaining about carpal tunnel.  The AP wins out over the Coaches’ poll because they give specific and useful advice and spell out the penalty for bias.   The Coaches’ Poll is at a disadvantage here since everyone who votes in their poll is a school employee with an inherent bias.

POLL

Rank

AP

1

Coaches

2

Harris

3

Monitoring and Replacing Voters During the Season:

AP – We monitor ballots on a weekly basis.   They can call, fax or e-mail, and there's a human on the phone.  Other than not following the guidelines, a voter may be replaced forrepeatedly failing to call in a vote promptly,” or for a “conflict of interest,” or “refusing to vote for a team on probation.”   (Also) we evaluate all voters every year.

Coaches – - Votes are called in by phone and recorded. One of our college desk staffers then enters them into a computer. He follows up on any ballots that might be questionable. (This individual has been doing it for more than 10 years.)

We closely examine each ballot every Sunday. If we see something that seems the least bit out of whack, we contact the coach, with whom we can usually resolve the issue. Most of the time, it's over an inadvertent omission. If it cannot be resolved there, we will bring an AFCA representative into the discussion. 

The only voters who have been replaced during the season have been a few who were dismissed from their coaching position and opted not to continue to participate in the voting. Our preference is that they stay on through the bowl games, and most have agreed to do so. Those who have declined have been succeeded by the coach who replaced them. 

Harris -- Each week, Harris Interactive has rigorous processes in place to ensure that each panelist’s rankings reflect their intent.  We utilize three methods for voting, including phone (live interviewer), fax, and online. (Also)  if those members of the media who are panelists change employers either before or during the season, they may become ineligible for the HICFP.

Pollspeak’s Take – The AP earns top spot for taking action during the season for the way a person has voted.  Coaches’ come second for at least replacing missing voters.  Harris comes in third since it seems that clerical issues are the main concern.  See last year’s Pollspeak Report to Harris Interactive - College Football 2007 which shows that Harris Interactive actually allows missing ballots during the season, seemingly without penalty to the voter during that season.

POLL

Rank

AP

1

Coaches

2

Harris

3

Accessibility:

AP – The AP was completely open and very responsive.   The people directly in charge of the poll were kind enough to answer quickly even from Beijing.

Coaches – The USA Today ranks right up there with the AP.  Again, the right people answered quickly even while in Beijing.  However, the AFCA was completely unresponsive.  Like a 1-star recruit, they dragged down the Coaches’ Poll class ranking.

Harris A very nice PR person acted as a liaison but no direct access to those in charge of the poll.  Also, response time wasn’t as good as the AP or USA Today…and they lose a spot for not being in Beijing.

Pollspeak’s Take – We would like to thank all of the organizations (except the AFCA) for taking the time to answer our questions. 

POLL

Rank

AP

1

Coaches

2

Harris

3

Secret Ballots:

AP – Has no secret ballots.  Every ballot is posted for every voter every week.  This allows football fans to BROWSE them or analyze them in-depth using POLLSTALKER.

Coaches – “We are satisfied the current process provides the soundest football rankings.”

Harris – “The BCS has set the guideline that the final rankings will be made public.” 

Pollspeak’s Take – Secret Ballots are like the bowl game of our questions.  Both the Coaches’ Poll and Harris Interactive are satisfied with keeping ballots secret because they aren’t forced to do otherwise (other than the last poll of the regular season).  We asked them if there was some advantage to this method, but never received a proper response.   The AP is the only major poll to have every ballot public and is therefore the only poll to receive points in this category.  Why aren’t the other two tied for second?  Because we have declared them ineligible for post-season play and forbid our voters from ranking them.  How do you like them apples?

POLL

Rank

AP

1

Coaches

-

Harris

-

The Final Tally:

Score is determined in the standard way.  Every first place vote is worth 3 points, second place is 2 points, and third place is 1 point.  So the final scores are:

POLL

Rank

Points

AP

1

17

Coaches

2t

11

Harris

2t

11

Congratulations to the AP for being ranked pre-season #1The poll isn’t perfect, but it is the best we have.   Keep in mind that these are just pre-season rankings.  If the polls keep fighting each week to improve and provide us with timely and accurate information, they may jump in our future rankings.

Harris InteractiveFirst Harris Interactive Poll - Sept. 28th  (posted 8/26/08)

Here's a quick update direct from Harris Interactive:  "The first Harris Interactive College Football Poll (HICFP) results are slated to be released on September 28, 2008." 

So a full month of games will be played before we see their first rankings, and, yes, the ballots will once again be secret except the last poll of the season.  If you want to see public ballots in the future, which would allow Pollstalker to work with the Harris Interactive and Coaches' polls, please sign the PETITION.

AP LogoAP Poll:  Does It Need More Voters?  Also, Herbstreit:  A National Fugitive Hiding Somewhere in Ohio?  (posted 8/24/08)

Today we turn to the AP Poll in part two of our series covering voter changes and demographics in the polls.  See Pollspeak’s previous article on the Coaches’ Poll below.  It’s more difficult to spot regional bias in the AP Poll than in the Coaches’ Poll.  We’re not saying that bias doesn’t exist, but the potential for it is just much less transparent.

Coaches are often rewarded by their schools based on how well their team does and how well other teams in their conference perform -- even if the reward is indirect.  For example, many conferences share bowl money between schools.  So if more teams from a conference go to more or bigger bowls, there is more money for everyone.  So the potential for bias by coaches, who are school employees, is inherent in their vote… especially when the ballots are secret.  This doesn’t mean all coaches will vote with overt bias, but the potential is obvious.  See Pollspeak’s article on the 2007 Coaches’ Poll for many examples.  Also note that Pollspeak sponsors a PETITION to remove secret ballots from the Coaches’ and Harris Interactive Polls.

There is no definitive link between AP voters and the schools on which they vote.  In fact, the AP forbids a business relationship.  This is of course a good thing for reducing the potential for bias, but it does make bias harder to spot.  (That’s why POLLSTALKER was invented.)  Even when a writer works in a college football city, there isn’t necessarily a bias towards the team in that city.  Just look at Taylor Zarour’s pre-season ballot as an example.  He works in a cradle of ACC football, Raleigh, North Carolina, but on his Bio page (before it was changed), he says he grew up “an avid fan of the Crimson Tide,” and listed one of his all-time favorite sports moments as “Every time Tennessee and Auburn lose a football game.”  He then proceeded to leave Tennessee and Auburn off of his pre-season ballot.  The AP does have rules against school affiliations and “homerism”, which will be discussed in an upcoming article.  In the meantime, here’s how the AP voters fall into place:

Click here for a full list of the 2007 & 2008 AP voter changes.  In short, the AP made far more changes than the Coaches’ poll, replacing 28 voters, or about 43% of the 65 total voters.

Looking at this breakdown of AP voters per state, there was no major geographical shifting of voters.  Each state has the same number of voters in 2008 as 2007.  However, there definitely were some shifts within each state.

Alabama’s votes moved from Montgomery and Mobile in 2007 to Dothan and Birmingham in 2008.  This puts a voter in the home of Conference USA’s UAB Blazers.  However, it also takes away the closest voter to Auburn (Montgomery, 55 miles).  Now the closest city to Auburn is Dotha, which is 120 miles away (and 240 miles to Bama in Tuscaloosa).  Mobile is about the same distance to Auburn and Alabama, and was replaced with Birmingham, which is 110 miles to Auburn and 60 miles to Tuscaloosa.  Again, proximity may not be an indicator of bias, but let’s compare this with what is going on in Florida.

Florida had all three of its voters replaced.  This isn’t surprising since Floridians are notorious for having voting issues (ask Al Gore).  Still, where the votes landed is very interesting.  In 2007, the votes were in:  Brevard (Orlando/Melbourne), Miami and St. Petersburg.  In 2008, they are in Tallahassee (FSU), Gainesville (UF) and Tampa (USF).  I’ve been to both Tallahassee and Gainesville, and these are not major metropolitan areas.  Okay, Tallahassee has the state capitol and another university in FAMU.  Gainesville exports fine musical talent (Tom Petty and ½ of The Eagles) and is the world’s largest importer of jorts, but if Gainesville is capable of hosting an AP voter, then certainly other cities like Tuscaloosa, Auburn, Lubbock, College Station, Clemson, University Park, Eugene, etc. can host a voter.

It’s probably time to give the state of Florida a fourth vote.  With the emergence of USF, the already football-rich state of Florida has earned it. (Texas and California are currently the only two states with four votes).  The fourth vote should likely go back to the Miami area to cover the University of Miami and the Sun Belt’s FIU and FAU.  This would still leave Orlando’s UCF in no man’s land similar to some teams in Texas and California.

Speaking of Texas and California, let’s look at where those votes fall:

Texas City

Home Teams

El Paso

UTEP

Houston

Rice, Houston

Fort Worth

TCU, SMU (Dallas), North Texas (Denton), Baylor (Waco), which is closest to Fort Worth (85 miles), but in between FW, Houston and Austin

Austin

Texas

As a major football school, Texas A&M doesn’t really fit nicely into any of these areas.  College Station is 90 miles from Houston, but similarly less than 100 miles from Austin.

Also left out in the cold is Texas Tech in Lubbock.  The closest voter to Lubbock is in Fort Worth, which is nearly 300 miles away.

California  City

Home Teams

Los Angeles area (x2)

UCLA, USC

San Francisco area  (X2)

San Jose St., California, Stanford

For the sake of simplicity, we’re considering San Francisco/San Jose and LA/Riverside to be the same geographical areas.

This leaves Fresno State about half-way between the voters and San Diego State a couple hours south of LA…or about five hours on a bad LA traffic day (I’ve done that drive.)  If Florida were to get four votes, maybe it is time for Texas and California to get 5? Interestingly, not a single voter from Texas or California was replaced this year. 

Technically, there is one state with even more than 4 votes, and that’s New York. Oh, you won’t see it listed on the AP’s list of voters.  It only shows one vote for New York.  However, at the very bottom there is also a list of “National” voters.  While these people may be national personalities, they are all headquartered in New York.  Okay, ESPN’s headquarters is actually in Bristol, Connecticut, but it is owned and partnered with ABC, which is based in New York.  So that makes six votes for New York.  Why six?  Well, because one more is hidden in Ohio – Kirk Herbstreit.  Yes, he played QB for Ohio State, and he may do some work for WBNS-AM radio, but certainly he is most well known (and well paid) for his work at ESPN.  Admittedly, there are lots of arguments that could be made here.  Technically Walt Disney owns ABC and ESPN, so you could say the votes are California votes, or you could say that ESPN should be considered Connecticut.  Without belaboring the point, when determining demographics for these voters, we can clearly place these votes in the northeast of the countryThat is a point often brought up by Pac-10 fans claiming ESPN has an “east-coast bias.”

A quick note on Herbstreit -- we’re not sure why he was lumped into “Ohio” instead of “National,” but we’ve sent the question to the AP.  For now, we’ll guess that there is a rule against having two voters from the same organization.  If that’s the case, having Craig James from ABC, Chris Fowler from ESPN, and Kirk Herbstreit from WBNS-AM is really stretching that rule.  Pollspeak has no issue with all three participating, but we’d rather see the voters stay and the rule go away.  Then we can be up-front about the locations of these people for regional bias tracking.

There are other examples of the AP re-aligning voters to cities along school ties, like in Michigan.  In 2007, Michigan’s votes were in Ann Arbor (Michigan) and Oakland County, which you would expect would be near Michigan State.  However, South Lyon is one of the closer cities in Oakland to East Lansing, but it is still 50 miles away and only 15 miles to Ann Arbor.  So in 2008, the AP moved the vote from Oakland to Lansing.

We can’t be sure if the AP will eventually try to realign all votes towards major school cities or if it will just be constantly changing.  There are still plenty of examples to the contrary.  For example, the state of Oregon’s lone vote is neither in Eugene nor Corvallis.  It’s in Portland.  Would it be better to put two voters in Oregon, one in each major school’s city?  Applied nationwide, that could lead to over 100 voters. 

Of course, the AP can’t completely control voter locations.  Voters have to be willing to do the job, and they have to be eligible (no conflict of interests, school booster, etc.)  So there may be some smaller cities that don’t have willing or eligible voters.  Since the AP also allows radio and TV personalities, you would think the odds are good, though.  On that note, here’s a breakdown of voters by medium:

Medium

# of Voters

Print*

56

TV

6

Radio**

3

* Includes Steward Mandel of SI.com

** Includes Kirk Herbstreit of ESPN TV

In practice, we don’t know if increasing the number of voters would reduce bias.  Especially since we know that beat writers don’t necessarily vote along geographic lines.  The AP currently instructs voters to vote without bias, but if that is sufficient, why are they shifting votes to school cities?  If the AP did put a voter in every school city, they could say that potential bias would be cancelled out.  So if they are going to shift votes to school cities, they should be consistent to prevent the potential for even more uneven bias.  Either way, the AP should continue to forbid biased voting…as long as they are diligent in looking for it.  Pollspeak is here to help, and POLLSTALKER is the tool for the job.

Coaches' WhistleBig 10 Has The Edge In Coaches' Poll (posted 8/22/08)

As part of our preseason analysis of the polls, we look at who's doing the voting.  We compare the voters from last year to this year and point out who's left and who's new.  We’ll also look at potential regional or conference biases.  We’ll begin the series with the USA Today Coaches’ Poll. 

11 coaches from 2007 no longer have a vote in 2008.  Obviously some of them are not coaching this year, but some are.  Also two coaches have transferred schools and taken their votes with them.  Art Briles, formerly of Houston, now coaching Baylor, retained a vote.  Also, Rich Rodriguez, formerly of West Virginia, now coaching Michigan, retained his vote.  The Coaches’ Poll actually added one more voter in 2008.  So there are now 61 voters, whereas in 2007, there were 60.  That means 12 coaches are voting this year that didn’t have a vote last year.

You can see the full list of coaching changes here; however, below is a summary of who’s in and out:

New in 2008

Removed since 2007

Bo Pelini, Nebraska

Bill Callahan, Nebraska

Butch Jones, Central Michigan

Bill Cubit, Western Michigan

Gary Pinkel, Missouri

Bill Doba, Washington State

Gene Chizik, Iowa State

Bob Stoops, Oklahoma

Jim Leavitt, South Florida

Dennis Franchione, Texas A&M

Kyle Whittingham, Utah

Houston Nutt, Arkansas

Mike Price, Texas-El Paso

Jeff Bower, Southern Mississippi

Rick Neuheisel, UCLA

Joe Novak, Northern Illinois

Todd Dodge, North Texas

Larry Blakeney, Troy

Todd Graham, Tulsa

Lloyd Carr, Michigan

Turner Gill, Buffalo

Sonny Lubick, Colorado State

Urban Meyer, Florida

 

We could look at which teams lost or gained a vote.  For example, Nebraska and Michigan retained votes even though their coaches were replaced.  However, more interesting is how many votes each conference is getting:

2007

ACC

Big 10

Big 12

Big East

C-USA

MAC

M-West

Pac-10

SEC

Sun Belt

WAC

IND

60

6

7

6

4

6

6

4

5

7

4

4

1

 

2008

ACC

Big 10

Big 12

Big East

C-USA

MAC

M-West

Pac-10

SEC

Sun Belt

WAC

IND

61

6

7

7

4

6

6

4

5

7

4

4

1

So there is one extra voter in 2008, and that vote went to the Big 12.  However, more important is how the votes are distributed by conference.  Of course, Notre Dame has a vote, but we’ll overlook them as they are independent.

# of Votes (2008)

Conference Names

7

Big 10, Big 12, SEC

6

ACC, C-USA, MAC

5

Pac 10

4

Big East, M-West, Sun Belt, WAC

Upon first glance, the most striking thing is that the Big East is lumped in with non-traditional BCS conferences getting only 4 votes.  While other non-traditional BCS conferences like C-USA and the MAC get 6 votes (1 more than the Pac 10 even).  However, here is another way to look at the breakdown that might help:

2008

ACC

Big 10

Big 12

Big East

C-USA

MAC

M-West

Pac-10

SEC

Sun Belt

WAC

# of votes

6

7

7

4

6

6

4

5

7

4

4

# of Teams

12

11

12

8

12

13

9

10

12

8

9

% of teams with vote

50%

~64%

~58%

50%

50%