Democratic Underground Latest Greatest Lobby Journals Search Options Help Login
Google

Growing Polling Controversy on Daily Tracking Polls Part III: Why phrigndumass is ahead of the game

Printer-friendly format Printer-friendly format
Printer-friendly format Email this thread to a friend
Printer-friendly format Bookmark this thread
This topic is archived.
Home » Discuss » Archives » General Discussion: Presidential (Through Nov 2009) Donate to DU
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:09 PM
Original message
Growing Polling Controversy on Daily Tracking Polls Part III: Why phrigndumass is ahead of the game
Some time ago readers of phrigndumass' daily widget began to notice a widening discrepancy between the daily polls of Gallup and Rasmussen and the composite picture that he provides:

http://www.democraticunderground.com/discuss/duboard.php?az=view_all&address=132x6805429

Part I: Raised the Issue of how are the Pollsters weighing when the demographics are changing so quickly

http://journals.democraticunderground.com/grantcart/133

Part II: Detailed Plouffe's statements at the convention that parralleled some of the points above and also indicated that they use polling to pinpoint movements in particular groups and that the national daily tracking polls are useless:

http://www.democraticunderground.com/discuss/duboard.php?az=view_all&address=132x6820061



Part III: The controversy about the validity of the Daily Tracking Polls Continues

More support of the Plouffe position and more criticism of Gallup





http://www.pollster.com/blogs/gallup_daily_the_worst_thing_i.php


Gallup Daily - The Worst Thing in journalism in 10 Years?

By David Moore



In Mark Blumenthal's post on how David Plouffe is polling for Barack Obama, the Democratic nominee's communications director Dan Pfeiffer is quoted as saying that "the Gallup Daily is the worst thing that's happened to journalism in 10 years." Gallup's Frank Newport predictably rejected the comments, claiming that Pfeiffer's comments "are the same types of sentiments that have been expressed since George Gallup's first presidential polls in 1936."




I don't think Frank is correct in his boiler plate response. It is not useful to dismiss all criticisms of polls these days as the same old tired comments of seven decades ago that have long been discredited.
If I understand Mark's blog correctly, Pfeiffer and Plouffe object to the Gallup Daily because it does not, contrary to Frank's assertion, provide an accurate description of where the presidential race stands today.



According to Mark's post, Plouffe claims that the topline polling data aren't especially useful (they "don't tell you anything"). Instead, the campaign focuses on who are the "true undecideds," and what messages will persuade them to vote for Obama. Knowing how many undecided voters there are is an integral part of understanding the presidential race. That's true for the campaigns, and it is no less true for political observers and the public.



But Gallup refuses to measure the undecided vote, and instead gives a hypothetical description of a presidential race, "if the election were held today" - showing us that 95 percent of voters have already made up their minds. But the election is not being held today, and the Gallup Daily does not tell us the truth about how many voters are - at this point in the campaign - committed to a candidate, and how many voters have yet to make up their minds. From Plouffe's and Pfeiffer's point of view, the Gallup Daily is useless - even in understanding the national sentiment.



Frank claims that the public needs "independent polling" so that it doesn't have to rely on "campaign operatives' self-promoting insights on where the race stands." I couldn't agree with him more. But the public needs accurate independent polling, which gives the public a full picture of where the presidential race stands. Gallup Daily does not do that. But it could










Joseph Marshall: Plouffe is right about particular numbers




When you read the rest of the briefing you can also see why Plouffe has a point about the irrelevance of daily polling. If thousands of white women voters in Texas, Alabama and Utah make a break to McCain because of the "role model" of gun-totin', moose-eatin' Sarah Palin, Plouffe couldn't care less. His opposite number in the McCain campaign couldn't care less either .

On the other hand, if Palin's anti-abortion stance starts gaining ground among Hispanic Catholics, this will have every insider's attention. In other words, Plouffe's business is with the right voters in the right places.


It probably should be a larger part of the business of pollsters and news pundits, too. But pollsters are paid to poll, pundits are paid to pund, and Plouffe is paid to elect Obama.

If the pollsters started to merely cherry-pick their samples the way Plouffe does, their integrity and judgment would be questioned. And if the pundits didn't dutifully ponder any mass movement of women voters toward McCain in the terminally red states, all hell would break loose--and some of those fine voters might also tote guns and like pundit for dinner on the days when they don't eat moose.

The Gallup Daily is not the worst thing to happen in ten years. It's a fine poll and a great help to pundits and reporters doing their jobs. But Plouffe may be pardoned for hyperbole, since it's a hindrance to his job, if only to waste his time answering questions about it.







Brambster: The problem is the way that the numbers are being reported



brambster:
I think we're mistaking what the statement really said. He said it was the worst thing that has happened to journalism and not polling.


The focus then was on the undecideds, and I don't believe this was completely a reflection of whether or not they were tracked, but rather the focus of the media on the decided vote which is fairly static until very late in the cycle, while the campaign's focus is on their message and what is best for bringing the undecided voters over to their side.

So for every minute of coverage on the horse race and those that have already made up their minds, that is a minute less that might be used to spread their tested messages to undecided voters.

National polls also focuses too much attention on the national numbers which do not track the expected electoral vote advantage at a given point in time.

If polls were tracking EV's instead of national popular votes, the Obama campaign would have been largely trouncing the McCain campaign by up to a 2:1 margin for much of the last 3 months, but instead the race is being characterized as a dead heat by some when you just simply take the national poll results.


So maybe this really boils down to the polls drowning out the message to undecideds, and also not giving what the Obama campaign believes is a proper characterization of the race as a whole which I'm sure they believe is anything but a dead heat. If the media reported it as being a full on drubbing, it would surely impact the strength of the second place candidate.




What is increasingly evident is that phrigndumass' 360 degree look of trends and broad use of indicators is one of the most effective chroniclers of where this race is at. It's use of different indicator measurers, compilation of multiple electoral vote indicators, popular vote based on state and not national polls, and various methods of showing electoral vote status, strength and trending make it the best daily update on the internet, more comprehensive and accessible than the other more well known sites like fivethirtyeight.com.

Sometimes the closer something is and the more accessible it is the less it is appreciated by those that see it every day. Its like the neighbor of the Eiffel Tower that remarks "Its nice but I really would like to see the Grand Canyon".

As the pollsters continue to light up their analytical columns with methodological detail it is nice to see the hard work that phrigndumass puts in that gives us a clearer and unbiased work on the great event that we are building to.

Nothing Gallup does can meet the sublime simplicity and clear presentation of this simple chart that he updates daily:





thanks phrig your no dum ass
Printer Friendly | Permalink |  | Top
bluestateguy Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:13 PM
Response to Original message
1. Congress has got to rein in the destructive polling industry
First thing is to haul all of the pollsters in front of a congressional committee and publicly shame them.
Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:17 PM
Response to Reply #1
6. well I was thinking more along the lines of a dunking booth
Edited on Sat Aug-30-08 11:19 PM by grantcart
Printer Friendly | Permalink |  | Top
 
RagAss Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:19 PM
Response to Reply #6
7. Oh ..Dunking?...I'll put the Guillotine back in the garage then......
Printer Friendly | Permalink |  | Top
 
cliffordu Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:13 PM
Response to Original message
2. K&R Grantcart.
Nice work, thank the phrig'n for me.
Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:14 PM
Response to Reply #2
3. can't we don't speak to each other anymore
you have to visit his thread and do it yourself
Printer Friendly | Permalink |  | Top
 
cliffordu Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:16 PM
Response to Reply #3
4. Ouch. Sorry.
Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:17 PM
Response to Reply #4
5. gotcha
Printer Friendly | Permalink |  | Top
 
cliffordu Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:31 PM
Response to Reply #5
14. Ok, Paybacks will soon arrive.....
:rofl:
Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:25 PM
Response to Reply #4
10. BTW why is yours the only avatar that is showing?
Printer Friendly | Permalink |  | Top
 
cliffordu Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:31 PM
Response to Reply #10
13. I'm special.
Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 06:28 PM
Response to Reply #13
32. uh as in special education?
Printer Friendly | Permalink |  | Top
 
Coexist Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:21 PM
Response to Original message
8. ...
Printer Friendly | Permalink |  | Top
 
berni_mccoy Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:23 PM
Response to Original message
9. K&R! Gallup and AP are becoming more and more obvious about the propaganda
They are part of the RW Media machine trying to convince the general population of a reality that does not exist.
Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:28 PM
Response to Reply #9
11. Well there is a legitimate methodological problem that they are facing

if Obama adds 200,000 newly registered voters in FL and he has identified (as Plouffe says he has) 600,000 registered AA voters that did not vote last election how are they supposed to weight the different demographich group.

Now I think it can be done because in the examples above phrigndumass did it for Texas.

But for them to do it would cause an uproar and claims of bias towards Obama.
Printer Friendly | Permalink |  | Top
 
roguevalley Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:30 PM
Response to Original message
12. all hail phrygndumbass! heh-heh-heh ... I always wanted to say that.
:P
Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 12:21 AM
Response to Reply #12
17. lol
Printer Friendly | Permalink |  | Top
 
Lisa0825 Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:37 PM
Response to Original message
15. grantcart, you and phrigndumass have been the greatest!
I can always count on you two to educate and inform me! :yourock:
Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Aug-30-08 11:39 PM
Response to Reply #15
16. phrign and I both agree that you are half right lol
Printer Friendly | Permalink |  | Top
 
JeffR Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 12:25 AM
Response to Original message
18. Let's get phriggy with it!
:woohoo:

Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 04:04 AM
Response to Reply #18
19. lol
Printer Friendly | Permalink |  | Top
 
No Elephants Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 05:11 AM
Response to Reply #18
21. Good One!
Printer Friendly | Permalink |  | Top
 
Awsi Dooger Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 04:58 AM
Response to Original message
20. Sorry, but the more you dismiss national polls the more you'll be wrong
Plouffe isn't magical and isn't inventing anything.

I remember exactly the same absurdity in 2004. This site and all the progressive sites were in desperation mode to denounce Gallup. The obsession at the time was Party ID. The traditional relationship in previous cycles was Democrats +3 or +4 in Party ID. Gallup in 2004 had determined that the old standard was no longer valid in 2004, that Republicans had parity or even an edge in Party ID.

For two months there was an ongoing battle to ridicule Gallup. Thread after thread would try to amend Gallup's poll results by using the "proper weighting." There was a full page ad titled, "Galluping to the Right," purchased by a liberal group in a major paper.

Here's one link I quickly found from the time period:

http://www.leftbusinessobserver.com/Gallup.html

Anyway, it turns out Gallup was correct, in essence. There had been a shift in Party ID. It was dead even in exit polls. I know, exit polls that we don't believe. That's always the issue around here.

Gallup is one of many. It should be factored in an average, nothing more. But if we ignore or deny that average to clutch state polls and not national, our conclusions will be mistaken.

As always, I'm amazed we want to make this more complicated than it is. All the scrambling to evaluate and weigh hundreds of factors and fixate on recency is basically worthless. The big picture situational factors dominate.
Printer Friendly | Permalink |  | Top
 
phrigndumass Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 07:46 AM
Response to Reply #20
22. Hi Awsi ... National polls shouldn't be dismissed, I agree :)
Neither should the historical data. So we agree on that as well. I just take the OCD approach ... don't trust anything until you confirm it for yourself.

I do track the national polls and their demographics under the toplines:



:hi:
Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 11:28 AM
Response to Reply #20
24. Well you have fallen in the exact same trap that Gallup has fallen into


and that is assuming that the weighting and demographic turnout of the last election will essentially be the same as this one with a slight increase in minority turnout.

Our crititicism is not of Gallup's performance in the last general election so all of your citations to that are completely pointless.

The Obama campaign has identified 600,000 African American voters in Florida that did not vote in the last election and we know from press reports that they have registered more than 100,000 African American voters for this one.

In the OP we acknowledge that it is an almost overwhelming burden for Gallup to recalibrate turnout projections and revise their weighting calibrations, but it seems that they are not even trying.

phrigndumass even took those questions and applied to a case study:http://journals.democraticunderground.com/grantcart/133


To sum up:

1) None of our criticisms with Gallup have to do with 2004 so all of your observations are without merit
2) You (and Gallup) have not addressed how do you change weighting formulas in an election that is going to have a substantially different demographic turnout than before.
3) We are not stoking this controversy - its the pollsters that are doing it themselves. If you google "polling weight" for the last 30 days you get more than 17,000 responses. In polling circles this is a very big story.
4) The reviews of pollsters on Gallup is basic in line with our amaturish musings - I have yet to find a single pollster who agrees with the "boiler plate" explanation that you adopt. Even pollsters who think Gallup is doing a good job admit there is a problem.
5) There is a common sense problem here that you completely overlook. In the past there hasn't been much of a discrepancy between the national tracking poll and the combined state poll and the electoral college vote, they basically were within a few points of each other. If you follow phrigndumass morning thread you will see that there is a huge disparity between the popular vote of the states and that of the national poll, the comparison with the electoral college is even greater. Your reply makes no effort to explain why the composite of all of the state polls are at such a large variance with the national polls.



Printer Friendly | Permalink |  | Top
 
phrigndumass Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 07:52 AM
Response to Original message
23. My face has turned beet red!
:blush: :blush: :blush: :blush:

Thanks for your very kind words, grantcart! I would argue only one point: 538 is a better projecting model than mine is. My work is a snapshot, while theirs is a true model projection. I'm more of a documentarian.

Everyone loves how useful your posts are! Very few DUers can write with insight and clarity the way you do.

:yourock:
Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 11:37 AM
Response to Reply #23
25. The post started simply as an update of the polling controversy but the more you read
the reactions to Plouffe and Galllup the more it shows how strong your daily effort is.


Here is why I think it is better than 538 for the common guy. Your thread gives a much clearer presentation of electoral college strength than 538 does, or atleast its a lot more accessible. At thie point it isn't a question of where the Electoral College is, but how strong are the votes are. Your presentation gives it at a glance and without need of a calculator.
Printer Friendly | Permalink |  | Top
 
fight4my3sons Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 02:00 PM
Response to Original message
26. k&r grantcart
:hi:
Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 02:27 PM
Response to Reply #26
28. thanks
Printer Friendly | Permalink |  | Top
 
Ichingcarpenter Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 02:25 PM
Response to Original message
27. kick nominated n/t
Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 02:36 PM
Response to Reply #27
29. thanks
Printer Friendly | Permalink |  | Top
 
Arkana Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 02:37 PM
Response to Original message
30. My guess is phrig takes into account the groundswell of young voters
that WILL happen this year. For chrissakes, they doubled their numbers for Kerry in 2004--what will they do for a candidate that truly inspires them?
Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-31-08 03:05 PM
Response to Reply #30
31. actually his threads take into account more state by state polling
and they are more likely to be weighted better.


A prevue of coming attactions, phrig is working on massive effort that would go state by state and reweight their numbers by adjusting for more realistic turn out of minority and youth voters.

An early estimate shows that even a conservative adjustment will add 3% to Obama's national numbers but even more interesting will be the impact on EV.

Look forward to an interesting post by him next weekend.
Printer Friendly | Permalink |  | Top
 
grantcart Donating Member (1000+ posts) Send PM | Profile | Ignore Mon Sep-01-08 09:33 AM
Response to Original message
33. morning kick
Printer Friendly | Permalink |  | Top
 
DU AdBot (1000+ posts) Click to send private message to this author Click to view 
this author's profile Click to add 
this author to your buddy list Click to add 
this author to your Ignore list Sat May 04th 2024, 11:29 AM
Response to Original message
Advertisements [?]
 Top

Home » Discuss » Archives » General Discussion: Presidential (Through Nov 2009) Donate to DU

Powered by DCForum+ Version 1.1 Copyright 1997-2002 DCScripts.com
Software has been extensively modified by the DU administrators


Important Notices: By participating on this discussion board, visitors agree to abide by the rules outlined on our Rules page. Messages posted on the Democratic Underground Discussion Forums are the opinions of the individuals who post them, and do not necessarily represent the opinions of Democratic Underground, LLC.

Home  |  Discussion Forums  |  Journals |  Store  |  Donate

About DU  |  Contact Us  |  Privacy Policy

Got a message for Democratic Underground? Click here to send us a message.

© 2001 - 2011 Democratic Underground, LLC