Author Topic: Polls and accuracy  (Read 292 times)

Offline Ripsnort

  • Radioactive Member
  • *******
  • Posts: 27251
Polls and accuracy
« on: February 19, 2001, 09:11:00 AM »
Just curious, I heard a radio program (KIRO in Seattle, alittle to the left, but I like to listen to all sides) say that of all the polls in the U.S., that the Gallup Polls seemed to be the best, cross-culture, cross median polls....anyone have a clue as to whether KIRO was accurate in reporting this?

Offline Kieren

  • Zinc Member
  • *
  • Posts: 3
Polls and accuracy
« Reply #1 on: February 19, 2001, 09:21:00 AM »
I don't know. I do know that inherently I distrust polls given that it is so easy to manupulate the information to mean what the pollster wants it to mean. Simply asking leading questions can accomplish this...

Offline Ripsnort

  • Radioactive Member
  • *******
  • Posts: 27251
Polls and accuracy
« Reply #2 on: February 19, 2001, 09:26:00 AM »
Yep, that's exactly why I'm not too sure about polls as well, but some must be accurate to a point in regards to a cross section of opinion, no?

Reporting the news can be misleading, with a raise of an eyebrow, the tone of the voice, the manner in which the information is presented..or lack thereof...etc.

Offline Ripsnort

  • Radioactive Member
  • *******
  • Posts: 27251
Polls and accuracy
« Reply #3 on: February 19, 2001, 02:58:00 PM »
Anyway, here's a Gallup poll:
 
Quote
REAGAN TOPS PRESIDENTS POLL:
                                                         Americans questioned over the
                                                         weekend by GALLUP chose Ronald
                                                         Reagan (18 percent) as the greatest
                                                         U.S. president, while John F.
                                                         Kennedy (16 percent) and Abraham
                                                         Lincoln (14 percent) finished
                                                         second and third...

Offline Ripsnort

  • Radioactive Member
  • *******
  • Posts: 27251

Offline Dead Man Flying

  • Platinum Member
  • ******
  • Posts: 6301
Polls and accuracy
« Reply #5 on: February 19, 2001, 04:18:00 PM »
Ripsnort, the answer to your question is that it depends.  If administered in a scientific manner, polls can be very, VERY reliable.  If administered with a particular motivation in mind, obviously the results must be viewed with some scrutiny.

Several things make a poll scientific.  First, the sample size matters.  There is a tradeoff between sample size and margin of error.  The smaller the sample size, the larger the margin of error (and the lower the costs of administering the survey).  The relationship isn't linear, however, and you'll experience diminishing returns from increased sample sizes.  Ideally, a survey should have between 1500 to 2000 respondents for a margin of error at or below plus/minus 2%.  This is Newsweek's biggest problem, as they tend to survey about 500 to 700 people for their polls.

Second, a survey must be randomly administered, or as near-randomly administered as possible.  The problem here is that most polling firms won't tell you how they drew up their sample.  Ideally you'd want a completely random sample; as this is impossible, a design such as random-sample clustering works well.  If I'm not mistaken, I believe this method breaks down the country into various regions, and these regions into various areas, and these areas into smaller areas, on and on down to the individual.  Randomization then occurs at each stage.

Finally, polls must have valid questions.  A poll asking, "What are your views on abortion?  Are you in favor of it, against it, undecided, or none of these?" is far more scientific than a poll asking, "Do you support the mass execution of unborn human lives through the atrocity of abortion?"  Be wary of polls that don't disclose the exact wording of the questions asked to interviewees.  As a matter of priming, question order also may influence answers.  Unfortunately, it's nearly impossible for the casual reader to discern the order in which questions were asked.

That said, Gallup is a decent organization, and certainly the best known among polling firms.  As it is under so much scrutiny to get things right, chances are that their polls are conducted with as much professionalism as possible.

Probably the best survey design and administration you'll find, period, is the annual National Election Studies(NES)out of the University of Michigan.  The link there, if you're curious, is  http://www.umich.edu/~nes/

Hope this helps,

Todd/DMF

Ice

  • Guest
Polls and accuracy
« Reply #6 on: February 19, 2001, 04:29:00 PM »
But....but....I was told that Bill Clinton was the greatest American President!?!?!?!

Offline Dead Man Flying

  • Platinum Member
  • ******
  • Posts: 6301
Polls and accuracy
« Reply #7 on: February 19, 2001, 04:38:00 PM »
Just looked at the poll results here.  As the margin of error for this survey was plus/minus 5%, any articles interpreting the results should be taken with a grain of salt.  The simple fact is that Reagan with 18%, Kennedy with 16%, and Lincoln with 14% are statistically indistinguishable from one another.  We cannot determine the "winner."

-- Todd/DMF