- Ms Kaye is a Tyee Builder. You can be, too.
- Mary Carlisle is a Tyee Builder. You can be, too.
- Prem Gill is a Tyee Builder. You can be, too.
- Nancy Flight is a Tyee Builder. You can be, too.
- Justin Everett is a Tyee Builder. You can be, too.
- John Westover is a Tyee Builder. You can be, too.
- Nora Etches is a Tyee Builder. You can be, too.
- Edward Henderson is a Tyee Builder. You can be, too.
- Bharadwaj Chandramouli is a Tyee Builder. You can be, too.
- Dean Chatterson is a Tyee Builder. You can be, too.
- Marius Scurtescu is a Tyee Builder. You can be, too.
- Robert Parkes is a Tyee Builder. You can be, too.
- James Murton is a Tyee Builder. You can be, too.
- Susan Doyle is a Tyee Builder. You can be, too.
- Vincent Strgar is a Tyee Builder. You can be, too.
- Helen Spiegelman is a Tyee Builder. You can be, too.
- Subir Guin is a Tyee Builder. You can be, too.
- Kimball Finigan is a Tyee Builder. You can be, too.
- Joanne Manley is a Tyee Builder. You can be, too.
- David Leach is a Tyee Builder. You can be, too.
Can You Really Poll Online?
Bad news numbers have Liberals wondering.
Angus Reid: online poll pusher.
Everyone knows the maxim about blaming the messenger, but in this story, it's the horse that's taking the heat.
Two weeks ago, Angus Reid Strategies released a poll that showed the federal Liberals tanking. The poll, put out March 3 and conducted over seven days in late February, had the governing Conservatives 16 per cent ahead of their rivals and, according to the accompanying press release, "on the brink of majority."
The results were surprising, but not much. The Liberals have bled support since Christmas. A series of Conservative ads attacking leader Stéphane Dion only aggravated their wounds. So if the size of the Tory lead was unexpected, it was miles far from implausible. Still, that didn't stop some prominent Liberals from laying into the numbers.
Unlike traditional opinion polls, the Reid one wasn't conducted on the phone. No random calls at dinnertime, no random Canadians answering long strings of questions about their political preferences. Instead, the survey was done entirely online. And that's where, for those aforementioned Liberals, the problems start.
Blogger Jason Cherniak, maybe the best-known non-professional Grit on the web, was first out of the gate. "I was already pretty sure that online surveys can only be extrapolated to the online community," he wrote. "Now I am convinced."
Warren Kinsella, one of the architects of the Liberal's 2000 election victory, wasn't far behind. "Among those online (and as the blogosphere demonstrates, daily), important demographic groups are significantly under-represented: older people, rural residents, those with lower incomes, and women," he wrote. "And, despite what some of even the respected pollsters claim, pollsters aren't being terribly scientific in their recruitment efforts."
Now, there's nothing wrong with attacking a bad poll. We've done our fair share of that here at The Tyee. But one suspects the people at Angus Reid might not entirely agree with the Liblogger perspective on their scientific methods. So, aiming to do some unrepresentative sampling of my own, I phoned up Reid (the company, not the man) and spoke to President and Chief Operating Officer Edward Morawksi.
Morawski was pretty dismissive of the bloggers' concerns. No poll, or polling method is perfect, he told me, but there's no evidence that a well selected online sample is any less perfect that a telephone one. In fact, he argued, in some countries the online versus phone debate was settled years ago; the Internet won hands down. "In the U.K. today, the most respected pollster is YouGov," an entirely online operation Morawski said. And in the U.S., it's Harris, also all web based.
Polling, Morawski says, is all about the sample. To accurately predict how a larger population feels about something -- a brand, a politician, even Conrad Black -- you need to survey a balanced chunk of the whole. (The opinions of 3,000 white males from Regina won't tell you much about how the entire country feels about anything.) Angus Reid selects their sample randomly from a larger group signed up on the Reid website. The results are then calibrated to take into account things like age, gender and voting preference.
The main criticism that Cherniak and Kinsella had was that by picking their sample online, AR Strategies excluded all those Canadians who aren't, thus preventing a truly representative slice. Morawski acknowledged that was a problem. But, he countered, there are ways to work around it. And what's more, the sample problems for telephone pollsters are just as bad and maybe worse.
The big issue for telephone polling is refusal rates, something Reid himself called "the big dirty secret" of the polling industry in a 2004 Tyee article. Put simply, every year more people refuse to take part in surveys. Many more simply don't pick up the phone for unknown callers, and some don't have home phones at all. In another Tyee article from 2005, Tom Barrett reported that for a typical B.C. election poll, a pollster must dial 6,000 to 10,000 numbers to get a representative sample. That, according to Morawski and Reid, means building a representative sample by phone gets tougher every year.
The Angus Reid online polls try to work around that by building in incentives for people to participate, Morawski told me. Each selected member of the sample is paid between $1 and $4 for each survey they fill out. Morawski said they are also conscious about keeping the surveys short and, as much as possible, enjoyable.
At the end of our interview, Morawski came back to the idea that no method for polling is perfect. "We get it, we know it, there are concerns," he said. "Is the Internet perfect, no.... It is just a new method and a new technology."
Related Tyee stories:



9
Login or register to post comments
BC Dude
5 years ago
May God save us from a
May God save us from a Conservative majority gov as we will be sold off to the NWO!
Frank
5 years ago
The bright side
The bright side is that perhaps Canadians are finally waking up to the fact that what the Libs promise when they're out of power has no relation to what they do when they're actually in power.
Dion lost a lot of left-wing support right off the bat with his shots. Guess he didn't realize that the only place the Libs can grow is by taking support from the NDP, Bloc and Greens, 2 of which are left of the Libs.
Not that it matters, people don't want to hear about another Red Book full of promises that will never be kept.
southdeltawalker
5 years ago
live by the polls....die by the polls
All online polling will tell us is which party or group can quickly mobilize it's supporters to answer the questions to their parties/group advantage.
Polls are no longer an indication of what people are thinking. You get a better sense of that by reading the "Tyee", letters to the editors and what the political commentators are saying.
Of course, who is left out of this "scientific" polling are: the poor, immigrants, migrant workers, women and those who just can't be bothered as they know it doesn't mean anything.
As for the Liberals...what are they thinkin?? or maybe they are not thinkin?? Who needs a poll to them them that the Liberals are tanking! Hey have you listened to Dion lately.....wake me up when he says something interesting!
4CANADA
5 years ago
DION/Polls
Dion sure has been a disappointment... Kennedy should of been the man.. but isn't that SO like the pretend "liberals"..."lets go with the neo-liberal french guy and create the impression were returning to our roots"...
when I heard Mike marrisen was heading up dion's west coast "team" red flags went up big time...the same guy who extols and has been deeply connected to the fascist "liberals" of BC, you know the guys who came in promising big tax cuts but forgot to mention , oh yeah were also going to; double med premiums,eliminate senior bus passes, close womens shelters etc etc etc etc , ..Party Politics is the current death knell of democracy.
As for fast food polls ..interesting how the papers spout them all the time with virtually no context ie something as simple as, hey what was the actual question(s) being asked? Or an investigative piece about how accurate or inaccurate these polls are or have been,who's polls are more reliable etc I guess they make good headlines though eh?
Peace,
Bancroft
moodyguy
5 years ago
who to vate for???
These poles may be bad news for the liberal party, however,it is far worse for the very large number of Canadian who want to vote for an alternative to the extreme right (temporally disguised for now) of Mr Harper. Dion has so far been a dissappointment and Layton has been talking, if about anything at all, about stuff that is not important to canadians now.
Wake up politicians and give us choice or we will see an extreme gov't in power.
Bytesmiths
5 years ago
You've got a choice...
Hating Harper? Disappointed by Dion? Lummoxed by Layton?
Check out Elizabeth May. She's smart, experienced, and talks straight. Vote Green!
BC Dude
5 years ago
Here's a party worth voting
Here's a party worth voting for a party "For The People By The People"
http://canadianactionparty.ca/cgi/page.cgi?zine=show&aid=343&_id=27
Isn't it about time WE had the Fortitude to go after these greedy bas_ _r_s?
Now it’s spring lets start by joining and going out to the corners of OUR streets every evening at 6pm till 7pm and look to see how many will be there with US it's thought that could catch on!
WE HAVE TO START SOMEWHERE!
Make a sign like "Corner Democracy"
BC Dude
5 years ago
This is what gordo, Ralphy
This is what gordo, Ralphy and Harper are all about the NWO, scary shite.
http://www.freedomtofascism.com./
Elizabeth Woods
5 years ago
Polling On-line
Granted, I don't know much about polling, but it seems to me that a random sample from a group who signed up to answer surveys, is still representtaive ONLY of that group. Just like phone polling, it tells us nothing about those who choose not to answer. In time, with luck, perhaps polls will become so unrepresentative as to be useless and eventually ignored.