ZenPundit
Wednesday, March 01, 2006
 
PERILS OF PUSH POLLING FOREIGN POLICY

John Zogby, the well known political pollster is in the news today due to a poll he ran for a left-wing peace group that was published in the Christian Science Monitor that purports to show a remarkable shift in sentiment by American troops in Iraq to favor immediate withdrawal and a deep division between regular troops and reservists. Serious questions are being raised on both the Left and Right about the methodology used by Zogby as well as the phrasing of the questions themselves.

For starters, a proper representative sampling appears not to have been used by Zogby in this poll; Bruce Kesler at the Democracy Project writes:

"Today, Mystery Pollster -- who is liberal, a reputable and experienced evaluator of polls, and who had access to some of the “secret” methodology – reveals his judgments [ ed. Note " Mystery Pollster"communicated with John Zogby directly]. They parallel mine.

First, to be clear, the Center for Peace and Global Studies is in effect a "partisan" sponsor in that, according to Zogby, they oppose the war in Iraq.

Second, while Zogby says his interviewers selected respondents randomly at various locations, he makes no claim of random selection with respect to the locations involved. I apologize for being so vague, but the most I can say is that the method Zogby used to gain access to those locations constrained his ability to make random selections.

Third, even if consumers of this data knew all that I know about how Zogby's interviewers "walked up to troops" (as commenter Karen puts it), they would still have questions about the impact of such an interaction might have on the kinds of troops most likely to agree to participate in the survey. Consider the exit poll example again. Even though exit pollsters have disclosed the procedures they use to train interviewers and select respondents, we still debate the effect of those procedures on the kinds of voters that choose to participate. Disclosure in that case cannot resolve all questions, but it at least enables an informed debate. Unfortunately, such discussion and debate is impossible in this case. "

Aside from the problem of of the Zogby poll not being properly representative in general there may be a particular selection bias at work here. As a military affairs writer for The Chicago Tribune, Colonel E. W. Chamberlain III has noted, the troops that civilian journalists have the easiest access to in a war zone are also those most likely to have the lowest morale and loudest gripes. Garrison or routine duty is inherently demotivating compared to more exciting missions in the field that far fewer journalists ever see outside of the Robert Kaplan types.

A definitive answer on the accuracy of the Zogby poll is not possible unless John Zogby chooses to make such information regarding his exact methodology available. If it is accurate, that poll would be a critical data point for field commanders, policy makers and the Congress to know. It would indicate very serious problems in terms of the troops morale and mission objectives and a need for the administration to take action.

If it is not accurate then it is either bad data honestly arrived at or an attempt to drive public debate and thus foreign policy under false pretenses to a position favored by the Zogby client and perhaps Mr. Zogby himself, given his personal interest in America adopting a more evenhanded or pro-Arab policy for the Middle-East. Either way the poll would not be adding illumination to the events in Iraq but throwing up dust and distorting the OODA loop.

John Zogby is an influential and important pollster but credibility once lost, is lost. He owes it to both himself and the American troops in Iraq to offer the public some clarification.
 
Comments:
Remember Zogby's last big moment in the spotlight?

From Wikipedia:
In 2004, however, his predictions failed to materialize. Before polls had even closed in the 2004 presidential election, Zogby predicted a comfortable win for John Kerry (311 electoral votes, versus 213 for Bush, with 14 too close to call), saying that "Bush had this election lost a long time ago," adding that voters wanted a change and would vote for "any candidate who was not Bush." While admitting that he was mistaken, Zogby did not admit any possible flaws in his poll methods, insisting that his predictions were all "within the margin of error." Meanwhile, opponents charged that his calling the race for Kerry while polling was still going on may have been a cynical attempt to depress the turnout.

The MSM has been predicting widespread civil war for three years now in Iraq, claiming bad morale was crippling the Army and Marines and God knows how many other fantasies they dreamed up could undermine the American people's support of the war.

Its just so damn craven, nothing surprises me out of these people anymore.
 
Hi eddie,

I'd forgotten that Zogby did he bad Kerry polling, good reminder !
 
I haven't trusted Zogby polls for a long time: his results have a consistent leftward bias compared to other polls, actual votes, and other comparators.
 
Post a Comment

<< Home
Zenpundit - a NEWSMAGAZINE and JOURNAL of scholarly opinion.

My Photo
Name:
Location: Chicago, United States

" The great majority of mankind are satisfied with appearances as though they were realities" -- Machiavelli

Determined Designs Web Solutions Lijit Search
ARCHIVES
02/01/2003 - 03/01/2003 / 03/01/2003 - 04/01/2003 / 04/01/2003 - 05/01/2003 / 05/01/2003 - 06/01/2003 / 06/01/2003 - 07/01/2003 / 07/01/2003 - 08/01/2003 / 08/01/2003 - 09/01/2003 / 09/01/2003 - 10/01/2003 / 10/01/2003 - 11/01/2003 / 11/01/2003 - 12/01/2003 / 12/01/2003 - 01/01/2004 / 01/01/2004 - 02/01/2004 / 02/01/2004 - 03/01/2004 / 03/01/2004 - 04/01/2004 / 04/01/2004 - 05/01/2004 / 05/01/2004 - 06/01/2004 / 06/01/2004 - 07/01/2004 / 07/01/2004 - 08/01/2004 / 08/01/2004 - 09/01/2004 / 09/01/2004 - 10/01/2004 / 10/01/2004 - 11/01/2004 / 11/01/2004 - 12/01/2004 / 12/01/2004 - 01/01/2005 / 01/01/2005 - 02/01/2005 / 02/01/2005 - 03/01/2005 / 03/01/2005 - 04/01/2005 / 04/01/2005 - 05/01/2005 / 05/01/2005 - 06/01/2005 / 06/01/2005 - 07/01/2005 / 07/01/2005 - 08/01/2005 / 08/01/2005 - 09/01/2005 / 09/01/2005 - 10/01/2005 / 10/01/2005 - 11/01/2005 / 11/01/2005 - 12/01/2005 / 12/01/2005 - 01/01/2006 / 01/01/2006 - 02/01/2006 / 02/01/2006 - 03/01/2006 / 03/01/2006 - 04/01/2006 / 04/01/2006 - 05/01/2006 / 05/01/2006 - 06/01/2006 / 06/01/2006 - 07/01/2006 / 07/01/2006 - 08/01/2006 / 08/01/2006 - 09/01/2006 / 09/01/2006 - 10/01/2006 / 10/01/2006 - 11/01/2006 / 11/01/2006 - 12/01/2006 / 12/01/2006 - 01/01/2007 / 01/01/2007 - 02/01/2007 / 02/01/2007 - 03/01/2007 / 03/01/2007 - 04/01/2007 / 04/01/2007 - 05/01/2007 / 05/01/2007 - 06/01/2007 / 06/01/2007 - 07/01/2007 / 07/01/2007 - 08/01/2007 / 08/01/2007 - 09/01/2007 / 09/01/2007 - 10/01/2007 / 10/01/2007 - 11/01/2007 / 11/01/2007 - 12/01/2007 /



follow zenpundit at http://twitter.com
This plugin requires Adobe Flash 9.
Get this widget!
Sphere Featured Blogs Powered by Blogger StatisfyZenpundit

Site Feed Who Links Here
Buzztracker daily image Blogroll Me!