Since the Iraq war began, an important question for those closely following the conflict has been the number of excess Iraqi casualties resulting from the war and occupation. Various researchers have attempted to estimate this number. I raq Body Count has kept a running tab of civilian deaths reported in the Western media and, more recently, by certain Iraqi government sources., but their figure, now at around 95,000, is undoubtedly low due to its reliance on media reports and Iraqi government figures. During times of intense conflict, many deaths likely go unreported in the media, while there have been numerous inconsistencies in and reports of political manipulation of government figures as it may not be in the government’s interest to admit the extent of deaths from the conflict.
An alternate way to estimate conflict-associated mortality is through the conduct of carefully sampled household surveys counting the number of deaths in selected households and using statistical techniques to extrapolate to the overall population. Much attention has been focused especially, by myself and others, on the Lancet mortality studies of 2004 and 2006\. The first of these studies estimated that there had been approximately 100,000 excess deaths from the war by September 2004. The second study estimated that there were around 650,000 excess deaths through summer 2006. They further found that the vast majority of these excess casualties — around 600,000 — were from violence, a stark contrast from most other such conflicts studied where large numbers die from poor health and the breakdown of social organization associated with conflict. “Excess casualties” here means the number who died above that number that would have been expected to die had prewar trends continued and the war and occupation not occurred.
We have recently learned that Gilbert Burham, the lead author of second Lancet study, has been sanctioned by Johns Hopkins for deviating from the approved IRB protocol and collecting the names of many survey respondents, a fact that was implicitly denied in numerous public pronouncements. The school does assert that, as far as they can determine, no one was harmed by this ethical lapse. As a result of this sanction, Burnham has been barred by Johns Hopkins from serving as the principal investigator (lead researcher) on studies involving “human subjects” (live people) for five years. He was also ordered to publish a correction in the Lancet, which has now appeared:
“The Methods section of this Article (Oct 21, 2006) stated that ‘Participants were assured that no unique identifiers would be gathered.’ Upon review, it was determined that a significant number of the surveys contained names of respondents and household inhabitants. This was a lapse in the authors’ obligations to protect participants. However, to the authors’ knowledge, the completed surveys remained in possession of the research team at all times and there were no known breaches in confidentiality.”
This error, and its possible coverup in subsequent public statements means that, in my opinion, we can no longer rely upon the Lancet II mortality estimates. If one major methodological detail was distorted, we simply cannot know whether other aspects of the study were carried out as stated. Until and unless there is far greater detail on these methods, I do not feel that their estimate of 650,000 post-invasion surplus deaths can be trusted.
Burnham had early last month been censured by the American Association for Public Opinion Research for refusing to reveal details of the study methodology. I must say I find this censure highly unusual at best as Burnham is not a member of AAPOR. I have never previously heard of a professional association investigating, much less censuring, a non-member. However, as the Hopkins investigation shows, the non-cooperation may have been to cover up the methodological discrepancy, rather than for more understandable reasons.
I find this episode deeply disturbing. The issue of the magnitude of civilian deaths in Iraq is a profoundly important one. Given the known political sensitivity of the issue, the researchers should have been especially careful in the controllable aspects of their methodology. They were not. Rather, they gave ammunition to those who would inevitably attack their conclusions for political or ideological reasons. The result is that we are less knowledgeable about this important question than many of us believed as an important data source is no longer reliable.
While I find David Kane’s self-satisfied tone to be disturbing, I must admit that he was more right than I had believed regarding the weaknesses in the Lancet II study. As Kane points out, Burnham’s public statements were, in spirit if not in legalistic wording, not accurate.
We are left with several other studies estimating Iraqi casualties. The British ORB polling company estimated as of August 2007
that over 1,000,000 Iraqi citizens have died as a result of the conflict which started in 2003
While ORB is a reputable polling company, the faith we can place in these results is weakened due to their failure to publish a detailed methodology; such information is typically included in papers published in peer-reviewed journals, which is one reason researchers typically place greater credence on studies published in such journals. When the Lancet II findings were credible, the ORB study appeared to be a replication of the general order of magnitude of casualties found in that study. With the increased doubts about the Lancet II study, the ORB stands as an outlier. I wish the firm would publish a detailed methodology that would allow better evaluation of their findings.
At the low end, a study conducted by the Iraq Ministry of Health and other Iraq government entities in collaboration with the World Health Organization, estimated 151,000 violent between January 2002 and June 2006. While the authors did not estimate the total number of excess deaths — nonviolent as well as violent — presumably because these estimates would be less precise, dependent as they would be on estimates of prewar mortality rates, those estimates would be considerably higher by several hundred thousand. Critiques of this study have questioned whether many Iraqi citizens might be reluctant to admit to Iraqi government-associated researchers that a family member was killed by violence. Thus, it is not implausible to assume that this study is an undercount and constitutes a lower bound. As the Ministry of Health study period ended while some of the most severe violence was still occurring, there have likely been many more violent deaths since then.
Thus, the best guess we can make at present is that at least 200,000 people died through violence since the US-led invasion, and that the true figure may be far higher. Moreover, an additional number that could be in the hundreds of thousands may have died from nonviolent causes — e.g., lack of clean water and healthcare — associated with the conflict, but this figure is uncertain. No matter what the correct figures turn out to be, it is clear that far too many have died as a result of this war of choice and subsequent occupation which may have deposed a dictator but which also disrupted an entire society.
1
1
1
