I just ran across this post ("Debating the Viability of Terrorism-Prediction Markets") over at the 'Footnoted' blog at the Chronicle of Higher Education discussing the risks of terrorism how best to assess them and whether they can be known at all. (If you've grown weary hearing about war, politics and terrorism, just skip to my non-terrorist business conclusions in the last paragraph.
In a recent interview [PDF] with the Federal Reserve Bank of Richmond, W. Kip Viscusi is asked about the public-policy response to the threat of terrorism and whether we are weighing the costs and benefits in a generally rational way. "The reason this is tricky is we don’t have very good numbers on what these risks are," Viscusi says. "The estimates of the probability of a terrorist attack or the number of people who are going to die in the coming year are all over the map. So if you can’t assess the likelihood of a terrorist attack or how deadly it is going to be, it is really hard to say how much you should spend to try to prevent it." [emphasis added]
Vscusi is characterized later in the article (and not without reason) as "one of the foremost academic experts on risk". His comment is in response to a persistent school of thought that claims, as Bruce Schneier does, that from an actuarial perspective, "terrorism doesn't happen".
Without the qualifier, the idea sounds terribly cold. With all reverence for the families of those who have lost loved ones in terrorist incidents however, it's not. Businesses and governments--not to mention non-profit institutions, individuals and families--all need to assess risks as rationally as possible and take measures to hedge them. Like it or not, the value of a human life can be defined--at least partially--in dollar terms. Anyone who's ever taken a course in economics or statistics (or
balanced a checkbook for that matter) has figured out that
infinite spending to protect against risk is infinitely foolish and
that infinite spending on risk 'A' (and no spending at all on risks 'B', 'C', and 'D')
is only a variant on the same wrong-headed assumption.
That's not what's really at issue. What is at issue is the degree to which the political leanings of some lead them to believe that we can know how much to spend combating terrorism and that the 'right' number is obviously much less than we are spending today (e.g., tactical domestic measures, overhead for business, strategic overseas measures, etc.) To which my response is: really? Show me your pre-9-11 white paper predicting the order-of-magnitude sea-change that occurred in that 'industry' on 9-11.
Bryan Caplan is one of Viscussi's critics. The CHE post notes:
"I am frankly puzzled," Caplan writes at EconLog. Citing the work of John Mueller,we have a long experience with terrorism, which has
"shown it to be an extremely small problem in the broad scheme of
things. How much longer does Viscusi want to wait before he'll conclude
that the risk is very low?"
Unfortunately, long experience in and of itself is not sufficient for prediction, even at a macro level. Hold that thought for a quick diversion.
Here's where it gets weird. In criticizing Viscussi, Caplan, an econ prof at
famously free-market GMU, ends up in league with Schneier, who as far as I can tell, tends towards the opposite end of the
political spectrum. Both conclude, for entirely different reasons, that
the future threat of terrorism can be known and condensed to a dollar
figure and that rational budgets (both public and private) can be
set accordingly. Oh that it were so.
Caplan, in particular "favors the establishment of a prediction
market to help assess the likelihood of a terrorist attack". That's something I can conditionally applaud. If the results are used to "help assess", then we're fine. The possibility that a prediction market might help draw in and roll up marginal, highly distributed, even intuitive information that can supplement traditional (and sadly inadequate) intelligence-gathering mechanisms is certainly a good thing. I've been a huge fan of prediction markets for years. They should be used for more things than they are today. To my delight, more and more are catching on.
But...
...as longtime readers know, I've also concluded that there are some (and arguably many) problems for which prediction markets are not only silly but grossly misleading. I don't have the space to review them all of them here. Thinking that they can precisely predict and quantify particular terrorist threats or even the threat of terrorism generally is a notion that falls into that category. Almost by definition, a successful terrorist venture is compartmentalized, secret and surprising.
In short, Caplan, Schneier and others appear to have an ideologically-induced blind spot that leads them to declare certainty where it does not exist. Let me explain.
Schneier and Caplan draw their essential argument from a backward-looking, actuary-style catalog of terrorist incidents. This many people died. This much property was lost. Productivity was reduced by this much for this long. Etc. Etc. It all sounds very rational. If we had reason to believe that terrorism were a natural, forecastable, perhaps even cyclical phenomenon, that approach would be absolutely correct. We don't.
The main problem, as I've noted before, is that:
The unpredictability of terrorism renders any backwards-looking, purely quantitative, actuarial mode of analysis inappropriate and ineffective. That is, future deaths due to terrorism are something that neither Schneier nor anyone else can possibly predict with any degree of confidence.
Until 2001, the biggest single terrorist incident had caused around 300 deaths. Then in the space of a few hours, that number went up by an order of magnitude. There was no consensus (or even a significant plurality) of expert opinion predicting that that would happen - much less when, where and how. [emphasis in original]
And that's the problem.
Sudden, step-function, order-of-magnitude change, precipitated by a small group that has every reason to keep its plans secret is inherently unpredictable. It can only be imagined. If that sounds familiar outside of the terrorist context, it should. Businesses face this kind of challenge all the time; it is the very nature of business, in fact: snowboards vs. skis; digital photography vs. wet-process; PCs vs. mainframes; VoIP vs. legacy telephony; biotech vs. big pharma. The list is very long. It's harder to name an industry that hasn't been touched by this kind of change at some point (often precipitating the re-invention and re-definition of the former "industry") than it is to come up with a long list of examples of industries that have be altered in this way. Bottom line: it's important to differentiate between problems that lend themselves to forecasting and those that can only be dealt with via imaginative scenarios.
Recent Comments