Clinton seeks what from a Florida win?

This article from the FT is pretty typical at the moment:  “Clinton seeks profit from a Florida win

[F]ollowing her heavy defeat to Barack Obama in South Carolina last weekend, Mrs Clinton hopes to derive favourable publicity from her expected victory in Florida’s straw poll on Tuesday.

Almost 400,000 Floridians have already cast postal votes in the Democratic race, even though all of the candidates stuck to their pledge not to campaign there or run local advertising [after Florida had all of its Democratic delegates stripped for bringing the date of its primary forward].

Mr Obama’s camp has accused Mrs Clinton of cynicism for signalling she will ask the party to restore Florida’s delegates to the convention. Florida would have more delegates than Iowa, New Hampshire, Nevada and South Carolina combined.

Why does everyone play this as Hillary the cynical and faintly desperate candidate backing down on her pledge?  I understand why Obama’s staff are playing it that way, but why are the commentators agreeing with that view?

If she wins the nomination – and the best bet right now is that she will – then it will prove enormously valuable that she went to Florida, no matter whether their delegates get to vote for that nomination or not.  If she hadn’t gone but still won the nomination, then come November the Republican candidate would be speaking endlessly about her absence in such a key state while waxing lyrical about the democratic right of people to have their say.

Whoever the Democratic front-runner was at this stage was always going to be forced to go to Florida because of the attention that the Republicans are giving to it.  Hillary is simply making the most of it.  Barack Obama, who is behind in both the primary polls and the betting markets in most of the super-Tuesday states, cannot afford to think of November yet; if he’s looking at anything past the 5th of February, I’d be stunned.

John Pilger versus “the great game”

John Pilger (biography on Wikipedia) has a new piece out in the New Statesman, “The ‘good war’ is a bad war.” This is the central part of his essay:

The truth about the “good war” is to be found in compelling evidence that the 2001 invasion, widely supported in the west as a justifiable response to the 11 September attacks, was actually planned two months prior to 9/11 and that the most pressing problem for Washington was not the Taliban’s links with Osama Bin Laden, but the prospect of the Taliban mullahs losing control of Afghanistan to less reliable mujahedin factions, led by warlords who had been funded and armed by the CIA to fight America’s proxy war against the Soviet occupiers in the 1980s. Known as the Northern Alliance, these mujahedin had been largely a creation of Washington, which believed the “jihadi card” could be used to bring down the Soviet Union. The Taliban were a product of this and, during the Clinton years, they were admired for their “discipline”. Or, as the Wall Street Journal put it, “[the Taliban] are the players most capable of achieving peace in Afghanistan at this moment in history”.

The “moment in history” was a secret memorandum of understanding the mullahs had signed with the Clinton administration on the pipeline deal. However, by the late 1990s, the Northern Alliance had encroached further and further on territory controlled by the Taliban, whom, as a result, were deemed in Washington to lack the “stability” required of such an important client. It was the consistency of this client relationship that had been a prerequisite of US support, regardless of the Taliban’s aversion to human rights. (Asked about this, a state department briefer had predicted that “the Taliban will develop like the Saudis did”, with a pro-American economy, no democracy and “lots of sharia law”, which meant the legalised persecution of women. “We can live with that,” he said.)

By early 2001, convinced it was the presence of Osama Bin Laden that was souring their relationship with Washington, the Taliban tried to get rid of him. Under a deal negotiated by the leaders of Pakistan’s two Islamic parties, Bin Laden was to be held under house arrest in Peshawar. A tribunal of clerics would then hear evidence against him and decide whether to try him or hand him over to the Americans. Whether or not this would have happened, Pakistan’s Pervez Musharraf vetoed the plan. According to the then Pakistani foreign minister, Niaz Naik, a senior US diplomat told him on 21 July 2001 that it had been decided to dispense with the Taliban “under a carpet of bombs”.

That is fascinating stuff. I am glad that people like Pilger exist as journalists because he really does push to uncover the truth. Any lie by any government is shameful. Nevertheless, while I am happy to accept the facts that Pilger presents as true, it’s difficult to read this article and to know what he actually wants other than to continue his vociferous criticism of Western foreign policy and that of the United States in particular.

On the one hand, he highlights above some of the awful aspects of an Afghanistan ruled (let’s not say governed) by the Taliban: no democracy, no freedom of religion, little (if any) freedom of speech, the utter subjugation of women, an economy based on the extraction and capture of wealth. On the other hand, he later speaks of the …

… historic ban on opium production that the Taliban regime had achieved. A UN official in Kabul described the ban to me as “a modern miracle”. The miracle was quickly rescinded. As a reward for supporting the Karzai “democracy”, the Americans allowed Northern Alliance warlords to replant the country’s entire opium crop in 2002. Twenty-eight out of the 32 provinces instantly went under cultivation.

But he doesn’t bother noting that the Taliban were only able to enforce their ban by killing anyone who violated it. I’m pretty sure that Pilger opposes the death penalty. I’m absolutely certain that he opposes it when it’s instigated without any recourse to defence in a fair trial.

I agree entirely with Pilger that the main priorities of the U.S. in looking at other countries have been political stability and economic liberalism, with the rule of law being a distant third and anything else almost entirely off the radar. I likewise agree that this is principally because these represent minimum conditions for the inevitably large U.S. companies to do business in those countries. I say “inevitably” because small U.S. companies are not in a position to invest internationally. Pilger views this as a modern form of imperialism. It’s a tempting position, but I tend to think of it more as the U.S. looking out for it’s own and leaving other countries to sort out their own particular rights and values. It is not non-interventionism, but a sort of ideally-minimal-but-occasionally-dramatic-interventionism.

I would understand if Pilger thought that the West ought to promote the good things it has aspired to itself: women’s rights, religious freedom, the welfare state and so forth. But Pilger is apparantly against humanitarian intervention, which he describes as the work of the ascendant, “narcissistic, war-loving wing” of liberalism, so I am again left confused as to what he wants the West to actually do. Does he want complete isolation?

Let me put it this way: Zimbabwe is in a terrible state. From once being described as the “bread-basket of Africa,” it is now the basket-case of the continent. It’s inflation is so high as to become unmeasurable. A third of it’s population has fled the country. It has no democracy. The opposition, when they attempt to rally, is beaten. For it’s part, the West has imposed sanctions, but China has happily handed truckloads of cash to Mugabe’s regime in exchange for Zimbabwe’s natural resources. What does John Pilger think the foreign policy of the U.S.A., the U.K. and the rest of the West ought to be towards Zimbabwe?

New Hampshire and the prediction markets

Plenty of people, Paul Krugman among them, are pointing out that just like the polls (which, on average, had Obama ahead of Clinton by over 8 points), the prediction markets were plainly wrong in forecasting the outcome of the Democratic New Hampshire primary. They’ve got a point.

These are the daily closing prices on the Clinton and Obama contracts to win the New Hampshire primary from InTrade:

dem_nh_clinton.png

dem_nh_obama.png

Up until Iowa, they were fairly steady at ~60% for Clinton and ~40% for Obama, but from the 3rd of January onwards, there was a clear movement towards Obama. On the day before the primary, the markets had Obama 97.8% likely to win. On the day, Clinton won with 39.07% of the vote, while Obama received 36.47%. So why did the market get it wrong?

Paul Krugman contends that the prediction markets were just reflecting the polls and talking heads, presumably because that was all the information there was to be had. This naturally raises the question of why they were wrong (e.g. did we just witness the Bradley effect in action?), but that is not the point here. A prediction market, according to the theory, is meant to be superior to the polls in predicting outcomes because it combines information contained in the polls with information from other sources. So perhaps Krugman is right. But if he is, why did the market go so far towards Obama?

My guesses:

  • Perhaps Krugman is partially right, but the talking heads provided a positive feedback loop. The polls predicted Obama, which the markets saw. The talking heads saw the polls too (perhaps in more detail) and then spoke about it on television, but added effectively no extra information. The markets saw the talking heads and believed it to be extra information in support of the polls.
  • Like any market, the prediction markets are susceptible to bubbles. Perhaps we saw one here in the days between Iowa and New Hampshire.
  • A lack of “true” liquidity. There was plenty of nominal liquidity in these markets leading up to and during the counting, but how much of the trading was arbitrage, how much was momentum (i.e. bubble) trading and how much was “true,” changing-belief-based trading? As the counting occurred, I was watching both the leaked figures on the Drudge Report and the movement on InTrade. It seemed that the prediction market was moving steadily towards Clinton, but nowhere near as quickly as one would have expected. For example, at 9:40pm, with 46% of the vote counted, Clinton was leading 49,719 (40%) to 45,383 (36%), from which one would conclude with extremely high confidence that Clinton would win, but the market was still only putting her at 65%.
  • Perhaps – and I’m by no means certain of this last point – in order for a prediction market to work perfectly, we also need people to set the size of their position in proportion to their confidence in that prediction. So perhaps there were traders who, looking at Drudge or some other source were extremely confident that Clinton would win from quite early in the counting, but since they did not take large enough positions, they did not move the market. In other words, liquidity requirements for a successful prediction market are not just on the number of trades, but on the volume traded.

Update: Justin Wolfers, a long-time researcher in prediction markets, has an article in the WSJ highlighting how surprising the result was given the market predictions.

We were led to this research by an age-old racetrack puzzle economists call the “favorite-long shot bias“: Horse bettors historically have overbet long shots, and they win less often than their odds suggest. Our research suggests that similar biases hold in political prediction markets.

As such, Sen. Clinton’s comeback is even more stunning, as political underdogs have historically won even less often than suggested by their prediction market odds.

Historical comparisons are already being drawn between the New Hampshire primary and the famous 1948 presidential race in which President Harry S. Truman beat Republican challenger Thomas Dewey, despite the infamous “Dewey Defeats Truman” headline in the Chicago Tribune.

Yet the magnitude of the Clinton surprise is arguably even greater. Indeed, historical research by Professors Paul Rhode of the University of Arizona and Koleman Strumpf of Kansas University has shown that in the Truman-Dewey race, prediction markets had seen hope for President Truman despite his dreadful polling numbers, and he was rated an 11% chance of winning the election by election-eve. Thus, Sen. Clinton’s victory on Tuesday was more surprising than President Truman’s in 1948.

Personally, I seem to be thinking of this the other way around. Assuming that prediction markets are generally better than other forms of forecasting, I find it surprising that they got it so wrong on this occasion. Rather than thinking of the result as the equivalent of a 6-sigma event given the prediction market, I wonder what was different this time that so disturbed the market’s ability to predict?

Update 2: Okay, okay a 3-sigma event 🙂  Justin in an email:

For the polls, this was about a 3-sigma event.  For the market, which had Hillary priced at about a 7% chance [JB: Justin is referring to the WSJ market], it is about a 1.7 sigma event.  They aren’t that unusual.  Indeed, they probably happen about 7% of the time

History of US Legislative and Executive power

Following the recent (midterm) US elections and looking at this article over at the Economist, I was fascinated by the graphic they provided at the bottom detailing periods of Democrat and Republican control over the House of Representatives and the Senate. The obvious missing information was on presidential control, so I did one up myself. You can grab it (as an Excel spreadsheet) here.

It’s interesting to note that since 1901, the Democrats have generally been dominant in the House of Representatives (64.8% of overall control) and the Senate (57.4%), but the Republicans have maintained a slight upper hand in the Presidency (48.1% Democrat).

Americans do seem to prefer having just one party in control at a time (59.3% of the time all three are under the control of the same party rather than the 25% that would have been expected by pure chance).

Update: I have redone this following the 2008 election here.