Cool Tools

19 June 2008

Sometimes The Best Strategy is Patience

From a recent IBM press release [emphasis added]:

A complex physics calculation that will take [the new] Roadrunner [supercomputer] one week to complete, would have taken the 1998 machine 20 years...

Put that in the back of your mind. Now step back and ponder the following hypothetical situation:

You're a business executive (or government official) facing a big, gnarly problem that absolutely, positively must be solved in ten years. If you don't make the deadline, something bad will happen. You'll go out of business, you'll fail to win re-election, your shareholders will revolt, the Huns will invade. Something bad. You've got to solve this problem. Your career (and maybe more) depend on it.

With current technologies, processes and general know-how though, you know you can't make it in time. Sure, you can reach the goal -- in theory, eventually -- but it's going to be really really expensive. And it's certain you're going to be late. Ten years late, in this case.

The problem will get solved, but the Huns will be running the place by that point. You'll be out of a job, maybe worse: lawsuit, jail, early retirement, HBR case studies that make you look like a complete idiot and laughingstock in hindsight... that sort of thing. Your grandkids will still love you... until they get to business school and read the case. But I digress.

So, you have two choices: 

Start throwing wheelbarrows of cash and thousands of bodies at the problem. Or invest judiciously in innovation -- and, at least as importantly, an innovation culture -- and wait patiently for those to bear fruit. (There's a third option: waiting for others to innovate for you, but we'll leave that aside for now because it only applies in limited situations where you can be fairly certain someone is working on the thing you need and that you'll be able to buy whatever it is they come up with.)

In either case, (#2 or #3, that is) you may have to wait years. You won't have much to tell your shareholders in the meantime, other than "we've hired the best, given them the best resources, incented them up the wazoo and tried not to be too meddlesome -- those creative folks don't take well to corporate bureaucrats, y'know." But when something does come along, you'll be able to really impress them: "You remember that problem we thought would take twenty years to solve? We finally got started on it, and we're targeting completion... next Wednesday." Sounds like promotion material, doesn't it? And your grandkids won't be laughing at you when they get to business school.

The tough part, of course, is all the verbal bobbing and weaving for the first ten years when nothing seems to be happening. No highly visible hordes of minions toting 10-ton blocks of stone up pyramids on wooden rollers (and dying by the dozens, getting you in trouble with OSHA). Just a bunch of folks wandering around in lab coats (or, more likely, surf shorts and goatees, playing foos-ball between all-night stints at the white-board).

Sometimes waiting (and investing) is better than charging ahead, using up all of your cash on old, dumb, slow methods that you know will be a day late and a dollar short.

H/T: Irving Wladawsky-Berger

10 January 2008

One of the Benefits of Working in "Cube Land"

Your choice of seating at work may affect much more than your sensory pleasure at knowing when someone is eating tuna fish or onions versus citrus fruit or chocolate. Google has discovered that it's the most important factor in your being in the loop: in particular, whether you win or lose based on your close colleagues' prediction market trading. Google_pm_trader_map

(See 'heat map' at right: successful traders are depicted in green; losing traders in red).

(H/T: Jeffrey Henning)

'Real' traders take note! (Pick your desk-mates carefully.)

Random thought: this adds a whole new dimension to the elaborate strategies seasoned business travelers use to get primo seating on airplanes. Exit row? No thanks. Just give me the seat next to Warren Buffett.

01 June 2007

Recursive PMs: Using the Crowd for Cover

In the middle of May I speculated--reasoning from first principles only and with no inside information--about how prediction markets might help the book industry pick winners:

"For some types of books (and authors) prediction markets might be appropriate."

That sparked a note from a reader, tipping me off that:

"Confidentially, something's about to launch very soon in this area."

Sure enough, MediaPredict launched a week later, eliciting this highly positive piece in the 5/21 NYTimes: "Publisher to Let the Public Have a Vote on Book Projects".

Media Predict is soliciting book proposals from agents and the public, and posting pages of them on the site. Traders, who are given $5,000 in fantasy cash, can buy shares based on their guess about whether a particular book proposal is likely to get a deal, or whether Touchstone Books, an imprint of Simon & Schuster, will select it as a finalist in a contest called Project Publish. If either happens within a four-month period, the value of the shares go to $100 apiece; if not, the share price falls to zero.

The devil as they say, is in the details. Traders are voting not on how popular a work could become with the book-buying public but with the binary, intermediated and likely recursive question of whether the editors at Simon and Schuster will select it.

In other words, S&S editors are going to be breathing their own exhaust--now with more butt-covering camouflage. (Which reminds me a little of this.) It's the kind of conversation I've seen some couples get into:

Man (off-handedly and with a smile): What would you like for dinner, honey?
Woman: Oh, whatever you'd prefer is just fine with me!
Man (thinking burgers and beers with the guys): I'd prefer what pleases you, dear.
Woman: Well I don't know. What were you thinking?
Man: I was thinking I'd like to know what you're thinking.

And 'round and 'round and 'round it goes. That's an imperfect and terribly stereotyped analogy, and no, it's not my happy marriage. Well, OK sometimes maybe it is. But let's move on, shall we?   :)

The more abstract version of that analysis is this: The system S&S has set up with MediaPredict has no outside, arbitrating reference point--such as how many copies a particular book would actually sell.

Hey, now there's an idea: ask the market directly about its spending enthusiasm for a given title. (Print-on-demand technology, not to mention digital rights management, render completely moot the objection that only a few select books can be produced. The hurdle revolves around marketing and a legacy business model of annointing a few winners.)

Unfortunately, S&S's Touchstone Books does not appear to take that important dis-intermediating step. I doubt it's MediaPredict's fault. I suspect (without any proof except my experience with how Fortune 500 executives think and in particular how publishing executives think) that the use of prediction markets may have been de-clawed in this case to avoid dis-enfranchising S&S editors. Think about it:

The PM predicts Bestseller status for a book the editors decide to pass up. It gets picked up by another publisher, fulfilling the PM's expectations and making bundles of money for an S&S competitor. At that point, S&S editors not only have egg on their face, but the S&S board (and shareholders) are emboldened to ask: Tell us why exactly we need you if all you're going to do is to second-guess and stand in the way of this smart little prediction market thingy we've set up over here to perform the same function?

Justin Wolfers (respected PM guru at Wharton) notes the same basic flaw, though you'd have to read to the end of the article to find his critique.

[Wolfers] said that if Simon & Schuster relies on the traders' judgments to select a book, it could skew the bets themselves.

"If they say we find it really persuasive that everyone bet on book A, they're just looking at a book that everyone bet that everyone else bet that everyone else thinks is the best book," Mr. Wolfers said. "So you don't end up with the wisdom of crowds, but the infinite reflection of crowds looking at crowds."

This is at least the second time I've noticed a major media outlet burying what should have been the lead on a prediction markets story--and with it, Wolfers' critique. If I were him, I'd be a little peeved. Last fall, the Washington Post carried a piece ("The Top Pickers vs. The Pack") that completely mashed two irreconcilable ideas, as I noted in "WaPo Misguided on 'Experts' vs. The Swarm":

The article takes the academically and empirically well-proven notion of collective intelligence (aka the wisdom of crowds), and presumptively twists it into the more comforting and familiar (if statistically invalid) notion that "father-knows-best"--only we haven't done a good enough job of finding the right "father" up until now.

I don't know why the media's treatment of prediction markets is missing the mark, but they need to get smart faster. PMs are not going away. Not taking seriously the critiques of Wolfers and others isn't helping. The NYTimes digs itself further into a hole by taking a flawed comparison at face value:

Media Predict is modeled after other so-called prediction markets like the Hollywood Stock Exchange, which allows traders to bet on the four-week North American box office receipts of movies, or the Iowa Electronic Markets, which allow people to bet on election results...

The glaring difference: the HSX and the IEM ask traders to vote on highly distributed end-result questions. As I've observed many times (e.g., here, here, here and here) prediction markets--while very cool indeed, and applicable to many more things than those to which they are being applied today--are just plain lousy at calling things like Papal elections or the nomination of judges where information is closely held by a select group. I suspect it's even worse when that group has sponsored the market and each is trying to predict the actions and preferences of the other.

If the same principle were to be applied to American Idol, voters would weigh in with their opinions not on which singer(s) they liked best, but on which one(s) they thought Simon Cowell was going to like. That's not entirely without its entertainment value, but it adds little to what Mr. Cowell was going to say anyway. Simon (& Schuster) could take a lesson from what the other Simon (Cowell) lacks: humility. The crowd is often right. If they're paying, they're even more right.

As for MediaPredict itself, I'm reserving judgment. At this stage of market development, more new players trying more approaches, covering more questions and attracting more corporate attention is a good thing--and entirely expected. As the MP folks write on their blog: "Love us or hate us, we’re here…" That may be a little extreme. How about: I love that you're here.

28 March 2007

Five-Dimensional Visualization: Lifespan vs. Income

Check out this extremely cool visualization of how life expectancy relates to national income, region and population--all over time (be sure to press the 'play' button in the lower left). Cleverly (a la Tom Barnett's core and gap concept), the tool is called the "Gap Minder".

Everyone's mind works a little differently, but if there's universal truth in the adage that "a picture is worth a thousand words", then such data-rich portrayals of complex interrelationships have got to be worth millions. In a world increasingly dominated by PowerPoint, we can only hope that they will play a much bigger part in our public and private dialogues about dynamic, complex problem spaces.

29 November 2006

In Control: Bomb-Sniffing Bees

It's hard to believe it's been more than a decade since Kevin Kelly's ground-breaking book "Out of Control" ushered in (at least to my mind) a new popular appreciation for the possibilities opening up as a result of understanding complex systems, chaos theory, swarm dynamics and a host of other cool new meta-ideas about how the world works.

On the cover (in both old and new editions) is a drawing of a swarm of bees, some of them live, some of them digital. Thus it is with fascination, giddiness (how cool is that!) and a sense of time passing much too quickly that we note this new development in the war on terror.

An extraordinary invention by a small British company is being praised by American scientists... Los Alamos sniffer squad trainer Tim Haartman, an entomologist - insect specialist - at the lab, said: "The technology is there. It's just a case of putting it into production."...

Inscentinel showed the Los Alamos scientists that the bees can be trained to sniff out anything from home-made fertilizer bombs, through demolition dynamite to C-4 plastic explosives. Unlike sniffer dogs which require three months training, it takes 10 minutes to train the bees.

After training three or four bees are put in a shoebox-sized "sniffer box", held in position on plastic mountings. Air is sucked by a fan into the box via plastic tubes and wafts gently over the bees. If they detect explosives in the air, the trained bees all stick out their proboscises together.

A miniature video camera in the box is trained on them and is connected to a computer programmed with movement recognition software. As soon as the movement of the proboscises is detected, an alarm sounds to alert the security operator.

25 May 2006

Visualizing Complexity

As a huge fan of data-rich, insight-generating ways to represent complex phenomena (an appetite originally whetted by Yale prof Ed Tufte - see books on sidebar), I was blown away by this site. At the moment it contains 326 different 'maps' ranging from e-mail patterns at Enron to "the energy landscape for the folding of the beta3s peptide[s}"

Clear an hour and click around. The only word I can come up with is... fascinating.

My Photo

July 2008

Sun Mon Tue Wed Thu Fri Sat
    1 2 3 4 5
6 7 8 9 10 11 12
13 14 15 16 17 18 19
20 21 22 23 24 25 26
27 28 29 30 31    

Sites, People, Blogs