Just another Reality-based bubble in the foam of the multiverse.

Sunday, August 08, 2010

Skynet Does Wall Street

Why bother nuking the world when an AI can maximize the chaos without damaging a transistor?

Mysterious and possibly nefarious trading algorithms are operating every minute of every day in the nation's stock exchanges.

What they do doesn't show up in Google Finance, let alone in the pages of the Wall Street Journal. No one really knows how they operate or why. But over the past few weeks, Nanex, a data services firm has dragged some of the odder algorithm specimens into the light.

The trading bots visualized in the stock charts in this story aren't doing anything that could be construed to help the market. Unknown entities for unknown reasons are sending thousands of orders a second through the electronic stock exchanges with no intent to actually trade. Often, the buy or sell prices that they are offering are so far from the market price that there's no way they'd ever be part of a trade. The bots sketch out odd patterns with their orders, leaving patterns in the data that are largely invisible to market participants.

In fact, it's hard to figure out exactly what they're up to or gauge their impact. Are they doing something illicit? If so, what? Or do the patterns emerge spontaneously, a kind of mechanical accident? If so, why? No matter what the answers to these questions turn out to be, we're witnessing a market phenomenon that is not easily explained. And it's really bizarre.

It's thanks to Nanex, the data services firm, that we know what their handiwork looks like at all. In the aftermath of the May 6 "flash crash," which saw the Dow plunge nearly 1,000 points in just a few minutes, the company spent weeks digging into their market recordings, replaying the day's trades and trying to understand what happened. Most stock charts show, at best, detail down to the one-minute scale, but Nanex's data shows much finer slices of time. The company's software engineer Jeffrey Donovan stared and stared at the data. He began to think that he could see odd patterns emerge from the numbers. He had a hunch that if he plotted the action around a stock sequentially at the millisecond range, he'd find something. When he tried it, he was blown away by the pattern. He called it "The Knife." This is what he saw:



...For now, Donovan plans to keep putting out the charts, which he calls "crop circles," of the odd trading algorithms at work. That's an apt name for the visualizations we see of this alien world of bot trading. And it certainly gets at a central mystery surrounding them: if trading firms aren't sending out these orders, how are they getting into the market?

On the quantitative trading forum, Nuclear Phynance, the consensus on the patterns seemed to be that they simply just emerged. They were the result of "a dynamical system that can enter oscillatory/unstable modes of behaviour," as one member put it. If so, what you see here really is just the afterscent of robot traders gliding through the green-on-black darkness of the financial system on their way from one real trade to another.

No matter why the bots end up executing these behaviors, the Nanex charts offer a window onto a kind of market behavior that's fascinating and oddly beautiful. And we may never have seen them, if not for the mildly obsessive behavior of one dedicated nerd.

"Who looks at millisecond charts?" Donovan said. "You'd never see those patterns in any other fashion. The SEC and CFTC certainly weren't."


Nothing to see here, just a ghost in the machine.

Move along, move along, these aren't the 'droids you're looking for.

No comments: