The recent NSA scandals have revealed the dangers of Bigger Data. But that phenomenon’s closely linked to Bigger’s other areas of overgrowth, especially in finance and investment. The scandal and controversy surrounding Facebook’s IPO (initial public offering) offered a glimpse into the intersection of Mega-Banks, Mega-Investors, and Mega-Data.
Every large enterprise is now pursuing bigger data. A new private study suggests that there continue to be fewer corporate data centers in the United States, but that each is correspondingly larger. Highly centralized databases leave businesses, economies and societies more vulnerable to disruptions caused by accidents, natural disasters, or acts of terror.
The Big Data vendors include Twitter, Facebook and Google. But they also include niche forms of Big Data, like banking. Newly launched banking investigations involve something called "dark pools," an alternative form of trading that takes place outside the normal stock markets. There is now evidence that the banks and service companies whose data platforms provide this service have been "front-running" trades, using customer information from their data systems to enrich themselves.
Even news organizations are entering the data-selling business. For $2,000 a month, Thomson Reuters offers a service called “ultra-low latency” which gives subscribers access to key economic reports two seconds before they’re released to the public. As Business Insider notes, “two seconds in … trading time is an eternity.” That’s because stock markets are computerized Big Data operations, too, and transactions can occur at nearly light-speed.
Big Data corporations are typically currently valued well in excess of what its real revenues would suggest. That’s certainly true of Facebook, because the world of Bigger believes in the power of data—and Facebook has it.
Most Facebook users would probably say that its interface is hard to use. Its founders aren’t wealthy because they’re brilliant programmers. They’re not visionaries, either. They thought they were creating a relatively small set of social networks for colleges. But they stumbled onto something powerful—the power of data that users volunteered about themselves—and they exploited it aggressively before anyone else could compete with them.
That’s how the world of Bigger works. You don’t need to be the best. You need to be the first. Then you need to be aggressive in order to stay the biggest. The forces of Bigger will do the rest.