Real-time data mining comes to Twitter

Dataminr has now been granted coveted access to Twitter’s Firehouse – the full feed of all tweets
Dataminr has now been granted coveted access to Twitter’s Firehouse – the full feed of all tweets

This ability for Twitter to be ahead of the news game was ably demonstrated by Dataminr and Bin Laden – the company told its clients about Bin Laden’s death before it broke over the traditional news services. According to a report in Ars Technica, “‘Dataminr sent an alert in this instance at 10:20 [p.m. Eastern time on May 1, 2011], based on only 19 messages,’ Dataminr founder and CEO Ted Bailey told the Twitter Devnest crowd. ‘This was, for our clients, the earliest warning system in the entire financial industry for this event, which had a dramatic effect on the market once it hit the financial radar.’” This was four minutes before Keith Urbahn, former chief of staff to former defense secretary Donald Rumsfeld, tweeted, “So I'm told by a reputable person they have killed Osama Bin Laden. Hot damn.” 

Dataminr has now been granted coveted access to Twitter’s Firehouse – the full feed of all tweets, unlimited. “We leverage Twitter and other social media data-sets,” says the company’s website, “as a global sensor network for detecting emerging events and public trends. Our clients include buy-side and sell-side firms in the finance industry as well as municipal and federal agencies in the government sector.”

Dataminr brings big data analytics to the world’s largest source of breaking news. It analyzes all 340 million daily tweets, discovering and reporting what it calls ‘actionable signals’, providing an early warning system for its clients.

But Dataminr isn’t just another social media analytics company; it brings big data analytics to standard social network analyses. Apart from analyzing the tweets themselves, “Dataminr takes the unique approach of merging Tweets with third-party and client proprietary data to perform multi-variable event detection,” it claims in its announcement. The result is the ability to map breaking world events to corporate interests in real time; an ability that will undoubtedly interest all large organizations, from international finance to multinational corporations, from national security and law enforcement agencies to the traditional news services themselves – and infosec at large.

What’s hot on Infosecurity Magazine?