Monthly Archives June 2012

Big Data for Big Weather Predictions

umbrella1 Big Data for Big Weather Predictions

The almost infinite applications of Big Data have been well documented in this blog, from identifying neighborhoods to empowering digital agencies to uncovering health trends to revolutionizing the dairy industry.  Last week, venture capitalists made a big bet on a new use for Big Data, an agricultural insurance policy protecting farmers from extreme weather, or more simply put, weather insurance.

Yup, we’ll write it again, just so you believe us – weather insurance.  The Climate Corporation just received $50 million in funding, in order to hire 50 data scientists, software engineers, and quantitative researchers.

The Climate Corp. sells something called Total Weather Insurance, which pays local farmers when they are impacted by weather events that affect their profits. The company uses a massive cloud-driven data analytics service to predict the possibility of extreme weather, along with the potential impact. It prices its insurance policies accordingly based on that information.


Watch the Webcast: Real Time Analytics: The Future of Big Data in the Agency

A couple of weeks ago, our Chief Science Officer, Dhruv Bansal presented a webcast on how Big Data is changing the game for agencies looking to take their social media technologies and customer insight practices to the next level.  In this video, you’ll learn how agencies can build their own Big Data platform – enabling them to go from data sources to selling insights – in a fraction of the time expected, and at a fraction of the cost.

Watch the video and you can learn more about how the Infochimps Platform enables some of the world’s top agencies to broaden and scale their proprietary product offerings through:

  • Sentiment and Influencer Analysis
  • Client Customer Insights
  • Real-Time Social Media Analytics
  • Infographic and Report Generation
  • Meme and/or Topic Tracking
  • Cross-Channel Reporting
  • Campaign Personalization/Behavorial Insights

 Watch the Webcast: Real Time Analytics: The Future of Big Data in the Agency

Konami Code Doppelgangers

Konami Code Konami Code Doppelgangers

After a morning discussion about 80s video games and nerd culture, we thought we would share with you, faithful blog reader, one of greatest secrets of the Infochimps website.

Go here to our team page and give it a whirl.  Bonus geek points if you can spot all the references!

Hadoop in the Cloud – Infochimps and VMware

logo Hadoop in the Cloud   Infochimps and VMware

Infochimps is proud to be a part of a new effort launched today by VMware to enable big data applications running on Hadoop to be deployed more easily on top of virtual and cloud-based IT environments. The Serengeti project, released today under the Apache 2.0 license, is built upon a number of open source technologies including our own Ironfan tool and supports all major Hadoop distributions including Cloudera, Greenplum, Hortonworks, and MapR.

Ironfan is the foundation of the Infochimps Platform and the basis of our customers’ Big Data deployments. It makes provisioning and configuring Big Data infrastructure simple – you can easily spin up clusters when you need them and kill them when you don’t, so our customers can spend their time, money, and engineering focus on finding insights, not configuring and deploying machines. Ironfan is quickly becoming the number one deployment tool for Hadoop platforms in the cloud, and this endorsement by VMware and inclusion in Serengeti is further evidence of the popularity of the tool.

What does Serengeti mean for Infochimps users?
From the beginning, the Infochimps Platform has been built on a foundation of open source tools for managing data that simplify the experience of working with complex technologies such as Hadoop. Within the Infochimps Platform, Ironfan, as well as other tools like Wukong and Swineherd, are major open sourced components of the stack. And with our enterprise tools including Data Delivery Service and Dashpot, customers can deploy complete Big Data environments and be assured of highly reliable delivery of data to their Hadoop environments.

The Serengeti project supports our open source tradition with its strong open source foundation and support by all of the major Hadoop distributions. Within the Serengeti project, Ironfan enables users to quickly and easily configure and deploy Hadoop clusters on top of VMware vSphere® in minutes with a single command. Now, users running VMware’s virtual and cloud infrastructure can more easily take advantage of the power of Hadoop as well as other Big Data technologies like the Infochimps Data Delivery Service, Dashpot, and Infochimps big data expertise to manage, process, and analyze massive amounts of unstructured, semi-structured, or structured data at scale and in the cloud.

We’re excited to be included in Serengeti and look forward to working with VMware customers and partners as they further their use of Big Data technologies.

Interested in learning more about Infochimps, VMware, and Serengeti? Contact us today for more information!

Why the American Community Survey is Important

The American Community Survey is an ongoing statistical survey that samples a small percentage of the population every year. It’s one of our most popular APIs in the Data Marketplace and the data within it provides the key data for the Digital Elements IP Intelligence Demographics API.

Learn more about the importance and usefulness of this annual supplement to the US Census.

(via Flowing Data)

The Shortest TED Talk Ever

… from one of our favorite data gurus, Hans Rosling. A quick examination of shifting wealth and growing population. Enjoy!

Take a Tour of Our Big Data Platform

Sometimes, when we are trying to explain what Infochimps does, it can be tough to help folks understand the total package. To help with this, we put together a tour of the Infochimps Platform. Now, you can discover how we can work with your team to take data from the sources you need, make it useful, and deliver the insights you need to improve your business. Check it out!

chimpworld Take a Tour of Our Big Data Platform