Musings on the challenges of big data in a year of serious hype
There’s a reason you haven’t heard more than a handful of big data success stories in 2012. Handling big data correctly is hard, requires huge infrastructure and resource investments, and may not be worth it…yet. According to one survey in November 2012, 60% of businesses said it’s too early to tell if their big data project was successful and produced a proper ROI. It seems that so much of the hype around big data is focused on the technologies you need to buy and the talent you need to acquire (data scientist is the latest fad title), and not on what’s most important: what you can do with the data, what value you can extract, what business decisions you can speed up or improve with all that data.
With companies jumping on the big data bandwagon to the tune of $28 billion this year, it’s time to discuss why it might be best to ignore the hype for now and focus on reaping insight from the data you have already. Here’s why I’m not impressed with your big data:
You don’t actually have big data.
The marketing hype can lead you to believe you have a “big data problem” when you really don’t. Using the terminology incorrectly has the potential to harm your business, causing you to invest in unnecessary infrastructure when you may be able to leverage what you already have in place. Even Microsoft and Yahoo! have made this mistake…