IMG_5396_thumb.jpg

Hadoop Summit Amsterdam 2014: Crossing The Chasm

Herb Cunitzhadoop summitThis year’s Hadoop Summit in Amsterdam was even more interesting than last year’s, with more sponsors (including SAP), more functionality for enterprise use cases, and more enterprise examples.

The conference was in the historic Beurs Van Berlage conference center. It’s a great venue for out-of-town guests situated just a few minutes’ walk from Amsterdam’s Central Station.

After Hortonworks president Herb Cunitz welcomed attendees, CEO Rob Bearden outlined the Big Data opportunities in a market he estimated to be worth $100Bn market by 2020.

hortonworks big data market growth

He believes that Hadoop has now crossed the chasm and is well on its way to mainstream acceptance (and 50% of that 2020 Big Data market).

hadoop 2 crossing the chasm

Mike Gualtieri principal analyst at Forrester went over the latest Forrester survey data. Data-related projects are at the forefront of the minds of today’s IT executives, with 57% of them rating it as one of their top two priorities (followed by Systems of Record and Systems of Engagement applications).

Organizations are particularly interested in using new technology to support rising customer expectations: surveys show that 66% of us want to be treated as individuals, and 58% want us to enjoy our dealing with companies more.

Gualtieri likened Hadoop to a data lake that was created by a dam, with lots of turbines at the bottom to process the data. He called Hadoop a “unique technology” and the “first general-purpose Data Operating System (DataOS)”

With survey results showing that 81% of large enterprises are already believers in the technology (16% are using it in production, 45% in POC, and 20% plan to use it in the future), Galtieri believes “A huge production wave is coming for Hadoop”

Martin Wilcox and Chris Twogood of Teradata and Timothy Mallalieu of  Microsoft all talked about the need to integrate Hadoop with traditional data technologies to get the most out of the new opportunities.

Hortonworks founder Arun Murthy gave an overview of the key recent advances in Hadoop 2.0, including the benefits of the YARN resource manager, the completion of the Stinger project to increase the performances of HIVE queries, and the STORM project for processing streaming data.

You can watch the Day 1 keynotes here.

IMG_5383

Amsterdam dawn

Comments

One response to “Hadoop Summit Amsterdam 2014: Crossing The Chasm”

  1. […] not even using it in live production systems. Last October a survey by Forrester Research found that 45 percent of Hadoop users were doing so in a “proof of concept” test, versus just 16 […]