Steve Lucas, EVP of Database and Technology, unveiled SAP’s Big Data Processing Framework at the keynote session of SAP Insider BI2012 in Orlando earlier this year.

I was honored to have the opportunity to be on stage with Steve for the first time, and we were ably assisted by Fred Samson.

In the recorded session below, we discuss what “big data” means, why you should care, and how SAP is making it easy to Ingest, Store, Process, and Present “extreme data” with a seamless set of technologies adapted to different needs, including SAP HANA, Sybase IQ, and open-source technologies like Hadoop.

There will be more details about the framework in SAPPHIRE NOW sessions in the US and Europe.

Jump straight to the content you’re interested in:

• 02:00 – What you can do with Big Data
• 32:50 – SAP Smart Meter Analytics with SAP HANA
• 43:30 – BI4.0 running with Amazon Cloud on top of Sybase IQ
• 52:00 – The Cloud
• 54:28 – Sharing reports with BI OnDemand
• 1:03:28 – Mobility
• 1:20:00 – Latest consumer application from SAP

You can download the presentation here:

• Big Data: Are You Ready? (Adobe PDF)
• Big Data: Are You Ready? (PowerPoint)

As usual, if you’re interested in SAP BusinessObjects Analytics, you should subscribe to http://www.blogs.sap.com/analytics.

I’m in the Baltics this week (Estonia, Lithuania, Latvia), presenting a business innovation keynote and a big data track session as part of the SAP Innovation Forum.

Yesterday’s sessions in Tallinn were fascinating, including:

• Industry thought leader Peep Aavikso, on why smart companies need smart people
• Janeck Gustavson of Eesti Energy talking about their use of SAP Business Planning and Consolidation (BPC)
• A very passionate talk from Olga Lustsik of Swedbank Estonia explaining the power of activity based costing, and how they have implemented SAP Profit and Cost Management (PCM)
• An interactive whiteboarding session with SAP’s Santosh Takoor explaining how to align corporate strategy with systems of execution for best in class operations in finance (with SAP Enterprise Performance Management and lots of compelling customer examples)
• SAP’s Dr. Jens Baumman on rapid deployment solutions for SAP ERP
• SAP’s Eero Koskinen on the power of SAP HANA
• And finally a GREAT demonstration of the latest SAP solutions and prototypes by the SAP Demo team

My keynote presentation was based on some of the material from a previous post: 2012, The Year Analytics Means Business

Here are the slides:

• Business In The Moment: From Reactive to Proactive (pdf)
• Business in The Moment: From Reactive to Proactive (ppt)

And for my track session:

• Turn Big Data Into Business Value With Real-Time BI (pdf)
• Turn Big Data Into Business Value With Real-Time BI (ppt)

Today’s sessions are in Vilnius, Lithuania, including a fascinating presentation from Sarunas Chomentauskas, Co-founder of Metasite Business Solutions, on how they have used open-source Big Data technologies for their customers including customer churn, and machine learning techniques including how to explain the difference between a dog and a cat to a computer…

I’ll update this post over the course of the coming days. You can follow the tour on twitter using the #SAPInnovation hashtag.

Dawn this morning over Vilnius, Lithuania

It was the SAP World Tour in Sopot, Poland last week, and I had the honor of presenting a keynote session on business analytics.

The three-day event kicked off with a evening on a tall ship in nearby Gdynia, with traditional nautical music and evening entertainment including hitting a large nail into a stump of wood(?!).

The opening “run better” presentation was done as a panel discussion with Grzegorz Rogali?ski, the SAP country manager, and Tomasz Niebylski, head of presales, and hosted by a local TV journalist.

As always, here are my slides in both Adobe PDF and Microsoft PowerPoint format:

And here are some other photos from the event:

And here are some photos from the event, on Flickr:

I often mention in my presentations that “120% of us don’t understand statistics” – and here’s the proof: somebody marked my presentation as 7 out of 5 for content and style:

(many thanks, whoever you are!)

In true Web 2.0 fashion, I’m attending the SAP TechEd event in Berlin by watching the virtual TechEd stream, with live coverage of the main keynotes and interviews in key areas. You can watch a replay yourself on the Virtual TechEd site.

The session started off with the new (excellent) “run better” SAP ad, featuring a wide selection of SAP customers:

Mark Yolton then stepped up on stage to welcome the crowd and members of the SAP Community Network. He emphasized the importance of people and community at the event — 15,000 attendees across the four locations, with over a thousand hours of lectures and on-hands sessions.

Next up was SAP CTO Vishal Sikka, who kicked off with a message designed to combat the positioning of various SAP competitors including Oracle: “People are looking for solutions, not stacks”. It’s now about the ecosystem, and it’s not possible for an ecosystem to come together on a single stack. Organizations need “non-disruptive” change. A stable core is important, but there has to be continuous evolution on top.

Vishal reiterated some of the messages from previous years, including the notion of “timeless software”, that allows you to innovate even with older platforms.

Vishal emphasized the continuing importance of SAP NetWeaver: “It’s the foundation of what we do”. He went over some of the numbers: 18,000 NetWeaver customers, 10,000 using BW, and 6,000 using the SAP Portal, many with more than 100,000 users, including the SAP community network itself with over 2 million members. “It’s alive, it’s kicking, and the numbers tell us that it’s not only being used to run the core infrastructure, but also extending it to their non-SAP applications. It’s strategic to our customers, and so it’s strategic to us.”

Vishal then invited Bjoern Goerke, in charge of the SAP NetWeaver platform, to discuss the new NetWeaver 7.3, due out later this quarter.

Bjoern explained how the NetWeaver team were delivering innovation without disruption into existing landscapes. Everything is now on the same release level, worked hard on maintainability, scalability, and performance – for example, reducing the downtime needed to install enhancement packs from several hours down to just a few minutes.

Next Vishal talked about the importance of Business Intelligence, and the upcoming release of SAP BusinessObjects 4.0 (project name “Aurora”). For the first time, all the clients tools have a common look and feel, and there’s improved integration with SAP Netweaver (identity management, BW, etc.).

The next subject was mobility. With Sybase, SAP is now the clear leader in enterprise mobility. There are now more than 4 billion mobile devices in the world, and Sybase is essential to using them. Over 2 billion messages are sent through Sybase systems every day (SMS, etc.), and Sybase recently crossed the threshold of a trillion messages through their servers. And Sybase also brings other great technology – their CEP (complex event processing) platform, the ASA and IQ databases will all be integrated into the NetWeaver framework.

He then invited Sam Yen on stage to show you how NetWeaver, BusinessObjects, and Sybase can work together.

The demonstration scenario was a series of Norwegian oil rigs, where there are sensors recording almost 600,000 events per minute, but there’s very low bandwidth between the rigs and the central offices, so  a lot of the processing has to be locally, and intelligently.

Suddenly, the oil production drops, and we can see the information in real-time using an Xcelsius (now BusinessObjects Dashboards) dashboard.

Let’s drill into the detail. We can see that Gate A was in the danger zone, and has been shut down.

What’s going on behind the scenes? Here’s the CEP development environment, that lets people easily create and change the real-time events that they would like to track and monitor

This is a very real need in oil and gas organizations today, but it takes a lot of painful programming. Because these systems are connected to NetWeaver, people can have these types of dashboards, running on top of Event Insight, as part of their enterprise portal.

Sam demonstrated the new SAP Enterprise Workspace, that users can customize with their own content, without any help needed from IT.

For example, he added the previous Event Insight dashboard, by choosing from the available applications…

And then simply dragging and dropping the module into the workspace.

Users have full ability to customize their experience including information from the outside world, etc.

Another example could be choosing vendors based on their carbon footprint. We look at the list of vendors:

And then he added a a sustainability module, using the functionality available in Carbon Impact.

Here’s the current version of Carbon impact shown within the portal:

Soon, SAP will be extending this functionality, with some of the products from the SAP BusinessObjects Innovation Center, such as Social Intelligence, in this case used in order to find sustainability experts inside my organization. People can easily do a search:

Find out how they are related to the rest of the organization:

And then invite them into the Enterprise Workspace.

Sam explained that the same portal and content can be made available for business partners outside the organization – Enterprise Workspaces in the cloud:

Vishal Sikka then moved from the improvements to existing products, such as NetWeaver, and BusinessObjects, to “New Horizons”, the new possibilities available in the future, with cloud computing, mobility, and in-memory computing: “On the one hand, we need continuous evolution. On the other hand, there are new possibilities – how to we bring fundamentally new solutions to the existing landscapes?”

Vishal outlined three big changes to technology possibilities:

(1) Cloud. There have been advances not only virtualization, but also in the ability to provision new services in public clouds. We need have the integrity of existing systems, AND improve the ease of consumption. How can we do that?

SAP want to bring the benefits of cloud computing to everyone, and the flagship product is Business ByDesign, which is not only a full suite for mid-size companies, but also the basis of the applications that SAP will deliver in the cloud.

Having a cloud platform lets us build applications, such as SAP StreamWork for collaboration and Carbon Impact, which runs on the Amazon Cloud.

(2) Mobile. Mobile internet use is already seven times the use of broadband. There are lots of new devices poised to join the market, including the RIM “PlayBook”. Users want a great experience. Vishal: “The screens want to be liberated from the tyranny of the desktop!”. What is possible?

There’s the Sybase Unwired platform that allows you to write applications once and deploy them to multiple platforms. And beyond the mobile devices, there are other platforms, such as SharePoint, Facebook, and Lotus Notes. The Gateway project was designed to make it easier to access SAP applications from these environments, as well as existing SAP systems back to R3 v 4.6C. It will be generally available later this year – you can already sign up for the ramp up program.

Microsoft and Cap Gemini recently worked together on an HR system for Microsoft that used the new Gateway functionality.

Representatives of the two companies explained that it enabled them to easily and quickly implement a new HR hiring application – something that is a critical application for Microsoft.

They explained that the application took about one-sixth of the time it normally would have done to implement, thanks to the Gateway functionality.

Sam Yen came back on stage to give a demonstration of the technology working together

He showed the end to end traceability of the SAP application within a SharePoint portal:

He explained that Gateway makes it easy to consume SAP data, no matter what front end you are using – for example, using a Macintosh.

Sam showed how you could create and start consuming SAP data on an iPad in less than two minutes. First, you choose the data you want to expose:

And in what form you would like to expose it:

Then you can use the standard Apple environment to compile an application:

And make it available to the iPad – in this case a simple employee search using information from the SAP HR database:

The last topic was in-memory computing, described by Vishal as a “once-in-a-lifetime opportunity”.

He explained that the current hardware possibilities were pretty much unimaginable ten years ago. With multi-core processing, software vendors have to rewrite their software to take advantage of parallelism, but once they have, the possibilities are amazing: real-time access to information, at a lower cost.

He gave an example of what’s possible, explaining that at a previous event in Berlin, in July, the CTO of one of the largest CPG companies in the world had challenged him to help them predict demand for their products at a row level – they had 460 billion records. Vishal put a team on it, and found that not only was it possible to access the data, it could be done 20x faster than anything the customer had previously tried. 460 billion records of data was about 45 terabytes. Compressed into a column database, it was around three to five terabytes. They put together a machine with ten server blades for around $530,000 using standard Intel parts.

The new HANA product is available for ramp up on November 30th, and he invited the audience to take part. One of the first customers is already in a pilot, running live. Vishal explained that the future direction is to “revitalize our entire product portfolio, starting with new applications – planning, forecasting, simulations”. He gave the example of utility companies using it to monitor and react to information from smart meters in real time.

Sam Yen came back on stage to give some examples.

The first was accessing over 4 billion rows of data in less than 0.03seconds, using HANA and the BusinessObjects Explorer front end.

The second example showed how you can get real-time access to live application data. He showed an SAP internal application for pipeline data. Here’s the initial view, seen on an iPad using BusinessObjects Explorer for iPad:

He then went into the SAP system to change some of the pipeline values, in a database containing half a million records. The data is then replicated to the HANA box in real-time using Sybase Replication services.

The simulation would normally take several hours to run, but now the data is reflected on the iPad in seconds:

Vishal finished with a high-level summary of the themes of his presentation: Innovation without disruption, through the new NetWeaver and BusinessObjects products, and the new possibilities afforded by the cloud, mobile use, and in-memory analytics.

IDC are running a series of Business Intelligence sessions across central and eastern Europe on the following dates:

Sofia September 16, 2010 | Kiev September 23, 2010 | Prague October 19, 2010
Zagreb October 21, 2010 | Almaty October 21, 2010 | Belgrade October 26, 2010
Ljubljana October 28, 2010 | Bratislava November 09, 2010 | Budapest November 11, 2010
Moscow November 18, 2010 | Athens November 19, 2010 | Warsaw November 23, 2010
Istanbul December 02, 2010 | Bucharest December 07, 2010 | Nicosia December 10, 2010
Ankara December 15, 2010

I have the pleasure of being a keynote speaker for several of these.

Here’s a copy of the first presentation that I gave last week in Sofia, Bulgaria – click to download the PowerPoint version (feel free to use the slides – but please give credit/point people to this blog)

I gave a presentation in Finland earlier this year as part of the Nordic “Butterfly” tour, talking about the future of Business Intelligence:

Ever since the first abacus, information technology has been an essential part of delivering timely information, staying accountable to stakeholders, reducing inefficiencies, and flexibility when faced with fast-changing environments. But for the first time in history, consumer technology interfaces have been outpacing what’s available to the average corporate knowledge worker.

How can we combine the best of enterprise technology and Web 2.0 to build greater visibility, transparency, and accountability into the way organizations work? Business intelligence technology needs to meet the demands of tomorrow’s “digital natives”; integrate seamlessly with cloud data and platforms; align people, conversations, and data with business strategy; and make the most of the infrastructures we have today:

• Simple: the right interfaces for the right people at the right time
• Seamless: tightly integrated with data sources, applications, and business processes
• Social: allow people to collaborate around analyzing information and making decisions
• Strategic: closing the loop between strategy to execution

The feedback from the audience was very positive, and so we’ve taken the 45-minute presentation and posted it to YouTube as a series of short, single-topic sections (see below). The presentation is available for download as an Adobe PDF document, and as the original PowerPoint presentation file.

The conference also included a more detailed BI presentation (not recorded) that focused on more leading-edge future BI topics such as social network analysis and augmented corporate reality. It is also available for download as an Adobe pdf file, and as a PowerPoint presentation file

Take a look, and if you find it interesting, please share with others in your organization! (and if you are interested in a tailored BI vision presentation for your company or conference, please contact me at telliott@timoelliott.com)

[Update: There’s now a nice convenient viewer for the various videos available:]

Part 1 Introduction (3:12 min)

Summary:

• High-level BI trends
• Brief summary of BusinessObjects porfolio

Part 2  Simple (9:05 min)

Summary:

• Taking BI to the next level: Simple
• Roadblocks to success
• Taking cues from the consumer world
• BI interfaces that you don’t need training to use
• Japanese picnics

Part 3 Simple Continued (4:23 min)

Summary:

• Adapting interfaces to end users
• Other interfaces, including mobile devices
• Going faster

Part 4 Seamless (9:33 min)

Summary:

• Taking BI to the next level: Seamless
• The importance of data
• Bridging the gap between central and personal data
• Text analytics
• BI OnDemand
• Embedded BI
• “Automagical” Text to Query

Part 5: Social (5:07 mins)

Summary:

• Taking BI to the next level: Social
• Collaboration is important
• Spitfire Marine example
• StreamWork demonstration

Part 6: Strategic (9:26 min)

Summary:

• Taking BI to the next level: Strategic
• Budgeting and finance
• Financial vs. other Risk
• Sustainability performance management
• Business applications of the future
• Conclusion

Today’s presentation at the Mastering SAP BusinessObjects conference in Melbourne, Australia is about implementing a BI strategy in your organization. Here’s the abstract:

Most organizations know that they should be taking a strategic approach to Business Intelligence. But what does this actually mean, and how do you go about doing it?

Using real-life examples of successful strategic BI implementations, we’ll cover key strategic themes such as fitting BI into your overall IT strategy, implementing BI competency centers and standards, effectively selling BI initiatives within the business, and using BI to align strategy and execution within the IT function itself.

• What is a BI strategy, and why is it important?
• What are the key areas to concentrate on when implementing a BI strategy?
• How can IT act as its own best reference, and use BI to improve its own performance?

You can download the presentation in pdf or ppt format, and you may also be interested in last year’s presentation about BI Competency Centers

I’m in Melbourne for the Mastering SAP BusinessObjects Annual User Conference. There’s a great agenda including talks from Dave Rathbun of PepsiCo, Ingo Hilgefort of SAP BusinessObjects (the man who literally wrote the book on Web Intelligence — and Explorer, and BusinessObjects with BW), Tom Nather of Cleveland Clinic, Mark Rousel of Sydney Water, Rajeev Kapur of Newell Rubbermaid, and many, many others.

The hashtage for the conference is #mbo10 if you’d like to follow along…

I’m presenting the keynote this morning on “The Clear Intelligence Future: Simple, Seamless, Social, and Strategic” (a slightly updated version from last month’s Nordic BI Tour), and here are the slides in ppt and pdf format.