{"id":13538,"date":"2017-05-10T06:00:01","date_gmt":"2017-05-10T04:00:01","guid":{"rendered":"http:\/\/timoelliott.com\/blog\/?p=13538"},"modified":"2020-06-08T14:02:12","modified_gmt":"2020-06-08T12:02:12","slug":"data-lake-insights-in-digitalist-magazine-executive-quarterly","status":"publish","type":"post","link":"https:\/\/timoelliott.com\/blog\/2017\/05\/data-lake-insights-in-digitalist-magazine-executive-quarterly.html","title":{"rendered":"Data Lake Insights in Digitalist Magazine Executive Quarterly"},"content":{"rendered":"

The 2Q\u00a0Digitalist Magazine Executive Quarterl<\/a>y is now out! It includes an article Data Lakes: Insight from the Deep<\/a> that SAP Big Data expert John Schitka <\/a>and I helped write on how organizations\u00a0are using Data Lakes to store large amounts of information and find deep correlation patterns.<\/p>\n

Prescriptive farming<\/h3>\n

The Climate Corporation<\/a> uses a data lake to collect massive amounts of agricultural data and applies machine-learning techniques to help farmers optimize their planting.<\/p>\n

Predictive maintenance for trains<\/h3>\n

SAP Customer CSX<\/a> is a transportation company in Florida. Previously, raw data from wheel bearings sensors could only be kept for 10 days because of volume restrictions. Using a data lake based on SAP HANA and Hadoop<\/a>, the company is now able to keep it as long as it likes, and look for deeper correlations with information from other sensors.<\/p>\n

Combatting insider trading<\/h3>\n

The Financial Industry Regulatory Authority<\/a> (FINRA) regulates broker behavior in the United States. It uses a data lake and algorithms to find the patterns of fraud that human analysts might miss.<\/p>\n

How not to\u00a0drown in the data lake!<\/h3>\n

The article also includes best practices for implementing data lakes<\/a> in your organization. For a start, don’t expect it to replace data warehousing any time soon:<\/p>\n

\u201cThere have been so many millions of dollars going to data warehousing over the last two decades. The idea that you\u2019re just going to move it all into a data lake isn\u2019t going to happen\u201d — Mike Ferguson<\/a>, managing director of Intelligent Business Strategies, a UK analyst firm.<\/p><\/blockquote>\n

Yes, SAP does Hadoop, Spark & more!<\/h3>\n

You’ve probably heard a lot about SAP HANA’s big data capabilities, but that’s only part of the bigger data lake strategy that includes SAP Vora, providing business analysis and more, natively on Spark<\/a>, and an elastic cloud platform<\/a>\u00a0using\u00a0Hadoop, Spark, etc, based on the acquisition of\u00a0Altiscale last year.<\/a><\/p>\n

\"\"<\/a><\/p>\n

For more on these themes — and much, much more, check out the Digitalist Magazine Executive Quarterly<\/a>, best consumed using the iPhone\/Ipad on iTunes<\/a>\u00a0or the Android application on Google Play<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

Don’t drown in your data lake! Examples and swimming lessons from Digitalist Magazine Executive Quarterly<\/p>\n","protected":false},"author":2,"featured_media":13541,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[2],"tags":[1246,391,392,1248,710,1247],"class_list":["post-13538","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-best-practice","tag-2q","tag-digitalist","tag-digitalist-magazine","tag-executive-quarterly","tag-magazine","tag-q2"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2017\/05\/SAP_Q217_250x250.jpg?fit=250%2C250&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p3X9RF-3wm","_links":{"self":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/13538","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/comments?post=13538"}],"version-history":[{"count":0,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/13538\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media\/13541"}],"wp:attachment":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media?parent=13538"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/categories?post=13538"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/tags?post=13538"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}