{"id":12351,"date":"2013-08-21T11:14:59","date_gmt":"2013-08-21T10:14:59","guid":{"rendered":"http:\/\/timoelliott.com\/blog\/?p=5659"},"modified":"2013-08-21T11:14:59","modified_gmt":"2013-08-21T10:14:59","slug":"hadoop-is-a-tank-in-memory-is-a-plane-why-would-you-need-either","status":"publish","type":"post","link":"https:\/\/timoelliott.com\/blog\/2013\/08\/hadoop-is-a-tank-in-memory-is-a-plane-why-would-you-need-either.html","title":{"rendered":"Hadoop is a Tank. In-Memory is a Plane. Why Would You Need Either?!"},"content":{"rendered":"<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border: 0px;\" title=\"blueprint-tank-and-plane\" alt=\"blueprint-tank-and-plane\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/08\/blueprint-tank-and-plane.jpg?resize=690%2C310&#038;ssl=1\" width=\"690\" height=\"310\" border=\"0\" \/><\/p>\n<p>Hadoop is a tank. Built by a workers\u2019 cooperative, it\u2019s complex and adaptable, and can handle any terrain.<\/p>\n<p>In-memory is a plane. Pricier to purchase, but it\u2019s sleek and efficient and goes hundreds of times faster than the average car.<\/p>\n<p>You currently have a sedan car and can drive just about anywhere you want to go. You wonder why the heck people think you\u2019d be interested in buying a tank or a plane. Here\u2019s why:<\/p>\n<h3>(1) Efficiency<\/h3>\n<p>It turns out that the costs of tank and plane travel fell through the floor \u2013 to the point where they\u2019re now cheaper and easier alternatives for many trips:<\/p>\n<ul>\n<li>Instead of taking the long road around the mountain (e.g. storing bulk information in a traditional DW), you can just jump in your tank and drive straight over the top (e.g. storing information in Hadoop).<\/li>\n<li>Instead of driving slowly to the next state (e.g. run a long ERP batch job), you can jump in the plane and get there in a fraction of the time at a fraction of the cost (e.g. run the same job in-memory).<\/li>\n<\/ul>\n<p>It\u2019s just technological progress. Don\u2019t be the person in the horse and buggy wondering why everybody else has moved to new-fangled motor cars &#8212; hadoop and in-memory are quickly becoming a standard part of information architectures.<\/p>\n<h3>(2) Opportunity<\/h3>\n<p>With the new vehicles, there\u2019s now a lot more terrain to explore:<\/p>\n<ul>\n<li>Tanks can take you to places the roads just don\u2019t go. Yes, some of it is boring wasteland without much to look at, but you can now visit some spectacular spots that would otherwise be inaccessible (e.g. sentiment analysis on massive datasets).<\/li>\n<li>Planes allows you to visit entirely different continents, or go to another state as easily as you visit the local store (e.g. analyze data in previously-unthinkable ways, or intervene in business processes while they\u2019re still happening).<\/li>\n<\/ul>\n<p>Maybe you\u2019re happy with your daily commute, and don\u2019t feel the need for anything new. But don\u2019t be surprised if the best spots are taken when you do finally get around to visiting.<\/p>\n<h3>The Future<\/h3>\n<p>One of the reasons you can drive around so easily today is because we spent decades building a lot of expensive roads. Our information landscapes are the same \u2013 a lot of work went into your enterprise data warehouse and data flows.<\/p>\n<p>But as people look at expanding to new territories, they\u2019re realizing that tanks and planes don\u2019t need roads. The drivers of the next generation of \u201cBig Data\u201d information landscapes will be a lot freer to travel where and when they want to go, without IT first having to build roads for them (and policing and coordinating that travel will be harder).<\/p>\n<p>And which of these types of transport will you need in the future? All of them! A tank with wings or a personal helicopter may be possible one day. But right now, you should keep your car, start investing in new vehicles, and draw up a plan for a good integrated transportation network.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hadoop is a Tank. In-Memory is a Plane. You need a new comprehensive transportation plan. <\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[14],"tags":[27,94,100,556,560,773,911,931],"class_list":["post-12351","post","type-post","status-publish","format-standard","hentry","category-thoughts","tag-bigdata","tag-analogy","tag-analytics","tag-hadoop","tag-hana","tag-nosql","tag-sap","tag-saphana"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p3X9RF-3dd","_links":{"self":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/12351","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/comments?post=12351"}],"version-history":[{"count":0,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/12351\/revisions"}],"wp:attachment":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media?parent=12351"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/categories?post=12351"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/tags?post=12351"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}