{"id":12309,"date":"2013-04-17T12:37:08","date_gmt":"2013-04-17T11:37:08","guid":{"rendered":"http:\/\/timoelliott.com\/blog\/?p=4817"},"modified":"2013-04-17T12:37:08","modified_gmt":"2013-04-17T11:37:08","slug":"why-in-memory-computing-is-cheaper-and-changes-everything","status":"publish","type":"post","link":"https:\/\/timoelliott.com\/blog\/2013\/04\/why-in-memory-computing-is-cheaper-and-changes-everything.html","title":{"rendered":"Why In-Memory Computing Is Cheaper And Changes Everything"},"content":{"rendered":"<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border: 0px;\" title=\"donald feinberg banner\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/04\/donald-feinberg-banner.jpg?resize=690%2C310&#038;ssl=1\" alt=\"donald feinberg banner\" width=\"690\" height=\"310\" border=\"0\" \/><\/p>\n<p>I attended a SAP-sponsored breakfast meeting organized in Sydney earlier this year, as part of a\u00a0<a href=\"https:\/\/timoelliott.com\/blog\/2013\/02\/innovative-analytics-in-asia-and-anz.html\" target=\"_blank\">ANZ\/APJ innovation analytics tour<\/a>. The meeting was hosted by <a href=\"http:\/\/www.linkedin.com\/pub\/ryan-blackwood\/3\/50a\/a41\" target=\"_blank\">Ryan Blackwood<\/a>, Director of Strategy &amp; Innovation for SAP Australia, and featured a talk by <a href=\"http:\/\/www.gartner.com\/AnalystBiography?authorId=490\" target=\"_blank\">Donald Feinberg, Gartner VP and Distinguished Analyst<\/a> on the \u201c<a href=\"http:\/\/www.gartner.com\/technology\/research\/nexus-of-forces\/\" target=\"_blank\">Nexus of Forces<\/a>\u201d: social, mobile, cloud and information.<\/p>\n<p>Here the first part of the notes I took from Donald&#8217;s presentation, formatted for legibility. In Part 2, Donald talks about the <a href=\"https:\/\/timoelliott.com\/blog\/2013\/04\/the-business-impact-of-in-memory-computing-from-run-to-transform.html\">business impact of in-memory technologies<\/a>\u00a0and in Part 3,\u00a0<a href=\"https:\/\/timoelliott.com\/blog\/2013\/04\/how-and-why-to-create-an-in-memory-action-plan.html\">how to create an in-memory action plan<\/a>.<\/p>\n<hr \/>\n<p>Some people think that we\u2019re talking about in-memory because of all the hype that\u2019s been going on in the market \u2013 but it\u2019s not just SAP. Every single vendor out there is getting involved in in-memory technology. We actually started looking at in-memory technology at Gartner back in 2009 and in-memory databases have been around for years in some form going back to the 90s.<\/p>\n<p><strong>This technology is now becoming disruptive.<\/strong><\/p>\n<h3>Common in-memory myths<\/h3>\n<p><a href=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/04\/in-memory-myths3.jpg?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; margin: 0px; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border: 0px;\" title=\"in-memory-myths[3]\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/04\/in-memory-myths3_thumb.jpg?resize=571%2C441&#038;ssl=1\" alt=\"in-memory-myths[3]\" width=\"571\" height=\"441\" border=\"0\" \/><\/a><\/p>\n<p>Myths:<\/p>\n<ul>\n<li><strong>Is in-memory hype spread by SAP<\/strong>? Not likely, because there are over 50 companies that have some type of in-memory technology.<\/li>\n<li><strong>It\u2019s new and unproven?<\/strong> Wrong. We have been using in-memory technology since the 90s. We\u2019re not talking here about caching in-memory. We did that in with <a href=\"http:\/\/en.wikipedia.org\/wiki\/IBM_System\/360\" target=\"_blank\">360s<\/a>, with only 24k of memory. In-memory technologies that actually use in-memory not for cache, but for actual data that they fetch and change, has been around since the early 90s.<\/li>\n<li><strong>That in-memory technology is expensive and only if you have really deep pockets can you afford it?<\/strong> Not true. There are several in-memory technology vendors whose largest customer base is SME, who by definition doesn\u2019t have a lot of money to spend. And the cost of the technology is coming down fast.<\/li>\n<li><strong>And this is not a niche technology just for analytics<\/strong>. We\u2019re using it for all kinds of use cases today, such as trading fraud in the financial industry, for telephone fraud, for gaming where everything has to be instantaneous. Analytics will run faster, but it is not true that it\u2019s only for analytics.<\/li>\n<\/ul>\n<h3>In-memory is going to change the way you do everything<\/h3>\n<blockquote><p>In-memory computing will have a long term, disruptive impact by radically changing users\u2019 expectations, application design principles, products\u2019 architecture and vendors\u2019 strategy<\/p><\/blockquote>\n<p>This is going to change the way you do everything. <strong>Everybody in this room will be running their entire IT organization in-memory in the next 15 to 20 years<\/strong>. It\u2019s not going to happen overnight. But within the next 15 years, you will run your whole operation in memory. You won\u2019t have tape drives, you won\u2019t have disk drives. You\u2019ll be using flash and memory. Flash will be your backup, your archive, and memory is where you\u2019re going to run everything. And that\u2019s absolutely a fact.<\/p>\n<h3>What is in-memory computing?<\/h3>\n<p><a href=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/04\/what-is-in-memory.jpg?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; margin: 0px; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border: 0px;\" title=\"what-is-in-memory\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/04\/what-is-in-memory_thumb.jpg?resize=538%2C396&#038;ssl=1\" alt=\"what-is-in-memory\" width=\"538\" height=\"396\" border=\"0\" \/><\/a><\/p>\n<p>When we talk about in-memory computing, we are talking about DRAM: the \u201cd\u201d stands for destructive: it doesn\u2019t hold data it if you lose power. It\u2019s not about flash or NAND memory. Flash is a form of memory, but it\u2019s not what we\u2019re talking about when we talk about in-memory computing.<\/p>\n<p>All forms of flash today are used like disk drives. Even though we may remove the controller as a bottleneck, the applications are still doing I\/O to a flash drive or a flash board. It is getting much more reliable and cheaper, so it is going to become a persistence mechanism replacing disk.<\/p>\n<p>Today, the reliability of flash is longer than that of disk drives. If you replace your hardware every three to four years, and you have flash SSD and disk, you will probably not see a failure on the flash at all in that period of time, but I guarantee you that you will change disk drives.<\/p>\n<p>When we talk about in-memory, we are talking about the physical database being in-memory rather than as it is \u201ctraditionally\u201d done: on disk.<\/p>\n<p>What is the difference? Database engines today do I\/O. So if they want to get a record, they read. If they want to write a record, they write, update, delete, etc. The application, which in this case is a DBMS, thinks that it\u2019s always writing to disk. If that record that they\u2019re reading and writing happens to be in flash, it will certainly be faster, but it\u2019s still reading and writing. Even if I\u2019ve cached it in DRAM, it\u2019s the same thing: I\u2019m still reading and writing.<\/p>\n<p>What we\u2019re talking about here is the actual database is physically in in-memory. I\u2019m doing a fetch to get data and not a read. So the logic of the database changes. That\u2019s what in-memory is about as opposed to the traditional types of computing.<\/p>\n<h3>Why is it time for in-memory computing?<\/h3>\n<p>Why now? The most important thing is this: DRAM costs are dropping about 32% every 12 months. Things are getting bigger, and costs are getting lower. If you looked at the price of a Dell server with a terabyte of memory three years ago, it was almost $100,000 on their internet site. Today, a server with more cores &#8212; sixteen instead of twelve &#8212; and a terabyte of DRAM, costs less than $40,000.<\/p>\n<h3>In-memory results in lower total cost of ownership<\/h3>\n<p>So the costs of this stuff is not outrageous. For those of you who don\u2019t understand storage, I always get into this argument: the total cost of acquisition of an in-memory system is likely higher than a storage system. There\u2019s no question. But the total cost of TCO is lower \u2013 because you don\u2019t need storage people to manage memory. There are no LUNs [logical unit numbers]: all the things your storage technicians do goes away.<\/p>\n<p>People cost more than hardware and software \u2013 a lot more. So the TCO is lower. And also, by the way, power: one study IBM did showed that memory is 99% less power than spinning disks. So unless you happen to be an electric company, that\u2019s going to mean a lot to you. Cooling is lower, everything is lower.<\/p>\n<p><strong>So don\u2019t let somebody say to you we can\u2019t go in-memory because it\u2019s so much more money. Acquisition costs may be higher. If you calculate out a TCO, it\u2019s going to be less.<\/strong><\/p>\n<p>&gt;&gt;Continue to Part 2, where\u00a0Donald\u00a0talks about the\u00a0<a href=\"https:\/\/timoelliott.com\/blog\/2013\/04\/the-business-impact-of-in-memory-computing-from-run-to-transform.html\">business impact of in-memory technologies<\/a>, or\u00a0Part 3,\u00a0<a href=\"https:\/\/timoelliott.com\/blog\/2013\/04\/how-and-why-to-create-an-in-memory-action-plan.html\">how to create an in-memory action plan<\/a>.<\/p>\n<p>In addition: if you&#8217;re interested in hearing Donald Feinberg talk about this, a <a href=\"http:\/\/www.itbriefingcenter.com\/programs\/gartner_1421_sap.html\">web seminar is available<\/a> (registration required)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Gartner VP and Distinguished Analyst Donald Feinberg explain the myths and realities of in-memory computing<\/p>\n","protected":false},"author":2,"featured_media":4812,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[9],"tags":[100,160,185,204,213,244,405,492,521,560,577,581,595,755,911,931],"class_list":["post-12309","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-presentations","tag-analytics","tag-bi","tag-bobj","tag-business-intelligence","tag-businessobjects","tag-cheaper","tag-dram","tag-flash","tag-gartner","tag-hana","tag-htap","tag-hybrid","tag-in-memory","tag-nand","tag-sap","tag-saphana"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/04\/donald-feinberg-banner-1.jpg?fit=690%2C310&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p3X9RF-3cx","_links":{"self":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/12309","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/comments?post=12309"}],"version-history":[{"count":0,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/12309\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media\/4812"}],"wp:attachment":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media?parent=12309"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/categories?post=12309"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/tags?post=12309"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}