{"id":12444,"date":"2014-12-03T17:58:19","date_gmt":"2014-12-03T16:58:19","guid":{"rendered":"http:\/\/timoelliott.com\/blog\/?p=6908"},"modified":"2014-12-03T17:58:19","modified_gmt":"2014-12-03T16:58:19","slug":"what-is-htap","status":"publish","type":"post","link":"https:\/\/timoelliott.com\/blog\/2014\/12\/what-is-htap.html","title":{"rendered":"What is HTAP?"},"content":{"rendered":"<p><a href=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2014\/12\/what-is-htap-large.jpg?ssl=1\" target=\"_blank\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-6910\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2014\/12\/what-is-htap-large.jpg?resize=608%2C608&#038;ssl=1\" alt=\"what is htap large\" width=\"608\" height=\"608\" \/><\/a><a href=\"http:\/\/en.wikipedia.org\/wiki\/Hybrid_Transactional\/Analytical_Processing_(HTAP)\" target=\"_blank\">HTAP<\/a> stands for Hybrid Transaction \/ Analytical Processing &#8212; and it&#8217;s the future of business applications.<\/p>\n<p>The term was <a href=\"https:\/\/www.gartner.com\/doc\/2657815\/hybrid-transactionanalytical-processing-foster-opportunities\" target=\"_blank\">coined in early 2014 by analyst firm Gartner<\/a> to describe a new generation of in-memory data platforms that can perform both <a title=\"Online transaction processing\" href=\"http:\/\/en.wikipedia.org\/wiki\/Online_transaction_processing\" target=\"_blank\">online transaction processing<\/a> (OLTP) and <a title=\"Online analytical processing\" href=\"http:\/\/en.wikipedia.org\/wiki\/Online_analytical_processing\" target=\"_blank\">online analytical processing<\/a> (OLAP) without requiring data duplication.<\/p>\n<p>For the last few decades, it has been considered best practice to keep\u00a0operational and analytic systems\u00a0separate, in order to prevent\u00a0analytic workloads from\u00a0disrupting\u00a0operational processing. In order to achieve adequate speeds for analytic queries, data has\u00a0typically copied from one or more operational systems to a Data Mart or <a href=\"http:\/\/en.wikipedia.org\/wiki\/Data_warehouse\" target=\"_blank\">Data Warehouse<\/a>.<\/p>\n<p>This approach was challenged in 2009 with the publication of a white paper by <a href=\"http:\/\/en.wikipedia.org\/wiki\/Hasso_Plattner\" target=\"_blank\">Dr. Hasso Plattner<\/a> entitled\u00a0<a href=\"http:\/\/www.sigmod09.org\/images\/sigmod1ktp-plattner.pdf\" target=\"_blank\">A Common Database Approach for OLTP and OLAP Using\u00a0an In-Memory Column Database<\/a>. The paper argued\u00a0that advances in in-memory technology\u00a0enabled\u00a0a new approach for standard business applications where data could be stored just once without compromising either\u00a0transactions or\u00a0analytical workloads.<\/p>\n<p>HTAP systems are now commercially available, from major vendors such as SAP with the <a href=\"http:\/\/saphana.com\" target=\"_blank\">SAPHANA<\/a> platform, and smaller startups such as <a href=\"http:\/\/en.wikipedia.org\/wiki\/VoltDB\" target=\"_blank\">VoltDB<\/a>, <a href=\"http:\/\/en.wikipedia.org\/wiki\/NuoDB\" target=\"_blank\">NuoDB<\/a>, <a href=\"http:\/\/www.clustrix.com\/\" target=\"_blank\">Clustrix<\/a>, and <a href=\"http:\/\/www.memsql.com\/\" target=\"_blank\">MemSQL<\/a>.<\/p>\n<p>Gartner believes that <a href=\"http:\/\/www.zdnet.com\/sql-and-nosql-fine-but-how-does-the-hybrid-database-fit-in-7000029277\/\" target=\"_blank\">HTAP systems can address the four major drawbacks of this traditional approach<\/a>:<\/p>\n<blockquote><p>First, for analytics in HTAP, data doesn&#8217;t have to move from operational databases to data warehouses.\u00a0Secondly, transactional data is readily available for analytics when created.\u00a0Thirdly, drill-down from analytic aggregates always points to fresh HTAP application data.\u00a0Finally, you eliminate or at least cut the need for multiple copies of the same data.<\/p><\/blockquote>\n<p>Gartner\u00a0emphasizes that <a href=\"http:\/\/blogs.gartner.com\/donald-feinberg\/2014\/09\/28\/in-memory-dbms-vs-in-memory-marketing\/\" target=\"_blank\">in-memory databases are very different from\u00a0just using existing databases with\u00a0Flash disks or in-memory caches<\/a>. To get the full benefits of using in-memory, databases need to take an entirely different approach from existing disk-based systems. This may be why, even though most of the major database manufacturers now offer in-memory processing options, <a href=\"http:\/\/www.bluefinsolutions.com\/Blogs\/John-Appleby\/May-2012\/Update-III-The-SAP-HANA-FAQ-answering-key-SAP\/\" target=\"_blank\">these are\u00a0typically only for analytics only, and require a copy of the data<\/a>. This in turn means there is a delay between when a new transaction being written to the database and when it is available for analysis &#8212; i.e. they are not HTAP systems.<\/p>\n<p>While some\u00a0industry analysts continue to assume in-memory systems are a &#8220;<a href=\"https:\/\/timoelliott.com\/blog\/2014\/09\/is-sap-hana-a-luxury.html\" target=\"_blank\">luxury<\/a>&#8221; that is only justified in situations that require real-time\u00a0processing, <a href=\"https:\/\/timoelliott.com\/blog\/2013\/04\/why-in-memory-computing-is-cheaper-and-changes-everything.html\" target=\"_blank\">Gartner believes HTAP approaches are more cost-effective<\/a>, with the higher hardware costs more than outweighed by lower costs of operations and greater flexibility. These seems to be confirmed by the increasing numbers of organizations that have announced they are <a href=\"http:\/\/sapinsider.wispubs.com\/Assets\/Articles\/2014\/August\/IP-over-1200-customers-and-growing\" target=\"_blank\">moving their business applications to in-memory HTAP systems<\/a>.<\/p>\n<p>After extensive research, Gartner has concluded that industry disruption through HTAP technology <a href=\"https:\/\/www.gartner.com\/doc\/2657815\/hybrid-transactionanalytical-processing-foster-opportunities\" target=\"_blank\">is set to grow:<\/a><\/p>\n<blockquote><p>Hybrid transaction\/analytical processing will empower application leaders to innovate via greater situation awareness and improved business agility. This will entail an upheaval in the established architectures, technologies and skills driven by use of in-memory computing technologies as enablers.<\/p><\/blockquote>\n<p>Many Big Data architectural approaches such as <a href=\"https:\/\/timoelliott.com\/blog\/2014\/12\/from-data-lakes-to-data-swamps.html\" target=\"_blank\">Data Lakes <\/a>continue to separate transactional\u00a0and analytical activities. The rise of HTAP applications makes it clear that such approaches are only\u00a0part of an\u00a0overall information architecture strategy.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>What is Hybrid Transactional\/Analytical Processing (HTAP)? It&#8217;s the future of business applications.<\/p>\n","protected":false},"author":2,"featured_media":12874,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[2],"tags":[100,114,173,577,778,780,781,791,911,916],"class_list":["post-12444","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-best-practice","tag-analytics","tag-applications","tag-big-data","tag-htap","tag-olap","tag-oltap","tag-oltp","tag-operations","tag-sap","tag-sap-hana"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2014\/12\/what-is-htap-large-608x608-1.jpg?fit=608%2C608&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p3X9RF-3eI","_links":{"self":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/12444","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/comments?post=12444"}],"version-history":[{"count":0,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/12444\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media\/12874"}],"wp:attachment":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media?parent=12444"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/categories?post=12444"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/tags?post=12444"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}