{"id":18154,"date":"2020-03-09T09:56:10","date_gmt":"2020-03-09T08:56:10","guid":{"rendered":"https:\/\/timoelliott.com\/blog\/?page_id=18154"},"modified":"2023-01-23T18:15:15","modified_gmt":"2023-01-23T17:15:15","slug":"why-analytics","status":"publish","type":"page","link":"https:\/\/timoelliott.com\/blog\/about\/an-executive-guide-to-enterprise-analytics-strategy\/why-analytics","title":{"rendered":"Why Analytics?"},"content":{"rendered":"<p>[under construction &#8212; please ignore the mess]<\/p>\n<p>Why should your organization be interested in analytics in the first place?<\/p>\n<p>Well, let&#8217;s start with a little history: here are some lessons learned from analytics in the past in order to succeed with analytics in the future.<\/p>\n<h2><a name=\"_Toc495336370\"><\/a>Analytics is as old as the abacus<\/h2>\n<p><a href=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2020\/03\/640px-Abacus_4.jpg?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" class=\"wp-image-18160 alignleft\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2020\/03\/640px-Abacus_4.jpg?resize=261%2C196&#038;ssl=1\" alt=\"\" width=\"261\" height=\"196\" srcset=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2020\/03\/640px-Abacus_4.jpg?w=640&amp;ssl=1 640w, https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2020\/03\/640px-Abacus_4.jpg?resize=608%2C456&amp;ssl=1 608w\" sizes=\"auto, (max-width: 261px) 100vw, 261px\" \/><\/a>Using calculation devices to increase efficiency, cut costs, and increase profits is as old as the abacus.<\/p>\n<p>And every computer has been sold with the promise of providing business executives with the real-time information they need to make better decisions\u2014including the very first ones used for business.<\/p>\n<p><a href=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2014\/05\/leo-608x417-1.jpg?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12867\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2014\/05\/leo-608x417-1.jpg?resize=608%2C417&#038;ssl=1\" alt=\"leo-608x417.jpg\" width=\"608\" height=\"417\" srcset=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2014\/05\/leo-608x417-1.jpg?w=608&amp;ssl=1 608w, https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2014\/05\/leo-608x417-1.jpg?resize=300%2C206&amp;ssl=1 300w\" sizes=\"auto, (max-width: 608px) 100vw, 608px\" \/><\/a><\/p>\n<p><em>A version of Lyons Electronic Office which became the world\u2019s first business computer in 1953 \u2013 and was used to run predictive analytics.<\/em><\/p>\n<h3><a name=\"_Toc495336371\"><\/a>The first computer for better business decisions<\/h3>\n<p>In the UK in 1951, the first ever computer designed to manage a business was created. It was baptised LEO, short for Lyons Electronic Office, and the first application it ever ran was analytics.<\/p>\n<p>Other computers existed at the time. ENIAC, an \u201celectronic brain\u201d had been designed by the US Army to calculate missile trajectories. And IBM was working with MIT on an air defense computer. But Lyon\u2019s management decided that new computer technology could help with business, too<\/p>\n<p>Lyons &amp; Co. wasn\u2019t a computer company. It didn&#8217;t even make calculating machines. Instead, it was famous around the world for cakes, tea, and sandwiches. Its 30,000 employees manufactured 36 miles of swiss roll cakes every day and uniformed staff served over 150 million meals a year in Lyons teashops across the UK.<\/p>\n<p>The company struggled with an issue that is familiar to anybody running food businesses today\u2014the bakery products were perishable. If they weren\u2019t sold by the end of the day they would be wasted and if they ran out then valuable sales would be lost.<\/p>\n<p>LEO was designed and built by Lyon\u2019s own engineers to ensure that each teashop would be restocked every day with just the right about of bread rolls, boiled beef, and ice cream.<\/p>\n<p>And Lyons was excited by the possibility that LEO could help track the performance of each teashop, and each product sold, in order to enable managers to make well-informed decisions.<\/p>\n<p>The very first job to run on the new computer\u2014which took up around 2,500 square feet of floor space\u2014was \u201cbakery valuations\u201d and by 1954, the system was fully operational and churning out standard reports for managers across the organization.<\/p>\n<h3><a name=\"_Toc495336372\"><\/a>Actionable information at their fingertips<\/h3>\n<p>For the first time, managers could see at a glance which products were popular and which were not. LEO handled the conversion of meal orders into the individual items required to make them, such as beef, carrots, and dumplings. And reports meant managers could easily compare the sales value of goods delivered to each store with the revenue for the month to check for efficiency and fraud.<\/p>\n<p>The system was designed for \u201cmanagement by exception,\u201d with reports on the top ten and worst ten performing stores for different products, so that managers could make adjustments. And they could compare the sales that were forecasted with the amounts that were actually sold to see if store managers were consistently under- or over-estimating demand.<\/p>\n<p>LEO was even used to track the production quality of products such as the high-quality tea blends on which so much of the company\u2019s reputation was based.<\/p>\n<h3><a name=\"_Toc495336373\"><\/a>Information meets culture<\/h3>\n<p>Some of the biggest cultural issues that make analytics deployments difficult today were also present in these early days.<\/p>\n<p>The first problem was the company\u2019s choice of key performance indicators lead to suboptimal practices. For example, waste was considered the ultimate sin of a store manager. The inevitable result was that the shops often had empty shelves in the afternoon, resulting in untapped revenue potential and dissatisfied customers.<\/p>\n<p>The second issue was getting top managers to adapt their management style to the new possibilities. The most advanced data processing system in the world was in the hands of a conservative management whose style hadn\u2019t changed since the previous century. The LEO team had designed the system to focus on the key figures required to run the teashops, rather than what the managers themselves had asked for. The managers still liked having their printouts of everything that was happening everywhere.<\/p>\n<h3><a name=\"_Toc495336374\"><\/a>What history tells us<\/h3>\n<p>There\u2019s a lot of industry hype about analytics, big data, and artificial intelligence. But it\u2019s clear that the biggest goal of analytics\u2014better decisions\u2014 has remained stable for a long time. And so have the biggest barriers to achieving it.<\/p>\n<p><a href=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2020\/03\/for-men-who-decide-the-future-ad.jpg?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-18161\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2020\/03\/for-men-who-decide-the-future-ad.jpg?resize=525%2C714&#038;ssl=1\" alt=\"\" width=\"525\" height=\"714\" srcset=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2020\/03\/for-men-who-decide-the-future-ad.jpg?resize=753%2C1024&amp;ssl=1 753w, https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2020\/03\/for-men-who-decide-the-future-ad.jpg?resize=515%2C700&amp;ssl=1 515w, https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2020\/03\/for-men-who-decide-the-future-ad.jpg?resize=768%2C1044&amp;ssl=1 768w, https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2020\/03\/for-men-who-decide-the-future-ad.jpg?w=1236&amp;ssl=1 1236w\" sizes=\"auto, (max-width: 525px) 100vw, 525px\" \/><\/a><\/p>\n<p><a href=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/03\/ad-for-old-computer-1956-Univac-690px-2.jpg?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12708\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/03\/ad-for-old-computer-1956-Univac-690px-2.jpg?resize=690%2C970&#038;ssl=1\" alt=\"ad-for-old-computer-1956-Univac-690px.jpg\" width=\"690\" height=\"970\" srcset=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/03\/ad-for-old-computer-1956-Univac-690px-2.jpg?w=690&amp;ssl=1 690w, https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/03\/ad-for-old-computer-1956-Univac-690px-2.jpg?resize=213%2C300&amp;ssl=1 213w\" sizes=\"auto, (max-width: 690px) 100vw, 690px\" \/><\/a><\/p>\n<p><em>Computer manufacturers have been promising real-time information for executive decision-makers since the 1950s!<\/em><\/p>\n<h2>Analytics isn\u2019t a technology problem<\/h2>\n<p>It\u2019s a problem of business definitions and processes that aren\u2019t optimized for data flow.<\/p>\n<h2><a name=\"_Toc495336375\"><\/a>Why can\u2019t I get the data I need?!<\/h2>\n<p>If LEO was able to provide business information in the 1950s, why is it still so hard today?! It&#8217;s because it&#8217;s hard, and because\u00a0expectations keep rising.<\/p>\n<h3><a name=\"_Toc495336376\"><\/a>Technology is hard!<\/h3>\n<p>Today\u2019s computer systems have become very good at gathering and storing the kinds of data you need to run the business on a day-to-day basis.<\/p>\n<p>But analyzing that data remains difficult. You need to gather information across multiple systems\u2014not just inside your organization, but also from the market as a whole. You need to be able to compare the data to history in order to get context. Data from different systems will use different terms. Even as technology improves, the amount of data that we want to access and analyze grows with it (and beyond it!).<\/p>\n<h3><a name=\"_Toc495336389\"><\/a>Expectations constantly rise beyond what is possible<\/h3>\n<p><strong><em>\u201cBusiness people will always be dissatisfied with their information systems\u201d<br \/>\n<\/em><\/strong><\/p>\n<p>&#8211;Timo&#8217;s Law of Analytics<\/p>\n<p>Survey after survey over the last twenty years has shown that the average satisfaction with corporate information systems has stayed steady, at around 15%<\/p>\n<p>That doesn&#8217;t mean they were a mistake, and it doesn\u2019t mean that the billions invested in analytics systems have been worthless.<\/p>\n<p>It just means that computer systems have become more sophisticated, but haven\u2019t kept up with executive\u2019s needs. Ultimately, the job of an executive could be defined as \u201cmaking decisions&#8221;\u2014and that\u2019s something computers will never do.<\/p>\n<h2>Decision=not enough information<\/h2>\n<p>A\u00a0<em>decision<\/em>\u00a0is a situation where information is lacking\u00a0<em>by definition.\u00a0<\/em><\/p>\n<p>Why? Because we only use the word \u201cdecision\u201d when there is some uncertainty and human discretion involved.<\/p>\n<p>For example, let\u2019s image a simple decision where the information systems have provided all the information currently available to make that decision. There are two possibilities: either the data shows that the choice is obvious, and choosing yes or no is a formality, or there\u2019s some need for reflection before choosing an answer.<\/p>\n<p>The second option necessarily means that there are some extra factors that must be weighed that the computers cannot or have not provided. This is, by definition, the job of executives.<\/p>\n<p>Of course, over time, both the data and the processing power of computers gets better, and so they can take over more of what we currently call \u201cdecisions\u201d.<\/p>\n<p>For example:<\/p>\n<ul>\n<li>People used to \u201cdecide\u201d airline pricing; now computers do, and it\u2019s just become part of the revenue optimizing application.<\/li>\n<li>Amazon\u2019s systems\u00a0<em>choose<\/em>\u00a0what books to recommend to me, but do they really \u201cdecide\u201d ?<\/li>\n<li>UPS drivers used to decide what route to take, now the system just tells them where to go, without any\u00a0<a href=\"http:\/\/timoelliott.com\/blog\/2007\/07\/bi_briefs_ups_facebook_mysql_s.html\">left-hand turns<\/a><\/li>\n<li>Or to take it to an extreme: automatic chokes on cars replaced a \u201cdecision\u201d that drivers used to have to make about the fuel\/air mixture \u2014 yet we would never call such a simple switch a \u201cdecision system.\u201d<\/li>\n<\/ul>\n<p>The bar is constantly being raised. Any choices that are automated just disappears into the mass of everything else that has already been automated. As computers take on the lower-level tasks, people are able to move on to more complicated and strategic levels of decision.<\/p>\n<p>Of course computers can help make ever-more sophisticated choices, and there can be real competitive advantages to automating decisions that are currently carried out by people (see <a href=\"http:\/\/smartenoughsystems.com\/wp\/main\/\">Smart Enough Systems<\/a>\u00a0by John Taylor and Neil Radon for a good overview of approaches to Enterprise Decision Management).<\/p>\n<p>But to decide (and err) is human. Recognizing this and setting expectations appropriately can help smooth the relationship between the people that consume information and the groups that provide it.<\/p>\n<p>This is not just a pointless debate about semantics: there are real world impacts on IT organizations and the BI industry.<\/p>\n<h2><a name=\"_Toc495336383\"><\/a>Data is the problem<\/h2>\n<p>Why is analytics hard? Ultimately, it comes down to data.<\/p>\n<h3>Trust<\/h3>\n<p>Business people don\u2019t trust the data they are provided. Poor data quality is a given, but most organizations don\u2019t know where or how much they are suffering \u2014 you need to shine a flashlight into the dark corners. And cleansing the data isn\u2019t enough \u2014 the process and results must be transparent to the users (you trust Fedex to deliver, right? So why do you care about tracking?)<\/p>\n<h3>Different types of data<\/h3>\n<p>The challenges of data are sometimes described described using the &#8220;3Vs&#8221;: Volume, Velocity, and Variety., first coined by Doug Laney of Gartner over a decade. Since then, many others have tried to take it to 11 with additional Vs including Validity, Veracity, Value, and Visibility.<\/p>\n<p>Transactions, Interactions, and Observations. This one is from Shaun Connolly of Hortonworks. Transactions make up the majority of what we have collected, stored and analyzed in the past. Interactions are data that comes from things like people clicking on web pages. Observations are data collected automatically.<\/p>\n<p>Process-Mediated Data, Human-Sourced Information, and Machine-Generated Data. This is brought to us by Barry Devlin, who co-wrote the first paper on data warehousing. It is basically the same as the above, but with clearer names.<\/p>\n<p>[illustration]<\/p>\n<p>&#8220;To make good decisions, you have to be skilled at ignoring information&#8221;<\/p>\n<h2><a name=\"_Toc495336377\"><\/a>What\u2019s (really) new?<\/h2>\n<h3><a name=\"_Toc495336378\"><\/a>Exponential data growth<\/h3>\n<p>Warnings of the exponential rise of data volumes predates computers. But now that almost every device and business process is generating data 24\/7, there\u2019s certainly a lot opportunity than in the past.<\/p>\n<h3><a name=\"_Toc495336379\"><\/a>More power<\/h3>\n<p>Over the last decade, a variety of new techniques have made it much more feasible and economically viable to process large amounts of information at high speed. These include the rise of cloud computing, in-memory processing, new open-source massively-parallel platforms, more powerful processors based on graphics technology.<\/p>\n<h3><a name=\"_Toc495336380\"><\/a>Greater visibility using sensors<\/h3>\n<p>New systems like sensors mean that previously invisible business processes can be revealed:\u00a0&#8216;analyzing data that was previously ignored because of technology limitations.&#8217;<\/p>\n<p>&nbsp;<\/p>\n<h3><a name=\"_Toc495336381\"><\/a>\u201cSignal\u201d data<\/h3>\n<p>Most corporate computer systems are very good at recording what\u2019s going on in the business. But by the time the information is available to management, it\u2019s often too late to do anything about problems.<\/p>\n<p>Instead, companies can now use &#8216;signal&#8217; data to anticipate what&#8217;s going to happen, and intervene to improve the situation.<\/p>\n<p>Examples include tracking brand sentiment on social media (if your &#8216;likes&#8217; fall off a cliff, your sales will surely follow) and predictive maintenance (complex algorithms determine when you need to replace an aircraft part, before the plane gets expensively stuck on the runway).<\/p>\n<h3><a name=\"_Toc495336382\"><\/a>Greater awareness<\/h3>\n<p>There has been a big increase in business awareness that data is a valuable resource for discovering useful knowledge.<\/p>\n<p>&nbsp;<\/p>\n<p>Iceberg Illustration here?<\/p>\n<p>&nbsp;<\/p>\n<h2>The Foundation for the Business models of the future<\/h2>\n<p>It\u2019s now way beyond just \u201cbetter decisions\u201d<\/p>\n<p>Loop \u2013 information gathered to make better decisions, but now they power things like the customer interaction.<\/p>\n<h2>The virtuous circle of information<\/h2>\n<p>Illustration.<\/p>\n<p>More data = better customer experiences = more customers = more data. The sooner you get started, the better!<\/p>\n<p>&nbsp;<\/p>\n<p>In his wonderful book The Human Face of Big Data, journalist Rick Smolan says big data is &#8220;the process of helping the planet grow a nervous system, one in which we are just another, human, type of sensor.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>[under construction &#8212; please ignore the mess] Why should your organization be interested in analytics in the first place? Well, let&#8217;s start with a little history: here are some lessons learned from analytics in the past in order to succeed with analytics in the future. Analytics is as old as the abacus Using calculation devices [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":18014,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"class_list":["post-18154","page","type-page","status-publish","hentry"],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/P3X9RF-4IO","_links":{"self":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/pages\/18154","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/comments?post=18154"}],"version-history":[{"count":3,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/pages\/18154\/revisions"}],"predecessor-version":[{"id":21090,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/pages\/18154\/revisions\/21090"}],"up":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/pages\/18014"}],"wp:attachment":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media?parent=18154"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}