{"id":12417,"date":"2014-04-29T10:58:45","date_gmt":"2014-04-29T09:58:45","guid":{"rendered":"http:\/\/timoelliott.com\/blog\/?p=6641"},"modified":"2014-04-29T10:58:45","modified_gmt":"2014-04-29T09:58:45","slug":"qa-self-service-vs-traditional-business-intelligence","status":"publish","type":"post","link":"https:\/\/timoelliott.com\/blog\/2014\/04\/qa-self-service-vs-traditional-business-intelligence.html","title":{"rendered":"Q&#038;A: Self-Service vs Traditional Business Intelligence"},"content":{"rendered":"<p><a href=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2014\/04\/self-service-bi.jpg?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-6644\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2014\/04\/self-service-bi.jpg?resize=608%2C503&#038;ssl=1\" alt=\"self-service-bi\" width=\"608\" height=\"503\" \/><\/a><\/p>\n<p>I was recently contacted by <a href=\"http:\/\/www.linkedin.com\/in\/falktewes\/en\" target=\"_blank\">Falk Tewes<\/a>, an\u00a0 MBA student at New Buckinghamshire University in the UK who is working on a master thesis about &#8216;Management aspects of a Self-Service BI strategy: the role of BI Governance\u2018.<\/p>\n<p>With his permission, here are <strong>his questions<\/strong> and <strong>my answers<\/strong> around self-service BI and governance. If you have your own ideas\/answers to these questions, please reach out to Falk, or use the comment section below!<\/p>\n<p><strong>What is your background with BI and self-service BI?<\/strong><\/p>\n<p>I have worked in business intelligence for the last 25 years or so. I worked for Shell in 1989, and one of my roles was gathering information from the payroll and HR systems and using it to create a series of management reports for executive decision-making. This required a mainframe, a few floppy disks, the one PC the department owned, and some macros on an early copy of Lotus 1-2-3, the first big commercial spreadsheet program. I then joined BusinessObjects in 1991, and have worked for the company ever since (now part of SAP).<\/p>\n<h3>Part 1: Definition and expectations of self-service BI<\/h3>\n<p><strong>How would you define self-service BI?<\/strong><\/p>\n<p>There are always two \u201cdefinitions\u201d when it comes to IT terms, and most people try to mix them up, creating endless confusion.<\/p>\n<p>The first is the business need, e.g. in this case:<\/p>\n<ul>\n<li>Business people accessing the data they need for decision-making, without having to go to technology experts each time they have a new question.<\/li>\n<\/ul>\n<p>The second is the technology used to fulfill that business need, e.g.<\/p>\n<ul>\n<li>Tools that allow people to gather information from multiple sources, analyze it, and share it with others, without having to know the technical protocols required to access the data.<\/li>\n<\/ul>\n<p>For the purposes of this document, it\u2019s best to focus on the technology, because that is what typically changes first, solving old business needs and creating new ones.<\/p>\n<p><strong>What do you find people misunderstand about self-service BI\u2019s concept?<\/strong><\/p>\n<p>That it\u2019s a very hard thing to define concretely in terms of technology implementation. The underlying business need is a very broad concept that covers a very wide range of different types of technologies and information uses, and that the distinctions between \u201creports,\u201d \u201cdashboards\u201d, \u201cdata discovery,\u201d etc are blurry \u2014 and the need for \u201cbusiness information\u201d covers a lot more than what is stored in traditional databases (documents, external news feeds, etc.)<\/p>\n<p>There\u2019s no truly self-service BI solution. Somebody has always done some work in advance. The data has to be brought together at some point in a way that makes sense, and this has to be done by somebody with expertise in data and technology.<\/p>\n<p><strong>In your opinion, what are the benefits of self-service BI compared to traditional BI and how can it help organizations to meet its strategic and operational business goals? <\/strong><\/p>\n<p>BusinessObjects was explicitly a \u201cself-service BI\u201d tool in 1991 (using my definitions above), so I\u2019m not sure the comparison with \u201ctraditional\u201d is appropriate.<\/p>\n<p>Business needs don\u2019t change so much over time \u2014 what does change is the technology used, the data available, and the culture\/expertise of information use.<\/p>\n<p>So the question should really be about comparing \u201cnew technology possibilities\u201d with \u201cold technology possibilities\u201d<\/p>\n<p>What\u2019s different now is that:<\/p>\n<ul>\n<li>There is a lot more data available, and a smaller proportion of that data come from corporate processes. You could mash up data with full-client tools like BusinessObjects in the 1990s, but the default assumption was that most of it would come from your corporate systems and data warehouse.<\/li>\n<li>The underlying data was too complicated for users to access in \u201craw\u201d form, and a \u201csemantic layer\u201d of some kind was required that gave a business-friendly view of the information. Increased analytic maturity (i.e. people are more used to manipulating data) and better underlying technology platforms (simpler, faster, iterative interactions with data are now possible) have reduced this need (but not eliminated it \u2014 indeed, it\u2019s one of the biggest challenges of \u201cgoverned data discovery\u201d)<\/li>\n<li>Although the tools were designed for self-service, many deployments of these solutions ended up being \u201creport factories\u201d where the semantic layer was used by IT\/business experts to create reports for others. This often reintroduced the bottlenecks and frustrations that self-service BI was supposed to get rid of.<\/li>\n<\/ul>\n<p><strong>What is your opinion towards visual analytics in the context of self-service BI and how do they differ?<\/strong><\/p>\n<p>The ability to have fast, interactive feedback to new questions means that the user interface can be improved. Instead of forcing users to ask a question, get a result, and then use that result to make a chart, you can do much more of the interaction on the chart itself. It\u2019s more appropriate for iterative discovery than reporting. It\u2019s also easier and more appealing to use, which is an important consideration in a technology that is still, sadly, seen as a \u201cnice to have\u201d in more organizations \u2014 i.e. people are rarely forced to use BI as part of their job.<\/p>\n<h3>Part 2: The Role of Governance<\/h3>\n<p><strong>How would you define Governance in regard to self-service BI?<\/strong><\/p>\n<p>My definition of data governance is \u201cstopping people from doing stupid things with data\u201d. Sadly, stupidity is a vast subject.<\/p>\n<p>Data governance includes security, having people agree on common definitions (it\u2019s amazingly hard to define something like \u201chow many employees does the company have?\u201d \u2014 and the answer will vary considerably depending on why you are asking the question\/what you\u2019re going to do with the data), bad analysis, wasteful recreation of the same analyses, etc.<\/p>\n<p>Self-service BI can exacerbate all these problems by removing the checks and balances on data preparation and use. Without governance you are likely to end up with lots of silos of information, bad analysis, and extra costs.<\/p>\n<p>There\u2019s some nice literature on the problems of <a href=\"https:\/\/www.sig.eu\/en\/about-sig\/publications\/governance-spreadsheets-through-spreadsheet-change-reviews\/\" target=\"_blank\">spreadsheet governance<\/a> that is similar to the problems unsupervised self-service BI can lead to.<\/p>\n<p><strong>How would you rate the role of Data Governance for successful self-service BI usage?<\/strong><\/p>\n<p>First define \u201csuccess\u201d!<\/p>\n<p>Self-service tools can be very popular with business people that have been frustrated with the red tape and lack of agility associated with traditional IT organizations. To the extent that they can now make better business decisions faster, it\u2019s clearly \u201csuccessful\u201d \u2014 but there can be tradeoffs in terms of long-term costs and complexity.<\/p>\n<p><strong>Data Governance is just part of Governance. What other aspects of Governance would you describe as important to self-service BI and why?<\/strong><\/p>\n<p>I\u2019m going to take \u201cgovernance\u201d to mean processes and procedures in general.<\/p>\n<p>The cultural aspects of information use are extremely important for BI\u2014 whether people are incented to use information, whether information is hoarded as \u201cpower,\u201d who is responsible for information, how it impacts people\u2019s bonuses, how the people involved in providing information to the business are organized, etc.<\/p>\n<p>All of this is vastly more important than the technology itself. Frank Buytendijk has written a <a href=\"http:\/\/www.frankbuytendijk.com\/\" target=\"_blank\">series of books<\/a> that cover many of these people and culture issues in more detail.<\/p>\n<p><strong>Why do you find Governance as important for self-service BI and would you recommend a company without Governance policy to implement a self-service BI strategy?<\/strong><\/p>\n<p>De facto \u201cgovernance\u201d always exists, even if it\u2019s not codified. The underlying principles around information culture are more important than having documented procedures, etc. And as noted above \u201csuccess\u201d depends on what is being measured, but I believe that the benefits of governance policies and procedures clearly outweigh the costs.<\/p>\n<h3>Part 3: Success factors for Self-Service BI<\/h3>\n<p><strong>Are there any factors that you would consider as critical when developing and implementing a self-service BI strategy? <\/strong><\/p>\n<p>One of the most interesting things about BI is that it\u2019s ultimately indistinguishable from whatever we mean by \u201cmanagement.\u201d I\u2019m not sure there are any \u201ccritical\u201d factors, but there\u2019s a long, long list of best practice.<\/p>\n<p>Some more here on \u201c<a href=\"http:\/\/assets.timoelliott.com\/docs\/why_bi_projects_fail_2012.pdf\" target=\"_blank\">why BI projects fail<\/a>\u201d \u2014 sadly I never wrote this up as a full blog post<\/p>\n<p><strong>What do organizations have to change to take advantage of empowering their users to gain new insights through self-service BI? <\/strong><\/p>\n<p>Change the <a href=\"https:\/\/timoelliott.com\/blog\/2010\/10\/what-does-a-world-class-bi-program-look-like.html\" target=\"_blank\">information culture<\/a><\/p>\n<h3>Part 4: Components of traditional BI usable for SS BI<\/h3>\n<p><strong>In what way could self-service BI improve the organizational wide use of BI tools?<\/strong><\/p>\n<p>Self-service BI typically builds on \u201ctraditional BI\u201d \u2014 i.e. the trusted data sources (finance, etc.) available through the enterprise data warehouse are a key part of the data analysis done in the \u201cself-service\u201d tools.<\/p>\n<p><strong>What types of components of traditional BI strategies would you consider for using with self-service BI?<\/strong><\/p>\n<p>There are many benefits to traditional BI. In particular, successful analytics requires at least some key information to be reliable, consistent, and secured. This often-painful process is one of the key areas of success of traditional BI implementations.<\/p>\n<h3>Annotations<\/h3>\n<p><strong>Is there anything else you would like to mention when talking about self-service BI?<\/strong><\/p>\n<p>At one level, \u201cbusiness intelligence\u201d is just an artifact of limited technology.<\/p>\n<p>The very first business application ever, in 1951, was used for analytics (for predictive \u201c<a href=\"https:\/\/timoelliott.com\/blog\/2012\/12\/baking-and-computers-a-history-of-analytics-pioneers.html\" target=\"_blank\">bakery valuations<\/a>\u201d). But it quickly became clear that because of technology limitations, it wasn\u2019t economically feasible to do \u201ctransactions\u201d (OLTP) and \u201cqueries\u201d (OLAP) on the same system. So the data had to be copied to a separate data store for analytics, with \u201cbusiness intelligence\u201d tools for analysts.<\/p>\n<p>But new technology means that we can now go back to the origins of business applications, with \u201c<a href=\"https:\/\/www.gartner.com\/doc\/2657815\/hybrid-transactionanalytical-processing-foster-opportunities.\" target=\"_blank\">Hybrid Transactional\/Analytic Processing<\/a>\u201d systems<\/p>\n<p>For example, the new SAP\u00a0 \u201c<a href=\"http:\/\/scn.sap.com\/community\/embedded-analytics\/blog\/2014\/03\/17\/preview-of-new-smart-accounting-part-1\" target=\"_blank\">Simplified Accounting<\/a>\u201d application uses in-memory technology to store data just once, at the most granular level. Every other financial view needed (consolidations, balance sheet, management accounting, etc.) is calculated on the fly, in real-time. This reduces the data storage needs by up to 98% and vastly reduces the complexity that lead to the poor performance of \u201ctraditional BI\u201d<\/p>\n<p>In other words, the fast growth of \u201cself-service BI\u201d (driven by local in-memory tech enhancements) has been because of traditional limitations \u2014 and those limitations are falling (because in-memory is now core to the underlying transactional systems)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>What&#8217;s the difference between &#8220;self-service&#8221; and &#8220;traditional&#8221; business intelligence?<\/p>\n","protected":false},"author":2,"featured_media":12864,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[7],"tags":[100,160,204,333,334,537,957],"class_list":["post-12417","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-interviews","tag-analytics","tag-bi","tag-business-intelligence","tag-data-discovery","tag-data-governance","tag-governance","tag-self-service"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2014\/04\/self-service-bi-2.jpg?fit=608%2C503&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p3X9RF-3eh","_links":{"self":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/12417","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/comments?post=12417"}],"version-history":[{"count":0,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/12417\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media\/12864"}],"wp:attachment":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media?parent=12417"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/categories?post=12417"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/tags?post=12417"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}