{"id":12325,"date":"2013-06-03T13:50:13","date_gmt":"2013-06-03T12:50:13","guid":{"rendered":"http:\/\/timoelliott.com\/blog\/?p=5190"},"modified":"2013-06-03T13:50:13","modified_gmt":"2013-06-03T12:50:13","slug":"results-of-the-fitness-challenge-using-sap-lumira","status":"publish","type":"post","link":"https:\/\/timoelliott.com\/blog\/2013\/06\/results-of-the-fitness-challenge-using-sap-lumira.html","title":{"rendered":"Results of the Fitness Challenge using SAP Lumira"},"content":{"rendered":"<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"fitbit-banner\" alt=\"fitbit-banner\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/fitbit-banner.jpg?resize=690%2C310&#038;ssl=1\" width=\"690\" height=\"310\" border=\"0\" \/><\/p>\n<p>During SAPPHIRE NOW in Orlando, the analytics team issued a \u201c<a href=\"http:\/\/blogs.sap.com\/analytics\/2013\/05\/07\/fitness-analytics-at-asug-and-sapphire-now-orlando\/\" target=\"_blank\">fitness challenge<\/a>,\u201d asking people to record their activity with a device such as a <a href=\"http:\/\/fitbit.com\" target=\"_blank\">Fitbit<\/a> or <a href=\"https:\/\/jawbone.com\/up\" target=\"_blank\">Jawbone Up<\/a> and email us the results.<\/p>\n<p>The resulting analysis was a microcosm of the kinds of issues that happen in organizations every day \u2013 along with announcing the winner, here\u2019s an explanation of how I did the analysis using <a href=\"http:\/\/www.saphana.com\/community\/learn\/solutions\/sap-lumira\/sap-lumira-desktop\" target=\"_blank\">SAP Lumira<\/a> (previously known as <a href=\"http:\/\/www54.sap.com\/solutions\/analytics\/business-intelligence\/software\/data-visualization\/index.html\" target=\"_blank\">SAP Visual Intelligence<\/a>).<\/p>\n<p>The first thing I did was to take a look at the different files provided by the participants, in a variety of different formats (CSV, XLS). I could have used the powerful data merge capabilities of SAP Lumira (including the new \u201cUnion\u201d option shown below), but for this one-off analysis, I used Excel to cut and paste the data into the right formats.<\/p>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"union\" alt=\"union\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/union1.jpg?resize=690%2C416&#038;ssl=1\" width=\"690\" height=\"416\" border=\"0\" \/><\/p>\n<p>The first problem was the differences between the data sets generated by the Fitbit One and Jawbone One devices:<\/p>\n<ul>\n<li>The Fitbit export columns were clearly labeled and easy to understand, whereas Jawbone ones were a little more cryptic. I eventually found an <a href=\"http:\/\/forums.jawbone.com\/t5\/LIVE-UP\/csv-Column-Labels-Mostly-Deciphered\/m-p\/52480\" target=\"_blank\">explanation<\/a> of the different fields and was able to add some conversions to align the data (e.g. m_distance = distance in meters, so multiply by 0.000621371 to get miles)<\/li>\n<li>The devices measure different things\u2013 for example, the Fitbit divides activity time into \u201clightly active,\u201d \u201cfairly active,\u201d and \u201cvery active\u201d time while the Jawbone takes a different approach, providing fields such as \u201clongest active time\u201d and \u201ctotal workout time.\u201d<\/li>\n<li>The devices measured the same thing in different ways. For example, \u201ccalories burned\u201d for the Jawbone seems to be just the calories burned during exercise, whereas the Fitbit estimates calorie burn for the whole day.<\/li>\n<\/ul>\n<p>Once I had made all the adjustments in Excel, I created a new document, imported the data, and accepted the default \u201csemantic enrichment\u201d which correctly identified the measures and date field.<\/p>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"saplumira\" alt=\"saplumira\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/saplumira1.jpg?resize=690%2C429&#038;ssl=1\" width=\"690\" height=\"429\" border=\"0\" \/><\/p>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"data2\" alt=\"data2\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/data2.jpg?resize=690%2C447&#038;ssl=1\" width=\"690\" height=\"447\" border=\"0\" \/><\/p>\n<p>Then it was very easy to create a visualization of the number of steps taken by day (several people provided data for Monday, but I excluded it since it was a travel day for most people).<\/p>\n<p>The results: the seven participants in the challenge took a total of 284,908 steps during the conference. As you can see from the chart, people started off with great intentions on day one, but couldn\u2019t keep it up for days 2 and 3:<\/p>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"steps-by-day[5]\" alt=\"steps-by-day[5]\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/steps-by-day5.jpg?resize=690%2C447&#038;ssl=1\" width=\"690\" height=\"447\" border=\"0\" \/><\/p>\n<p>By breaking this result down by person and day, we can see that the the slowing-down trend was true of most people, except <a href=\"http:\/\/twitter.com\/dgraversen\" target=\"_blank\">Daniel Graversen<\/a> and <a href=\"http:\/\/twitter.com\/henrikwagner73\">Henrik Wagner<\/a> (both Jawbone One users). Daniel, in particular, put in an all-out effort on day three to clinch the \u201cmost steps in a single day\u201d title.<\/p>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"steps-by-person-by-day\" alt=\"steps-by-person-by-day\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/steps-by-person-by-day.jpg?resize=690%2C518&#038;ssl=1\" width=\"690\" height=\"518\" border=\"0\" \/><\/p>\n<p>We can also see that the two Jawbone users, on average, were more active than the Fitbit users:<\/p>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"devices[3]\" alt=\"devices[3]\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/devices3.jpg?resize=688%2C236&#038;ssl=1\" width=\"688\" height=\"236\" border=\"0\" \/><\/p>\n<p>So who won the challenge? As ever, it depends (a bit) on how you choose to measure \u201cwinning!\u201d<\/p>\n<p>Daniel Graversen\u2019s last-minute burst clearly wins him the bragging rights on the total number of steps (shown horizontally this time, just for show SAP Lumira does horizontal charts, too)<\/p>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"steps-by-person-total\" alt=\"steps-by-person-total\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/steps-by-person-total.jpg?resize=690%2C518&#038;ssl=1\" width=\"690\" height=\"518\" border=\"0\" \/><\/p>\n<p>Looking at total distance, however, appeared to show a different winner \u2013 me! (<a href=\"http:\/\/twitter.com\/timoelliott\" target=\"_blank\">Timo Elliott<\/a>)<\/p>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"distance-by-person\" alt=\"distance-by-person\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/distance-by-person.jpg?resize=690%2C447&#038;ssl=1\" width=\"690\" height=\"447\" border=\"0\" \/><\/p>\n<p>That looked a little strange, though, given how many fewer steps I\u2019d taken. When I looked closer, I realized that I had another data quality problem I hadn\u2019t seen in Excel: as a European, my Fitbit was exporting the data in kilometers, not miles, giving me a distinctly unfair advantage. This was easy to fix fix using the powerful data manipulation tools in SAP Lumira. I created a new column called \u201cDistance in Miles\u201d with the formula \u201c<strong>if {Name}=&#8221;Timo Elliott&#8221; then {Distance}*0.621371192 else {Distance}\u201d<\/strong> (the product provides hints at each step, so you don\u2019t have to know the syntax).<\/p>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"formula\" alt=\"formula\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/formula.jpg?resize=690%2C164&#038;ssl=1\" width=\"690\" height=\"164\" border=\"0\" \/><\/p>\n<p>The updated chart looked a little more realistic \u2013 it showed that Daniel Graversen also won in total distance, with over 30 miles during the conference. It also shows that Greg Myers beat me in distance despite my lead in steps \u2013 i.e. he\u2019s much taller with a longer stride (this value can be set by the user under the advanced options\u2026). Just for variety, this example uses color and a legend to indicate the names, rather than showing them on the X axis (this is not best practice).<\/p>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"distance-in-miles[1]\" alt=\"distance-in-miles[1]\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/distance-in-miles11.jpg?resize=690%2C518&#038;ssl=1\" width=\"690\" height=\"518\" border=\"0\" \/><\/p>\n<p>There are, however, other measures that could be used to determine a \u201cwinner\u201d! <a href=\"http:\/\/twitter.com\/oswaldxxl\" target=\"_blank\">Jamie Oswald<\/a> won in calories burned (even though the Jawbone numbers from Daniel Graversen and Henrik Wagner are probably not comparable, it doesn&#8217;t seem like they&#8217;d come out ahead of Jamie):<\/p>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; margin: 0px; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"calories-burned-by-person\" alt=\"calories-burned-by-person\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/calories-burned-by-person.jpg?resize=690%2C518&#038;ssl=1\" width=\"690\" height=\"518\" border=\"0\" \/><\/p>\n<p>And, of course, we could drill into any of these measures to get the daily winners, eg <a href=\"http:\/\/twitter.com\/gpmyers\" target=\"_blank\">Greg Myers<\/a> had the highest number of steps on Monday and I had the highest number on Tuesday (this chart shows another of SAP Lumira\u2019s many different available \u201cpalettes\u201d for charting):<\/p>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"daily-winners\" alt=\"daily-winners\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/daily-winners.jpg?resize=690%2C518&#038;ssl=1\" width=\"690\" height=\"518\" border=\"0\" \/><\/p>\n<p>I also uploaded the same data to the (very) beta version of <a href=\"http:\/\/beta.saplumira.com\/\" target=\"_blank\">SAP Lumira Cloud<\/a>, where I was able to do easy visualization of the prepared data set, and share it with others:<\/p>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"cloud\" alt=\"cloud\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/cloud1.jpg?resize=690%2C359&#038;ssl=1\" width=\"690\" height=\"359\" border=\"0\" \/><\/p>\n<p>To conclude, I was fascinated to see that even this small-scale \u201c<a href=\"http:\/\/en.wikipedia.org\/wiki\/Quantified_Self\" target=\"_blank\">quantified self<\/a>\u201d analysis was rich in the same kinds of issues that plague much larger and more important projects:<\/p>\n<ul>\n<li>Multiple data sources in different formats (Excel files, CSV files, different column names for the same data, etc.)<\/li>\n<li>Different data from different sources (the devices all measure effort and calories, but look at different aspects of the same activity)<\/li>\n<li>Similar fields having very different definitions (\u201ccalories\u201d for the Fitbit is for the full day, whereas it seems to be just for sport with the Jawbone)<\/li>\n<li>Units confusion (is that distance column in miles or kilometers?)<\/li>\n<li>Forgotten data (I initially overlooked Henrik Wagner\u2019s data! \u2013\u00a0 the eagle-eyed among you will have noticed that it\u2019s not in the SAP Lumira Cloud data set)<\/li>\n<li>Manual copying and pasting of data (each person collected their own data and sent it by email, it took time and effort, I could have made errors during the cut-and-paste, etc.)<\/li>\n<li>Possibility of people \u201ctweaking\u201d the numbers (this is just for bragging rights, but if there were monetary awards, it would be easy to game the system, e.g. by setting an overly-high stride length to get a high distance, or just shaking the fitness device to simulate steps!)<\/li>\n<li>Multiple, competing KPIs that could be used to define success (what were we trying to achieve, anyway?)<\/li>\n<\/ul>\n<p>If you haven\u2019t already done so, you should give SAP Lumira a try. It is a great tool for collecting data, manipulating it on the fly, and sharing it with others (<a href=\"http:\/\/scn.sap.com\/community\/visual-intelligence\/blog\/2013\/05\/22\/special-saplumira-offer-extended-to-may-31\" target=\"_blank\">and until May 31st, 2013 you can get a copy of SAP Lumira Personal for only $9<\/a>!).<\/p>\n<p>Here&#8217;s a video version of some of the analysis above (sorry, without Henrik&#8217;s data!)<\/p>\n<p><iframe loading=\"lazy\" src=\"http:\/\/www.youtube.com\/embed\/V4ZdkJgrP7g\" height=\"518\" width=\"690\" allowfullscreen=\"\" frameborder=\"0\"><\/iframe><\/p>\n<p>Many thanks to all the participants in the challenge, and I look forward to having more of you the next time we try this \u2013 maybe at the <a href=\"http:\/\/www.asugonline.com\/asug-sap-businessobjects-user-conference\/\" target=\"_blank\">ASUG SAP BusinessObjects User Conference in September<\/a>?<\/p>\n","protected":false},"excerpt":{"rendered":"<p>During SAPPHIRE NOW in Orlando, the analytics team issued a \u201cfitness challenge,\u201d asking people to record their activity with a device such as a Fitbit or Jawbone Up &#8212; here are the results, using SAP Lumira<\/p>\n","protected":false},"author":2,"featured_media":5165,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[15],"tags":[27,100,173,213,324,491,650,706,809,858,859,911,936],"class_list":["post-12325","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-dataviz-2","tag-bigdata","tag-analytics","tag-big-data","tag-businessobjects","tag-dashboards","tag-fitbit","tag-jawbone","tag-lumira","tag-personal","tag-quantified-self","tag-quantifiedself","tag-sap","tag-saplumira"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/05\/fitbit-banner-1.jpg?fit=690%2C310&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p3X9RF-3cN","_links":{"self":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/12325","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/comments?post=12325"}],"version-history":[{"count":0,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/12325\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media\/5165"}],"wp:attachment":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media?parent=12325"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/categories?post=12325"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/tags?post=12325"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}