{"id":21210,"date":"2023-04-01T10:23:46","date_gmt":"2023-04-01T08:23:46","guid":{"rendered":"https:\/\/timoelliott.com\/blog\/?p=21210"},"modified":"2023-04-01T10:23:46","modified_gmt":"2023-04-01T08:23:46","slug":"whats-hard-about-ai-operations","status":"publish","type":"post","link":"https:\/\/timoelliott.com\/blog\/2023\/04\/whats-hard-about-ai-operations.html","title":{"rendered":"What’s hard about AI? Operations!"},"content":{"rendered":"

What’s hard about #AI<\/strong>? It’s not creating the models or doing the data science\u2014it’s actually making it part of an operational process.<\/p>\n

You don’t have to take my word for it, here’s a quote from Gartner AI Expert Erick Brethenoux<\/a> talking on a recent (and free!) web seminar “Beyond the Hype: Enterprise Impact of ChatGPT and Generative AI<\/strong><\/a>“<\/strong><\/p>\n

“As an AI expert myself, I didn\u2019t have enough appreciation for my colleagues that are downstream, doing all the hard work and getting the AI systems to be operational.<\/p><\/blockquote>\n

Operationalizing AI has been the biggest issue since I\u2019ve been at Gartner\u2014actually trying to get the system to deliver business value for the enterprise\u2026we can design upstream, we can get all the content we want, we can get all the models, but at the end of the day, it\u2019s going to have to be part of a system somewhere.<\/p><\/blockquote>\n

So we see a shift\u2014not a disappearance\u2014of the skills, that are going from AI experts in general a lot more into the software engineering side of things, to get those systems to have a direct and practical impact on the value for the enterprise”<\/p><\/blockquote>\n

And that’s exactly what I’ve seen with our most innovative customers. Data scientists typically extract data from operational systems and move it to a hyperscalar data lake, then use open source algorithms to create and test their mdoels. The problem is that the vast majority of those models never go into production, for two reasons:<\/p>\n

First, a lot of the business context of the data is lost during the extraction process (special formats used in the production system, hierarchies, etc.), which can end up in models that “work” on the test data, but not in the operational system.<\/p>\n

Second, there has to be an end-to-end process that takes into the realities of operational systems: it has to respect security protocols, compliance frameworks such as GDPR; it has to be maintainable over time (how and when do the models get refreshed, etc); and it has to scale to the needs of the operational activity.<\/p>\n

Fixing these means that the data science teams have to work closely with the core applications teams from the beginning, with the business goals in mind, rather than treating the operational systems simply as a “dumb source of data”.<\/p>\n","protected":false},"excerpt":{"rendered":"

What’s hard about #AI? It’s not creating the models or doing the data science\u2014it’s actually making it part of an operational process.<\/p>\n","protected":false},"author":2,"featured_media":21212,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[1],"tags":[],"class_list":["post-21210","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2023\/04\/Robot-wearing-a-hard-hat-operational-AI.jpg?fit=1456%2C816&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p3X9RF-5w6","_links":{"self":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/21210","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/comments?post=21210"}],"version-history":[{"count":1,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/21210\/revisions"}],"predecessor-version":[{"id":21213,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/21210\/revisions\/21213"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media\/21212"}],"wp:attachment":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media?parent=21210"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/categories?post=21210"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/tags?post=21210"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}