{"id":12339,"date":"2013-07-12T15:04:24","date_gmt":"2013-07-12T14:04:24","guid":{"rendered":"http:\/\/timoelliott.com\/blog\/?p=5433"},"modified":"2013-07-12T15:04:24","modified_gmt":"2013-07-12T14:04:24","slug":"the-nsas-data-quality-problem","status":"publish","type":"post","link":"https:\/\/timoelliott.com\/blog\/2013\/07\/the-nsas-data-quality-problem.html","title":{"rendered":"The NSA&#8217;s Data Quality Problem"},"content":{"rendered":"<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" style=\"background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;\" title=\"snowden data quality banner\" alt=\"snowden data quality banner\" src=\"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/07\/snowden-data-quality-banner.jpg?resize=690%2C310&#038;ssl=1\" width=\"690\" height=\"310\" border=\"0\" \/><\/p>\n<p style=\"text-align: left;\">Even basic data quality problems can have big consequences. The National Security Agency learned this to its cost recently when the US applied for leaker <a href=\"http:\/\/en.wikipedia.org\/wiki\/Edward_Snowden\">Edward Snowden&#8217;s<\/a> extradition from Hong Kong.<\/p>\n<p>The extradition paperwork <a href=\"http:\/\/news.sky.com\/story\/1108552\/snowden-hong-kong-says-us-got-name-wrong\" target=\"_blank\">suffered<\/a> from two classic data quality problems:<\/p>\n<ul>\n<li>Incorrect data &#8212; Snowden&#8217;s middle name was incorrectly noted as &#8220;James&#8221; instead of &#8220;Joseph&#8221;;<\/li>\n<li>Missing data &#8212; the passport number was not included.<\/li>\n<\/ul>\n<p>These errors meant the order \u201c<a href=\"http:\/\/news.sky.com\/story\/1108552\/snowden-hong-kong-says-us-got-name-wrong\" target=\"_blank\">did not fully comply with the requirements<\/a>\u201d of the Hong Kong authorities, giving them an excuse to turn down the request and avoid a unwanted diplomatic confrontation.<\/p>\n<p>Snowden took the chance to slip away to the international transit lounge of a Moscow airport.\u00a0 And US diplomatic embarrassment didn\u2019t end there, as more poor information resulted in Bolivian President Evo Morales\u2019 plane being <a href=\"http:\/\/www.guardian.co.uk\/world\/2013\/jul\/05\/european-states-snowden-morales-plane-nsa\" target=\"_blank\">grounded<\/a> because various European states had been <a href=\"http:\/\/www.guardian.co.uk\/world\/2013\/jul\/05\/european-states-snowden-morales-plane-nsa\" target=\"_blank\">assured<\/a> that Snowden was on aboard.<\/p>\n<p>The delicious irony of the NSA, whose <a href=\"http:\/\/mashable.com\/2013\/06\/14\/infographic-how-prism-might-work\/\" target=\"_blank\">massive databases<\/a> on millions of Americans were revealed by Snowden, being unable to correctly spell the name <em>of its own employee <\/em>went largely uncommented.<\/p>\n<p>Why? Probably because such errors are so commonplace that they are taken for granted. The NSA presumably has the right name it its systems, but this information was warped at some point as it was manually transferred onto the extradition document by a rushed official.<\/p>\n<p>Equivalent situations happen every day in companies around the globe. Data quality problems are ubiquitous, and can have far-reaching consequences that aren&#8217;t always foreseen.<\/p>\n<p>The moral of the story is that poor data quality is never a technical problem. It is always the result, directly or indirectly, of human error.<\/p>\n<p>Thankfully, <a href=\"http:\/\/www54.sap.com\/pc\/tech\/enterprise-information-management\/software\/data-integrity-steward\/index.html\" target=\"_blank\">new tools<\/a> are available that can help business people and IT organizations collaborate to fix data quality problems \u2013 <a href=\"http:\/\/scn.sap.com\/community\/events\/sapphire-now\/blog\/2012\/11\/29\/information-governance-with-sap-information-steward\" target=\"_blank\">using analytics to improve analytics<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Even basic data quality problems can have big consequences, as the NSA learned to its cost.<\/p>\n","protected":false},"author":2,"featured_media":5432,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[14],"tags":[27,95,160,173,204,213,342,359,614,640,647,664,774,842,911,982],"class_list":["post-12339","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-thoughts","tag-bigdata","tag-analtyics","tag-bi","tag-big-data","tag-business-intelligence","tag-businessobjects","tag-data-quality","tag-dataquality","tag-information-steward","tag-irony","tag-james","tag-joseph","tag-nsa","tag-prism","tag-sap","tag-snowden"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/timoelliott.com\/blog\/wp-content\/uploads\/2013\/07\/snowden-data-quality-banner-1.jpg?fit=690%2C310&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p3X9RF-3d1","_links":{"self":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/12339","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/comments?post=12339"}],"version-history":[{"count":0,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/posts\/12339\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media\/5432"}],"wp:attachment":[{"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/media?parent=12339"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/categories?post=12339"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/timoelliott.com\/blog\/wp-json\/wp\/v2\/tags?post=12339"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}