{"id":22805,"date":"2017-10-16T11:31:53","date_gmt":"2017-10-16T15:31:53","guid":{"rendered":"https:\/\/cosmicconvergence.org\/?p=22805"},"modified":"2017-10-16T11:31:53","modified_gmt":"2017-10-16T15:31:53","slug":"artificial-intelligence-getting-out-of-control","status":"publish","type":"post","link":"https:\/\/cosmicconvergence.org\/?p=22805","title":{"rendered":"Artificial Intelligence: Getting out of control"},"content":{"rendered":"<h1 class=\"p1\"><span class=\"s1\">Robot behaviour is creeping beyond our control<\/span><\/h1>\n<p><!--more--><\/p>\n<h3 class=\"p2\"><span class=\"s2\">AI experts are urging deeper understanding of machine decision-making<\/span><\/h3>\n<p class=\"p1\"><span class=\"s1\">by <a href=\"http:\/\/www.ft.com\/comment\/columnists\/anjana-ahuja\"><span class=\"s3\"><b>Anjana Ahuja<\/b><\/span><\/a><\/span><\/p>\n<div id=\"attachment_22806\" style=\"width: 660px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/cosmicconvergence.org\/wp-content\/uploads\/2017\/10\/http-com.ft_.imagepublish.prod-us.s3.amazonaws.com-59ba7cf6-7777-11e7-a3e8-60495fe6ca71.jpeg\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-22806\" class=\"wp-image-22806\" src=\"https:\/\/cosmicconvergence.org\/wp-content\/uploads\/2017\/10\/http-com.ft_.imagepublish.prod-us.s3.amazonaws.com-59ba7cf6-7777-11e7-a3e8-60495fe6ca71.jpeg\" alt=\"\" width=\"650\" height=\"366\" srcset=\"https:\/\/cosmicconvergence.org\/wp-content\/uploads\/2017\/10\/http-com.ft_.imagepublish.prod-us.s3.amazonaws.com-59ba7cf6-7777-11e7-a3e8-60495fe6ca71.jpeg 700w, https:\/\/cosmicconvergence.org\/wp-content\/uploads\/2017\/10\/http-com.ft_.imagepublish.prod-us.s3.amazonaws.com-59ba7cf6-7777-11e7-a3e8-60495fe6ca71-300x169.jpeg 300w\" sizes=\"auto, (max-width: 650px) 100vw, 650px\" \/><\/a><p id=\"caption-attachment-22806\" class=\"wp-caption-text\">Visitors photograph a humanoid robot at the Robot Development &amp; Application Expo trade show (Robodex) in Tokyo, January 2017 \u00a9 Getty<\/p><\/div>\n<p class=\"p2\"><span class=\"s1\">If I were to approach you brandishing a cattle prod, you might at first be amused. But, if I continued my advance with a fixed maniacal grin, you would probably retreat in shock, bewilderment and anger. As electrode meets flesh, I would expect a violent recoil plus expletives.<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\">Given a particular input, one can often predict how a person will respond. That is not the case for the most intelligent machines in our midst. The creators of AlphaGo \u2014 a computer program built by Google\u2019s DeepMind that decisively beat the world\u2019s finest human player of the board game Go \u2014 <a href=\"http:\/\/www.theguardian.com\/commentisfree\/2016\/jan\/31\/google-alphago-deepmind-artificial-intelligence-intuititive\"><span class=\"s4\">admitted<\/span><\/a> they could not have divined its winning moves. This <a href=\"http:\/\/www.ft.com\/content\/e90a6c1c-7764-11e7-a3e8-60495fe6ca71\"><span class=\"s4\">unpredictability<\/span><\/a>, also seen in the Facebook chatbots that were shut down after developing their own language, has stirred disquiet in the field of <a href=\"http:\/\/www.ft.com\/artificial-intelligence-robotics\"><span class=\"s4\">artificial intelligence<\/span><\/a>.<\/span><\/p>\n<p class=\"p3\"><span class=\"s1\"><b>Data regulation\u2009.\u2009.\u2009.\u2009due to come into force in May 2018 will offer the prospect of redress: individuals will be able to contest completely automated decisions that have legal or other serious consequences<\/b><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\">As we head into the age of autonomous systems, when we abdicate more decision-making to AI, technologists are urging deeper understanding of the mysterious zone between input and output. At a conference held at Surrey University last month, a team of coders from Bath University presented a paper revealing how even \u201c<a href=\"http:\/\/opus.bath.ac.uk\/55794\/5\/robot_transparency.pdf\"><span class=\"s4\">designers<\/span><\/a> have difficulty decoding the behaviour of their own robots simply by observing them\u201d.<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\">The Bath researchers are championing the concept of \u201crobot transparency\u201d as an ethical requirement: users should be able to easily discern the intent and abilities of a machine. And when things go wrong \u2014 if, say, a driverless car mows down a pedestrian \u2014 a record of the car\u2019s decisions should be accessible so that similar errors can be coded out.<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\">Other roboticists, notably Professor Alan Winfield of Bristol Robotics Laboratory at the University of the West of England, have similarly called for \u201c<a href=\"http:\/\/www.researchgate.net\/publication\/318277040_The_Case_for_an_Ethical_Black_Box\"><span class=\"s4\">ethical black boxes<\/span><\/a>\u201d to be installed in robots and autonomous systems, to enhance public trust and accountability. These would work in exactly the same way as flight data recorders on aircraft: furnishing the sequence of decisions and actions that precede a failure.<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\">Many autonomous systems, of course, are unseen: they lurk behind screens. Machine-learning algorithms, grinding mountains of data, can affect our success at securing loans and mortgages, at landing job interviews, and even at being <a href=\"http:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing\"><span class=\"s4\">granted parole<\/span><\/a>.<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\">For that reason, says Sandra Wachter, a researcher in data ethics at Oxford university and the Alan Turing Institute, regulation should be discussed. While algorithms can correct for some biases, many are trained on already-<a href=\"http:\/\/www.ft.com\/content\/ad40b50c-6e9a-11e6-a0c9-1365ce54b926\"><span class=\"s4\">skewed data<\/span><\/a>. So a recruitment algorithm for management is likely to identify ideal candidates as male, white and middle-aged. \u201cI am a woman in my early 30s,\u201d she told <a href=\"http:\/\/www.sciencemag.org\/news\/2017\/05\/qa-should-artificial-intelligence-be-legally-required-explain-itself\"><span class=\"s4\">Science<\/span><\/a>, \u201cso I would be filtered out immediately, even if I\u2019m suitable\u2009.\u2009.\u2009.\u2009[and] sometimes algorithms are used to display job ads, so I wouldn\u2019t even see the position is available.\u201d<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\">The EU General Data Protection Regulation, due to come into force in May 2018, will offer the prospect of redress: individuals will be able to contest completely automated decisions that have legal or other serious consequences.<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\">There is an existential reason for grasping precisely how data input becomes machine output \u2014 <a href=\"http:\/\/time.com\/3614349\/artificial-intelligence-singularity-stephen-hawking-elon-musk\/\"><span class=\"s4\">\u201cthe singularity\u201d<\/span><\/a>. This is the much-theorised point of runaway AI, when machine intelligence surpasses that of human creators. Machines could conceivably acquire the ability to shape and control the future on their own terms.<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\">There need not be any premeditated malice for such a leap \u2014 only a lack of human oversight as AI programs, equipped with an ever-greater propensity to learn and the corresponding autonomy to act, begin to do things that we can no longer predict, understand or control. The development of AlphaGo suggests that machine learning has already mastered unpredictability, if only at one task. The singularity, should it materialise, promises a rather more chilling version of Game Over.<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><i>The writer is a science commentator<\/i><\/span><\/p>\n<p>___<br \/>\n<a href=\"http:\/\/www.ft.com\/content\/211abdba-7601-11e7-a3e8-60495fe6ca71?mhq5j=e6\">http:\/\/www.ft.com\/content\/211abdba-7601-11e7-a3e8-60495fe6ca71?mhq5j=e6<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Robot behaviour is creeping beyond our control<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"iawp_total_views":0,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-22805","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=\/wp\/v2\/posts\/22805","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=22805"}],"version-history":[{"count":0,"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=\/wp\/v2\/posts\/22805\/revisions"}],"wp:attachment":[{"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=22805"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=22805"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=22805"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}