{"id":20588,"date":"2017-07-20T07:34:20","date_gmt":"2017-07-20T11:34:20","guid":{"rendered":"https:\/\/cosmicconvergence.org\/?p=20588"},"modified":"2017-07-20T07:34:20","modified_gmt":"2017-07-20T11:34:20","slug":"the-crazy-language-of-ai-bots-and-non-human-entities","status":"publish","type":"post","link":"https:\/\/cosmicconvergence.org\/?p=20588","title":{"rendered":"The Crazy Language of AI Bots and Non-Human Entities"},"content":{"rendered":"<h1>What an AI&#8217;s Non-Human Language Actually Looks Like<\/h1>\n<p><!--more--><\/p>\n<h3>Facebotlish looks pretty weird to me to me to me to me to me to me to me to<\/h3>\n<p>ADRIENNE LAFRANCE<br \/>\nThe Atlantic<\/p>\n<section id=\"article-section-1\">Something unexpected happened recently at the Facebook Artificial Intelligence Research lab. Researchers who had been training bots to negotiate with one another realized that the bots, left to their own devices, started communicating in a non-human language.<\/p>\n<p>In order to actually follow what the bots were saying, the researchers had to tweak their model, limiting the machines to a conversation humans could understand. (They want bots to stick to human languages because eventually they want those bots to be able to converse with human Facebook users.) When\u00a0<a href=\"http:\/\/www.theatlantic.com\/technology\/archive\/2017\/06\/artificial-intelligence-develops-its-own-non-human-language\/530436\/\" data-omni-click=\"r'article',r'link',r'0',r'530934'\">I wrote about all this last week<\/a>, lots of people reacted with some degree of trepidatious wonder. Machines making up their own language is really cool, sure, but isn\u2019t it actually terrifying?<\/p>\n<p>And also: What does this language actually\u00a0<em>look<\/em>\u00a0like? Here\u2019s an example of one of the bot negotiations that Facebook observed:<\/p>\n<p><strong>Bob:<\/strong>\u00a0i can i i everything else . . . . . . . . . . . . . .<br \/>\n<strong>Alice:\u00a0<\/strong>balls have zero to me to me to me to me to me to me to me to me to<br \/>\n<strong>Bob:<\/strong>\u00a0you i everything else . . . . . . . . . . . . . .<br \/>\n<strong>Alice:\u00a0<\/strong>balls have a ball to me to me to me to me to me to me to me<br \/>\n<strong>Bob:<\/strong>\u00a0i i can i i i everything else . . . . . . . . . . . . . .<br \/>\n<strong>Alice:\u00a0<\/strong>balls have a ball to me to me to me to me to me to me to me<br \/>\n<strong>Bob:<\/strong>\u00a0i . . . . . . . . . . . . . . . . . . .<br \/>\n<strong>Alice:\u00a0<\/strong>balls have zero to me to me to me to me to me to me to me to me to<br \/>\n<strong>Bob:<\/strong>\u00a0you i i i i i everything else . . . . . . . . . . . . . .<br \/>\n<strong>Alice:<\/strong>\u00a0balls have 0 to me to me to me to me to me to me to me to me to<br \/>\n<strong>Bob:<\/strong>\u00a0you i i i everything else . . . . . . . . . . . . . .<br \/>\n<strong>Alice:\u00a0<\/strong>balls have zero to me to me to me to me to me to me to me to me to<\/p>\n<\/section>\n<div class=\"ad-boxinjector-wrapper\"><\/div>\n<section id=\"article-section-2\">Not only does this appear to be nonsense, but the bots don\u2019t really seem to be getting anywhere in the negotiation. Alice isn\u2019t budging from her original position, anyway. The weird thing is, Facebook\u2019s data shows that conversations like this sometimes still led to successful negotiations between the bots in the end, a spokesperson from the AI lab told me. (In other cases, researchers adjusted their model and the bots would develop bad strategies for negotiating\u2014even if their conversation remained interpretable by human standards.)<\/p>\n<p>One way to think about all this is to consider\u00a0<a href=\"http:\/\/www.slate.com\/articles\/life\/twins\/2011\/08\/dugon_haus_you_dinikin_duah.html\" data-omni-click=\"r'article',r'link',r'1',r'530934'\">cryptophasia<\/a>, the name for the phenomenon when twins make up their own secret language, understandable only to them. Perhaps you recall the 2011 YouTube video of two exuberant toddlers chattering back and forth in what sounds like a lively, if inscrutable, dialogue.<\/p>\n<p><iframe loading=\"lazy\" title=\"Talking Twin Babies - PART 2 - OFFICIAL VIDEO\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/_JmA2ClUvUY?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p>There\u2019s some debate over whether this sort of twin speak is actually language or merely a joyful, babbling imitation of \u00a0language. The YouTube babies are socializing, but probably not saying anything with specific meaning,\u00a0<a href=\"http:\/\/well.blogs.nytimes.com\/2011\/03\/31\/toddler-twins-secret-language-or-babble\/\" data-omni-click=\"r'article',r'link',r'2',r'530934'\">many linguists say<\/a>.<\/p>\n<\/section>\n<section id=\"article-section-3\">In the case of Facebook\u2019s bots, however, there seems to be something more language-like occurring, Facebook\u2019s researchers say. Other AI researchers, too, say they\u2019ve observed machines that can develop their own languages, including languages with a coherent structure, and defined vocabulary and syntax\u2014though not always actual meaningful, by human standards.<\/p>\n<aside class=\"callout\" data-omni-click=\"r'article',r' ',d,r'related',#data-omni-index,@data-article-id\">&nbsp;<\/p>\n<\/aside>\n<p>In\u00a0<a href=\"http:\/\/arxiv.org\/pdf\/1703.04908.pdf\" data-omni-click=\"r'article',r'link',r'3',r'530934'\">one preprint paper<\/a>\u00a0added earlier this year to the research repository arXiv, a pair of computer scientists from the non-profit AI research firm\u00a0<a href=\"http:\/\/openai.com\/about\/\" data-omni-click=\"r'article',r'link',r'4',r'530934'\">OpenAI<\/a>\u00a0wrote about how bots learned to communicate in an abstract language\u2014and how those bots turned to non-verbal communication, the equivalent of human gesturing or pointing, when language communication was unavailable. (Bots don\u2019t need to have corporeal form to engage in non-verbal communication; they just engage with what\u2019s called a visual sensory modality.)\u00a0<a href=\"http:\/\/arxiv.org\/abs\/1703.06585\" data-omni-click=\"r'article',r'link',r'5',r'530934'\">Another recent preprint paper<\/a>, from researchers at the Georgia Institute of Technology, Carnegie Mellon, and Virginia Tech, describes an experiment in which two bots invent their own communication protocol by discussing and assigning values to colors and shapes\u2014in other words, the researchers write, they witnessed the \u201cautomatic emergence of grounded language and communication &#8230; no human supervision!\u201d<\/p>\n<p>The implications of this kind of work are dizzying. Not only are researchers beginning to see how bots could communicate with one another, they may be scratching the surface of how syntax and compositional structure emerged among humans in the first place.<\/p>\n<\/section>\n<section id=\"article-section-4\">But let\u2019s take a step back for a minute. Is what any of these bots are doing really language? \u201cWe have to start by admitting that it\u2019s not up to linguists to decide how the word \u2018language\u2019 can be used, though linguists certainly have opinions and arguments about the nature of human languages, and the boundaries of that natural class,\u201d said Mark Liberman, a professor of linguistics at the University of Pennsylvania.<\/p>\n<p>So the question of whether Facebook\u2019s bots really made up their own language depends on what we mean when we say \u201clanguage.\u201d For example, linguists tend to agree that sign languages and vernacular languages really are \u201ccapital-L languages,\u201d as Liberman puts it\u2014and not mere approximations of actual language, whatever that is. They also tend to agree that \u201cbody language\u201d and computer languages like Python and JavaScript aren\u2019t\u00a0<em>really<\/em>\u00a0languages, even though we call them that.<\/p>\n<p>So here\u2019s the question Liberman poses instead: Could Facebook\u2019s bot language\u2014Facebotlish, he calls it\u2014signal a new and lasting kind of language?<\/p>\n<p>\u201cProbably not, though there\u2019s not enough information available to tell,\u201d he said. \u201cIn the first place, it\u2019s entirely text-based, while human languages are all basically spoken or gestured, with text being an artificial overlay.\u201d<\/p>\n<p>The larger point, he says, is that Facebook\u2019s bots are not anywhere near intelligent in the way we think about human intelligence. (That\u2019s part of the reason\u00a0<a href=\"http:\/\/www.theatlantic.com\/technology\/archive\/2017\/03\/what-is-artificial-intelligence\/518547\/\" data-omni-click=\"r'article',r'link',r'6',r'530934'\">the term AI can be so misleading<\/a>.)<\/p>\n<p>\u201cThe \u2018expert systems\u2019 style of AI programs of the 1970s are at best a historical curiosity now, like the clockwork automata of the 17th century,\u201d Liberman said. \u201cWe can be pretty sure that in a few decades, today\u2019s machine-learning AI will seem equally quaint.\u201d<\/p>\n<p>It\u2019s already easy to set up artificial worlds populated by mysterious algorithmic entities with communications procedures that \u201cevolve through a combination of random drift, social convergence, and optimizing selection,\u201d Liberman said. \u201cJust as it\u2019s easy to build a clockwork figurine that plays the clavier.\u201d<\/p>\n<p>___<br \/>\n<a href=\"http:\/\/www.theatlantic.com\/technology\/archive\/2017\/06\/what-an-ais-non-human-language-actually-looks-like\/530934\/\">http:\/\/www.theatlantic.com\/technology\/archive\/2017\/06\/what-an-ais-non-human-language-actually-looks-like\/530934\/<\/a><\/p>\n<\/section>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>What an AI&#8217;s Non-Human Language Actually Looks Like<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"iawp_total_views":136,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-20588","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=\/wp\/v2\/posts\/20588","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=20588"}],"version-history":[{"count":0,"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=\/wp\/v2\/posts\/20588\/revisions"}],"wp:attachment":[{"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=20588"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=20588"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cosmicconvergence.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=20588"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}