Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the wp-plugin-hostgator domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home4/scienrds/scienceandnerds/wp-includes/functions.php on line 6114

Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the ol-scrapes domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home4/scienrds/scienceandnerds/wp-includes/functions.php on line 6114

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893
{"id":33207,"date":"2023-05-24T21:59:15","date_gmt":"2023-05-24T21:59:15","guid":{"rendered":"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/"},"modified":"2023-05-24T21:59:16","modified_gmt":"2023-05-24T21:59:16","slug":"some-neural-networks-learn-language-like-humans","status":"publish","type":"post","link":"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/","title":{"rendered":"Some Neural Networks Learn Language Like Humans"},"content":{"rendered":"

Source:https:\/\/www.quantamagazine.org\/some-neural-networks-learn-language-like-humans-20230522\/#comments<\/a><\/br>
\nSome Neural Networks Learn Language Like Humans<\/br>
\n2023-05-24 21:59:15<\/br><\/p>\n

\n

How do brains learn? It\u2019s a mystery, one that applies both to the spongy organs in our skulls and to their digital counterparts in our machines. Even though artificial neural networks (ANNs) are built from elaborate webs of artificial neurons, ostensibly mimicking the way our brains process information, we don\u2019t know if they process input in similar ways.\u00a0 \u00a0<\/span><\/p>\n

\u201cThere\u2019s been a long-standing debate as to whether neural networks learn in the same way that humans do,\u201d said Vsevolod Kapatsinski<\/a>, a linguist at the University of Oregon.<\/p>\n

Now, a study published<\/a> last month suggests that natural and artificial networks learn in similar ways, at least when it comes to language. The researchers \u2014 led by Ga\u0161per Begu\u0161<\/a>, a computational linguist at the University of California, Berkeley \u2014 compared the brain waves of humans listening to a simple sound to the signal produced by a neural network analyzing the same sound. The results were uncannily alike. \u201cTo our knowledge,\u201d Begu\u0161 and his colleagues wrote, the observed responses to the same stimulus \u201care the most similar brain and ANN signals reported thus far.\u201d<\/p>\n

Most significantly, the researchers tested networks made up of general-purpose neurons that are suitable for a variety of tasks. \u201cThey show that even very, very general networks, which don\u2019t have any evolved biases for speech or any other sounds, nevertheless show a correspondence to human neural coding,\u201d said Gary Lupyan<\/a>, a psychologist at the University of Wisconsin, Madison who was not involved in the work. The results not only help demystify how ANNs learn, but also suggest that human brains may not come already equipped with hardware and software specially designed for language.<\/p>\n

To establish a baseline for the human side of the comparison, the researchers played a single syllable \u2014 \u201cbah\u201d \u2014 repeatedly in two eight-minute blocks for 14 English speakers and 15 Spanish speakers. While it played, the researchers recorded fluctuations in the average electrical activity of neurons in each listener\u2019s brainstem \u2014 the part of the brain where sounds are first processed.<\/p>\n

In addition, the researchers fed the same \u201cbah\u201d sounds to two different sets of neural networks \u2014 one trained on English sounds, the other on Spanish. The researchers then recorded the processing activity of the neural network, focusing on the artificial neurons in the layer of the network where sounds are first analyzed (to mirror the brainstem readings). It was these signals that closely matched the human brain waves.<\/p>\n

The researchers chose a kind of neural network architecture known as a generative adversarial network (GAN), originally invented in 2014 to generate images. A GAN is composed of two neural networks \u2014 a discriminator and a generator \u2014 that compete against each other. The generator creates a sample, which could be an image or a sound. The discriminator determines how close it is to a training sample and offers feedback, resulting in another try from the generator, and so on until the GAN can deliver the desired output.<\/i><\/p>\n

In this study, the discriminator was initially trained on a collection of either English or Spanish sounds. Then the generator \u2014 which never heard those sounds \u2014 had to find a way of producing them. It started out by making random sounds, but after some 40,000 rounds of interactions with the discriminator, the generator got better, eventually producing the proper sounds. As a result of this training, the discriminator also got better at distinguishing between real and generated ones.<\/p>\n

It was at this point, after the discriminator was fully trained, that the researchers played it the \u201cbah\u201d sounds. The team measured the fluctuations in the average activity levels of the discriminator\u2019s artificial neurons, which produced the signal so similar to the human brain waves.<\/p>\n

This likeness between human and machine activity levels suggested that the two systems are engaging in similar activities. \u201cJust as research has shown that feedback from caregivers shapes infant productions of sounds, feedback from the discriminator network shapes the sound productions of the generator network,\u201d said Kapatsinski, who did not take part in the study.<\/p>\n

The experiment also revealed another interesting parallel between humans and machines. The brain waves showed that the English- and Spanish-speaking participants heard the \u201cbah\u201d sound differently (Spanish speakers heard more of a \u201cpah\u201d), and the GAN\u2019s signals also showed that the English-trained network processed the sounds somewhat differently than the Spanish-trained one.<\/p>\n

\u201cAnd those differences work in the same direction,\u201d explained Begu\u0161. The brainstem of English speakers responds to the \u201cbah\u201d sound slightly earlier than the brainstem of Spanish speakers, and the GAN trained in English responded to that same sound slightly earlier than the Spanish-trained model. In both humans and machines, the difference in timing was almost identical, roughly a thousandth of a second. This provided additional evidence, Begu\u0161 said, that humans and artificial networks are \u201clikely processing things in a similar fashion.\u201d<\/p>\n<\/div>\n

<\/br><\/br><\/br><\/p>\n

Uncategorized<\/br>
\n<\/br>
\nSource:https:\/\/www.quantamagazine.org\/some-neural-networks-learn-language-like-humans-20230522\/#comments<\/a><\/br><\/br><\/p>\n","protected":false},"excerpt":{"rendered":"

Source:https:\/\/www.quantamagazine.org\/some-neural-networks-learn-language-like-humans-20230522\/#comments Some Neural Networks Learn Language Like Humans 2023-05-24 21:59:15 How do brains learn? It\u2019s a mystery, one that applies both to the spongy organs in our skulls and to their digital counterparts in our machines. Even though artificial neural networks (ANNs) are built from elaborate webs of artificial neurons, ostensibly mimicking the way our […]<\/p>\n","protected":false},"author":1,"featured_media":33208,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","om_disable_all_campaigns":false,"pagelayer_contact_templates":[],"_pagelayer_content":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-33207","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"yoast_head":"\nSome Neural Networks Learn Language Like Humans - Science and Nerds<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Some Neural Networks Learn Language Like Humans - Science and Nerds\" \/>\n<meta property=\"og:description\" content=\"Source:https:\/\/www.quantamagazine.org\/some-neural-networks-learn-language-like-humans-20230522\/#comments Some Neural Networks Learn Language Like Humans 2023-05-24 21:59:15 How do brains learn? It\u2019s a mystery, one that applies both to the spongy organs in our skulls and to their digital counterparts in our machines. Even though artificial neural networks (ANNs) are built from elaborate webs of artificial neurons, ostensibly mimicking the way our […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/\" \/>\n<meta property=\"og:site_name\" content=\"Science and Nerds\" \/>\n<meta property=\"article:published_time\" content=\"2023-05-24T21:59:15+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-05-24T21:59:16+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/some-neural-networks-learn-language-like-humans_646e88b3f30dd.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1440\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/\",\"url\":\"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/\",\"name\":\"Some Neural Networks Learn Language Like Humans - Science and Nerds\",\"isPartOf\":{\"@id\":\"https:\/\/scienceandnerds.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/some-neural-networks-learn-language-like-humans_646e88b3f30dd.webp?fit=2560%2C1440&ssl=1\",\"datePublished\":\"2023-05-24T21:59:15+00:00\",\"dateModified\":\"2023-05-24T21:59:16+00:00\",\"author\":{\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\"},\"breadcrumb\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/some-neural-networks-learn-language-like-humans_646e88b3f30dd.webp?fit=2560%2C1440&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/some-neural-networks-learn-language-like-humans_646e88b3f30dd.webp?fit=2560%2C1440&ssl=1\",\"width\":2560,\"height\":1440},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/scienceandnerds.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Some Neural Networks Learn Language Like Humans\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/scienceandnerds.com\/#website\",\"url\":\"https:\/\/scienceandnerds.com\/\",\"name\":\"Science and Nerds\",\"description\":\"My WordPress Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/scienceandnerds.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/scienceandnerds.com\"],\"url\":\"https:\/\/scienceandnerds.com\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Some Neural Networks Learn Language Like Humans - Science and Nerds","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/","og_locale":"en_US","og_type":"article","og_title":"Some Neural Networks Learn Language Like Humans - Science and Nerds","og_description":"Source:https:\/\/www.quantamagazine.org\/some-neural-networks-learn-language-like-humans-20230522\/#comments Some Neural Networks Learn Language Like Humans 2023-05-24 21:59:15 How do brains learn? It\u2019s a mystery, one that applies both to the spongy organs in our skulls and to their digital counterparts in our machines. Even though artificial neural networks (ANNs) are built from elaborate webs of artificial neurons, ostensibly mimicking the way our […]","og_url":"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/","og_site_name":"Science and Nerds","article_published_time":"2023-05-24T21:59:15+00:00","article_modified_time":"2023-05-24T21:59:16+00:00","og_image":[{"width":2560,"height":1440,"url":"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/some-neural-networks-learn-language-like-humans_646e88b3f30dd.webp","type":"image\/webp"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/","url":"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/","name":"Some Neural Networks Learn Language Like Humans - Science and Nerds","isPartOf":{"@id":"https:\/\/scienceandnerds.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/#primaryimage"},"image":{"@id":"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/some-neural-networks-learn-language-like-humans_646e88b3f30dd.webp?fit=2560%2C1440&ssl=1","datePublished":"2023-05-24T21:59:15+00:00","dateModified":"2023-05-24T21:59:16+00:00","author":{"@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e"},"breadcrumb":{"@id":"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/#primaryimage","url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/some-neural-networks-learn-language-like-humans_646e88b3f30dd.webp?fit=2560%2C1440&ssl=1","contentUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/some-neural-networks-learn-language-like-humans_646e88b3f30dd.webp?fit=2560%2C1440&ssl=1","width":2560,"height":1440},{"@type":"BreadcrumbList","@id":"https:\/\/scienceandnerds.com\/2023\/05\/24\/some-neural-networks-learn-language-like-humans\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/scienceandnerds.com\/"},{"@type":"ListItem","position":2,"name":"Some Neural Networks Learn Language Like Humans"}]},{"@type":"WebSite","@id":"https:\/\/scienceandnerds.com\/#website","url":"https:\/\/scienceandnerds.com\/","name":"Science and Nerds","description":"My WordPress Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/scienceandnerds.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","caption":"admin"},"sameAs":["https:\/\/scienceandnerds.com"],"url":"https:\/\/scienceandnerds.com\/author\/admin\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/some-neural-networks-learn-language-like-humans_646e88b3f30dd.webp?fit=2560%2C1440&ssl=1","_links":{"self":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/33207","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/comments?post=33207"}],"version-history":[{"count":1,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/33207\/revisions"}],"predecessor-version":[{"id":33209,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/33207\/revisions\/33209"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media\/33208"}],"wp:attachment":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media?parent=33207"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/categories?post=33207"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/tags?post=33207"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}