Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the wp-plugin-hostgator domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home4/scienrds/scienceandnerds/wp-includes/functions.php on line 6114

Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the ol-scrapes domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home4/scienrds/scienceandnerds/wp-includes/functions.php on line 6114

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893
{"id":39345,"date":"2024-02-29T21:58:51","date_gmt":"2024-02-29T21:58:51","guid":{"rendered":"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/"},"modified":"2024-02-29T21:58:52","modified_gmt":"2024-02-29T21:58:52","slug":"how-selective-forgetting-can-help-ai-learn-better","status":"publish","type":"post","link":"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/","title":{"rendered":"How Selective Forgetting Can Help AI Learn Better"},"content":{"rendered":"

Source:https:\/\/www.quantamagazine.org\/how-selective-forgetting-can-help-ai-learn-better-20240228\/#comments<\/a><\/br>
\nHow Selective Forgetting Can Help AI Learn Better<\/br>
\n2024-02-29 21:58:51<\/br><\/p>\n

\n

A team of computer scientists has created a nimbler, more flexible type<\/a> of machine learning model. The trick: It must periodically forget what it knows. And while this new approach won\u2019t displace the huge models that undergird the biggest apps, it could reveal more about how these programs understand language.<\/p>\n

The new research marks \u201ca significant advance in the field,\u201d said Jea Kwon<\/a>, an AI engineer at the Institute for Basic Science in South Korea.<\/p>\n

The AI language engines in use today are mostly powered by artificial neural networks<\/a>. Each \u201cneuron\u201d in the network is a mathematical function that receives signals from other such neurons, runs some calculations and sends signals on through multiple layers of neurons. Initially the flow of information is more or less random, but through training, the information flow between neurons improves as the network adapts to the training data. If an AI researcher wants to create a bilingual model, for example, she would train the model with a big pile of text from both languages, which would adjust the connections between neurons in such a way as to relate the text in one language with equivalent words in the other.<\/p>\n

But this training process takes a lot of computing power. If the model doesn\u2019t work very well, or if the user\u2019s needs change later on, it\u2019s hard to adapt it. \u201cSay you have a model that has 100 languages, but imagine that one language you want is not covered,\u201d said Mikel Artetxe<\/a>, a co-author of the new research and founder of the AI startup Reka. \u201cYou could start over from scratch, but it\u2019s not ideal.\u201d<\/p>\n

Artetxe and his colleagues have tried to circumvent these limitations. A few years ago<\/a>, Artetxe and others trained a neural network in one language, then erased what it knew about the building blocks of words, called tokens. These are stored in the first layer of the neural network, called the embedding layer. They left all the other layers of the model alone. After erasing the tokens of the first language, they retrained the model on the second language, which filled the embedding layer with new tokens from that language.<\/p>\n

Even though the model contained mismatched information, the retraining worked: The model could learn and process the new language. The researchers surmised that while the embedding layer stored information specific to the words used in the language, the deeper levels of the network stored more abstract information about the concepts behind human languages, which then helped the model learn the second language.<\/p>\n

\u201cWe live in the same world. We conceptualize the same things with different words\u201d in different languages, said Yihong Chen<\/a>, the lead author of the recent paper. \u201cThat\u2019s why you have this same high-level reasoning in the model. An apple is something sweet and juicy, instead of just a word.\u201d<\/p>\n<\/div>\n

<\/br><\/br><\/br><\/p>\n

Uncategorized<\/br>
\n<\/br>
\nSource:https:\/\/www.quantamagazine.org\/how-selective-forgetting-can-help-ai-learn-better-20240228\/#comments<\/a><\/br><\/br><\/p>\n","protected":false},"excerpt":{"rendered":"

Source:https:\/\/www.quantamagazine.org\/how-selective-forgetting-can-help-ai-learn-better-20240228\/#comments How Selective Forgetting Can Help AI Learn Better 2024-02-29 21:58:51 A team of computer scientists has created a nimbler, more flexible type of machine learning model. The trick: It must periodically forget what it knows. And while this new approach won\u2019t displace the huge models that undergird the biggest apps, it could reveal more […]<\/p>\n","protected":false},"author":1,"featured_media":39346,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","om_disable_all_campaigns":false,"pagelayer_contact_templates":[],"_pagelayer_content":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-39345","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"yoast_head":"\nHow Selective Forgetting Can Help AI Learn Better - Science and Nerds<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How Selective Forgetting Can Help AI Learn Better - Science and Nerds\" \/>\n<meta property=\"og:description\" content=\"Source:https:\/\/www.quantamagazine.org\/how-selective-forgetting-can-help-ai-learn-better-20240228\/#comments How Selective Forgetting Can Help AI Learn Better 2024-02-29 21:58:51 A team of computer scientists has created a nimbler, more flexible type of machine learning model. The trick: It must periodically forget what it knows. And while this new approach won\u2019t displace the huge models that undergird the biggest apps, it could reveal more […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/\" \/>\n<meta property=\"og:site_name\" content=\"Science and Nerds\" \/>\n<meta property=\"article:published_time\" content=\"2024-02-29T21:58:51+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-02-29T21:58:52+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2024\/02\/how-selective-forgetting-can-help-ai-learn-better_65e0fe1bef454.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1440\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/\",\"url\":\"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/\",\"name\":\"How Selective Forgetting Can Help AI Learn Better - Science and Nerds\",\"isPartOf\":{\"@id\":\"https:\/\/scienceandnerds.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2024\/02\/how-selective-forgetting-can-help-ai-learn-better_65e0fe1bef454.webp?fit=2560%2C1440&ssl=1\",\"datePublished\":\"2024-02-29T21:58:51+00:00\",\"dateModified\":\"2024-02-29T21:58:52+00:00\",\"author\":{\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\"},\"breadcrumb\":{\"@id\":\"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2024\/02\/how-selective-forgetting-can-help-ai-learn-better_65e0fe1bef454.webp?fit=2560%2C1440&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2024\/02\/how-selective-forgetting-can-help-ai-learn-better_65e0fe1bef454.webp?fit=2560%2C1440&ssl=1\",\"width\":2560,\"height\":1440},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/scienceandnerds.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How Selective Forgetting Can Help AI Learn Better\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/scienceandnerds.com\/#website\",\"url\":\"https:\/\/scienceandnerds.com\/\",\"name\":\"Science and Nerds\",\"description\":\"My WordPress Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/scienceandnerds.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/scienceandnerds.com\"],\"url\":\"https:\/\/scienceandnerds.com\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How Selective Forgetting Can Help AI Learn Better - Science and Nerds","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/","og_locale":"en_US","og_type":"article","og_title":"How Selective Forgetting Can Help AI Learn Better - Science and Nerds","og_description":"Source:https:\/\/www.quantamagazine.org\/how-selective-forgetting-can-help-ai-learn-better-20240228\/#comments How Selective Forgetting Can Help AI Learn Better 2024-02-29 21:58:51 A team of computer scientists has created a nimbler, more flexible type of machine learning model. The trick: It must periodically forget what it knows. And while this new approach won\u2019t displace the huge models that undergird the biggest apps, it could reveal more […]","og_url":"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/","og_site_name":"Science and Nerds","article_published_time":"2024-02-29T21:58:51+00:00","article_modified_time":"2024-02-29T21:58:52+00:00","og_image":[{"width":2560,"height":1440,"url":"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2024\/02\/how-selective-forgetting-can-help-ai-learn-better_65e0fe1bef454.webp","type":"image\/webp"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/","url":"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/","name":"How Selective Forgetting Can Help AI Learn Better - Science and Nerds","isPartOf":{"@id":"https:\/\/scienceandnerds.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/#primaryimage"},"image":{"@id":"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2024\/02\/how-selective-forgetting-can-help-ai-learn-better_65e0fe1bef454.webp?fit=2560%2C1440&ssl=1","datePublished":"2024-02-29T21:58:51+00:00","dateModified":"2024-02-29T21:58:52+00:00","author":{"@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e"},"breadcrumb":{"@id":"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/#primaryimage","url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2024\/02\/how-selective-forgetting-can-help-ai-learn-better_65e0fe1bef454.webp?fit=2560%2C1440&ssl=1","contentUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2024\/02\/how-selective-forgetting-can-help-ai-learn-better_65e0fe1bef454.webp?fit=2560%2C1440&ssl=1","width":2560,"height":1440},{"@type":"BreadcrumbList","@id":"https:\/\/scienceandnerds.com\/2024\/02\/29\/how-selective-forgetting-can-help-ai-learn-better\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/scienceandnerds.com\/"},{"@type":"ListItem","position":2,"name":"How Selective Forgetting Can Help AI Learn Better"}]},{"@type":"WebSite","@id":"https:\/\/scienceandnerds.com\/#website","url":"https:\/\/scienceandnerds.com\/","name":"Science and Nerds","description":"My WordPress Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/scienceandnerds.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","caption":"admin"},"sameAs":["https:\/\/scienceandnerds.com"],"url":"https:\/\/scienceandnerds.com\/author\/admin\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2024\/02\/how-selective-forgetting-can-help-ai-learn-better_65e0fe1bef454.webp?fit=2560%2C1440&ssl=1","_links":{"self":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/39345","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/comments?post=39345"}],"version-history":[{"count":1,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/39345\/revisions"}],"predecessor-version":[{"id":39347,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/39345\/revisions\/39347"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media\/39346"}],"wp:attachment":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media?parent=39345"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/categories?post=39345"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/tags?post=39345"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}