Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the wp-plugin-hostgator domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home4/scienrds/scienceandnerds/wp-includes/functions.php on line 6114

Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the ol-scrapes domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home4/scienrds/scienceandnerds/wp-includes/functions.php on line 6114

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893
{"id":36552,"date":"2023-07-05T21:36:53","date_gmt":"2023-07-05T21:36:53","guid":{"rendered":"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/"},"modified":"2023-07-05T21:36:54","modified_gmt":"2023-07-05T21:36:54","slug":"openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control","status":"publish","type":"post","link":"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/","title":{"rendered":"OpenAI is forming a new team to bring \u2018superintelligent\u2019 AI under control"},"content":{"rendered":"

Source:https:\/\/techcrunch.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/<\/a><\/br>
\nOpenAI is forming a new team to bring \u2018superintelligent\u2019 AI under control<\/br>
\n2023-07-05 21:36:53<\/br><\/p>\n

\n
\n\t\t\t\n\t\t<\/div>\n<\/p><\/div>\n
\n

OpenAI is forming a new team led by Ilya Sutskever, its chief scientist and one of the company\u2019s co-founders, to develop ways to steer and control \u201csuperintelligent\u201d AI systems.<\/p>\n

In a blog<\/a> post published today, Sutskever and Jan Leike, a lead on the alignment team at OpenAI, predict that AI with intelligence exceeding that of humans could arrive within the decade. This AI \u2014 assuming it does, indeed, arrive eventually \u2014 won\u2019t necessarily be benevolent, necessitating research into ways to control and restrict it, Sutskever and Leike say.<\/p>\n

\u201cCurrently, we don\u2019t have a solution for steering or controlling a potentially superintelligent AI, and preventing it from going rogue,\u201d they write. \u201cOur current techniques for aligning AI, such as reinforcement learning from human feedback, rely on humans\u2019 ability to supervise AI. But humans won\u2019t be able to reliably supervise AI systems much smarter than us.\u201d<\/p>\n

To move the needle forward in the area of \u201csuperintelligence alignment,\u201d OpenAI is creating a new Superalignment team, led by both Sutskever and Leike, which will have access to 20% of the compute the company has secured to date. Joined by scientists and engineers from OpenAI\u2019s previous alignment division as well as researchers from other orgs across the company, the team will aim to solve the core technical challenges of controlling superintelligent AI over the next four years.<\/p>\n

How? By building what Sutskever and Leike describe as a \u201chuman-level automated alignment researcher.\u201d The high-level goal is to train AI systems using human feedback, train AI to assist in evaluating other AI systems and ultimately to build AI that can do alignment research. (Here, \u201calignment research\u201d refers to ensuring AI systems achieve desired outcomes or don\u2019t go off the rails<\/a>.)<\/p>\n

It\u2019s OpenAI\u2019s hypothesis that AI can\u00a0make faster and better alignment research progress than humans can.<\/p>\n

\u201cAs we make progress on this, our AI systems can take over more and more of our alignment work and ultimately conceive, implement, study and develop better alignment techniques than we have now,\u201d Leike and colleagues John Schulman and Jeffrey Wu postulated\u00a0in a previous blog post<\/a>. \u201cThey will work together with humans to ensure that their own successors are more aligned with humans. . . . Human researchers will focus more and more of their effort on reviewing alignment research done by AI systems instead of generating this research by themselves.\u201d<\/p>\n

Of course, no method is foolproof \u2014 and Leike, Schulman and Wu acknowledge the many limitations of OpenAI in their post. Using AI for evaluation has the potential to scale up inconsistencies, biases or vulnerabilities in that AI, they say. And it might turn out that the hardest parts of the alignment problem might not be related to engineering at all.<\/p>\n

But Sutskever and Leike think it\u2019s worth a go.<\/p>\n

\u201cSuperintelligence alignment is fundamentally a machine learning problem, and we think great machine learning experts \u2014 even if they\u2019re not already working on alignment \u2014 will be critical to solving it,\u201d they write. \u201cWe plan to share the fruits of this effort broadly and view contributing to alignment and safety of non-OpenAI models as an important part of our work.\u201d<\/p>\n<\/p><\/div>\n

<\/br><\/br><\/br><\/p>\n

Science, Tech, Technology<\/br>
\n<\/br>
\nSource:https:\/\/techcrunch.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/<\/a><\/br><\/br><\/p>\n","protected":false},"excerpt":{"rendered":"

Source:https:\/\/techcrunch.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/ OpenAI is forming a new team to bring \u2018superintelligent\u2019 AI under control 2023-07-05 21:36:53 OpenAI is forming a new team led by Ilya Sutskever, its chief scientist and one of the company\u2019s co-founders, to develop ways to steer and control \u201csuperintelligent\u201d AI systems. In a blog post published today, Sutskever and Jan Leike, a […]<\/p>\n","protected":false},"author":1,"featured_media":36553,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","om_disable_all_campaigns":false,"pagelayer_contact_templates":[],"_pagelayer_content":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[26,17,8],"tags":[],"class_list":["post-36552","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-science","category-tech","category-technology"],"yoast_head":"\nOpenAI is forming a new team to bring \u2018superintelligent\u2019 AI under control - Science and Nerds<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"OpenAI is forming a new team to bring \u2018superintelligent\u2019 AI under control - Science and Nerds\" \/>\n<meta property=\"og:description\" content=\"Source:https:\/\/techcrunch.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/ OpenAI is forming a new team to bring \u2018superintelligent\u2019 AI under control 2023-07-05 21:36:53 OpenAI is forming a new team led by Ilya Sutskever, its chief scientist and one of the company\u2019s co-founders, to develop ways to steer and control \u201csuperintelligent\u201d AI systems. In a blog post published today, Sutskever and Jan Leike, a […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/\" \/>\n<meta property=\"og:site_name\" content=\"Science and Nerds\" \/>\n<meta property=\"article:published_time\" content=\"2023-07-05T21:36:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-07-05T21:36:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2023\/07\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control_64a5e276607a0.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"711\" \/>\n\t<meta property=\"og:image:height\" content=\"399\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/\",\"url\":\"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/\",\"name\":\"OpenAI is forming a new team to bring \u2018superintelligent\u2019 AI under control - Science and Nerds\",\"isPartOf\":{\"@id\":\"https:\/\/scienceandnerds.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/07\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control_64a5e276607a0.jpeg?fit=711%2C399&ssl=1\",\"datePublished\":\"2023-07-05T21:36:53+00:00\",\"dateModified\":\"2023-07-05T21:36:54+00:00\",\"author\":{\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\"},\"breadcrumb\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/07\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control_64a5e276607a0.jpeg?fit=711%2C399&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/07\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control_64a5e276607a0.jpeg?fit=711%2C399&ssl=1\",\"width\":711,\"height\":399},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/scienceandnerds.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"OpenAI is forming a new team to bring \u2018superintelligent\u2019 AI under control\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/scienceandnerds.com\/#website\",\"url\":\"https:\/\/scienceandnerds.com\/\",\"name\":\"Science and Nerds\",\"description\":\"My WordPress Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/scienceandnerds.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/scienceandnerds.com\"],\"url\":\"https:\/\/scienceandnerds.com\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"OpenAI is forming a new team to bring \u2018superintelligent\u2019 AI under control - Science and Nerds","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/","og_locale":"en_US","og_type":"article","og_title":"OpenAI is forming a new team to bring \u2018superintelligent\u2019 AI under control - Science and Nerds","og_description":"Source:https:\/\/techcrunch.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/ OpenAI is forming a new team to bring \u2018superintelligent\u2019 AI under control 2023-07-05 21:36:53 OpenAI is forming a new team led by Ilya Sutskever, its chief scientist and one of the company\u2019s co-founders, to develop ways to steer and control \u201csuperintelligent\u201d AI systems. In a blog post published today, Sutskever and Jan Leike, a […]","og_url":"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/","og_site_name":"Science and Nerds","article_published_time":"2023-07-05T21:36:53+00:00","article_modified_time":"2023-07-05T21:36:54+00:00","og_image":[{"width":711,"height":399,"url":"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2023\/07\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control_64a5e276607a0.jpeg","type":"image\/jpeg"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/","url":"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/","name":"OpenAI is forming a new team to bring \u2018superintelligent\u2019 AI under control - Science and Nerds","isPartOf":{"@id":"https:\/\/scienceandnerds.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/#primaryimage"},"image":{"@id":"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/07\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control_64a5e276607a0.jpeg?fit=711%2C399&ssl=1","datePublished":"2023-07-05T21:36:53+00:00","dateModified":"2023-07-05T21:36:54+00:00","author":{"@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e"},"breadcrumb":{"@id":"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/#primaryimage","url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/07\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control_64a5e276607a0.jpeg?fit=711%2C399&ssl=1","contentUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/07\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control_64a5e276607a0.jpeg?fit=711%2C399&ssl=1","width":711,"height":399},{"@type":"BreadcrumbList","@id":"https:\/\/scienceandnerds.com\/2023\/07\/05\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/scienceandnerds.com\/"},{"@type":"ListItem","position":2,"name":"OpenAI is forming a new team to bring \u2018superintelligent\u2019 AI under control"}]},{"@type":"WebSite","@id":"https:\/\/scienceandnerds.com\/#website","url":"https:\/\/scienceandnerds.com\/","name":"Science and Nerds","description":"My WordPress Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/scienceandnerds.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","caption":"admin"},"sameAs":["https:\/\/scienceandnerds.com"],"url":"https:\/\/scienceandnerds.com\/author\/admin\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/07\/openai-is-forming-a-new-team-to-bring-superintelligent-ai-under-control_64a5e276607a0.jpeg?fit=711%2C399&ssl=1","_links":{"self":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/36552","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/comments?post=36552"}],"version-history":[{"count":1,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/36552\/revisions"}],"predecessor-version":[{"id":36554,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/36552\/revisions\/36554"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media\/36553"}],"wp:attachment":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media?parent=36552"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/categories?post=36552"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/tags?post=36552"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}