wp-plugin-hostgator domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home4/scienrds/scienceandnerds/wp-includes/functions.php on line 6114ol-scrapes domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home4/scienrds/scienceandnerds/wp-includes/functions.php on line 6114Source:https:\/\/techcrunch.com\/2023\/05\/30\/ai-extiction-risk-statement\/<\/a><\/br> Make way for yet another headline-grabbing AI policy intervention: Hundreds of AI scientists, academics, tech CEOs and public figures \u2014 from OpenAI CEO Sam Altman and DeepMind CEO Demis Hassabis to veteran AI computer scientist Geoffrey Hinton, MIT\u2019s Max Tegmark and Skype co-founder Jaan Tallinn to Grimes the musician and populist podcaster Sam Harris, to name a few \u2014 have added their names to a statement urging global attention on existential AI risk.<\/p>\n The statement, which is being hosted on the website<\/a> of a San Francisco-based, privately-funded not-for-profit called the Center for AI Safety<\/a> (CAIS), seeks to equate AI risk with the existential harms posed by nuclear apocalypse and calls for policymakers to focus their attention on mitigating what they claim is \u2018doomsday\u2019 extinction-level AI risk.<\/p>\n Here\u2019s their (intentionally brief) statement in full:<\/p>\n Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.<\/p>\n<\/blockquote>\n Per a short explainer on CAIS\u2019 website the statement has been kept \u201csuccinct\u201d because those behind it are concerned to avoid their message about \u201csome of advanced AI\u2019s most severe risks\u201d being drowned out by discussion of other \u201cimportant and urgent risks from AI\u201d which they nonetheless imply are getting in the way of discussion about extinction-level AI risk.<\/p>\n However we have actually heard the self-same concerns being voiced loudly and multiple times in recent months, as AI hype has surged off the back of expanded access to generative AI tools like OpenAI\u2019s ChatGPT and DALL-E \u2014 leading to a surfeit of headline-grabbing discussion about the risk of \u201csuperintelligent\u201d killer AIs. (Such as\u00a0this one<\/a>, from earlier this month, where statement-signatory Hinton warned of the \u201cexistential threat\u201d of AI taking control. Or this one<\/a>, from just last week, where Altman called for regulation to prevent AI destroying humanity.)<\/p>\n There was also the open letter signed by Elon Musk (and scores of others) back in March<\/a> which called for a six-month pause on development of AI models more powerful than OpenAI\u2019s GPT-4 to allow time for shared safety protocols to be devised and applied to advanced AI \u2014 warning over risks posed by \u201cever more powerful digital minds that no one \u2014 not even their creators \u2014 can understand, predict, or reliably control\u201d.<\/p>\n So, in recent months, there has actually been a barrage of heavily publicized warnings over AI risks that don\u2019t exist yet.<\/p>\n This drumbeat of hysterical headlines has arguably distracted attention from deeper scrutiny of existing harms. Such as the tools\u2019 free use of copyrighted data to train AI systems without permission or consent (or payment); or the systematic scraping of online personal data in violation of people\u2019s privacy; or the lack of transparency from AI giants vis-a-vis the data used to train these tools. Or, indeed, baked in flaws like disinformation (\u201challucination\u201d) and risks like bias (automated discrimination). Not to mention AI-driven spam! And the environmental toll of the energy expended to train these AI monsters.<\/p>\n It\u2019s certainly notable that after a meeting last week between the UK prime minister and a number of major AI execs, including Altman and Hassabis, the government appears to be shifting tack on AI regulation \u2014 with a sudden keen interest in existential risk, per the Guardian\u2019s reporting<\/a>.<\/p>\n Talk of existential AI risk also distracts attention from problems related to market structure and dominance, as Jenna Burrell, director of research at Data & Society, pointed out in this recent Columbia Journalism Review<\/a> article reviewing media coverage of ChatGPT \u2014 where she argued we need to move away from focusing on red herrings like AI\u2019s potential \u201csentience\u201d to covering how AI is further concentrating wealth and power.<\/p>\n So of course there are clear commercial motivations for AI giants to want to route regulatory attention into the far-flung theoretical future, with talk of an AI-driven doomsday \u2014 as a tactic to draw lawmakers\u2019 minds away from more fundamental competition and antitrust considerations in the here and now. (And data exploitation as a tool to concentrate market power is nothing new.)<\/p>\n Certainly it speaks volumes about existing AI power structures that tech execs at AI giants including OpenAI, DeepMind, Stability AI and Anthropic are so happy to band and chatter together when it comes to publicly amplifying talk of existential AI risk. And how much more reticent to get together to discuss harms their tools can be seen causing right now.<\/p>\n OpenAI was a notable non-signatory to the aforementioned (Musk signed) open letter but a number of its employees are backing the CAIS-hosted statement (while Musk apparently is not). So the latest statement appears to offer an (unofficial) commercially self-serving reply by OpenAI (et al) to Musk\u2019s earlier attempt to hijack the existential AI risk narrative in his own interests (which no longer favor OpenAI<\/a> leading the AI charge).<\/p>\n Instead of the statement calling for a development pause, which would risk freezing OpenAI\u2019s lead in the generative AI field, it lobbies policymakers to focus on risk mitigation \u2014 doing so while OpenAI is simultaneously crowdfunding efforts to shape \u201cdemocratic processes for steering AI\u201d<\/a>, as Altman put it. So the company is actively positioning itself (and applying its investors\u2019 wealth) to influence the shape of any future mitigation guardrails, alongside ongoing in-person lobbying efforts <\/a>targeting international regulators. Altman also recently made public threats<\/a> that OpenAI\u2019s tool could be pulled out of Europe if draft EU AI rules aren\u2019t watered down to exclude its tech.<\/p>\n Elsewhere, some signatories of the earlier letter have simply been happy to double up on another publicity opportunity \u2014 inking their name to both (hi Tristan Harris!).<\/p>\n But who is CAIS? There\u2019s limited public information about the organization hosting this message. However it is certainly involved in lobbying policymakers, at its own admission. Its website says its mission is \u201cto reduce societal-scale risks from AI\u201d and claims it\u2019s dedicated to encouraging research and field-building to this end, including funding research \u2014 as well as having a stated policy advocacy role.<\/p>\n An FAQ on the website offers limited information about who is financially backing it (saying its funded by private donations). While, in answer to an FAQ question asking \u201cis CAIS an independent organization\u201d, it offers a brief claim to be \u201cserving the public interest\u201d:<\/p>\n CAIS is a nonprofit organization entirely supported by private contributions. Our policies and research directions are not determined by individual donors, ensuring that our focus remains on serving the public interest.<\/p>\n<\/blockquote>\n We\u2019ve reached out to CAIS with questions.<\/p>\n In a Twitter thread<\/a> accompanying the launch of the statement, CAIS\u2019 director, Dan Hendrycks, expands on the aforementioned statement explainer \u2014 naming \u201csystemic bias, misinformation, malicious use, cyberattacks, and weaponization\u201d as examples of \u201cimportant and urgent risks from AI\u2026 not just the risk of extinction\u201d.<\/p>\n \u201cThese are all important risks that need to be addressed,\u201d he also suggests, downplaying concerns policymakers have limited bandwidth<\/a> to address AI harms by arguing: \u201cSocieties can manage multiple risks at once; it\u2019s not \u2018either\/or\u2019 but \u2018yes\/and.\u2019 From a risk management perspective, just as it would be reckless to exclusively prioritize present harms, it would also be reckless to ignore them as well.\u201d<\/p>\n The thread also credits David Krueger, an assistant professor of Computer Science at the University of Cambridge, with coming up with the idea to have a single-sentence statement about AI risk and \u201cjointly\u201d helping with its development.<\/p>\n<\/p><\/div>\n <\/br><\/br><\/br><\/p>\n
\nOpenAI\u2019s Altman and other AI giants back warning of advanced AI as \u2018extinction\u2019 risk<\/br>
\n2023-05-30 22:01:40<\/br><\/p>\n\n
\n