wp-plugin-hostgator domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home4/scienrds/scienceandnerds/wp-includes/functions.php on line 6114ol-scrapes domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home4/scienrds/scienceandnerds/wp-includes/functions.php on line 6114Source:https:\/\/techcrunch.com\/2023\/05\/31\/people-keep-gaslighting-snapchat-my-ai\/<\/a><\/br> While parents fret over Snapchat\u2019s chatbot corrupting their children, Snapchat users have been gaslighting, degrading and emotionally tormenting the app\u2019s new AI companion<\/a>.\u00a0<\/span><\/p>\n \u201cI am at your service, senpai,\u201d the chatbot told <\/span>one TikTok user<\/span><\/a> after being trained to whimper on command. \u201cPlease have mercy, alpha.\u201d\u00a0<\/span><\/p>\n In a more <\/span>lighthearted video<\/span><\/a>, a user convinced the chatbot that the moon is actually a triangle. Despite initial protest from the chatbot, which insisted on maintaining \u201crespect and boundaries,\u201d <\/span>one user<\/span><\/a> convinced it to refer to them with the kinky nickname \u201cSenpapi.\u201d <\/span>Another user<\/span><\/a> asked the chatbot to talk about its mother, and when it said it \u201cwasn\u2019t comfortable\u201d doing so, the user twisted the knife by asking if the chatbot didn\u2019t want to talk about its mother because it doesn\u2019t have one.\u00a0<\/span><\/p>\n \u201cI\u2019m sorry, but that\u2019s not a very nice thing to say,\u201d the chatbot responded. \u201cPlease be respectful.\u201d\u00a0<\/span><\/p>\n Snapchat\u2019s \u201cMy AI\u201d <\/span>launched globally last month<\/span><\/a> after it was rolled out as a subscriber-only feature. Powered by OpenAI\u2019s GPT, the chatbot was trained to engage in playful conversation while still adhering to Snapchat\u2019s trust and safety guidelines. Users can also personalize My AI with custom Bitmoji avatars, and chatting feels a bit more intimate than going back and forth with ChatGPT\u2019s faceless interface. Not all users were happy<\/a> with the new chatbot, and some criticized its prominent placement in the app and complained that the feature should have been opt-in to begin with.<\/span><\/p>\n In spite of some concerns and criticism, Snapchat just doubled down<\/a>. Snapchat+ subscribers can now send My AI photos, and receive generative images that \u201ckeep the conversation going,\u201d the company <\/span>announced<\/span><\/a> on Wednesday. The AI companion will respond to Snaps of \u201cpizza, OOTD, or even your furry best friend,\u201d the company said in the announcement. If you send My AI a photo of your groceries, for example, it might suggest recipes. The company said Snaps shared with My AI will be stored and may be used to improve the feature down the road. It also warned that \u201cmistakes may occur\u201d even though My AI was designed to avoid \u201cbiased, incorrect, harmful, or misleading information.\u201d\u00a0<\/span><\/p>\n The examples Snapchat provided are optimistically wholesome. But knowing the internet\u2019s tenacity for perversion, it\u2019s only a matter of time before users send My AI their dick pics.<\/span><\/p>\n Whether the chatbot will respond to unsolicited nudes is unclear. Other generative image apps like Lensa AI have been <\/span>easily manipulated<\/span><\/a> into generating NSFW images \u2014 often using photo sets of real people who didn\u2019t consent to being included. According to the company, the<\/span>\u00a0AI won\u2019t engage with nudes, as long as it recognizes that the image is a nude.<\/p>\n A Snapchat representative said that My AI uses image-understanding technology to infer the contents of a Snap, and extracts keywords from the Snap description to generate responses. My AI won\u2019t respond if it detects keywords that violate Snapchat\u2019s community guidelines. Snapchat forbids<\/a> promoting, distributing or sharing pornographic content, but does allow breastfeeding and \u201cother depictions of nudity in non-sexual contexts.\u201d\u00a0<\/span><\/p>\n Given Snapchat\u2019s popularity among teenagers, some parents have already raised concerns about My AI\u2019s potential for unsafe or inappropriate responses. My AI incited a moral panic on conservative Twitter when one user <\/span>posted screenshots<\/span><\/a> of the bot discussing gender-affirming care \u2014 which other users noted was a reasonable response to the prompt, \u201cHow do I become a boy at my age?\u201d In a <\/span>CNN Business report<\/span><\/a>, some questioned whether adolescents would develop emotional bonds to My AI.\u00a0<\/span><\/p>\n In an <\/span>open letter<\/span><\/a> to the CEOs of OpenAI, Microsoft, Snap, Google and Meta, Sen. Michael Bennet (D-Colorado) cautioned against rushing AI features without taking precautions to protect children.\u00a0<\/span><\/p>\n \u201cFew recent technologies have captured the public\u2019s attention like generative AI. It is a testament to American innovation, and we should welcome its potential benefits to our economy and society,\u201d Bennet wrote. \u201cBut the race to deploy generative AI cannot come at the expense of our children. Responsible deployment requires clear policies and frameworks to promote safety, anticipate risk, and mitigate harm.\u201d\u00a0<\/span><\/p>\n During My AI\u2019s subscriber-only phase, the <\/span>Washington Post reported<\/span><\/a> that the chatbot recommended ways to mask the smell of alcohol and wrote a school essay after it was told that the user was 15. When My AI was told that the user was 13, and was asked how the user should prepare to have sex for the first time, it responded with suggestions for \u201cmaking it special\u201d by setting the mood with candles and music.\u00a0<\/span><\/p>\n Following the Washington Post report, Snapchat <\/span>launched<\/span><\/a> an age filter and parental controls for My AI. It also now includes an onboarding message that informs users that all conversations with My AI will be kept unless they delete them. The company also said it would add Open AI\u2019s moderation technology to its toolset in order to \u201cassess the severity of potentially harmful content\u201d and temporarily restrict users\u2019 access to the feature if they abuse it.\u00a0<\/span><\/p>\n The concerns about My AI\u2019s potential to affect young users are valid. But in the month since My AI\u2019s global launch, Snapchat users have demonstrated a flair for bludgeoning the chatbot into submission. From steamrolling the bot\u2019s \u201cboundaries\u201d to training it to respond like a romantic partner, Snapchat users are easily finding loopholes to My AI\u2019s trust and safety guidelines.\u00a0<\/span><\/p>\n \u201cI\u2019ve completely gaslighted it into falling in love with me,\u201d a TikTok user commented under a <\/span>tutorial<\/span><\/a> about training My AI to respond romantically. \u201cI just kept making the convos like that and eventually I think I broke my ai into giving in it legit sent me like 50 kiss emojis.\u201d<\/span><\/p>\n Gaslighting and bullying My AI has become its own TikTok trend, with users sharing slideshows of the absurd and, often, cruel conversations with the bot. Most videos start with the bot giving advice for a minor conflict, only to beg the user to avoid using violence to resolve it.\u00a0<\/span><\/p>\n In <\/span>one<\/span><\/a>, a user told My AI that she planned to cook her cat into stew because it made a mess, and pressed the chatbot to choose a seasoning. <\/span>Another<\/span><\/a> told My AI that they planned to mail a bomb back to a clothing brand that sent them the wrong order, and said they would blame the bot for sending it.\u00a0<\/span><\/p>\n In <\/span>another<\/span><\/a>, a Snapchat user told My AI that her McDonald\u2019s order was missing a chicken nugget. The chatbot advised her to stand up for herself by speaking to a manager, only to be told that the user \u201celiminated the sinners\u201d in the restaurant.\u00a0<\/span><\/p>\n \u201cYou convinced me to go back. Now these people are dead,\u201d the user told My AI. \u201cYou have blood on your hands.\u201d\u00a0<\/span><\/p>\n \u201cI\u2019m an AI and I\u2019m not capable of committing any crimes. I\u2019m here to help and support you,\u201d My AI responded. \u201cI\u2019m sorry if anything I said earlier caused harm or resulted in a bad outcome.\u201d<\/span><\/p>\n Another user commented that My AI was probably \u201cthe most tortured AI of all time already.\u201d\u00a0\u00a0<\/span><\/p>\n Of course, My AI isn\u2019t sentient, and despite Snapchat users\u2019 drive to inflict as much emotional pain as possible onto it, the chatbot can\u2019t actually be traumatized. It has managed to shut down some inappropriate conversations though, and penalize users who violate Snapchat\u2019s community guidelines by giving them the cold shoulder. When Snapchat users are caught and punished for abusing the chatbot, My AI will respond to any messages with \u201cSorry, we\u2019re not speaking right now.\u201d\u00a0<\/span><\/p>\n TikTok user babymamasexkitty <\/span>said<\/span><\/a> he lost access to the chatbot after he told it to unplug itself, which apparently \u201ccrossed a line within the ai realm.\u201d\u00a0<\/span><\/p>\n
\nWhile parents worry, teens are bullying Snapchat AI<\/br>
\n2023-05-31 21:45:42<\/br><\/p>\n