{"id":1023,"date":"2022-03-08T14:51:33","date_gmt":"2022-03-08T14:51:33","guid":{"rendered":"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/"},"modified":"2022-03-08T14:51:34","modified_gmt":"2022-03-08T14:51:34","slug":"google-is-releasing-an-open-source-harassment-filter-for-journalists","status":"publish","type":"post","link":"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/","title":{"rendered":"Google is releasing an open source harassment filter for journalists"},"content":{"rendered":"

Source: https:\/\/www.theverge.com\/2022\/3\/8\/22966204\/google-jigsaw-perspective-ai-twitter-moderation-harassment-manager-journalists<\/a>
\n
<\/br><\/code><\/p>\n

\n

Google\u2019s Jigsaw unit is releasing the code for an open source anti-harassment tool called Harassment Manager<\/a>. The tool, intended for journalists and other public figures, employs Jigsaw\u2019s Perspective API to let users sort through potentially abusive comments on social media platforms starting with Twitter. It\u2019s debuting as source code for developers to build on, then being launched as a functional application for Thomson Reuters Foundation journalists in June.<\/p>\n

Harassment Manager can currently work with Twitter\u2019s API to combine moderation options \u2014 like hiding tweet replies and muting or blocking accounts \u2014 with a bulk filtering and reporting system. Perspective checks messages\u2019 language<\/a> for levels of \u201ctoxicity\u201d based on elements like threats, insults, and profanity. It sorts messages into queues on a dashboard, where users can address them in batches rather than individually through Twitter\u2019s default moderation tools. They can choose to blur the text of the messages while they\u2019re doing it, so they don\u2019t need to read each one, and they can search for keywords in addition to using the automatically generated queues.<\/p>\n

\n <\/p>\n

<\/p>\n\"A<\/p>\n

<\/source><\/picture>\n

<\/span><\/p>\n

<\/span><\/p>\n

<\/p>\n

Google<\/cite><\/p>\n

<\/span><\/p>\n<\/figure>\n

Harassment Manager also lets users download a standalone report containing abusive messages; this creates a paper trail for their employer or, in the case of illegal content like direct threats, law enforcement. For now, however, there\u2019s not a standalone application that users can download. Instead, developers can freely build apps that incorporate its functionality and services using it will be launched by partners like the Thomson Reuters Foundation.<\/p>\n

Jigsaw announced Harassment Manager on International Women\u2019s Day, and it framed the tool as particularly relevant to female journalists who face gender-based abuse, highlighting input from \u201cjournalists and activists with large Twitter presences\u201d as well as nonprofits like the International Women\u2019s Media Foundation and the Committee To Protect Journalists. In a Medium post<\/a>, the team says it\u2019s hoping developers can tailor it for other at-risk social media users. \u201cOur hope is that this technology provides a resource for people who are facing harassment online, especially female journalists, activists, politicians and other public figures, who deal with disproportionately high toxicity online,\u201d the post reads.<\/p>\n

\n <\/p>\n

<\/p>\n\"A<\/p>\n

<\/source><\/picture>\n

<\/span><\/p>\n

<\/span><\/p>\n<\/figure>\n

Google has harnessed Perspective for automated moderation before. In 2019 it released a browser extension called Tune<\/a> that let social media users avoid seeing messages with a high chance of being toxic, and it\u2019s been used by many commenting platforms<\/a> (including Vox Media\u2019s Coral) to supplement human moderation. But as we noted around the release of Perspective<\/a> and Tune, the language analysis model has historically been far from perfect. It sometimes misclassifies satirical content or fails to detect abusive messages, and Jigsaw-style AI can inadvertently associate terms<\/a> like \u201cblind\u201d or \u201cdeaf\u201d \u2014 which aren\u2019t necessarily negative \u2014 with toxicity. Jigsaw itself has also been criticized for a toxic workplace culture<\/a>, although Google has disputed the claims.<\/p>\n

Unlike AI-powered moderation<\/a> on services like Twitter and Instagram, however, Harassment Manager isn\u2019t a platform-side moderation feature. It\u2019s apparently a sorting tool for helping manage the sometimes overwhelming scale of social media feedback, something that could be relevant for people far outside the realm of journalism \u2014 even if they can\u2019t use it for now.<\/p>\n<\/div>\n


<\/br><\/code><\/p>\n

Source: https:\/\/www.theverge.com\/2022\/3\/8\/22966204\/google-jigsaw-perspective-ai-twitter-moderation-harassment-manager-journalists<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Source: Google\u2019s Jigsaw unit is releasing the code for an open source anti-harassment tool called Harassment Manager. The tool, intended for journalists and other public figures, employs Jigsaw\u2019s Perspective API to let users sort through potentially abusive comments on social media platforms starting with Twitter. It\u2019s debuting as source code for developers to build on, […]<\/p>\n","protected":false},"author":1,"featured_media":1024,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","om_disable_all_campaigns":false,"pagelayer_contact_templates":[],"_pagelayer_content":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[15,8],"tags":[16],"class_list":["post-1023","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-policy","category-technology","tag-policy"],"yoast_head":"\nGoogle is releasing an open source harassment filter for journalists - Science and Nerds<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Google is releasing an open source harassment filter for journalists - Science and Nerds\" \/>\n<meta property=\"og:description\" content=\"Source: Google\u2019s Jigsaw unit is releasing the code for an open source anti-harassment tool called Harassment Manager. The tool, intended for journalists and other public figures, employs Jigsaw\u2019s Perspective API to let users sort through potentially abusive comments on social media platforms starting with Twitter. It\u2019s debuting as source code for developers to build on, […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/\" \/>\n<meta property=\"og:site_name\" content=\"Science and Nerds\" \/>\n<meta property=\"article:published_time\" content=\"2022-03-08T14:51:33+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-03-08T14:51:34+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/google-is-releasing-an-open-source-harassment-filter-for-journalists_62276d758db63.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/\",\"url\":\"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/\",\"name\":\"Google is releasing an open source harassment filter for journalists - Science and Nerds\",\"isPartOf\":{\"@id\":\"https:\/\/scienceandnerds.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/google-is-releasing-an-open-source-harassment-filter-for-journalists_62276d758db63.jpeg?fit=1200%2C628&ssl=1\",\"datePublished\":\"2022-03-08T14:51:33+00:00\",\"dateModified\":\"2022-03-08T14:51:34+00:00\",\"author\":{\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\"},\"breadcrumb\":{\"@id\":\"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/google-is-releasing-an-open-source-harassment-filter-for-journalists_62276d758db63.jpeg?fit=1200%2C628&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/google-is-releasing-an-open-source-harassment-filter-for-journalists_62276d758db63.jpeg?fit=1200%2C628&ssl=1\",\"width\":1200,\"height\":628},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/scienceandnerds.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Google is releasing an open source harassment filter for journalists\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/scienceandnerds.com\/#website\",\"url\":\"https:\/\/scienceandnerds.com\/\",\"name\":\"Science and Nerds\",\"description\":\"My WordPress Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/scienceandnerds.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/scienceandnerds.com\"],\"url\":\"https:\/\/scienceandnerds.com\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Google is releasing an open source harassment filter for journalists - Science and Nerds","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/","og_locale":"en_US","og_type":"article","og_title":"Google is releasing an open source harassment filter for journalists - Science and Nerds","og_description":"Source: Google\u2019s Jigsaw unit is releasing the code for an open source anti-harassment tool called Harassment Manager. The tool, intended for journalists and other public figures, employs Jigsaw\u2019s Perspective API to let users sort through potentially abusive comments on social media platforms starting with Twitter. It\u2019s debuting as source code for developers to build on, […]","og_url":"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/","og_site_name":"Science and Nerds","article_published_time":"2022-03-08T14:51:33+00:00","article_modified_time":"2022-03-08T14:51:34+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/google-is-releasing-an-open-source-harassment-filter-for-journalists_62276d758db63.jpeg","type":"image\/jpeg"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/","url":"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/","name":"Google is releasing an open source harassment filter for journalists - Science and Nerds","isPartOf":{"@id":"https:\/\/scienceandnerds.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/#primaryimage"},"image":{"@id":"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/google-is-releasing-an-open-source-harassment-filter-for-journalists_62276d758db63.jpeg?fit=1200%2C628&ssl=1","datePublished":"2022-03-08T14:51:33+00:00","dateModified":"2022-03-08T14:51:34+00:00","author":{"@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e"},"breadcrumb":{"@id":"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/#primaryimage","url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/google-is-releasing-an-open-source-harassment-filter-for-journalists_62276d758db63.jpeg?fit=1200%2C628&ssl=1","contentUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/google-is-releasing-an-open-source-harassment-filter-for-journalists_62276d758db63.jpeg?fit=1200%2C628&ssl=1","width":1200,"height":628},{"@type":"BreadcrumbList","@id":"https:\/\/scienceandnerds.com\/2022\/03\/08\/google-is-releasing-an-open-source-harassment-filter-for-journalists\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/scienceandnerds.com\/"},{"@type":"ListItem","position":2,"name":"Google is releasing an open source harassment filter for journalists"}]},{"@type":"WebSite","@id":"https:\/\/scienceandnerds.com\/#website","url":"https:\/\/scienceandnerds.com\/","name":"Science and Nerds","description":"My WordPress Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/scienceandnerds.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","caption":"admin"},"sameAs":["https:\/\/scienceandnerds.com"],"url":"https:\/\/scienceandnerds.com\/author\/admin\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/google-is-releasing-an-open-source-harassment-filter-for-journalists_62276d758db63.jpeg?fit=1200%2C628&ssl=1","_links":{"self":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/1023"}],"collection":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/comments?post=1023"}],"version-history":[{"count":1,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/1023\/revisions"}],"predecessor-version":[{"id":1025,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/1023\/revisions\/1025"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media\/1024"}],"wp:attachment":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media?parent=1023"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/categories?post=1023"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/tags?post=1023"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}