Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the wp-plugin-hostgator domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home4/scienrds/scienceandnerds/wp-includes/functions.php on line 6114

Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the ol-scrapes domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home4/scienrds/scienceandnerds/wp-includes/functions.php on line 6114

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home4/scienrds/scienceandnerds/wp-includes/functions.php:6114) in /home4/scienrds/scienceandnerds/wp-includes/rest-api/class-wp-rest-server.php on line 1893
{"id":32664,"date":"2023-05-18T21:58:18","date_gmt":"2023-05-18T21:58:18","guid":{"rendered":"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/"},"modified":"2023-05-18T21:58:19","modified_gmt":"2023-05-18T21:58:19","slug":"meta-built-a-code-generating-ai-model-similar-to-copilot","status":"publish","type":"post","link":"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/","title":{"rendered":"Meta built a code-generating AI model similar to Copilot"},"content":{"rendered":"

Source:https:\/\/techcrunch.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/<\/a><\/br>
\nMeta built a code-generating AI model similar to Copilot<\/br>
\n2023-05-18 21:58:18<\/br><\/p>\n

\n

Meta says it\u2019s created a generative AI tool for coding similar to GitHub\u2019s Copilot.<\/p>\n

The company made the announcement at an event focused on its AI infrastructure efforts<\/a>, including custom chips Meta\u2019s building to accelerate the training of generative AI models. The coding tool, called CodeCompose, isn\u2019t available publicly \u2014 at least not yet. But Meta says its teams use it internally to get code suggestions for Python and other languages as they type in IDEs like VS Code.<\/p>\n

\u201cThe underlying model is built on top of public research from [Meta] that we have tuned for our internal use cases and codebases,\u201d Michael Bolin, a software engineer at Meta, said in a prerecorded video. \u201cOn the product side, we\u2019re able to integrate CodeCompose into any surface where our developers or data scientists work with code.\u201d<\/p>\n

The largest of several CodeCompose models Meta trained has 6.7 billion parameters, a little over half the number of parameters in the model on which Copilot is based. Parameters are the parts of the model learned from historical training data and essentially define the skill of the model on a problem, such as generating text.<\/p>\n

CodeCompose was fine-tuned on Meta\u2019s first-party code, including internal libraries and frameworks written in Hack, a Meta-developed programming language, so it can incorporate those into its programming suggestions. And its base training data set was filtered of poor coding practices and errors, like deprecated APIs, to reduce the chance that the model recommends a problematic slice of code.<\/p>\n

\"\"<\/p>\n

In practice, CodeCompose makes suggestions like annotations and import statements as a user types. The system can complete single lines of code or multiple lines, optionally filling in entire large chunks of code.\u00a0<\/span><\/p>\n

\u201cCodeCompose can take advantage of the surrounding code to provide better suggestions,\u201d Bolin continued. \u201cIt can also uses code comments as a signal in generating code.\u201d<\/span><\/p>\n

Meta claims that thousands of employees are accepting suggestions from CodeCompose every week and that the acceptance rate is over 20%.<\/p>\n

The company didn\u2019t address, however, the controversies around code-generating AI.<\/p>\n

Microsoft, GitHub and OpenAI are being\u00a0sued<\/a>\u00a0in a class action lawsuit that accuses them of violating copyright law by allowing Copilot to regurgitate sections of licensed code without providing credit. Liability aside, some legal experts have suggested that AI like Copilot could put companies at risk if they were to unwittingly incorporate copyrighted suggestions from the tool into their production software.<\/p>\n

It\u2019s unclear whether CodeCompose, too, was trained on licensed or copyrighted code \u2014 even accidentally. When reached for comment, a Meta spokesperson had this to say:<\/p>\n

\u201cCodeCompose was trained on InCoder, which was released by Meta\u2019s AI research division. In a paper<\/a> detailing InCoder, we note that, to train InCoder, \u2018We collect a corpus of (1) public code with permissive, non-copyleft, open source licenses from GitHub and GitLab and (2) StackOverflow questions, answers and comments.\u2019 The only additional training we do for CodeCompose is on Meta\u2019s internal code.\u201d<\/p>\n

Generative coding tools can also introduce insecure code. According to a recent study<\/a> out of Stanford, software engineers who use code-generating AI systems are more likely to cause security vulnerabilities in the apps they develop. While the study didn\u2019t look at CodeCompose specifically, it stands to reason that developers who use it would fall victim to the same.<\/p>\n

Bolin stressed that developers needn\u2019t follow CodeCompose\u2019s suggestions and that security was a \u201cmajor consideration\u201d in creating the model. \u201cWe are extremely excited with our progress on CodeCompose to date, and we believe that our developers are best served by bringing this work in house,\u201d he added<\/p>\n<\/p><\/div>\n

<\/br><\/br><\/br><\/p>\n

Science, Tech, Technology<\/br>
\n<\/br>
\nSource:https:\/\/techcrunch.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/<\/a><\/br><\/br><\/p>\n","protected":false},"excerpt":{"rendered":"

Source:https:\/\/techcrunch.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/ Meta built a code-generating AI model similar to Copilot 2023-05-18 21:58:18 Meta says it\u2019s created a generative AI tool for coding similar to GitHub\u2019s Copilot. The company made the announcement at an event focused on its AI infrastructure efforts, including custom chips Meta\u2019s building to accelerate the training of generative AI models. The coding […]<\/p>\n","protected":false},"author":1,"featured_media":32665,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","om_disable_all_campaigns":false,"pagelayer_contact_templates":[],"_pagelayer_content":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[26,17,8],"tags":[],"class_list":["post-32664","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-science","category-tech","category-technology"],"yoast_head":"\nMeta built a code-generating AI model similar to Copilot - Science and Nerds<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Meta built a code-generating AI model similar to Copilot - Science and Nerds\" \/>\n<meta property=\"og:description\" content=\"Source:https:\/\/techcrunch.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/ Meta built a code-generating AI model similar to Copilot 2023-05-18 21:58:18 Meta says it\u2019s created a generative AI tool for coding similar to GitHub\u2019s Copilot. The company made the announcement at an event focused on its AI infrastructure efforts, including custom chips Meta\u2019s building to accelerate the training of generative AI models. The coding […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/\" \/>\n<meta property=\"og:site_name\" content=\"Science and Nerds\" \/>\n<meta property=\"article:published_time\" content=\"2023-05-18T21:58:18+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-05-18T21:58:19+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/meta-built-a-code-generating-ai-model-similar-to-copilot_64669f7b57abd.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"711\" \/>\n\t<meta property=\"og:image:height\" content=\"399\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/\",\"url\":\"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/\",\"name\":\"Meta built a code-generating AI model similar to Copilot - Science and Nerds\",\"isPartOf\":{\"@id\":\"https:\/\/scienceandnerds.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/meta-built-a-code-generating-ai-model-similar-to-copilot_64669f7b57abd.jpeg?fit=711%2C399&ssl=1\",\"datePublished\":\"2023-05-18T21:58:18+00:00\",\"dateModified\":\"2023-05-18T21:58:19+00:00\",\"author\":{\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\"},\"breadcrumb\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/meta-built-a-code-generating-ai-model-similar-to-copilot_64669f7b57abd.jpeg?fit=711%2C399&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/meta-built-a-code-generating-ai-model-similar-to-copilot_64669f7b57abd.jpeg?fit=711%2C399&ssl=1\",\"width\":711,\"height\":399},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/scienceandnerds.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Meta built a code-generating AI model similar to Copilot\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/scienceandnerds.com\/#website\",\"url\":\"https:\/\/scienceandnerds.com\/\",\"name\":\"Science and Nerds\",\"description\":\"My WordPress Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/scienceandnerds.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/scienceandnerds.com\"],\"url\":\"https:\/\/scienceandnerds.com\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Meta built a code-generating AI model similar to Copilot - Science and Nerds","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/","og_locale":"en_US","og_type":"article","og_title":"Meta built a code-generating AI model similar to Copilot - Science and Nerds","og_description":"Source:https:\/\/techcrunch.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/ Meta built a code-generating AI model similar to Copilot 2023-05-18 21:58:18 Meta says it\u2019s created a generative AI tool for coding similar to GitHub\u2019s Copilot. The company made the announcement at an event focused on its AI infrastructure efforts, including custom chips Meta\u2019s building to accelerate the training of generative AI models. The coding […]","og_url":"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/","og_site_name":"Science and Nerds","article_published_time":"2023-05-18T21:58:18+00:00","article_modified_time":"2023-05-18T21:58:19+00:00","og_image":[{"width":711,"height":399,"url":"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/meta-built-a-code-generating-ai-model-similar-to-copilot_64669f7b57abd.jpeg","type":"image\/jpeg"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/","url":"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/","name":"Meta built a code-generating AI model similar to Copilot - Science and Nerds","isPartOf":{"@id":"https:\/\/scienceandnerds.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/#primaryimage"},"image":{"@id":"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/meta-built-a-code-generating-ai-model-similar-to-copilot_64669f7b57abd.jpeg?fit=711%2C399&ssl=1","datePublished":"2023-05-18T21:58:18+00:00","dateModified":"2023-05-18T21:58:19+00:00","author":{"@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e"},"breadcrumb":{"@id":"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/#primaryimage","url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/meta-built-a-code-generating-ai-model-similar-to-copilot_64669f7b57abd.jpeg?fit=711%2C399&ssl=1","contentUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/meta-built-a-code-generating-ai-model-similar-to-copilot_64669f7b57abd.jpeg?fit=711%2C399&ssl=1","width":711,"height":399},{"@type":"BreadcrumbList","@id":"https:\/\/scienceandnerds.com\/2023\/05\/18\/meta-built-a-code-generating-ai-model-similar-to-copilot\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/scienceandnerds.com\/"},{"@type":"ListItem","position":2,"name":"Meta built a code-generating AI model similar to Copilot"}]},{"@type":"WebSite","@id":"https:\/\/scienceandnerds.com\/#website","url":"https:\/\/scienceandnerds.com\/","name":"Science and Nerds","description":"My WordPress Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/scienceandnerds.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","caption":"admin"},"sameAs":["https:\/\/scienceandnerds.com"],"url":"https:\/\/scienceandnerds.com\/author\/admin\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/meta-built-a-code-generating-ai-model-similar-to-copilot_64669f7b57abd.jpeg?fit=711%2C399&ssl=1","_links":{"self":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/32664","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/comments?post=32664"}],"version-history":[{"count":1,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/32664\/revisions"}],"predecessor-version":[{"id":32666,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/32664\/revisions\/32666"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media\/32665"}],"wp:attachment":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media?parent=32664"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/categories?post=32664"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/tags?post=32664"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}