{"id":31683,"date":"2023-05-10T22:26:39","date_gmt":"2023-05-10T22:26:39","guid":{"rendered":"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/"},"modified":"2023-05-10T22:26:40","modified_gmt":"2023-05-10T22:26:40","slug":"google-launches-palm-2-its-next-gen-large-language-model","status":"publish","type":"post","link":"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/","title":{"rendered":"Google launches PaLM 2, its next-gen large language model"},"content":{"rendered":"

Source:https:\/\/techcrunch.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/<\/a><\/br>
\nGoogle launches PaLM 2, its next-gen large language model<\/br>
\n2023-05-10 22:26:39<\/br><\/p>\n

\n

At its I\/O developer conference, Google today announced the launch of PaLM 2, its newest large language model (LLM). PaLM 2 will power Google\u2019s updated Bard chat tool, the company\u2019s competitor to OpenAI\u2019s ChatGPT, and function as the foundation model for most of the new AI features the company is announcing today. PaLM 2 is now available to developers through Google\u2019s PaLM API, Firebase and on Colab<\/a>.<\/p>\n

Google, similar to OpenAI, didn\u2019t provide a lot of the technical details about how it trained this next-gen model, including parameter counts (PaLM 2 is a 540-billion parameter model, for what it\u2019s worth). The only technical details Google provided here are that PaLM 2 was built on top of Google\u2019s latest JAX<\/a> and TPU v4<\/a> infrastructure.<\/p>\n

\"\"<\/a><\/p>\n

Image Credits:<\/strong> Google<\/p>\n<\/div>\n

\u201cWhat we found in our work is that it\u2019s not really the sort of size of model \u2014 that the larger is not always better,\u201d DeepMind VP Zoubin Ghahramani said in a press briefing ahead of today\u2019s announcement. \u201cThat\u2019s why we\u2019ve provided a family of models of different sizes. We think that actually parameter count is not really a useful way of thinking about the capabilities of models and capabilities are really to be judged by people using the models and finding out\u00a0 whether they\u2019re useful in the tests that they try to achieve with these models.\u201d<\/p>\n

Instead, the company decided to focus on its capabilities. Google says the new model is better at common sense reasoning, mathematics and logic. Indeed, as Ghahramani noted, the company trained the model on a large amount of math and science texts, as well as mathematical expressions. It\u2019s no secret that large language models \u2014 with their focus on language \u2014 have struggled with handling math questions without resorting to third-party plugins. Google, however, argues that PaLM 2 can easily solve math puzzles, reason through problems and even provide diagrams.<\/p>\n

PaLM 2 also now features improved support for writing and debugging code. The model was trained on 20 programming languages, including popular ones like JavaScript and Python, but also the likes of Prolog, Verilog and Fortran. PaLM 2 forms the basis of Codey, Google\u2019s specialized model for coding and debugging, which it is also launching today as part of its code completion and generation service, among other things.<\/p>\n

Google today also highlighted that PaLM 2 was trained on a corpus that features over 100 languages, making it, in Google\u2019s words, \u201cexcel at multilingual tasks,\u201d including more nuanced phrasing than previous models.<\/p>\n

Google talks about PaLM as a family of models, which include the likes of Codey but also Med-PaLM 2, the company\u2019s model focused on medical knowledge. There is also Sec-PaLM, a version that focuses on security use cases and a smaller PaLM 2 model that can run on smartphones, which could potentially open up PaLM to more privacy-centric use cases, though Google wouldn\u2019t commit to any timeline for this. Google says this model can process 20 tokens per second, which isn\u2019t extremely fast, but may just be acceptable for some use cases (Google wouldn\u2019t say which phone it tested this on, though).<\/p>\n

It\u2019s no secret that Google has taken a very deliberate approach to launching these AI features \u2014 something the company acknowledges. But at the same time, the standard line from Google\u2019s representatives about this is that the company wants to build these tools responsibly and with safety in mind. That, of course, is also what the company says about PaLM. Without being able to test it before today\u2019s announcement, we obviously don\u2019t know how well it performs and how it handles edge cases.<\/p>\n

\"Read<\/a><\/p>\n<\/p><\/div>\n

<\/br><\/br><\/br><\/p>\n

Science, Tech, Technology<\/br>
\n<\/br>
\nSource:https:\/\/techcrunch.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/<\/a><\/br><\/br><\/p>\n","protected":false},"excerpt":{"rendered":"

Source:https:\/\/techcrunch.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/ Google launches PaLM 2, its next-gen large language model 2023-05-10 22:26:39 At its I\/O developer conference, Google today announced the launch of PaLM 2, its newest large language model (LLM). PaLM 2 will power Google\u2019s updated Bard chat tool, the company\u2019s competitor to OpenAI\u2019s ChatGPT, and function as the foundation model for most of […]<\/p>\n","protected":false},"author":1,"featured_media":31684,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","om_disable_all_campaigns":false,"pagelayer_contact_templates":[],"_pagelayer_content":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[26,17,8],"tags":[],"class_list":["post-31683","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-science","category-tech","category-technology"],"yoast_head":"\nGoogle launches PaLM 2, its next-gen large language model - Science and Nerds<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Google launches PaLM 2, its next-gen large language model - Science and Nerds\" \/>\n<meta property=\"og:description\" content=\"Source:https:\/\/techcrunch.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/ Google launches PaLM 2, its next-gen large language model 2023-05-10 22:26:39 At its I\/O developer conference, Google today announced the launch of PaLM 2, its newest large language model (LLM). PaLM 2 will power Google\u2019s updated Bard chat tool, the company\u2019s competitor to OpenAI\u2019s ChatGPT, and function as the foundation model for most of […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/\" \/>\n<meta property=\"og:site_name\" content=\"Science and Nerds\" \/>\n<meta property=\"article:published_time\" content=\"2023-05-10T22:26:39+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-05-10T22:26:40+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/google-launches-palm-2-its-next-gen-large-language-model_645c1a2044883.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"531\" \/>\n\t<meta property=\"og:image:height\" content=\"399\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/\",\"url\":\"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/\",\"name\":\"Google launches PaLM 2, its next-gen large language model - Science and Nerds\",\"isPartOf\":{\"@id\":\"https:\/\/scienceandnerds.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/google-launches-palm-2-its-next-gen-large-language-model_645c1a2044883.jpeg?fit=531%2C399&ssl=1\",\"datePublished\":\"2023-05-10T22:26:39+00:00\",\"dateModified\":\"2023-05-10T22:26:40+00:00\",\"author\":{\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\"},\"breadcrumb\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/google-launches-palm-2-its-next-gen-large-language-model_645c1a2044883.jpeg?fit=531%2C399&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/google-launches-palm-2-its-next-gen-large-language-model_645c1a2044883.jpeg?fit=531%2C399&ssl=1\",\"width\":531,\"height\":399},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/scienceandnerds.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Google launches PaLM 2, its next-gen large language model\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/scienceandnerds.com\/#website\",\"url\":\"https:\/\/scienceandnerds.com\/\",\"name\":\"Science and Nerds\",\"description\":\"My WordPress Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/scienceandnerds.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/scienceandnerds.com\"],\"url\":\"https:\/\/scienceandnerds.com\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Google launches PaLM 2, its next-gen large language model - Science and Nerds","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/","og_locale":"en_US","og_type":"article","og_title":"Google launches PaLM 2, its next-gen large language model - Science and Nerds","og_description":"Source:https:\/\/techcrunch.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/ Google launches PaLM 2, its next-gen large language model 2023-05-10 22:26:39 At its I\/O developer conference, Google today announced the launch of PaLM 2, its newest large language model (LLM). PaLM 2 will power Google\u2019s updated Bard chat tool, the company\u2019s competitor to OpenAI\u2019s ChatGPT, and function as the foundation model for most of […]","og_url":"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/","og_site_name":"Science and Nerds","article_published_time":"2023-05-10T22:26:39+00:00","article_modified_time":"2023-05-10T22:26:40+00:00","og_image":[{"width":531,"height":399,"url":"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/google-launches-palm-2-its-next-gen-large-language-model_645c1a2044883.jpeg","type":"image\/jpeg"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/","url":"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/","name":"Google launches PaLM 2, its next-gen large language model - Science and Nerds","isPartOf":{"@id":"https:\/\/scienceandnerds.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/#primaryimage"},"image":{"@id":"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/google-launches-palm-2-its-next-gen-large-language-model_645c1a2044883.jpeg?fit=531%2C399&ssl=1","datePublished":"2023-05-10T22:26:39+00:00","dateModified":"2023-05-10T22:26:40+00:00","author":{"@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e"},"breadcrumb":{"@id":"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/#primaryimage","url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/google-launches-palm-2-its-next-gen-large-language-model_645c1a2044883.jpeg?fit=531%2C399&ssl=1","contentUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/google-launches-palm-2-its-next-gen-large-language-model_645c1a2044883.jpeg?fit=531%2C399&ssl=1","width":531,"height":399},{"@type":"BreadcrumbList","@id":"https:\/\/scienceandnerds.com\/2023\/05\/10\/google-launches-palm-2-its-next-gen-large-language-model\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/scienceandnerds.com\/"},{"@type":"ListItem","position":2,"name":"Google launches PaLM 2, its next-gen large language model"}]},{"@type":"WebSite","@id":"https:\/\/scienceandnerds.com\/#website","url":"https:\/\/scienceandnerds.com\/","name":"Science and Nerds","description":"My WordPress Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/scienceandnerds.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","caption":"admin"},"sameAs":["https:\/\/scienceandnerds.com"],"url":"https:\/\/scienceandnerds.com\/author\/admin\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/05\/google-launches-palm-2-its-next-gen-large-language-model_645c1a2044883.jpeg?fit=531%2C399&ssl=1","_links":{"self":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/31683"}],"collection":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/comments?post=31683"}],"version-history":[{"count":1,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/31683\/revisions"}],"predecessor-version":[{"id":31685,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/31683\/revisions\/31685"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media\/31684"}],"wp:attachment":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media?parent=31683"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/categories?post=31683"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/tags?post=31683"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}