accelerate the training of Transformer<\/a> models on H100 GPUs by six times compared to previous-generation chips, while the new fourth-generation Nivida NVlink can connect up to 256 H100 GPUs at nine times higher bandwidth than the previous generation. <\/p>\nThe H100 GPU itself contains 80 billion transistors and is the first GPU to support PCle Gen5 and utilize HBM3, enabling memory bandwidth of 3TB\/s. Nvidia says an H100 GPU is three times faster than its previous-generation A100 at FP16, FP32, and FP64 compute, and six times faster at 8-bit floating point math. <\/p>\n
\u201cFor the training of giant Transformer models, H100 will offer up to nine times higher performance, training in days what used to take weeks,\u201d said Kharya.<\/p>\n
The company also announced a new data center CPU, the Grace CPU Superchip, which consists of two CPUs connected directly via a new low-latency NVLink-C2C. The chip is designed to \u201cserve giant-scale HPC and AI applications\u201d alongside the new Hopper-based GPUs, and can be used for CPU-only systems or GPU-accelerated servers. It has 144 Arm cores and 1TB\/s of memory bandwidth. <\/p>\n\n <\/p>\n <\/p>\n<\/source><\/picture>\n
<\/span><\/p>\n
<\/span><\/p>\n
The new Grace CPU \u201csuperchip\u201d consists of two CPUs connected together. <\/em><\/figcaption>Image: Nvidia<\/cite><\/p>\n <\/span><\/p>\n<\/figure>\n
In addition to hardware and infrastructure news, Nvidia also announced updates to its various enterprise AI software services, including Maxine (an SDK to deliver audio and video enhancements, intended to power things like virtual avatars) and Riva (an SDK used for both speech recognition and text-to-speech). <\/p>\n
The company also teased that it was building a new AI supercomputer, which it claims will be the world\u2019s fastest when deployed. The supercomputer, named Eos, will be built using the Hopper architecture and contain some 4,600 H100 GPUs to offer 18.4 exaflops of \u201cAI performance.\u201d The system will be used for Nvidia\u2019s internal research only, and the company said it would be online in a few months\u2019 time. <\/p>\n
Over the past few years, a number of companies with strong interest in AI have built or announced their own in-house \u201cAI supercomputers\u201d for internal research, including Microsoft, Tesla, and Meta. These systems are not directly comparable with regular supercomputers as they run at a lower level of accuracy, which has allowed a number of firms to quickly leapfrog one another by announcing the world\u2019s fastest.<\/p>\n
However, during his keynote address, Nvidia CEO Jensen Huang did say that Eos, when running traditional supercomputer tasks, would rack 275 petaFLOPS of compute \u2014 1.4 times faster than \u201cthe fastest science computer in the US\u201d (the Summit). \u201cWe expect Eos to be the fastest AI computer in the world,\u201d said Huang. \u201cEos will be the blueprint for the most advanced AI infrastructure for our OEMs and cloud partners.\u201d<\/p>\n<\/div>\n
Source: https:\/\/www.theverge.com\/2022\/3\/22\/22989182\/nvidia-ai-hopper-architecture-h100-gpu-eos-supercomputer<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"Source: Nvidia has announced a slew of AI-focused enterprise products at its annual GTC conference. They include details of its new silicon architecture, Hopper; the first datacenter GPU built using that architecture, the H100; a new Grace CPU \u201csuperchip\u201d; and vague plans to build what the company claims will be the world\u2019s fastest AI supercomputer, […]<\/p>\n","protected":false},"author":1,"featured_media":2146,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","om_disable_all_campaigns":false,"pagelayer_contact_templates":[],"_pagelayer_content":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[17,8],"tags":[18],"class_list":["post-2145","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech","category-technology","tag-tech"],"yoast_head":"\n
Nvidia reveals H100 GPU for AI and teases \u2018world\u2019s fastest AI supercomputer\u2019 - Science and Nerds<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Nvidia reveals H100 GPU for AI and teases \u2018world\u2019s fastest AI supercomputer\u2019 - Science and Nerds\" \/>\n<meta property=\"og:description\" content=\"Source: Nvidia has announced a slew of AI-focused enterprise products at its annual GTC conference. They include details of its new silicon architecture, Hopper; the first datacenter GPU built using that architecture, the H100; a new Grace CPU \u201csuperchip\u201d; and vague plans to build what the company claims will be the world\u2019s fastest AI supercomputer, […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/\" \/>\n<meta property=\"og:site_name\" content=\"Science and Nerds\" \/>\n<meta property=\"article:published_time\" content=\"2022-03-23T15:13:13+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-03-23T15:13:14+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer_623b390a0f99f.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"894\" \/>\n\t<meta property=\"og:image:height\" content=\"468\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/\",\"url\":\"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/\",\"name\":\"Nvidia reveals H100 GPU for AI and teases \u2018world\u2019s fastest AI supercomputer\u2019 - Science and Nerds\",\"isPartOf\":{\"@id\":\"https:\/\/scienceandnerds.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer_623b390a0f99f.jpeg?fit=894%2C468&ssl=1\",\"datePublished\":\"2022-03-23T15:13:13+00:00\",\"dateModified\":\"2022-03-23T15:13:14+00:00\",\"author\":{\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\"},\"breadcrumb\":{\"@id\":\"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer_623b390a0f99f.jpeg?fit=894%2C468&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer_623b390a0f99f.jpeg?fit=894%2C468&ssl=1\",\"width\":894,\"height\":468},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/scienceandnerds.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Nvidia reveals H100 GPU for AI and teases \u2018world\u2019s fastest AI supercomputer\u2019\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/scienceandnerds.com\/#website\",\"url\":\"https:\/\/scienceandnerds.com\/\",\"name\":\"Science and Nerds\",\"description\":\"My WordPress Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/scienceandnerds.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/scienceandnerds.com\"],\"url\":\"https:\/\/scienceandnerds.com\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Nvidia reveals H100 GPU for AI and teases \u2018world\u2019s fastest AI supercomputer\u2019 - Science and Nerds","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/","og_locale":"en_US","og_type":"article","og_title":"Nvidia reveals H100 GPU for AI and teases \u2018world\u2019s fastest AI supercomputer\u2019 - Science and Nerds","og_description":"Source: Nvidia has announced a slew of AI-focused enterprise products at its annual GTC conference. They include details of its new silicon architecture, Hopper; the first datacenter GPU built using that architecture, the H100; a new Grace CPU \u201csuperchip\u201d; and vague plans to build what the company claims will be the world\u2019s fastest AI supercomputer, […]","og_url":"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/","og_site_name":"Science and Nerds","article_published_time":"2022-03-23T15:13:13+00:00","article_modified_time":"2022-03-23T15:13:14+00:00","og_image":[{"width":894,"height":468,"url":"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer_623b390a0f99f.jpeg","type":"image\/jpeg"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/","url":"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/","name":"Nvidia reveals H100 GPU for AI and teases \u2018world\u2019s fastest AI supercomputer\u2019 - Science and Nerds","isPartOf":{"@id":"https:\/\/scienceandnerds.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/#primaryimage"},"image":{"@id":"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer_623b390a0f99f.jpeg?fit=894%2C468&ssl=1","datePublished":"2022-03-23T15:13:13+00:00","dateModified":"2022-03-23T15:13:14+00:00","author":{"@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e"},"breadcrumb":{"@id":"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/#primaryimage","url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer_623b390a0f99f.jpeg?fit=894%2C468&ssl=1","contentUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer_623b390a0f99f.jpeg?fit=894%2C468&ssl=1","width":894,"height":468},{"@type":"BreadcrumbList","@id":"https:\/\/scienceandnerds.com\/2022\/03\/23\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/scienceandnerds.com\/"},{"@type":"ListItem","position":2,"name":"Nvidia reveals H100 GPU for AI and teases \u2018world\u2019s fastest AI supercomputer\u2019"}]},{"@type":"WebSite","@id":"https:\/\/scienceandnerds.com\/#website","url":"https:\/\/scienceandnerds.com\/","name":"Science and Nerds","description":"My WordPress Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/scienceandnerds.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","caption":"admin"},"sameAs":["https:\/\/scienceandnerds.com"],"url":"https:\/\/scienceandnerds.com\/author\/admin\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/03\/nvidia-reveals-h100-gpu-for-ai-and-teases-worlds-fastest-ai-supercomputer_623b390a0f99f.jpeg?fit=894%2C468&ssl=1","_links":{"self":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/2145","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/comments?post=2145"}],"version-history":[{"count":1,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/2145\/revisions"}],"predecessor-version":[{"id":2147,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/2145\/revisions\/2147"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media\/2146"}],"wp:attachment":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media?parent=2145"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/categories?post=2145"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/tags?post=2145"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}