Robots learn to perform chores by watching YouTube - Science and Nerds<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Robots learn to perform chores by watching YouTube - Science and Nerds\" \/>\n<meta property=\"og:description\" content=\"Source:https:\/\/techcrunch.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/ Robots learn to perform chores by watching YouTube 2023-06-22 21:52:38 Learning has been a holy grail in robotics for decades. If these systems are going to thrive in unpredictable environments, they\u2019ll need to do more than just respond to programming \u2014 they\u2019ll need to adapt and learn. What\u2019s become clear the more I read […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/\" \/>\n<meta property=\"og:site_name\" content=\"Science and Nerds\" \/>\n<meta property=\"article:published_time\" content=\"2023-06-22T21:52:38+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-06-22T21:52:39+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2023\/06\/robots-learn-to-perform-chores-by-watching-youtube_6494c2a74e46a.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"600\" \/>\n\t<meta property=\"og:image:height\" content=\"367\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/\",\"url\":\"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/\",\"name\":\"Robots learn to perform chores by watching YouTube - Science and Nerds\",\"isPartOf\":{\"@id\":\"https:\/\/scienceandnerds.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/06\/robots-learn-to-perform-chores-by-watching-youtube_6494c2a74e46a.jpeg?fit=600%2C367&ssl=1\",\"datePublished\":\"2023-06-22T21:52:38+00:00\",\"dateModified\":\"2023-06-22T21:52:39+00:00\",\"author\":{\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\"},\"breadcrumb\":{\"@id\":\"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/06\/robots-learn-to-perform-chores-by-watching-youtube_6494c2a74e46a.jpeg?fit=600%2C367&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/06\/robots-learn-to-perform-chores-by-watching-youtube_6494c2a74e46a.jpeg?fit=600%2C367&ssl=1\",\"width\":600,\"height\":367},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/scienceandnerds.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Robots learn to perform chores by watching YouTube\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/scienceandnerds.com\/#website\",\"url\":\"https:\/\/scienceandnerds.com\/\",\"name\":\"Science and Nerds\",\"description\":\"My WordPress Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/scienceandnerds.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/scienceandnerds.com\"],\"url\":\"https:\/\/scienceandnerds.com\/author\/admin\/\"}]}<\/script>\n","yoast_head_json":{"title":"Robots learn to perform chores by watching YouTube - Science and Nerds","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/","og_locale":"en_US","og_type":"article","og_title":"Robots learn to perform chores by watching YouTube - Science and Nerds","og_description":"Source:https:\/\/techcrunch.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/ Robots learn to perform chores by watching YouTube 2023-06-22 21:52:38 Learning has been a holy grail in robotics for decades. If these systems are going to thrive in unpredictable environments, they\u2019ll need to do more than just respond to programming \u2014 they\u2019ll need to adapt and learn. What\u2019s become clear the more I read […]","og_url":"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/","og_site_name":"Science and Nerds","article_published_time":"2023-06-22T21:52:38+00:00","article_modified_time":"2023-06-22T21:52:39+00:00","og_image":[{"width":600,"height":367,"url":"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2023\/06\/robots-learn-to-perform-chores-by-watching-youtube_6494c2a74e46a.jpeg","type":"image\/jpeg"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/","url":"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/","name":"Robots learn to perform chores by watching YouTube - Science and Nerds","isPartOf":{"@id":"https:\/\/scienceandnerds.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/#primaryimage"},"image":{"@id":"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/06\/robots-learn-to-perform-chores-by-watching-youtube_6494c2a74e46a.jpeg?fit=600%2C367&ssl=1","datePublished":"2023-06-22T21:52:38+00:00","dateModified":"2023-06-22T21:52:39+00:00","author":{"@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e"},"breadcrumb":{"@id":"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/#primaryimage","url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/06\/robots-learn-to-perform-chores-by-watching-youtube_6494c2a74e46a.jpeg?fit=600%2C367&ssl=1","contentUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/06\/robots-learn-to-perform-chores-by-watching-youtube_6494c2a74e46a.jpeg?fit=600%2C367&ssl=1","width":600,"height":367},{"@type":"BreadcrumbList","@id":"https:\/\/scienceandnerds.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/scienceandnerds.com\/"},{"@type":"ListItem","position":2,"name":"Robots learn to perform chores by watching YouTube"}]},{"@type":"WebSite","@id":"https:\/\/scienceandnerds.com\/#website","url":"https:\/\/scienceandnerds.com\/","name":"Science and Nerds","description":"My WordPress Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/scienceandnerds.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","caption":"admin"},"sameAs":["https:\/\/scienceandnerds.com"],"url":"https:\/\/scienceandnerds.com\/author\/admin\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2023\/06\/robots-learn-to-perform-chores-by-watching-youtube_6494c2a74e46a.jpeg?fit=600%2C367&ssl=1","_links":{"self":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/35651","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/comments?post=35651"}],"version-history":[{"count":1,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/35651\/revisions"}],"predecessor-version":[{"id":35653,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/35651\/revisions\/35653"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media\/35652"}],"wp:attachment":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media?parent=35651"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/categories?post=35651"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/tags?post=35651"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}

Learning has been a holy grail in robotics for decades. If these systems are going to thrive in unpredictable environments, they\u2019ll need to do more than just respond to programming \u2014 they\u2019ll need to adapt and learn. What\u2019s become clear the more I read and speak with experts is true robotic learning will require a combination of many solutions.<\/p>\n

Video is an intriguing solution that\u2019s been the centerpiece of a lot of recent work in the space. Roughly this time last year, we highlighted WHIRL<\/a> (in-the-Wild Human Imitating Robot Learning), a CMU-developed algorithm designed to train robotic systems by watching a recording of a human executing a task.<\/p>\n

This week, CMU Robotics Institute assistant professor Deepak Pathak is showcasing VRB<\/a> (Vision-Robotics Bridge), an evolution to WHIRL. As with its predecessor, the system uses video of a human to demonstrate the task, but the update no longer requires them to execute in a setting identical to the one in which the robot will operate.<\/p>\n

\u201cWe were able to take robots around campus and do all sorts of tasks,\u201d PhD student Shikhar Bahl notes in a statement. \u201cRobots can use this model to curiously explore the world around them. Instead of just flailing its arms, a robot can be more direct with how it interacts.\u201d<\/p>\n

The robot is watching for a few key pieces of information, including contact points and trajectory. The team uses opening a drawer as an example. The contact point is the handle and the trajectory is the direction in which it opens. \u201cAfter watching several videos of humans opening drawers,\u201d CMU notes, \u201cthe robot can determine how to open any drawer.\u201d<\/p>\n

Obviously not all drawers behave the same way. Humans have gotten pretty good at opening drawers, but that doesn\u2019t mean the occasional weirdly built cabinet won\u2019t give us some trouble. One of the key tricks to improving outcomes is making larger datasets for training. CMU is relying on videos from databases like Epic Kitchens and Ego4D, the latter of which has \u201cnearly 4,000 hours of egocentric videos of daily activities from across the world.\u201d<\/p>\n

Bahl notes that there\u2019s a massive archive of potential training data waiting to be watched. \u201cWe are using these datasets in a new and different way,\u201d the researcher notes. \u201cThis work could enable robots to learn from the vast amount of internet and YouTube videos available.\u201d<\/p>\n<\/p><\/div>\n

<\/br><\/br><\/br><\/p>\n

Science, Tech, Technology<\/br>
\n<\/br>
\nSource:https:\/\/techcrunch.com\/2023\/06\/22\/robots-learn-to-perform-chores-by-watching-youtube\/<\/a><\/br><\/br><\/p>\n","protected":false},"excerpt":{"rendered":"