\nFlipping is much easier than walking<\/br>
\n2023-04-27 21:53:16<\/br><\/p>\n
I wrote about<\/span> half of last week\u2019s Actuator on Wednesday in an empty office at MassRobotics after meeting with an early-stage startup. I\u2019m not ready to tell you about them just yet, but they\u2019re doing interesting work and have one of the wilder founding stories of recent vintage, so stay tuned for that. Also, shoutout to Joyce Sidopoulos for being a very gracious host to a reporter stuck between meetings in Boston for a few hours. I would leave a five-star Airbnb rating if I could.<\/p>\n From MassRobotics, I headed to Cambridge to have a nice long chat with Marc Raibert at the Boston Dynamics AI Institute<\/a>. The newly founded institute is headquartered in the new 19-floor Akamai building<\/a>, directly across the street from Google\u2019s massive building and a stone\u2019s throw away from the MIT lab where the seeds of the entire Boston Dynamics project were planted.<\/p>\n Akamai is currently leasing at least four of the building\u2019s floors, owing to some really unfortunate timing. The construction project was completed toward the end of 2019, which meant the space had a few good months before all hell broke loose. In May 2022, Akamai announced that it was offering permanent work from home flexibility<\/a> to 95% of its 10,000 staff. Obviously not everyone who is allowed to work from home does, but in the wake of the pandemic, it\u2019s safe to assume that many or most will.<\/p>\n All the better for Raibert and the institute, I suppose. With a massive infusion of cash from Boston Dynamics parent, Hyundai, the organization is ready to take on some of robotics\u2019 and AI\u2019s toughest problems. But first, growth. Raibert tells me a sizable chunk of his day is spent interviewing candidates. There are currently something like 35 job listings with more on the way. And then there\u2019s a listing under the title \u201cDon\u2019t see what you\u2019re looking for?\u201d with the description, \u201cIf you do not see a job posting for a role that matches your experience\/interest, please apply here. We are still interested in hearing from you!\u201d<\/p>\n Nice work if you can get it, as they say.<\/p>\n Currently the space looks like that of a standard startup, which could be a source of frustration for an organization looking to really lean into the laboratory setting. I get the sense that the next time I\u2019m afforded the opportunity to visit, it will look very different \u2014 and be a lot more full. What it does have currently, however, is a whole bunch of Spot robots. There\u2019s basically a doggy day care full of them off to one side. Raibert notes that the Spots were purchased and not given to the institute, as it and Boston Dynamics are separate entities, in spite of the name.<\/p>\n Along another way are artists\u2019 conceptions of how robots might integrate into our daily lives in the future. Some are performing domestic tasks, others are fixing cars, while others still are doing more fun acrobatic activities. Some of the systems bear an uncanny resemblance to Atlas and others are a bit more out there. Raibert says his team suggested the scenarios and the artist took them in whatever direction they saw fit, meaning nothing you see there should be taken as insight into what their robot projects might look like, going forward. The tasks they\u2019re trying to solve, on the other hand, may well be represented in the drawings.<\/p>\n Digging through some old MIT Leg Lab photos. Check out this shot of Boston Dynamics’ Marc Raibert (right) on the set of the Connery\/Snipes\/Crichton flick, Rising Sun circa 1992. pic.twitter.com\/DGtugbDaY1<\/a><\/p>\n \u2014 Brian Heater (@bheater) April 26, 2023<\/a><\/p>\n<\/blockquote>\n<\/div>\n In front of these are several dusty robots from Raibert\u2019s Leg Lab days that were \u201crescued\u201d from their longtime homes in the MIT robot museum. That\u2019s since taken me down a real rabbit hole, checking out the Leg Lab page<\/a>, which hasn\u2019t been updated since 1999 but features a pre-Hawaiian shirt Raibert smiling next to a robot and three dudes in hazmat suits on the set of 1993\u2019s Rising Sun<\/em>.<\/p>\n Also, just scrolling through that list of students and faculty: Gill Pratt, Jerry Pratt, Joanna Bryson, Hugh Herr, Jonathan Hurst, among others. Boy howdy.<\/p>\n Thursday was TechCrunch\u2019s big Early Stage event<\/a> at the Hynes Convention Center. For those who couldn\u2019t make it, we\u2019ve got some panel write-ups coming over the next week or so. I made sure the TechCrunch+ team published one of mine an hour or two ago, because I wanted to talk about it a bit here. The panel wasn\u2019t explicitly about robotics, but we covered a lot of ground that\u2019s relevant here.<\/p>\n The role of the university post-research is a topic I\u2019ve been thinking and writing a fair bit about over the past few years. It was a subject I was adamant we devote a panel to at the event, given that Boston\u2019s apparently home to a school or two. My coverage has tended to approach the subject from the point of view of the schools themselves, asking simply whether they\u2019re acting as a sufficient conduit. The answer is increasingly yes. Not to be too crass about it, but they\u2019ve historically left a lot of money on the table there. That\u2019s been a big piece of historical brain drain, as well. Look at how much better CMU and Pittsburgh have gotten at keeping startups local.<\/p>\n Pae Wu, SOSV & CTO at IndieBio (SOSV) talk about \u201cHow to Turn Research Into a Business\u201d at TechCrunch Early Stage in Boston on April 20, 2023. Image Credits:<\/strong> Haje Kamps \/ TechCrunch<\/p>\n<\/div>\n You would be hard pressed to find someone with a more informed perspective on the other side of the equation than Pae Wu, general partner at SOSV and CTO at IndieBio. A bit of context is probably useful here. Last week\u2019s event primarily featured talks from VCs targeted at an audience of early-stage investors. Wu spent part of her talk discussing how \u201crecovered academics\u201d can be successfully integrated into a founding team. But not every professor wants to embrace the \u201crecovered bit.\u201d<\/p>\n I should say that I\u2019ve experienced plenty of scenarios where professors appear to walk that line well. Just looking at the Berkeley Artificial Intelligence Research Lab, you\u2019ve got Ken Goldberg and Pieter Abbeel who are currently on the founding teams for Ambi Robotics and Covariant, respectively.<\/p>\n \u201cThere are some sectors where it can work very well to have members of your founding team who remain in academia,\u201d Wu says. \u201cWe see this all the time in traditional biotech and pharma. But in other types of situations, it can become, frankly, a drag on the company and problematic for the founders who are full-time. This is a very tough conversation that we have quite frequently with some of our committed academics: Your stake in this company isn\u2019t really aligned with your time commitment.\u201d<\/p>\n Wu points to scenarios where the professor remains in a leadership role, while going on autopilot for the day-to-day. The issue, she explains, is when they frequently pop their heads in for suggestions divorced from the very time- and resource-intensive work of running a company.<\/p>\n \u201cAcademics really love to say, \u2018Well, I\u2019m actually really good at multitasking, and therefore I can do this,\u2019\u201d she explains. \u201cThe majority of the time, the academic founder will come in and out and provide their sage wisdom to the full-time founders who have committed their lives and risked everything for this company. It starts to create challenges in getting the company to move forward. It creates interpersonal challenges as well for the founding team, because you have to be a special kind of saint to say, \u2018I\u2019m working 100 hours a week, I don\u2019t make any money, and my whole financial future rests on the success of this company. And this guy keeps coming in to tell me some random thing that he read on the Harvard Business Review.\u2019\u201d<\/p>\n Wu also offers a word of caution about university involvement at the early stage:<\/p>\n If you want to be a VC-backed startup, beware the helpful university stuff. It might feel very, very comfortable. They do a great job of incubating companies, but I don\u2019t know that they do a great job of accelerating companies. You get a lot of \u2018free stuff,\u2019 and [people often say] \u2018Oh, this is a convenient EIR (education, innovation and research) program to work with, and this guy started 15 companies before.\u2019 But this guy started 15 companies in sectors that have absolutely nothing to do with what you\u2019re trying to do. You would absolutely be better off finding somebody who actually cares about your mission, isn\u2019t paid by the university, but is incentivized to care deeply about your company.<\/p>\n<\/blockquote>\n You can read (and agree or disagree with) the full article over on TechCrunch+<\/a>.<\/p>\n Image Credits:<\/strong> Tufts<\/p>\n<\/div>\n Friday, coincidentally, turned out to be university day for me. I didn\u2019t manage to see much research on my last trip top Boston, so I made sure to carve out a day this time. The morning kicked off with a trip to Tufts. The last time I visited the school was in 2017<\/a>. Human-Robot Interaction Lab director Matthias Scheutz told the video crew and myself about training robots to trust.<\/p>\n Scheutz and I sat down again for a separate \u2014 but related \u2014 discussion. Before taking up the professor role, he received a joint PhD in cognitive science and computer science from Indiana University and another PhD in philosophy from the University of Vienna. It\u2019s an unlikely combination that informs much of the work he does. With all of the ethical and moral detours during our conversation, I couldn\u2019t stop thinking that it would have made a good podcast.<\/p>\n At the heart of the interview is the team\u2019s efforts to develop a shareable knowledge set between robots. In a subsequent demo in the nearby lab, one team member asked a Fetch research robot to assemble a screw caddy, but it doesn\u2019t have the requisite knowledge. The human coworker then instructs the robot how to perform the process, step by step \u2014 \u201cExecute while learning,\u201d as they put it. Once it gains the knowledge, it runs through around 100 simulations in quick succession to determine the probability that it will perform the task correctly.<\/p>\n Another team member asks a nearby Nao robot whether the Fetch knows how to perform the tasks. The two robots communicate nonverbally. Fetch runs through simulations again and shares the information with the Nao, who then communicates it to the human. The demo offers a quick shorthand for how networked robots can pass along the information they learned through a kind of network in the cloud \u2014 or a sky net, if you will.<\/p>\n I\u2019ve excerpted some of the more interesting bits from our conversation below.<\/p>\n [I\u2019m told the above is a Mean Girls reference.]<\/em><\/p>\n Distraction vs. overload<\/strong><\/p>\n If I can detect that you\u2019re distracted, maybe what I need to do is get your attention back to the task. That\u2019s a completely different interaction you want from one where you\u2019re overloaded. I should probably leave you alone to finish the thing. So, imagine a robot that cannot distinguish between the distraction state, which should be very engaged and get the person back on task, compared with the person being overloaded. In that case, if the robot doesn\u2019t know it, the interaction might be counterproductive for the team. If you can detect these states, it would be very helpful.<\/p>\n Shared mental models<\/strong><\/p>\n One of the videos we have up on our web page shows you can teach this one robot that doesn\u2019t know how to squat, how to squat, and the other one can immediately do it. The way to do it is to use the same shared mental model. We can\u2019t do this. If you don\u2019t know how to play piano, I cannot just put that in your head. That\u2019s also part of the problem with all these deep neural nets that are very popular these days. You cannot share knowledge at that level. I cannot implant in your neural network (this goes for people, too) what I have been trained over many years of practicing piano. But if you push the abstraction a little bit higher, where you have a description that is independent of how it\u2019s realized in the neural network, then you can share it.<\/p>\n On multitasking<\/strong><\/p>\n The hot stove is a good example. The moment [the touch is issued by the brain], you may already realize it\u2019s on, but it\u2019s maybe too late. There\u2019s a level of abstraction where I can intervene consciously and cognitively with the sequencing and I can alter things. There\u2019s a level of discrete actions where sequencing occurs, also automatically. For example, years ago, when I was at Notre Dame, I drove to campus, but I didn\u2019t want to go to campus. But I was thinking about work, and so this automatic system of mine drove me, and the next moment I was in a parking lot. I can talk to you and prepare food, no problem. But it needs to be rehearsed. If the activity is not rehearsed, you can\u2019t do it. We have a layer in the [robotic] architecture that does that automatic sequencing. That\u2019s the level at which we can share more complex actions.<\/p>\n Your Roomba doesn\u2019t know you exist<\/strong><\/p>\n There\u2019s a fine line, where you need to have these mechanisms in place, because otherwise harm will follow if they\u2019re not in place. You get this with autonomous cars; you get this in a lot of contexts. At the same time, we don\u2019t want to prevent all robots, because we want to use them for what they\u2019re good for \u2014 what they\u2019re beneficial for. They need to have more awareness of what\u2019s happening, what they\u2019re being used for. It\u2019s not a problem with a Roomba because it doesn\u2019t even know you exist. They have no notion of anything. But if you look at YouTube, you will find videos of Roomba shoving pets under the couch. They have no awareness of any person or any thing in the environment. They don\u2019t even know they\u2019re doing a vacuuming task. It\u2019s as simple as that. At the same time, you can see how much more massively sophisticated they would have to be in order to actually cognitively comprehend all the eventualities that could happen in an apartment.<\/p>\n When robots say no<\/strong><\/p>\n Years ago, we had this video of a robot saying no to people. In some cases, people may not be aware of the state the robot is in, give it an instruction, and if the robot carried out that instruction, it would be bad for the robot or a person. So the robot needs to say no. But it can\u2019t just say no and nothing else. It needs to tell you why not. If the robot just doesn\u2019t do it, that\u2019s not good. You won\u2019t trust that robot to do something again.<\/p>\n Editorial interjection here. <\/em>The \u201cno\u201d video caused a bit of a stir for its perceived violation of Asimov\u2019s second law, \u201cA robot must obey the orders given it by human beings except where such orders would conflict with the First Law.\u201d Obviously there\u2019s a clause baked into that second law that says the robot should not obey an order if doing so will injure a human (first law).<\/p>\n But Scheutz doesn\u2019t stop there. He paints a scenario in which a robot is carrying a box as it was told to do. Suddenly a different human tells the same robot to open a door, but doing so would cause it to drop \u2014 and damage \u2014 the box. In this case, the \u201cno\u201d isn\u2019t about protecting a human, but it is about following orders. Immediately following the second order effectively negates its ability to carry out the first.<\/p>\n It\u2019s here, then, that the robot is required to say, \u201cNo, but don\u2019t worry, I got you once I get this box where it needs to go.\u201d<\/p>\n Image Credits:<\/strong> MIT CSAIL<\/p>\n<\/div>\n After our chat, I head back to Cambridge for my first time back at MIT CSAIL since the pandemic started. Due to a last-minute change of plans, I wasn\u2019t able to reconnect with Daniela Rus, unfortunately. I did, however, get a chance to finally speak to Electrical Engineering and Computer Science (EECS) assistant professor Pulkit Agrawal. As it happened, I had recently written<\/a> about his team\u2019s work to teach a quadruped to play soccer on difficult surfaces like sand and mud.<\/p>\n When I arrived, I commented on the Intel RealSense box in front of me. I\u2019ve been looking for any reason to discuss the move away from LiDAR I\u2019ve been seeing among roboticists of late, and this was a great in. Again, some highlights below.<\/p>\n On why more roboticists are moving away from LiDAR<\/strong><\/p>\n Right now, we are not dealing with obstacles. If [the ball] does go away from the robot, it does need to deal with it. But even dealing with obstacles, you can do it with RGB. The way to think about this is that people wanted depth because they could write programs by hand of how to move the robot given a depth recording. But if we are going to move toward data-driven robotics, where I\u2019m not writing my own program, but computers are writing it, it doesn\u2019t matter whether I have depth or RGB. The only thing that matters is how much data I have.<\/p>\n On grippers<\/strong><\/p>\n Why do people use suction cups? Because they\u2019re like five bucks. It\u2019s broken, you replace it. Even to get them to use a two-finger gripper, it\u2019s $100. Even Amazon doesn\u2019t want to put more sensors. Suppose you go to a company and say, \u201cI want to add this sensor, because it might improve performance.\u201d They\u2019ll ask how much the sensor is going to cost and multiply it by the volume of how many robots they have.<\/p>\n On \u201cgeneral purpose\u201d robots<\/strong><\/p>\n Suppose you have one target, say, lifting boxes and putting them on the conveyer belt, and then there was pick and place and then loading them on the truck. You could have constructed three different robots that are more efficient at three different tasks. But you also have different costs associated with maintaining that different robot and integrating those different robots as part of your pipeline. But if I had the same robot that can do these different things, maybe it costs less to maintain them, but maybe they\u2019re less performant. It comes down to those calculations.<\/p>\n When I made reference to the Mini Cheetah robots the team has been working with, Agrawal commented, \u201cIt actually turns out flipping is much easier than walking.\u201d<\/p>\n \u201cSpeak for yourself,\u201d I countered.<\/p>\n He added, \u201cWhat is intuitive for humans is actually counterintuitive for machines. For example, playing chess or playing go, machines can beat us. But they can\u2019t open doors. That\u2019s Moravec\u2019s paradox<\/a>.\u201d<\/p>\n Image Credits:<\/strong> Bryce Durbin\/TechCrunch<\/p>\n<\/div>\n As promised, another question from our recent TechCrunch+ investor survey.<\/p>\n Following the lead of robot vacuums, how long will it take before additional home robot categories go truly mainstream?<\/strong><\/p>\n Kelly Chen, DCVC:<\/strong> Medium-term, at best. Alphabet\u2019s folding of Everyday Robots goes to show how even large resources cannot make home service robots viable today. The home is a highly unstructured environment. Going beyond the relatively simple exceptions that existing vacuum robots need to learn, the rest of the home is much more difficult. Additional tasks are in 3D, which may mean more sensors, actuators, manipulation, different grippers, force control, and much less predictability. We are not there yet in making this reliable and economical.<\/p>\n Helen Greiner, Cybernetix Ventures:<\/strong> Five years for lawn mowers in the USA, based on vision-based navigation (combined with GPS) coming out. No setup wires and better UIs will drive demand. The network effect (neighbors copying neighbors) will drive demand after initial adoption. Thirteen years for a humanoid helper, based on Agility and X1 cost reduced and smarter.<\/p>\n Paul Willard, Grep:<\/strong> It has already started. Labrador robots help mobility-challenged folks fetch and carry things around the house. So medication is always handy and taken on time, grocery delivery from the front door can be carried to the fridge and pantry to be put away, and dinner can be carried from the stove to the dining table while the customer has their hands full perhaps with a walker, a cane or a wheelchair. There will be more as the hardware that makes up the robots gets less expensive and more capable, simultaneously.<\/p>\n Cyril Ebersweiler, SOSV:<\/strong> Most robotics companies eyeing B2C have moved to B2B over the years. The time, scale and amounts of money required to launch such a brand these days isn\u2019t exactly what VCs are looking for.<\/p>\n Image Credits:<\/strong> Robust.AI<\/p>\n<\/div>\n Had a chance to catch up with Rodney Brooks again (we have to stop meeting like this). This time<\/a> he was joined by his Robust.AI co-founder and CEO, Anthony Jules. The startup\u2019s work was shrouded in mystery for some time, leading to this fun headline from IEEE<\/a>. We\u2019ve got a much better handle on what the team does now: It makes a robotic cart and software management system for the warehouse.<\/p>\n Brooks was understandably a bit hesitant to jump back into the hardware game. Jules told me:<\/p>\n We started off trying to be a software-only company. We started looking at the space and decided there was a great opportunity to really create something that was transformative for people. Once we got excited about it, we did very standard product work to understand what the pain points are and what it was that would really help people in this space. We had a pretty clear vision of what would be valuable. There was one day I literally said to Rod, \u2018I think I have a good idea for a company, but you\u2019re going to hate it, because it means we might have to build hardware.\u2019\u201d<\/p>\n<\/blockquote>\n Late last week, Robust announced a $20 million Series A-1, led by Prime Movers Lab and featuring Future Ventures, Energy Impact Partners, JAZZ Ventures and Playground Global. That follows a $15 million Series A announced back in late 2020.<\/p>\n A Veo Robotics setup in a human-robot co-working environment. Image Credits:<\/strong> Veo Robotics<\/p>\n<\/div>\n This week, Massachusetts-based Veo Robotics announced<\/a> that it has closed a $29 million Series B. That includes $15 million from last year and $14 million from this year. Safar Partners and Yamaha Motor Ventures participated, but the most notable back is Amazon through its $1 billion Industry Innovation Fund.<\/p>\n It\u2019s easy to view these investments as a kind of trial run for potential acquisitions, though the company has largely denied that it uses the money as an on-boarding process. That said, it is certainly a vote of confidence and, at the very least, probably an indication that the company will begin piloting this technology in its own workspaces \u2014 assuming it hasn\u2019t already.<\/p>\n \u201cThe newest generation of intelligent robotic systems work with people, not separately from them,\u201d says co-founder and CTO Clara Vu. \u201cUnlocking this potential requires a new generation of safety systems \u2014 this is Veo\u2019s mission, and we\u2019re very excited to be taking this next step.\u201d<\/p>\n Veo develops a software safety layer for industrial robots, allowing them to operate alongside human co-workers outside of the cages seen on many floors.<\/p>\n Image Credits:<\/strong> University of Tokyo<\/p>\n<\/div>\n We all remember the Digit predecessor Cassie, right? OSU\u2019s robot took strong cues from ostriches for its bipedal locomotion. RobOstrich (robot ostrich. Slow clap) is more concerned with the upper half of the world\u2019s largest flightless bird.<\/p>\n \u201cFrom a robotics perspective, it is difficult to control such a structure,\u201d the University of Tokyo\u2019s Kazashi Nakano told IEEE<\/a>. \u201cWe focused on the ostrich neck because of the possibility of discovering something new.\u201d<\/p>\n The system features 17 3D printed vertebrae, with piano wire serving as muscles. The system is actually a long robotic manipulator that offers a flexible compliance that other systems lack.<\/p>\n Let\u2019s do some more robot job listings next week. Fill out this form<\/a> to have your company listed.<\/p>\n Image Credits: Bryce Durbin \/ TechCrunch<\/p>\n<\/div>\n Take your head out of the sand already. Subscribe<\/a> to Actuator.\u00a0<\/em><\/p>\n<\/p><\/div>\n <\/br><\/br><\/br><\/p>\n\n
![\"\"](\"https:\/\/i0.wp.com\/techcrunch.com\/wp-content\/uploads\/2023\/04\/TC-Early-Stage-2023-68.jpg?resize=1140%2C760&ssl=1\")
<\/p>\n\n
![\"\"](\"https:\/\/i0.wp.com\/techcrunch.com\/wp-content\/uploads\/2023\/04\/Screenshot-2023-04-26-at-5.41.52-PM.jpg?resize=1024%2C625&ssl=1\")
<\/p>\nConversation with Matthias Scheutz<\/h2>\n
Conversation with Pulkit Agrawal<\/h2>\n
![\"robot](\"https:\/\/i0.wp.com\/techcrunch.com\/wp-content\/uploads\/2023\/03\/vTgqAO-M.jpeg?resize=1024%2C741&ssl=1\")
<\/p>\nTC+ Investor Survey<\/h2>\n
![\"\"](\"https:\/\/i0.wp.com\/techcrunch.com\/wp-content\/uploads\/2023\/04\/robot-arm-money-1.jpg?resize=1024%2C550&ssl=1\")
<\/p>\nNews<\/h2>\n
![\"Robust](\"https:\/\/i0.wp.com\/techcrunch.com\/wp-content\/uploads\/2023\/04\/Robust-Carters2.jpg?resize=1024%2C576&ssl=1\")
<\/p>\n\n
![\"A](\"https:\/\/i0.wp.com\/techcrunch.com\/wp-content\/uploads\/2022\/07\/veo-2.jpg?resize=1140%2C642&ssl=1\")
<\/p>\n![\"\"](\"https:\/\/i0.wp.com\/techcrunch.com\/wp-content\/uploads\/2023\/04\/a-robotic-spine-structure-that-ends-in-a-bird-like-head-and-open-beak-extends-out-and-then-up-vertically-from-lab-equipment.webp?resize=1024%2C768&ssl=1\")
<\/p>\n![\"\"](\"https:\/\/i0.wp.com\/techcrunch.com\/wp-content\/uploads\/2022\/04\/actuator-blue.webp?resize=1024%2C576&ssl=1\")
<\/p>\n