Archives

Play Video

Method lets humans help robots ‘see’ to get around stuff

The task set for this Fetch robot by Rice University computer scientists is made easier by their BLIND software, which allows for human intervention when the robot’s path is blocked by an obstacle. Keeping a human in the loop augments robot perception and prevents the execution of unsafe motion, according to the researchers. (Credit: Kavraki Lab/Rice)

Researchers have come up with a new strategy that allows humans to help robots “see” their environments and carry out tasks.

Just like us, robots can’t see through walls. Sometimes they need a little help to get where they’re going.

The strategy called Bayesian Learning IN the Dark—BLIND, for short—is a new solution to the long-standing problem of motion planning for robots that work in environments where not everything is clearly visible all the time.

The algorithm keeps a human in the loop to “augment robot perception and, importantly, prevent the execution of unsafe motion,” according to the study.

To do so, researchers at Rice University combined Bayesian inverse reinforcement learning (by which a system learns from continually updated information and experience) with established motion planning techniques to assist robots that have “high degrees of freedom”—that is, a lot of moving parts.

To test BLIND, the researchers directed a Fetch robot, an articulated arm with seven joints, to grab a small cylinder from a table and move it to another, but in doing so it had to move past a barrier.

“If you have more joints, instructions to the robot are complicated,” says Carlos Quintero-Peña of the George R. Brown School of Engineering. “If you’re directing a human, you can just say, ‘Lift up your hand.'”

But a robot’s programmers have to be specific about the movement of each joint at each point in its trajectory, especially when obstacles block the machine’s “view” of its target.

Rather than programming a trajectory up front, BLIND inserts a human mid-process to refine the choreographed options—or best guesses—suggested by the robot’s algorithm.

“BLIND allows us to take information in the human’s head and compute our trajectories in this high-degree-of-freedom space,” Quintero-Peña says.

“We use a specific way of feedback called critique, basically a binary form of feedback where the human is given labels on pieces of the trajectory,” he says.

These labels appear as connected green dots that represent possible paths. As BLIND steps from dot to dot, the human approves or rejects each movement to refine the path, avoiding obstacles as efficiently as possible.

“It’s an easy interface for people to use, because we can say, ‘I like this’ or ‘I don’t like that,’ and the robot uses this information to plan,” says Constantinos Chamzas of the George R. Brown School of Engineering. Once rewarded with an approved set of movements, the robot can carry out its task, he says.

“One of the most important things here is that human preferences are hard to describe with a mathematical formula,” Quintero-Peña says. “Our work simplifies human-robot relationships by incorporating human preferences. That’s how I think applications will get the most benefit from this work.”

“This work wonderfully exemplifies how a little, but targeted, human intervention can significantly enhance the capabilities of robots to execute complex tasks in environments where some parts are completely unknown to the robot but known to the human,” says computer scientists Lydia Kavraki, a robotics pioneer whose resume includes advanced programming for NASA’s humanoid Robonaut aboard the International Space Station.

The researchers presented the work at the Institute of Electrical and Electronics Engineers’ International Conference on Robotics and Automation.

The National Science Foundation supported the research.

Source: Rice University

Play Video

Rescue robots get a speed upgrade for rough terrain

A two-arm mobile manipulator, which would fall if it did not brace itself on the wall, rolls across the steep incline by using the team’s approach to identify placements for its arms. (Credit: Yu-Chi Lin)

A new algorithm speeds up path planning for robots that use their arms to make their way across treacherous terrain such as disaster areas or construction sites.

The improved path planning algorithm found successful paths three times as often as standard algorithms, while needing much less processing time.

“In a collapsed building or on very rough terrain, a robot won’t always be able to balance itself and move forward with just its feet,” says Dmitry Berenson, associate professor of electrical and computer engineering and core faculty at the Robotics Institute at the University of Michigan.

“You need new algorithms to figure out where to put both feet and hands. You need to coordinate all these limbs together to maintain stability, and what that boils down to is a very difficult problem.”

The research enables robots to determine how difficult the terrain is before calculating a successful path forward, which might include bracing on the wall with one or two hands while taking the next step forward.

“First, we used machine learning to train the robot on the different ways it can place its hands and feet to maintain balance and make progress,” says Yu-Chi Lin, recent robotics PhD graduate and software engineer at Nuro Inc. “Then, when placed in a new, complex environment, the robot can use what it learned to determine how traversable a path is, allowing it to find a path to the goal much faster.”

However, even when using this traversability estimate, it is still time-consuming to plan a long path using traditional planning algorithms.

“If we tried to find all the hand and foot locations over a long path, it would take a very long time,” Berenson says.

So, the team used a “divide-and-conquer” approach, splitting a path into tough-to-traverse sections, where they can apply their learning-based method, and easier-to-traverse sections, where a simpler path planning method works better.

“That sounds simple, but it’s really hard to know how to split up that problem correctly, and which planning method to use for each segment,” Lin says.

To do this, they need a geometric model of the entire environment. This could be achieved in practice with a flying drone that scouts ahead of the robot.

In a virtual experiment with a humanoid robot in a corridor of rubble, the team’s method outperformed previous methods in both success and total time to plan—important when quick action is needed in disaster scenarios.

Specifically, over 50 trials, their method reached the goal 84% of the time compared to 26% for the basic path planner, and took just over two minutes to plan compared to over three minutes for the basic path planner.

The team also showcased their method’s ability to work on a real world, mobile manipulator—a wheeled robot with a torso and two arms. With the base of the robot placed on a steep ramp, it had to use its “hands” to brace itself on an uneven surface as it moved. The robot utilized the team’s method to plan a path in just over a tenth of a second, compared to over 3.5 seconds with the basic path planner.

In future work, the team hopes to incorporate dynamically stable motion, similar to the natural movement of humans and animals, which would free the robot from having to be constantly in balance, and could improve its speed of movement.

The paper describing the work appears in Autonomous Robots. The Office of Naval Research funded the work.

Source: Dan Newman for University of Michigan

Play Video

AI teaches a robot how to learn to walk

The Rapid Motor Adaptation algorithm helps four-legged robots adjust in real-time to unseen scenarios such as changing terrains, changing payloads, wear, and tear. (Credit: Carnegie Mellon)

Artificial intelligence has done more than teach a robot to walk. It taught a robot to learn to walk, researchers report.

The distinction is key. A major hurdle to deploying legged robots, whether with two, four, or even more legs, is figuring out how the robot will respond to changing conditions. Humans can adapt as they walk over rocks, mud, sand, slippery ice, and uneven surfaces. They adjust to carrying a heavy backpack or limp along with an injured ankle.

Legged robots cannot adjust so quickly. Most legged robots must be hand-coded for their environments. A crack in a sidewalk or a patch of oil can stop a robot in its tracks or cause it to come tumbling down.

“The focus is not walking. It is learning.”

Rapid Motor Adaptation (RMA) seeks to change that. The artificial intelligence was jointly developed by Deepak Pathak and Zipeng Fu at Carnegie Mellon University’s School of Computer Science and Ashish Kumar and Jitendra Malik at the University of California, Berkeley AI Research.

It enables legged robots to adapt intelligently in real time to challenging, unfamiliar new terrain and circumstances.

“The focus is not walking. It is learning,” says Pathak, an assistant professor in the Robotics Institute. “By falling thousands of times or millions of times in simulation, it learns to walk from scratch and adapts to the ever-changing real world. Since the algorithm’s focus is learning, it is applicable to any kind of robot, not just this one.”

RMA is the first entirely learning-based system that does not rely on any hand-coded motions. and allows legged robots to adapt to their environment by exploring and interacting with the world.

Testing showed that robots with RMA outperformed competing systems when walking over varied surfaces, slopes, and obstacles, and when carrying different payloads.

“If you pick up a backpack, you adjust your motion without knowing the exact weight. If the terrain beneath your feet changes, you adjust your balance to compensate. RMA does this by adapting the robot joints in real-time,” says Kumar, a PhD student.

The technology isn’t limited to robotics. RMA is a step toward building AI systems that can learn in real time to adapt to changing and challenging conditions. The team will present their research at Robotics: Science and Systems.

Additional researchers from Facebook AI, Carnegie Mellon, and UC Berkeley contributed to the work.

Source: Carnegie Mellon University