Archives

Play Video

Picking this exoskeleton’s settings is a lot like using Pandora music

Ellie Wilson, a PhD student in mechanical engineering, demonstrates a new control strategy that customizes assistance provided by a pair of ankle exoskeletons. A machine learning algorithm presents her with two assistance profiles that it has selected based on previous data. She chooses one, and it presents another for comparison. After about 45 choices, most users have found an assistance profile that they choose repeatedly. (Credit: Brenda Ahearn/Michigan Engineering)

Taking inspiration from music streaming services, engineers have designed the simplest way for users to program their own exoskeleton assistance settings.

Of course, what’s simple for the users is more complex underneath, as a machine learning algorithm repeatedly offers pairs of assistance profiles that are most likely to be comfortable for the wearer.

The user then selects one of these two, and the predictor offers another assistance profile that it believes might be better. This approach enables users to set the exoskeleton assistance based on their preferences using a very simple interface, conducive to implementing on a smartwatch or phone.

“It’s essentially like Pandora music,” says Elliott Rouse, associate professor of robotics and mechanical engineering at the University of Michigan and and corresponding author of the study in Science Robotics.

“You give it feedback, a thumbs up or thumbs down, and it curates a radio station based on your feedback. This is a similar idea, but it’s with exoskeleton assistance settings. In both cases, we are creating a model of the user’s preferences and using this model to optimize the user’s experience.”

The team tested the approach with 14 participants, each wearing a pair of ankle exoskeletons as they walked at a steady pace of about 2.3 miles per hour. The volunteers could take as much time as they wanted between choices, although they were limited to 50 choices. Most participants were choosing the same assistance profile repeatedly by the 45th decision.

After 50 rounds, the experimental team began testing the users to see whether the final assistance profile was truly the best—pairing it against 10 randomly generated (but plausible) profiles. On average, participants chose the settings suggested by the algorithm about nine out of 10 times, which highlights the accuracy of the proposed approach.

“By using clever algorithms and a touch of AI, our system figures out what users want with easy yes-or-no questions,” says first author Ung Hee Lee, a recent doctoral graduate from mechanical engineering, now at the robotics company Nuro. “I’m excited that this approach will make wearable robots comfortable and easy to use, bringing them closer to becoming a normal part of our day-to-day life.”

The control algorithm manages four exoskeleton settings: how much assistance to give (peak torque), how long to go between peaks (timing), and how the exoskeleton both ramps up and reduces the assistance on either side of each peak. This assistance approach is based on how our calf muscle adds force to propel us forward in each step.

Rouse reports that few groups are enabling users to set their own exoskeleton settings.

“In most cases, controllers are tuned based on biomechanical or physiological results. The researchers are adjusting the settings on their laptops, minimizing the user’s metabolic rate. Right now, that’s the gold standard for exoskeleton assessment and control,” Rouse says.

“I think our field overemphasizes testing with metabolic rate. People are actually very insensitive to changes in their own metabolic rate, so we’re developing exoskeletons to do something that people can’t actually perceive.”

In contrast, user preference approaches not only focus on what users can perceive but also enable them to prioritize qualities that they feel are valuable.

The study builds on the team’s previous effort to enable users to apply their own settings to an ankle exoskeleton. In that study, users had a touchscreen grid that put the level of assistance on one axis and the timing of the assistance on another. Users tried different points on the grid until they found one that worked well for them.

Once users had discovered what was comfortable, over the course of a couple of hours, they were then able to find their settings on the grid within a couple of minutes. The new study cuts down that longer period of discovering which settings feel best as well as offering two new parameters: how the assistance ramps up and down.

The data from that earlier study were used to feed the machine learning predictor. An evolutionary algorithm produces variations based on the assistance profiles that those earlier users preferred, and then the predictor—a neural network—ranked those assistance profiles. With each choice the users made, new potential assistance profiles were generated, ranked and presented to the user alongside their previous choice.

X, Google’s “Moonshot Factory,” Robotics at Google (now Google Deepmind), and the D. Dan and Betty Kahn Foundation funded the work. The concept is currently licensed by Alphabet spinoff Skip Innovations.

Source: University of Michigan

Play Video

Exoskeleton boot steps into the real world without a tether

A close-up of the untethered exoskeleton, which monitors movement using inexpensive sensors. (Credit: Kurt Hickman)

For the first time, robotic exoskeletons, designed to help wearers walk and run faster with less effort, are taking untethered steps out of the lab and into the real world.

“This exoskeleton personalizes assistance as people walk normally through the real world,” says Steve Collins, associate professor of mechanical engineering who leads the Biomechatronics Laboratory at Stanford University. “And it resulted in exceptional improvements in walking speed and energy economy.”

The “robotic boot” has a motor that works with calf muscles to give the wearer an extra push with every step. But, unlike other exoskeletons, the push is personalized thanks to a machine-learning-based model that was trained through years of work using emulators.

“On a treadmill, our device provides twice the energy savings of previous exoskeletons,” says Patrick Slade, who worked on the exoskeleton as a postdoctoral fellow at Stanford. “In the real world, this translates to significant energy savings and walking speed improvements.”

The ultimate aim is to help people with mobility impairments, particularly older people, move throughout the world as they like. With this latest breakthrough, the research team believes the technology is ready for commercialization in the coming few years.

“The first time you put an exoskeleton on can be a bit of an adjustment,” says Ava Lakmazaheri, a graduate student in the Biomechatronics Laboratory who wore the exoskeleton in tests. “But, honestly, within the first 15 minutes of walking, it starts to feel quite natural. Walking with the exoskeletons quite literally feels like you have an extra spring in your step. It just really makes that next step so much easier.”

Personalized feedback

The major barrier for an effective exoskeleton in the past was individualization. “Most exoskeletons are designed using a combination of intuition or biomimicry, but people are too complicated and diverse for that to work well,” Collins explains.

To address that problem, this group relied on their exoskeleton emulators—large, immobile, expensive lab setups that can rapidly test how best to assist people and discover the blueprints for effective portable devices to use outside the lab. With students and volunteers hooked up to the emulators, the researchers collected motion and energy expenditure data to understand how the way a person walks with the exoskeleton relates to how much energy they are using.

These data revealed the relative benefits of different kinds of assistance offered by the emulator. It also informed a machine-learning model that the real-world exoskeleton now uses to adapt to each wearer. Unlike the emulator, the untethered exoskeleton can monitor movement using only inexpensive wearable sensors integrated into the boot.

“We measure force and ankle motion through the wearables to provide accurate assistance,” says Slade. “By doing this, we can carefully control the device as people walk and assist them in a safe, unobtrusive way.”

Energy-saving exoskeleton

The exoskeleton makes walking easier and can increase speed by applying torque at the ankle, replacing some of the function of the calf muscle. As users take a step, just before their toes are about to leave the ground the device helps them push off.

The energy savings and speed boost the exoskeleton provided were equivalent to “taking off a 30-pound backpack.”

When a person is first using the exoskeleton, it provides a slightly different pattern of assistance each time the person walks. By measuring the resulting motion, the machine learning model determines how to better assist the person the next time they walk. It takes only about one hour of walking for the exoskeleton to customize to a new user.

In tests, the researchers found their exoskeleton exceeded their expectations. According to their calculations, the energy savings and speed boost were equivalent to “taking off a 30-pound backpack.”

“Optimized assistance allowed people to walk 9% faster with 17% less energy expended per distance traveled, compared to walking in normal shoes. These are the largest improvements in the speed and energy of economy walking of any exoskeleton to date,” says Collins. “In direct comparisons on a treadmill, our exoskeleton provides about twice the reduction in effort of previous devices.”

The next step for the exoskeleton is to see what it can do for the target demographic: older adults and people who are beginning to experience mobility decline due to disability. The researchers also plan to design variations that improve balance and reduce joint pain, and to work with commercial partners to turn the device into a product.

“This is the first time we’ve seen an exoskeleton provide energy savings for real-world users,” says Slade. “I believe that over the next decade we’ll see these ideas of personalizing assistance and effective portable exoskeletons help many people overcome mobility challenges or maintain their ability to live active, independent, and meaningful lives.”

“We’ve been working towards this goal for about 20 years, and I’m honestly a little stunned that we were finally able to do it,” says Collins. “I really think this technology is going to help a lot of people.”

The study is published in the journal Nature. The National Science Foundation, a Stanford Graduate Fellowship, and a Wu Tsai Human Performance Alliance Postdoctoral Fellowship funded the work.

Source: Stanford University