Archives

  • Repeated stress speeds up eye aging
  • Play Video

    Watch: Person uses thoughts to operate a wheelchair

    "We demonstrated that the people who will actually be the end users of these types of devices are able to navigate in a natural environment with the assistance of a brain-machine interface," says José del R. Millán. (Credit: UT Austin)

    In one of the first studies of its kind, several people with motor disabilities were able to operate a wheelchair that translates their thoughts into movement.

    The study is an important step forward for brain-machine interfaces—computer systems that turn mind activity into action. Researchers have studied the concept of a thought-powered wheelchair for years, but most projects have used non-disabled subjects or stimuli that leads the device to more or less control the person rather than the other way around.

    In this case, three people with tetraplegia, the inability to move their arms and legs due to spinal injuries, operated the wheelchair in a cluttered, natural environment to varying degrees of success. The interface recorded their brain activity, and a machine-learning algorithm translated it into commands that drove the wheelchair.

    The researchers say this is a sign of future commercial viability for mind-powered wheelchairs that can assist people with limited motor function.

    “We demonstrated that the people who will actually be the end users of these types of devices are able to navigate in a natural environment with the assistance of a brain-machine interface,” says lead author José del R. Millán, professor in the electrical and computer engineering department at the University of Texas at Austin.

    The study is also significant because of the noninvasive equipment used to operate the wheelchair. The researchers did not implant any kind of device into the participants, nor did they use any kind of stimulation on them.

    Participants wore a cap covered with electrodes that recorded brain electrical activity, known as an electroencephalogram (EEG). An amplifying device sent those electrical signals to a computer that interpreted each participant’s intentions and translated them into movement.

    When people suffer major injuries that end in paralysis, the brain loses pathways to deliver commands to the body and create movement. But the mind remains active, and the interface is able to capture and facilitate movement, as if the brain were talking to the body instead of a computer.

    Two important dynamics were major contributors to the success of the study. The first involves a training program for the users.

    The users were taught methods to visualize moving the chair as if they were imagining moving their hands and feet. As the researchers observed the study participants, they saw changes to their brain activity as they delivered commands.

    The second contributor borrowed from robotics. The researchers outfitted their wheelchairs with sensors to understand the surrounding environment. And they also deployed robotic intelligence software that helped the chair fill in blanks in the users’ commands to facilitate accurate and safe movement of the wheelchair.

    “It works a lot like riding a horse,” says Millán, who is also a professor of neurology at UT Austin’s Dell Medical School. “The rider can tell the horse to turn left or to go into a gate. But the horse will ultimately have to figure out the optimal way to carry out those commands.”

    This research complements another project Millán worked on, the creation of a new EEG electrode able to be worn for long periods without being replaced.

    Long-term electrodes are part of the ultimate goal of these projects. And the researchers plan to embed all the other technology involved directly into the modified wheelchair.

    The study appears in the journal iScience.

    Additional coauthors are from the University of Padova in Italy, the University of Essex in the UK, Ruhr-Universität Bochum in Germany, École polytechnique fédérale de Lausanne in Switzerland, and the Wyss Center for Bio and Neuroengineering in Switzerland.

    Source: University of Texas at Austin

    Play Video

    Watch a man eat cake with mind-controlled robot arms

    Robert "Buz" Chmielewski takes a bite of yellow sponge cake from robotic prosthetic arm controlled by his brain. (Credit: Johns Hopkins)

    A new system that merges artificial intelligence, robotics, and a brain-machine interface takes a step toward restoring function and autonomy for people without full use of their limbs.

    For more than 30 years—following an accident in his teens—Robert “Buz” Chmielewski has been a quadriplegic with minimal movement and feeling in his hands and fingers. But in November he manipulated two prosthetic arms with his brain to feed himself dessert.

    “It’s pretty cool,” says Chmielewski, whose sense of accomplishment was unmistakable after using his thoughts to command the robotic limbs to cut and feed him a piece of golden sponge cake. “I wanted to be able to do more of it.”

    Nearly two years ago, Chmielewski underwent a 10-hour brain surgery at Johns Hopkins Hospital in Baltimore as part of a clinical trial originally spearheaded by the Defense Advanced Research Projects Agency and leveraging advanced prosthetic limbs developed by the Johns Hopkins Applied Physics Laboratory (APL).

    Its goal was to allow participants to control assistive devices, and enable perception of physical stimuli (touching the limbs) using neurosignals from the brain.

    Surgeons implanted six electrode arrays into both sides of his brain, and within months he was able to demonstrate, for the first time, simultaneous control of two of the prosthetic limbs through a brain-machine interface.

    Researchers were impressed with his progress during the first year of testing and wanted to further push the bounds of what could be accomplished. The team launched a parallel line of inquiry—termed “Smart Prosthetics”—to develop strategies for providing advanced robot control and sensory feedback from both hands at the same time using neural stimulation.

    The researchers set out to develop a closed-loop system that merges artificial intelligence, robotics, and a brain-machine interface. In the instance of Chmielewski serving himself dessert, the system enabled him to control the movements necessary to cut food with a fork and knife and feed himself.

    “Our ultimate goal is to make activities such as eating easy to accomplish, having the robot do one part of the work and leaving the user, in this case Buz, in charge of the details: which food to eat, where to cut, how big the cut piece should be,” says David Handelman, a senior roboticist specializing in human-machine teaming. “By combining brain-computer interface signals with robotics and artificial intelligence, we allow the human to focus on the parts of the task that matter most.”

    Francesco Tenore, an neuroscientist and principal investigator for the Smart Prosthetics study, says the next steps for this effort include not only expanding the number and types of activities of daily living that Buz can demonstrate with this form of human-machine collaboration, but also providing him with additional sensory feedback as he completes tasks so that he won’t have to rely on vision to know if he’s succeeding.

    “The idea is that he’d experience this the same way that uninjured people can ‘feel’ how they’re tying their shoelaces, for example, without having to look at what they’re doing,” Tenore says.

    In an interview just before Thanksgiving—the traditional launch of a food-heavy holiday season—Buz reflected on the significance of this research for individuals with limited mobility. Disabilities like his take away a person’s independence, he said, particularly their ability to eat by themselves.

    “A lot of people take that for granted. To be able to do this independently and still be able to interact with family is a game-changer,” he said.

    The Smart Prosthetics study received funding from an internal research grant from APL.

    Source: Johns Hopkins University