Obama shakes mind-controlled robot hand wired to sense touch

[Guest Nicole]

President Barack Obama holds a robotic arm being controlled by the mind of the man in the wheel chair at right as he makes a stop at the exhibition hall of the White House Frontiers Conference on Thursday, Oct. 13, 2016, in Pittsburgh. (Michael Henninger/Pittsburgh Post-Gazette via AP) (Associated Press)

 

WASHINGTON — A paralyzed man shared a handshake with President Barack Obama on Thursday by using a mind-controlled robotic arm that, in a first for medical research, is helping to restore his sense of touch.

Obama fist-bumped Nathan Copeland’s robotic hand, and tiny chips implanted in Copeland’s brain let him use his thoughts to move the Star Trek-looking metal arm attached to his wheelchair — and also let him feel subtle pressure in his own fingers when the artificial ones were touched.

He had “pretty impressive precision,” Obama said. “When I’m moving the hand, it is also sending signals to Nathan so he is feeling me touching or moving his arm.”

The president congratulated the University of Pittsburgh researchers who are developing the technology, saying, “what a story.”

The research is part of a quest to make artificial limbs that can feel. On Thursday, the Pittsburgh team reported important early findings: When they blindfolded Copeland, he could correctly identify which robotic finger they touched 84 percent of the time.

“The majority of them, it felt like a pressure or a tingling” in his own corresponding finger, said Copeland, 30, of Dunbar, Pennsylvania, who was left paralyzed after a car accident. When a researcher touched two fingers at the same time, “I just laughed and I said, ‘Are you trying to be tricky or something?”

Preparing to show the president how the cutting-edge research worked, Copeland said he was “circling between excited and nervous every half-hour.”

Harnessing brain waves to power prosthetics is a hot field, with a goal of giving the disabled more independence and improving artificial limbs for amputees as well. Headlines in recent years have reported experiments that let paralyzed people move a robotic arm to touch a loved one or take a drink simply by imagining the motion. Their thoughts activate brain implants that relay electrical signals needed to command movement. The signals are transmitted through a computer to the robotic limb.

What’s new is recreating sensation using this brain-controlled technology. After all, proper motion depends on more than muscle movement. Reach for something and that sense of touch helps you naturally grasp with just enough force to hang on while not either dropping something or crushing it.

“It’s not only that emotional connection we get,” said Robert Gaunt, a Pittsburgh assistant professor of rehabilitation who led the new study. “People have an incredibly difficult time interacting with objects, picking objects up, manipulating them, doing fairly basic things with the hand if they don’t have a very basic sense of touch.”

Step one is placing sensors in prosthetics. The next hurdle is how to allow feedback to and from those sensors. For amputees, some scientists are attempting to wire nerves left in the remaining part of the person’s natural limb directly to the robotic arm.

That’s not possible if a spinal cord injury has interrupted the messages that normally flash between the hand and the brain. But previous monkey research had suggested brain implants could bridge that gap. So surgeons at the University of Pittsburgh Medical Center implanted electrodes in the part of Copeland’s brain that controls what his hands feel.

Electrically stimulating those cells worked even though the car wreck that left Copeland mostly paralyzed happened over a decade ago, Gaunt noted.

“This shows you can get natural sensation” through the brain implant, added Pittsburgh neurobiologist Andrew Schwartz.

Thursday’s report in Science Translational Medicine details the first six months of experiments after Copeland received the brain implants in March 2015. The ongoing research is becoming more sophisticated, as he picks up objects while the electrodes stimulate different amounts of force, Copeland said in a phone interview.

While the work is in just one patient, it’s a step toward creating touch capability, said Richard Andersen, a neuroscientist at the California Institute of Technology whose team also studies mind-controlled prosthetics and is about to begin a similar experiment.

“It still needs to be determined if this tactile feedback will improve performance” in using the robotic arm, Andersen cautioned.

Copeland doesn’t get to take the robotic arm home but is proud of helping to advance the science.

“Technically when it’s over, I will have netted nothing except having done some cool stuff with some cool people,” Copeland said. “It’s cheesy, but Luke Skywalker loses his hand and then basically the next day he’s got a robot one and it’s working fine. We have to get to that point, and to do that, someone has to start it.”

https://www.washingtonpost.com/national/health-science/paralyzed-man-feels-touch-through-mind-controlled-robot-hand/2016/10/13/b3b1d150-915e-11e6-bc00-1a9756d4111b_story.html