Controlling Robotic Arm by Thought Alone

Credit: Spencer Kellis and Christian Klaes/Caltech

Giving himself a drink for the first time in 10 years,
Sorto says, "This study has been very meaningful to
me. As much as the project needed me, I needed the
project. The project has made a huge difference in
my life. It gives me great pleasure to be part of the
solution for improving paralyzed patients' lives."

The smile on Mr. Sorto's face says it all.

He has a functioning arm despite being paralyzed from the neck down.

Science stories like this are so encouraging about our ability to someday find solutions - not cures - for some of the most traumatic injuries humans suffer.  I have to keep reminding myself, we are still in the early days of the scientific revolution.  We are still exploring and experimenting and taking steps impossible just ten years ago.  We are learning, and if anything that is the essence of the human animal.

This is one cool story.

Here's the report:

Through a clinical collaboration between Caltech, Keck Medicine of USC and Rancho Los Amigos National Rehabilitation Center, a 34-year-old paralyzed man is the first person in the world to have a neural prosthetic device implanted in a region of the brain where intentions are made, giving him the ability to perform a fluid hand-shaking gesture, drink a beverage, and even play 'rock, paper, scissors,' using a robotic arm.
Paralyzed from the neck down after suffering a gunshot wound when he was 21, Erik G. Sorto now can move a robotic arm just by thinking about it and using his imagination.
Through a clinical collaboration between Caltech, Keck Medicine of USC and Rancho Los Amigos National Rehabilitation Center, the now 34-year-old Sorto is the first person in the world to have a neural prosthetic device implanted in a region of the brain where intentions are made, giving him the ability to perform a fluid hand-shaking gesture, drink a beverage, and even play "rock, paper, scissors," using a robotic arm. 

You Tube video:  Erik's first beer

Neural prosthetic devices implanted in the brain's movement center, the motor cortex, can allow patients with paralysis to control the movement of a robotic limb. However, current neuroprosthetics produce motion that is delayed and jerky--not the smooth and seemingly automatic gestures associated with natural movement. Now, by implanting neuroprosthetics in a part of the brain that controls not the movement directly but rather our intent to move, Caltech researchers have developed a way to produce more natural and fluid motions.

Designed to test the safety and effectiveness of this new approach, the clinical trial was led by principal investigator Richard Andersen, the James G. Boswell Professor of Neuroscience at Caltech, neurosurgeon Charles Y. Liu, professor of neurological surgery, neurology, and biomedical engineering at USC, and neurologist Mindy Aisen, chief medical officer at Rancho Los Amigos.

Andersen and his colleagues wanted to improve the versatility of movement that a neuroprosthetic can offer to patients by recording signals from a different brain region other than the motor cortex, i.e., the posterior parietal cortex (PPC), a high-level cognitive area. In earlier animal studies, the Andersen lab found that it is here, in the PPC, that the initial intent to make a movement is formed. These intentions are then transmitted to the motor cortex, through the spinal cord, and on to the arms and legs where the movement is executed.

"The PPC is earlier in the pathway, so signals there are more related to movement planning--what you actually intend to do--rather than the details of the movement execution," Andersen says. "When you move your arm, you really don't think about which muscles to activate and the details of the movement--such as lift the arm, extend the arm, grasp the cup, close the hand around the cup, and so on. Instead, you think about the goal of the movement, for example, 'I want to pick up that cup of water.' So in this trial, we were successfully able to decode these actual intents, by asking the subject to simply imagine the movement as a whole, rather than breaking it down into a myriad of components. We expected that the signals from the PPC would be easier for patients to use, ultimately making the movement process more fluid."

The device was surgically implanted in Sorto's brain at Keck Hospital of USC in April 2013, and he since has been training with Caltech researchers and staff at Rancho Los Amigos to control a computer cursor and a robotic arm with his mind. The researchers saw just what they were hoping for: intuitive movement of the robotic arm.

Sorto, a single father of two who has been paralyzed for over 10 years, was thrilled with the quick results: "I was surprised at how easy it was [to control the robotic arm]," he says. "I remember just having this out-of-body experience, and I wanted to just run around and high-five everybody."

The Surgery
The surgical team at Keck Medicine of USC performed the unprecedented neuroprosthetic implant in a five-hour surgery on April 17, 2013. Liu and his team implanted a pair of small electrode arrays in two parts of the posterior parietal cortex, one that controls reach and another that controls grasp. Each 4-by-4 millimeter array contains 96 active electrodes that, in turn, each record the activity of single neurons in the PPC. The arrays are connected by a cable to a system of computers that process the signals, to decode the brain's intent and control output devices, such as a computer cursor and a robotic arm.

How to Write
Science Fiction and Fantasy:
A Bestselling Science
Fiction/Fantasy Writer Shares
by
Orson Scott Card

Click on image
to order from
Powell's Books
"These arrays are very small so their placement has to be exceptionally precise, and it took a tremendous amount of planning, working with the Caltech team to make sure we got it right," says Liu, who also is director of the USC Neurorestoration Center and associate chief medical officer at Rancho Los Amigos. "Because it was the first time anyone had implanted this part of the human brain, everything about the surgery was different: the location, the positioning and how you manage the hardware. Keep in mind that what we're able to do--the ability to record the brain's signals and decode them to eventually move the robotic arm--is critically dependent on the functionality of these arrays, which is determined largely at the time of surgery."

"We are at a point in human research where we are making huge strides in overcoming a lot of neurologic disease," says neurologist Christianne Heck, associate professor of neurology at USC and co-director of the USC Neurorestoration Center. "These very important early clinical trials could provide hope for patients with all sorts of neurologic problems that involve paralysis such as stroke, brain injury, ALS and even multiple sclerosis."

The Rehabilitation
Sixteen days after his implant surgery, Sorto began his training sessions at Rancho Los Amigos National Rehabilitation Center, where a computer was attached directly to the ports extending from his skull, to communicate with his brain. The rehabilitation team of occupational therapists who specialize in helping patients adapt to loss of function in their upper limbs and "redesign" the way patients do tasks with the function they have left, worked with Sorto and the Caltech team daily to help Sorto visualize what it would be like to move his arm again.

"It was a big surprise that the patient was able to control the limb on day one -- the very first day he tried," Andersen says. "This attests to how intuitive the control is when using PPC activity."

Although he was able to immediately move the robot arm with his thoughts, after weeks of imagining, Sorto refined his control of the arm. Now, Sorto is able to execute advanced tasks with his mind, such as controlling a computer cursor; drinking a beverage; making a hand-shaking gesture; and performing various tasks with the robotic arm.

Aisen, the chief medical officer at Rancho Los Amigos who led the study's rehabilitation team, says that advancements in prosthetics like these hold promise for the future of patient rehabilitation.

"We at Rancho are dedicated to advancing rehabilitation and to restoration of neurologic function through new technologies, which can be assistive or can promote recovery by capitalizing on the innate plasticity of the human nervous system," says Aisen, also a clinical professor of neurology at the Keck School of Medicine of USC. "This research is relevant to the role of robotics and brain-machine interfaces as assistive devices, but also speaks to the ability of the brain to learn to function in new ways. We have created a unique environment that can seamlessly bring together rehabilitation, medicine, and science as exemplified in this study."

Sorto has signed on to continue working on the project for a third year. He says the study has inspired him to continue his education and pursue a master's degree in social work.

"This study has been very meaningful to me," says Sorto. "As much as the project needed me, I needed the project. It gives me great pleasure to be part of the solution for improving paralyzed patients' lives. I joke around with the guys that I want to be able to drink my own beer--to be able to take a drink at my own pace, when I want to take a sip out of my beer and to not have to ask somebody to give it to me. I really miss that independence. I think that if it were safe enough, I would really enjoy grooming myself--shaving, brushing my own teeth. That would be fantastic."

"The better understanding of the PPC will help the researchers improve the neuroprosthetic devices of the future," Andersen says. "What we have here is a unique window into the workings of a complex high-level brain area, as we work collaboratively with our subjects to perfect their skill in controlling external devices."

Related stories:

Story Source:  Materials provided by University of Southern California - Health Sciences. Tyson Aflalo, Spencer Kellis, Christian Klaes, Brian Lee, Ying Shi, Kelsie Pejsa, Kathleen Shanfield, Stephanie Hayes-Jackson, Mindy Aisen, Christi Heck, Charles Liu, Richard A. Andersen. Decoding motor imagery from the posterior parietal cortex of a tetraplegic human. Science, 2015

Comments

Post a Comment

Popular posts from this blog

How the lives of Georgian gaolbirds and highwaymen shaped modern Britain

Image
Writing historical fiction requires solid research of available materials and databases.  The key word here is available.   So news of a new publicly accessible database that allows an author to research a very interesting past era is priceless almost beyond words.   I expect some exciting fiction to come out of this announcement. Here's the story, with a link to the source in the attribution. *  *  *  *  * London Lives, a landmark project led by Professor Bob Shoemaker from the University of Sheffield and Professor Tim Hitchcock from the University of Sussex, has uncovered a mass of extraordinary new evidence which reveals how the lives of thousands of 18th-century poor and criminal Londoners helped shape modern Britain. Based on evidence made available in a publicly available database, the study sheds new light on the everyday lives of thieves, prostitutes, vagrants, highwaymen, con-men, paupers and jailbirds, revealing how their daily fight for survival led to t
Read more

An unexpected way to recover from a breakup

Image
Breaking up is truly hard to do. And recovery from a breakup can be even harder. Your friends may counsel you to put the whole thing out of your mind. But new research suggests that repeatedly reflecting on a break-up -- even through participation in a research study -- actually speeds emotional recovery. "Breakups are ubiquitous -- most adults have experienced at least one in their life -- and are typically very distressing," says Grace Larson of Northwestern University. After studying divorce and breakups for years using longitudinal, multi-method designs, Larson and her then-adviser David Sbarra of the University of Arizona wanted to study whether these research techniques on their own were affecting participants. One concern they had was that the studies could be harming participants, Larson says. "At first glance, it might seem like repeatedly reminding participants that they had just broken up -- and asking them to describe the breakup over and over --
Read more

Greek Bronze Age ended 100 years earlier than thought

Image
Source: www.shef.ac.uk The charred remains of Assiros Toumba in Greece. Writing historical fiction set in the Greek Bronze Age?  Or simply enjoy reading this genre'?  Here's a study you may find interesting. C onventional estimates for the collapse of the Aegean civilization may be incorrect by up to a century, according to new radiocarbon analyses. While historical chronologies traditionally place the end of the Greek Bronze Age at around 1025 BCE, this latest research suggests a date 70 to 100 years earlier. www.weather-forecast.com Archaeologists from the University of Birmingham selected 60 samples of animal bones, plant remains and building timbers, excavated at Assiros in northern Greece, to be radiocarbon dated and correlated with 95.4% accuracy using Bayesian statistical methodology at the University of Oxford and the Akademie der Wissenschaften Heidelberg, Germany. Researcher Dr Ken Wardle says, 'These new results tell a story that is totall
Read more

Mood Instability and Your Characters

Image
You're putting together a character who's mood simply bounces all over the place, happy one moment, in a fit of rage the next.  Researchers at King's College London note that this sort of mood instability is part of a number of mental health disorders.  So how do you structure the personality and behavior of a character like this?  Below is the King's College report, along with a brief description from mentalhealth.com, of typical behavior, sometimes in the extreme, of a person who is very emotionally unstable.  This is offered strictly as a guide for crafting character in fiction - and NOT for the amateur diagnosis of the state of someone's mental health.  That is always best left to trained professionals. Another note about emotionally unstable behavior:  as any parent will tell you, this is how adolescents and teen-agers often behave.  It's a normal part of growing up - but it is a matter of degree .  In the extreme, however, this behavior can be diag
Read more

Remember faces but not names? You got it wrong.

Image
Source:   Daily Excelsior So, you think you're good at remembering faces, but terrible with names? New research has revealed we are actually better at remembering names than faces The cringe-worthy experience of not being able to remember an acquaintance's name leads many of us to believe we are terrible with names. However, new research has revealed this intuition is misleading; we are actually better at remembering names than faces. With the Christmas party season fast approaching, there will be plenty of opportunity to re-live the familiar, and excruciatingly-awkward, social situation of not being able to remember an acquaintance's name. This cringe-worthy experience leads many of us to believe we are terrible at remembering names. However, new research has revealed this intuition is misleading; we are actually better at remembering names than faces. The authors of the study, from the University of York, suggest that when we castigate ourselves f
Read more