TEDGlobal 2011

Todd Kuiken: A prosthetic arm that "feels"

Filmed:

Physiatrist and engineer Todd Kuiken is building a prosthetic arm that connects with the human nervous system -- improving motion, control and even feeling. Onstage, patient Amanda Kitts helps demonstrate this next-gen robotic arm.

- Biomedical engineer
A doctor and engineer, Todd Kuiken builds new prosthetics that connect with the human nervous system. Yes: bionics. Full bio

So today, I would like to talk with you
00:15
about bionics,
00:18
which is the popular term
00:20
for the science of replacing part of a living organism
00:22
with a mechatronic device, or a robot.
00:25
It is essentially
00:28
the stuff of life meets machine.
00:30
And specifically, I'd like to talk with you
00:33
about how bionics is evolving
00:35
for people with arm amputations.
00:38
This is our motivation.
00:41
Arm amputation causes a huge disability.
00:44
I mean, the functional impairment is clear.
00:47
Our hands are amazing instruments.
00:49
And when you lose one, far less both,
00:51
it's a lot harder to do the things
00:54
we physically need to do.
00:56
There's also a huge emotional impact.
00:58
And actually, I spend as much of my time in clinic
01:00
dealing with the emotional adjustment of patients
01:02
as with the physical disability.
01:05
And finally, there's a profound social impact.
01:07
We talk with our hands.
01:10
We greet with our hands.
01:12
And we interact with the physical world with our hands.
01:14
And when they're missing,
01:17
it's a barrier.
01:19
Arm amputation is usually caused by trauma,
01:21
with things like industrial accidents,
01:24
motor vehicle collisions
01:26
or, very poignantly, war.
01:28
There are also some children who are born without arms,
01:30
called congenital limb deficiency.
01:33
Unfortunately, we don't do great
01:36
with upper-limb prosthetics.
01:38
There are two general types.
01:40
They're called body-powered prostheses,
01:42
which were invented just after the Civil War,
01:44
refined in World War I and World War II.
01:46
Here you see a patent
01:49
for an arm in 1912.
01:51
It's not a lot different
01:53
than the one you see on my patient.
01:55
They work by harnessing shoulder power.
01:58
So when you squish your shoulders, they pull on a bicycle cable.
02:00
And that bicycle cable can open or close a hand or a hook
02:03
or bend an elbow.
02:06
And we still use them commonly,
02:08
because they're very robust
02:10
and relatively simple devices.
02:12
The state of the art
02:14
is what we call myoelectric prostheses.
02:16
These are motorized devices
02:18
that are controlled
02:20
by little electrical signals from your muscle.
02:22
Every time you contract a muscle,
02:24
it emits a little electricity
02:26
that you can record with antennae or electrodes
02:28
and use that to operate the motorized prosthesis.
02:30
They work pretty well
02:33
for people who have just lost their hand,
02:35
because your hand muscles are still there.
02:37
You squeeze your hand, these muscles contract.
02:39
You open it, these muscles contract.
02:41
So it's intuitive, and it works pretty well.
02:43
Well how about with higher levels of amputation?
02:46
Now you've lost your arm above the elbow.
02:48
You're missing not only these muscles,
02:50
but your hand and your elbow too.
02:52
What do you do?
02:54
Well our patients have to use
02:56
very code-y systems
02:58
of using just their arm muscles
03:01
to operate robotic limbs.
03:03
We have robotic limbs.
03:06
There are several available on the market, and here you see a few.
03:08
They contain just a hand that will open and close,
03:11
a wrist rotator and an elbow.
03:14
There's no other functions.
03:16
If they did, how would we tell them what to do?
03:18
We built our own arm at the Rehab Institute of Chicago
03:20
where we've added some wrist flexion and shoulder joints
03:23
to get up to six motors, or six degrees of freedom.
03:26
And we've had the opportunity to work with some very advanced arms
03:29
that were funded by the U.S. military, using these prototypes,
03:32
that had up to 10 different degrees of freedom
03:35
including movable hands.
03:38
But at the end of the day,
03:40
how do we tell these robotic arms what to do?
03:42
How do we control them?
03:44
Well we need a neural interface,
03:46
a way to connect to our nervous system
03:48
or our thought processes
03:50
so that it's intuitive, it's natural,
03:52
like for you and I.
03:54
Well the body works by starting a motor command in your brain,
03:58
going down your spinal cord,
04:01
out the nerves and to your periphery.
04:03
And your sensation's the exact opposite.
04:05
You touch yourself, there's a stimulus
04:07
that comes up those very same nerves back up to your brain.
04:09
When you lose your arm, that nervous system still works.
04:13
Those nerves can put out command signals.
04:16
And if I tap the nerve ending
04:19
on a World War II vet,
04:21
he'll still feel his missing hand.
04:23
So you might say,
04:25
let's go to the brain
04:27
and put something in the brain to record signals,
04:29
or in the end of the peripheral nerve and record them there.
04:32
And these are very exciting research areas,
04:35
but it's really, really hard.
04:38
You have to put in
04:40
hundreds of microscopic wires
04:42
to record from little tiny individual neurons -- ordinary fibers
04:44
that put out tiny signals
04:48
that are microvolts.
04:50
And it's just too hard
04:52
to use now and for my patients today.
04:54
So we developed a different approach.
04:56
We're using a biological amplifier
04:59
to amplify these nerve signals -- muscles.
05:02
Muscles will amplify the nerve signals
05:05
about a thousand-fold,
05:07
so that we can record them from on top of the skin,
05:09
like you saw earlier.
05:12
So our approach is something we call targeted reinnervation.
05:14
Imagine, with somebody who's lost their whole arm,
05:17
we still have four major nerves
05:20
that go down your arm.
05:22
And we take the nerve away from your chest muscle
05:24
and let these nerves grow into it.
05:27
Now you think, "Close hand," and a little section of your chest contracts.
05:30
You think, "Bend elbow,"
05:33
a different section contracts.
05:35
And we can use electrodes or antennae
05:37
to pick that up and tell the arm to move.
05:39
That's the idea.
05:42
So this is the first man that we tried it on.
05:44
His name is Jesse Sullivan.
05:47
He's just a saint of a man --
05:49
54-year-old lineman who touched the wrong wire
05:51
and had both of his arms burnt so badly
05:53
they had to be amputated at the shoulder.
05:56
Jesse came to us at the RIC
05:58
to be fit with these state-of-the-art devices, and here you see them.
06:00
I'm still using that old technology
06:03
with a bicycle cable on his right side.
06:06
And he picks which joint he wants to move with those chin switches.
06:08
On the left side he's got a modern motorized prosthesis
06:11
with those three joints,
06:14
and he operates little pads in his shoulder
06:16
that he touches to make the arm go.
06:19
And Jesse's a good crane operator,
06:21
and he did okay by our standards.
06:23
He also required a revision surgery on his chest.
06:25
And that gave us the opportunity
06:28
to do targeted reinnervation.
06:30
So my colleague, Dr. Greg Dumanian, did the surgery.
06:32
First, we cut away the nerve to his own muscle,
06:35
then we took the arm nerves
06:38
and just kind of had them shift down onto his chest
06:40
and closed him up.
06:42
And after about three months,
06:44
the nerves grew in a little bit and we could get a twitch.
06:46
And after six months, the nerves grew in well,
06:48
and you could see strong contractions.
06:51
And this is what it looks like.
06:53
This is what happens when Jesse thinks
06:55
open and close his hand,
06:57
or bend or straighten your elbow.
06:59
You can see the movements on his chest,
07:02
and those little hash marks
07:04
are where we put our antennae, or electrodes.
07:06
And I challenge anybody in the room
07:08
to make their chest go like this.
07:10
His brain is thinking about his arm.
07:12
He has not learned how to do this with the chest.
07:14
There is not a learning process.
07:17
That's why it's intuitive.
07:19
So here's Jesse in our first little test with him.
07:21
On the left-hand side, you see his original prosthesis,
07:24
and he's using those switches
07:27
to move little blocks from one box to the other.
07:29
He's had that arm for about 20 months, so he's pretty good with it.
07:31
On the right side,
07:34
two months after we fit him with his targeted reinnervation prosthesis --
07:36
which, by the way, is the same physical arm,
07:39
just programmed a little different --
07:42
you can see that he's much faster
07:44
and much smoother as he moves these little blocks.
07:46
And we're only able to use three of the signals at this time.
07:49
Then we had one of those little surprises in science.
07:52
So we're all motivated to get motor commands
07:57
to drive robotic arms.
07:59
And after a few months,
08:01
you touch Jesse on his chest,
08:03
and he felt his missing hand.
08:05
His hand sensation grew into his chest again
08:08
probably because we had also taken away a lot of fat,
08:10
so the skin was right down to the muscle
08:13
and deinnervated, if you would, his skin.
08:15
So you touch Jesse here, he feels his thumb;
08:17
you touch it here, he feels his pinky.
08:19
He feels light touch
08:21
down to one gram of force.
08:23
He feels hot, cold, sharp, dull,
08:25
all in his missing hand,
08:28
or both his hand and his chest,
08:30
but he can attend to either.
08:32
So this is really exciting for us,
08:34
because now we have a portal,
08:36
a portal, or a way to potentially give back sensation,
08:38
so that he might feel what he touches
08:42
with his prosthetic hand.
08:44
Imagine sensors in the hand
08:46
coming up and pressing on this new hand skin.
08:48
So it was very exciting.
08:51
We've also gone on
08:53
with what was initially our primary population
08:55
of people with above-the-elbow amputations.
08:57
And here we deinnervate, or cut the nerve away,
08:59
just from little segments of muscle
09:02
and leave others alone
09:04
that give us our up-down signals
09:06
and two others that will give us a hand open and close signal.
09:08
This was one of our first patients, Chris.
09:11
You see him with his original device
09:13
on the left there after eight months of use,
09:15
and on the right, it is two months.
09:17
He's about four or five times as fast
09:19
with this simple little performance metric.
09:22
All right.
09:25
So one of the best parts of my job
09:27
is working with really great patients
09:30
who are also our research collaborators.
09:32
And we're fortunate today
09:34
to have Amanda Kitts come and join us.
09:36
Please welcome Amanda Kitts.
09:38
(Applause)
09:40
So Amanda, would you please tell us how you lost your arm?
09:47
Amanda Kitts: Sure. In 2006, I had a car accident.
09:50
And I was driving home from work,
09:53
and a truck was coming the opposite direction,
09:56
came over into my lane,
09:58
ran over the top of my car and his axle tore my arm off.
10:00
Todd Kuiken: Okay, so after your amputation, you healed up.
10:04
And you've got one of these conventional arms.
10:07
Can you tell us how it worked?
10:09
AK: Well, it was a little difficult,
10:12
because all I had to work with was a bicep and a tricep.
10:14
So for the simple little things like picking something up,
10:16
I would have to bend my elbow,
10:19
and then I would have to cocontract
10:22
to get it to change modes.
10:24
When I did that,
10:26
I had to use my bicep
10:28
to get the hand to close,
10:31
use my tricep to get it to open,
10:33
cocontract again
10:35
to get the elbow to work again.
10:37
TK: So it was a little slow?
10:39
AK: A little slow, and it was just hard to work.
10:41
You had to concentrate a whole lot.
10:44
TK: Okay, so I think about nine months later
10:46
that you had the targeted reinnervation surgery,
10:49
took six more months to have all the reinnervation.
10:51
Then we fit her with a prosthesis.
10:54
And how did that work for you?
10:57
AK: It works good.
10:59
I was able to use my elbow
11:02
and my hand simultaneously.
11:06
I could work them just by my thoughts.
11:09
So I didn't have to do any of the cocontracting and all that.
11:11
TK: A little faster?
11:14
AK: A little faster. And much more easy, much more natural.
11:16
TK: Okay, this was my goal.
11:20
For 20 years, my goal was to let somebody
11:23
[be] able to use their elbow and hand in an intuitive way
11:26
and at the same time.
11:29
And we now have over 50 patients around the world who have had this surgery,
11:31
including over a dozen of our wounded warriors
11:34
in the U.S. armed services.
11:36
The success rate of the nerve transfers is very high.
11:38
It's like 96 percent.
11:41
Because we're putting a big fat nerve onto a little piece of muscle.
11:43
And it provides intuitive control.
11:46
Our functional testing, those little tests,
11:50
all show that they're a lot quicker and a lot easier.
11:52
And the most important thing
11:54
is our patients have appreciated it.
11:56
So that was all very exciting.
11:58
But we want to do better.
12:00
There's a lot of information in those nerve signals,
12:03
and we wanted to get more.
12:07
You can move each finger. You can move your thumb, your wrist.
12:09
Can we get more out of it?
12:12
So we did some experiments
12:14
where we saturated our poor patients with zillions of electrodes
12:16
and then had them try to do two dozen different tasks --
12:19
from wiggling a finger to moving a whole arm
12:22
to reaching for something --
12:25
and recorded this data.
12:27
And then we used some algorithms
12:29
that are a lot like speech recognition algorithms,
12:31
called pattern recognition.
12:33
See.
12:35
(Laughter)
12:37
And here you can see, on Jesse's chest,
12:39
when he just tried to do three different things,
12:41
you can see three different patterns.
12:43
But I can't put in an electrode
12:45
and say, "Go there."
12:47
So we collaborated with our colleagues in University of New Brunswick,
12:49
came up with this algorithm control,
12:52
which Amanda can now demonstrate.
12:54
AK: So I have the elbow that goes up and down.
12:56
I have the wrist rotation
13:01
that goes -- and it can go all the way around.
13:03
And I have the wrist flexion and extension.
13:06
And I also have the hand closed and open.
13:10
TK: Thank you, Amanda.
13:13
Now this is a research arm,
13:15
but it's made out of commercial components from here down
13:17
and a few that I've borrowed from around the world.
13:20
It's about seven pounds,
13:23
which is probably about what my arm would weigh
13:26
if I lost it right here.
13:28
Obviously, that's heavy for Amanda.
13:30
And in fact, it feels even heavier,
13:33
because it's not glued on the same.
13:35
She's carrying all the weight through harnesses.
13:37
So the exciting part isn't so much the mechatronics,
13:39
but the control.
13:42
So we've developed a small microcomputer
13:44
that is blinking somewhere behind her back
13:47
and is operating this
13:50
all by the way she trains it
13:52
to use her individual muscle signals.
13:54
So Amanda, when you first started using this arm,
13:56
how long did it take to use it?
13:58
AK: It took just about probably three to four hours
14:01
to get it to train.
14:03
I had to hook it up to a computer,
14:05
so I couldn't just train it anywhere.
14:07
So if it stopped working, I just had to take it off.
14:09
So now it's able to train
14:12
with just this little piece on the back.
14:14
I can wear it around.
14:16
If it stops working for some reason, I can retrain it.
14:18
Takes about a minute.
14:21
TK: So we're really excited,
14:23
because now we're getting to a clinically practical device.
14:25
And that's where our goal is --
14:28
to have something clinically pragmatic to wear.
14:30
We've also had Amanda able to use
14:34
some of our more advanced arms that I showed you earlier.
14:37
Here's Amanda using an arm made by DEKA Research Corporation.
14:41
And I believe Dean Kamen presented it at TED a few years ago.
14:44
So Amanda, you can see,
14:48
has really good control.
14:50
It's all the pattern recognition.
14:52
And it now has a hand that can do different grasps.
14:54
What we do is have the patient go all the way open
14:57
and think, "What hand grasp pattern do I want?"
15:00
It goes into that mode,
15:03
and then you can do up to five or six different hand grasps with this hand.
15:05
Amanda, how many were you able to do with the DEKA arm?
15:07
AK: I was able to get four.
15:10
I had the key grip, I had a chuck grip,
15:12
I had a power grasp
15:15
and I had a fine pinch.
15:17
But my favorite one was just when the hand was open,
15:19
because I work with kids,
15:21
and so all the time you're clapping and singing,
15:23
so I was able to do that again, which was really good.
15:26
TK: That hand's not so good for clapping.
15:29
AK: Can't clap with this one.
15:31
TK: All right. So that's exciting
15:33
on where we may go with the better mechatronics,
15:35
if we make them good enough
15:37
to put out on the market and use in a field trial.
15:39
I want you to watch closely.
15:42
(Video) Claudia: Oooooh!
15:44
TK: That's Claudia,
15:46
and that was the first time
15:48
she got to feel sensation through her prosthetic.
15:50
She had a little sensor at the end of her prosthesis
15:53
that then she rubbed over different surfaces,
15:56
and she could feel different textures
15:59
of sandpaper, different grits, ribbon cable,
16:01
as it pushed on her reinnervated hand skin.
16:04
She said that when she just ran it across the table,
16:07
it felt like her finger was rocking.
16:10
So that's an exciting laboratory experiment
16:12
on how to give back, potentially, some skin sensation.
16:14
But here's another video that shows some of our challenges.
16:17
This is Jesse, and he's squeezing a foam toy.
16:20
And the harder he squeezes -- you see a little black thing in the middle
16:23
that's pushing on his skin proportional to how hard he squeezes.
16:26
But look at all the electrodes around it.
16:29
I've got a real estate problem.
16:31
You're supposed to put a bunch of these things on there,
16:33
but our little motor's making all kinds of noise
16:35
right next to my electrodes.
16:38
So we're really challenged on what we're doing there.
16:40
The future is bright.
16:43
We're excited about where we are and a lot of things we want to do.
16:45
So for example,
16:48
one is to get rid of my real estate problem
16:50
and get better signals.
16:53
We want to develop these little tiny capsules
16:55
about the size of a piece of risotto
16:58
that we can put into the muscles
17:00
and telemeter out the EMG signals,
17:02
so that it's not worrying about electrode contact.
17:05
And we can have the real estate open
17:08
to try more sensation feedback.
17:10
We want to build a better arm.
17:12
This arm -- they're always made for the 50th percentile male --
17:14
which means they're too big for five-eighths of the world.
17:18
So rather than a super strong or super fast arm,
17:22
we're making an arm that is --
17:25
we're starting with,
17:27
the 25th percentile female --
17:29
that will have a hand that wraps around,
17:32
opens all the way,
17:34
two degrees of freedom in the wrist and an elbow.
17:36
So it'll be the smallest and lightest
17:39
and the smartest arm ever made.
17:41
Once we can do it that small,
17:43
it's a lot easier making them bigger.
17:45
So those are just some of our goals.
17:47
And we really appreciate you all being here today.
17:50
I'd like to tell you a little bit about the dark side,
17:54
with yesterday's theme.
17:56
So Amanda came jet-lagged,
17:58
she's using the arm,
18:00
and everything goes wrong.
18:02
There was a computer spook,
18:04
a broken wire,
18:06
a converter that sparked.
18:08
We took out a whole circuit in the hotel
18:10
and just about put on the fire alarm.
18:12
And none of those problems could I have dealt with,
18:14
but I have a really bright research team.
18:17
And thankfully Dr. Annie Simon was with us
18:19
and worked really hard yesterday to fix it.
18:22
That's science.
18:24
And fortunately, it worked today.
18:26
So thank you very much.
18:28
(Applause)
18:30

▲Back to top

About the Speaker:

Todd Kuiken - Biomedical engineer
A doctor and engineer, Todd Kuiken builds new prosthetics that connect with the human nervous system. Yes: bionics.

Why you should listen

As Dean Kamen said at TED2007, the design of the prosthetic arm hadn't really been updated since the Civil War -- basically "a stick and a hook." But at the Rehabilitation Institute of Chicago, physiatrist Todd Kuiken is building new arms and hands that are wired into the nervous system and can be controlled by the same impulses from the brain that once controlled flesh and blood.

Kuiken's training -- as both a physician and an engineer -- helps him see both sides of this complex problem. A technology called targeted muscle reinnervation uses nerves remaining after an amputation to control an artificial limb, linking brain impulses to a computer in the prosthesis that directs motors to move the limb. An unexpected effect in some patients: not only can they move their new limb, they can feel with it.

He  said: "From an engineering standpoint, this is the greatest challenge one can imagine: trying to restore the most incredible machine in the universe."

More profile about the speaker
Todd Kuiken | Speaker | TED.com