TEDMED 2011
Charles Limb: Building the musical muscle
Filmed:
Readability: 3.7
718,820 views
Charles Limb performs cochlear implantation, a surgery that treats hearing loss and can restore the ability to hear speech. But as a musician too, Limb thinks about what the implants lack: They don't let you fully experience music yet. (There's a hair-raising example.) At TEDMED, Limb reviews the state of the art and the way forward.
Charles Limb - Researcher
Charles Limb is a doctor and a musician who researches the way musical creativity works in the brain. Full bio
Charles Limb is a doctor and a musician who researches the way musical creativity works in the brain. Full bio
Double-click the English transcript below to play the video.
00:15
Now when we think of our senses,
0
0
5000
00:20
we don't usually think of the reasons
1
5000
2000
00:22
why they probably evolved, from a biological perspective.
2
7000
2000
00:24
We don't really think of the evolutionary need
3
9000
3000
00:27
to be protected by our senses,
4
12000
2000
00:29
but that's probably why our senses really evolved --
5
14000
2000
00:31
to keep us safe, to allow us to live.
6
16000
3000
00:34
Really when we think of our senses,
7
19000
2000
00:36
or when we think of the loss of the sense,
8
21000
2000
00:38
we really think about something more like this:
9
23000
2000
00:40
the ability to touch something luxurious, to taste something delicious,
10
25000
3000
00:43
to smell something fragrant,
11
28000
2000
00:45
to see something beautiful.
12
30000
2000
00:47
This is what we want out of our senses.
13
32000
2000
00:49
We want beauty; we don't just want function.
14
34000
3000
00:52
And when it comes to sensory restoration,
15
37000
2000
00:54
we're still very far away from being able to provide beauty.
16
39000
3000
00:57
And that's what I'd like to talk to you a little bit about today.
17
42000
3000
01:00
Likewise for hearing.
18
45000
2000
01:02
When we think about why we hear,
19
47000
2000
01:04
we don't often think about the ability to hear an alarm or a siren,
20
49000
3000
01:07
although clearly that's an important thing.
21
52000
2000
01:09
Really what we want to hear is music.
22
54000
3000
01:12
(Music)
23
57000
15000
01:27
So many of you know that that's Beethoven's Seventh Symphony.
24
72000
2000
01:29
Many of you know that he was deaf, or near profoundly deaf,
25
74000
3000
01:32
when he wrote that.
26
77000
2000
01:34
Now I'd like to impress upon you
27
79000
2000
01:36
how unusual it is that we can hear music.
28
81000
3000
01:39
Music is just one of the strangest things that there is.
29
84000
3000
01:42
It's acoustic vibrations in the air,
30
87000
3000
01:45
little waves of energy in the air that tickle our eardrum.
31
90000
3000
01:48
Somehow in tickling our eardrum
32
93000
2000
01:50
that transmits energy down our hearing bones,
33
95000
2000
01:52
which get converted to a fluid impulse inside the cochlea
34
97000
3000
01:55
and then somehow converted into an electrical signal in our auditory nerves
35
100000
3000
01:58
that somehow wind up in our brains
36
103000
3000
02:01
as a perception of a song or a beautiful piece of music.
37
106000
3000
02:04
That process is entirely abstract and very, very unusual.
38
109000
3000
02:07
And we could discuss that topic alone for days
39
112000
3000
02:10
to really try to figure out, how is it that we hear something that's emotional
40
115000
4000
02:14
from something that starts out as a vibration in the air?
41
119000
3000
02:17
Turns out that if you have hearing loss,
42
122000
2000
02:19
most people that lose their hearing
43
124000
2000
02:21
lose it at what's called the cochlea, the inner ear.
44
126000
3000
02:24
And it's at the hair cell level that they do this.
45
129000
3000
02:27
Now if you had to pick a sense to lose,
46
132000
2000
02:29
I have to be very honest with you
47
134000
2000
02:31
and say, we're better at restoring hearing
48
136000
2000
02:33
than we are at restoring any sense that there is.
49
138000
2000
02:35
In fact, nothing even actually comes close
50
140000
2000
02:37
to our ability to restore hearing.
51
142000
2000
02:39
And as a physician and a surgeon, I can confidently tell my patients
52
144000
3000
02:42
that if you had to pick a sense to lose,
53
147000
2000
02:44
we are the furthest along medically and surgically with hearing.
54
149000
4000
02:48
As a musician, I can tell you
55
153000
2000
02:50
that if I had to have a cochlear implant,
56
155000
2000
02:52
I'd be heartbroken. I'd just be plainly heartbroken,
57
157000
2000
02:54
because I know that music would never sound the same to me.
58
159000
4000
02:58
Now this is a video that I'm going to show you
59
163000
3000
03:01
of a girl who's born deaf.
60
166000
2000
03:03
She's in a very supportive environment.
61
168000
2000
03:05
Her mother's doing everything she can.
62
170000
2000
03:07
Okay, play that video please.
63
172000
2000
03:09
(Video) Mother: That's an owl.
64
174000
2000
03:11
Owl, yeah.
65
176000
3000
03:18
Owl. Owl.
66
183000
3000
03:21
Yeah.
67
186000
2000
03:28
Baby. Baby.
68
193000
3000
03:31
You want it?
69
196000
3000
03:34
(Kiss)
70
199000
3000
03:37
Charles Limb: Now despite everything going for this child
71
202000
2000
03:39
in terms of family support
72
204000
2000
03:41
and simple infused learning,
73
206000
2000
03:43
there is a limitation to what a child who's deaf, an infant who was born deaf,
74
208000
3000
03:46
has in this world
75
211000
2000
03:48
in terms of social, educational, vocational opportunities.
76
213000
3000
03:51
I'm not saying that they can't live a beautiful, wonderful life.
77
216000
3000
03:54
I'm saying that they're going to face obstacles
78
219000
2000
03:56
that most people who have normal hearing will not have to face.
79
221000
3000
03:59
Now hearing loss and the treatment for hearing loss
80
224000
2000
04:01
has really evolved in the past 200 years.
81
226000
2000
04:03
I mean literally,
82
228000
2000
04:05
they used to do things like stick ear-shaped objects onto your ears
83
230000
3000
04:08
and stick funnels in.
84
233000
2000
04:10
And that was the best you could do for hearing loss.
85
235000
2000
04:12
Back then you couldn't even look at the eardrum.
86
237000
2000
04:14
So it's not too surprising
87
239000
2000
04:16
that there were no good treatments for hearing loss.
88
241000
2000
04:18
And now today we have the modern multi-channel cochlear implant,
89
243000
2000
04:20
which is an outpatient procedure.
90
245000
2000
04:22
It's surgically placed inside the inner ear.
91
247000
2000
04:24
It takes about an hour and a half to two hours, depending on where it's done,
92
249000
2000
04:26
under general anesthesia.
93
251000
2000
04:28
And in the end, you achieve something like this
94
253000
2000
04:30
where an electrode array is inserted inside the cochlea.
95
255000
3000
04:33
Now actually, this is quite crude
96
258000
2000
04:35
in comparison to our regular inner ear.
97
260000
2000
04:37
But here is that same girl who is implanted now.
98
262000
3000
04:40
This is her 10 years later.
99
265000
2000
04:42
And this is a video that was taken
100
267000
2000
04:44
by my surgical mentor, Dr. John Niparko, who implanted her.
101
269000
2000
04:46
If we could play this video please.
102
271000
2000
04:49
(Video) John Niparko: So you've written two books?
103
274000
2000
04:51
Girl: I have written two books. (Mother: Was the other one a book or a journal entry?)
104
276000
3000
04:54
Girl: No, the other one was a book. (Mother: Oh, okay.)
105
279000
3000
04:58
JN: Well this book has seven chapters,
106
283000
3000
05:01
and the last chapter
107
286000
3000
05:04
is entitled "The Good Things About Being Deaf."
108
289000
4000
05:08
Do you remember writing that chapter?
109
293000
3000
05:11
Girl: Yes I do. I remember writing every chapter.
110
296000
3000
05:14
JN: Yeah.
111
299000
2000
05:16
Girl: Well sometimes my sister can be kind of annoying.
112
301000
4000
05:20
So it comes in handy to not be annoyed by her.
113
305000
4000
05:24
JN: I see. And who is that?
114
309000
3000
05:27
Girl: Holly. (JN: Okay.)
115
312000
2000
05:29
Mother: Her sister. (JN: Her sister.) Girl: My sister.
116
314000
2000
05:31
JN: And how can you avoid being annoyed by her?
117
316000
3000
05:34
Girl: I just take off my CI, and I don't hear anything.
118
319000
3000
05:37
(Laughter)
119
322000
2000
05:39
It comes in handy.
120
324000
2000
05:41
JN: So you don't want to hear everything that's out there?
121
326000
3000
05:44
Girl: No.
122
329000
2000
05:46
CL: And so she's phenomenal.
123
331000
2000
05:48
And there's no way that you can't look at that as an overwhelming success.
124
333000
3000
05:51
It is. It's a huge success story in modern medicine.
125
336000
3000
05:54
However, despite this incredible facility
126
339000
3000
05:57
that some cochlear implant users display with language,
127
342000
2000
05:59
you turn on the radio and all of a sudden they can't hear music almost at all.
128
344000
4000
06:03
In fact, most implant users really struggle
129
348000
2000
06:05
and dislike music because it sounds so bad.
130
350000
3000
06:08
And so when it comes to this idea
131
353000
2000
06:10
of restoring beauty to somebody's life,
132
355000
2000
06:12
we have a long way to go when it comes to audition.
133
357000
2000
06:14
Now there are a lot of reasons for that.
134
359000
2000
06:16
I mentioned earlier the fact
135
361000
2000
06:18
that music is a different capacity because it's abstract.
136
363000
2000
06:20
Language is very different. Language is very precise.
137
365000
2000
06:22
In fact, the whole reason we use it
138
367000
2000
06:24
is because it has semantic-specificity.
139
369000
2000
06:26
When you say a word,
140
371000
2000
06:28
what you care is that word was perceived correctly.
141
373000
2000
06:30
You don't care that the word sounded pretty
142
375000
2000
06:32
when it was spoken.
143
377000
2000
06:34
Music is entirely different.
144
379000
2000
06:36
When you hear music, if it doesn't sound good, what's the point?
145
381000
2000
06:38
There's really very little point in listening to music
146
383000
2000
06:40
when it doesn't sound good to you.
147
385000
2000
06:42
The acoustics of music are much harder than those of language.
148
387000
3000
06:45
And you can see on this figure,
149
390000
2000
06:47
that the frequency range
150
392000
2000
06:49
and the decibel range, the dynamic range of music
151
394000
2000
06:51
is far more heterogeneous.
152
396000
2000
06:53
So if we had to design a perfect cochlear implant,
153
398000
2000
06:55
what we would try to do
154
400000
2000
06:57
is target it to be able to allow music transmission.
155
402000
3000
07:00
Because I always view music as the pinnacle of hearing.
156
405000
3000
07:03
If you can hear music,
157
408000
2000
07:05
you should be able to hear anything.
158
410000
2000
07:07
Now the problems begin first with pitch perception.
159
412000
3000
07:10
I mean, most of us know that pitch is a fundamental building block of music.
160
415000
3000
07:13
And without the ability to perceive pitch well,
161
418000
2000
07:15
music and melody is a very difficult thing to do --
162
420000
3000
07:18
forget about a harmony and things like that.
163
423000
2000
07:20
Now this is a MIDI arrangement of Rachmaninoff's Prelude.
164
425000
3000
07:23
Now if we could just play this.
165
428000
2000
07:25
(Music)
166
430000
24000
07:49
Okay, now if we consider
167
454000
3000
07:52
that in a cochlear implant patient
168
457000
2000
07:54
pitch perception could be off as much as two octaves,
169
459000
3000
07:57
let's see what happens here
170
462000
2000
07:59
when we randomize this to within one semitone.
171
464000
2000
08:01
We would be thrilled if we had one semitone pitch perception in cochlear implant users.
172
466000
3000
08:04
Go ahead and play this one.
173
469000
2000
08:06
(Music)
174
471000
23000
08:29
Now my goal in showing you that
175
494000
2000
08:31
is to show you that music is not robust to degradation.
176
496000
2000
08:33
You distort it a little bit, especially in terms of pitch, and you've changed it.
177
498000
4000
08:37
And it might be that you kind of like that.
178
502000
2000
08:39
That's kind of hypnotic.
179
504000
2000
08:41
But it certainly wasn't the way the music was intended.
180
506000
2000
08:43
And you're not hearing the same thing
181
508000
2000
08:45
that most people who have normal hearing are hearing.
182
510000
2000
08:47
Now the other issue comes with,
183
512000
2000
08:49
not just the ability to tell pitches apart,
184
514000
2000
08:51
but the ability to tell sounds apart.
185
516000
2000
08:53
Most cochlear implant users cannot tell the difference between an instrument.
186
518000
3000
08:56
If we could play these two sound clips in succession.
187
521000
2000
08:58
(Trumpet)
188
523000
2000
09:00
The trumpet.
189
525000
2000
09:02
And the second one.
190
527000
2000
09:04
(Violin)
191
529000
1000
09:05
That's a violin.
192
530000
2000
09:07
These have similar wave forms. They're both sustained instruments.
193
532000
2000
09:09
Cochlear implant users cannot tell the difference
194
534000
2000
09:11
between these instruments.
195
536000
2000
09:13
The sound quality, or the sound of the sound
196
538000
2000
09:15
is how I like to describe timbre, tone color --
197
540000
2000
09:17
they cannot tell these things whatsoever.
198
542000
2000
09:19
This implant is not transmitting
199
544000
3000
09:22
the quality of music that usually provides things like warmth.
200
547000
3000
09:25
Now if you look at the brain of an individual who has a cochlear implant
201
550000
3000
09:28
and you have them listen to speech,
202
553000
2000
09:30
have them listen to rhythm and have them listen to melody,
203
555000
2000
09:32
what you find is that the auditory cortex
204
557000
2000
09:34
is the most active during speech.
205
559000
2000
09:36
You would think that because these implants are optimized for speech,
206
561000
2000
09:38
they were designed for speech.
207
563000
2000
09:40
But actually if you look at melody,
208
565000
2000
09:42
what you find is that there's very little cortical activity
209
567000
2000
09:44
in implant users compared with normal hearing controls.
210
569000
3000
09:47
So for whatever reason,
211
572000
2000
09:49
this implant is not successfully stimulating auditory cortices
212
574000
3000
09:52
during melody perception.
213
577000
3000
09:55
Now the next question is,
214
580000
2000
09:57
well how does it really sound?
215
582000
2000
09:59
Now we've been doing some studies
216
584000
2000
10:01
to really get a sense of what sound quality is like for these implant users.
217
586000
3000
10:04
I'm going to play you two clips of Usher,
218
589000
2000
10:06
one which is normal
219
591000
2000
10:08
and one which has almost no high frequencies, almost no low frequencies
220
593000
2000
10:10
and not even that many mid frequencies.
221
595000
2000
10:12
Go ahead and play that.
222
597000
2000
10:14
(Music)
223
599000
4000
10:18
(Limited Frequency Music)
224
603000
6000
10:24
I had patients tell me that those sound the same.
225
609000
3000
10:27
They cannot differentiate sound quality differences
226
612000
3000
10:30
between those two clips.
227
615000
2000
10:32
Again, we are very, very far away in just getting to where we want to get to.
228
617000
3000
10:35
Now the question comes to mind: Is there any hope?
229
620000
3000
10:38
And yes, there is hope.
230
623000
2000
10:40
Now I don't know if anybody knows who this is.
231
625000
2000
10:42
This is ... does somebody know?
232
627000
2000
10:44
This is Beethoven.
233
629000
3000
10:47
Now why would we know what Beethoven's skull looks like?
234
632000
3000
10:50
Because his grave was exhumed.
235
635000
2000
10:52
And it turns out that his temporal bones were harvested when he died
236
637000
3000
10:55
to try to look at the cause of his deafness,
237
640000
2000
10:57
which is why he has molding clay
238
642000
2000
10:59
and his skull is bulging out on the side there.
239
644000
2000
11:01
But Beethoven composed music
240
646000
2000
11:03
long after he lost his hearing.
241
648000
2000
11:05
What that suggests is that, even in the case of hearing loss,
242
650000
3000
11:08
the capacity for music remains.
243
653000
2000
11:10
The brains remain hardwired for music.
244
655000
4000
11:14
I've been very lucky to work with Dr. David Ryugo
245
659000
2000
11:16
where I've been working on deaf cats that are white
246
661000
3000
11:19
and trying to figure out what happens when we give them cochlear implants.
247
664000
3000
11:22
This is a cat that's been trained to respond to a trumpet for food.
248
667000
4000
11:27
(Music)
249
672000
12000
11:41
Text: Beethoven doesn't excite her.
250
686000
2000
11:44
(Music)
251
689000
11000
11:56
The "1812 Overture" isn't worth waking for.
252
701000
2000
12:01
(Trumpet)
253
706000
9000
12:11
But she jumps to action when called to duty!
254
716000
3000
12:14
(Trumpet)
255
719000
4000
12:18
CL: Now I'm not suggesting
256
723000
2000
12:20
that the cat is hearing that trumpet the way we're hearing it.
257
725000
3000
12:23
I'm suggesting that with training
258
728000
2000
12:25
you can imbue a musical sound with significance,
259
730000
3000
12:28
even in a cat.
260
733000
2000
12:30
If we were to direct efforts
261
735000
2000
12:32
towards training cochlear implant users to hear music --
262
737000
3000
12:35
because right now there's virtually no effort put towards that,
263
740000
3000
12:38
no rehabilitative strategies,
264
743000
2000
12:40
very little in the way of technological advances to actually improve music --
265
745000
3000
12:43
we would come a long way.
266
748000
2000
12:45
Now I want to show you one last video.
267
750000
3000
12:48
And this is of a student of mine named Joseph
268
753000
2000
12:50
who I had the good fortune to work with for three years in my lab.
269
755000
3000
12:53
He's deaf, and he learned to play the piano
270
758000
3000
12:56
after he received the cochlear implant.
271
761000
2000
12:58
And here's a video of Joseph.
272
763000
3000
13:01
(Music)
273
766000
14000
13:45
(Video) Joseph: I was born in 1986.
274
810000
3000
13:48
And at about four months old,
275
813000
2000
13:50
I was diagnosed with profoundly severe hearing loss.
276
815000
2000
13:52
Not long after,
277
817000
2000
13:54
I was fitted with hearing aids.
278
819000
2000
13:56
But although these hearing aids
279
821000
2000
13:58
were the most powerful hearing aids on the market at the time,
280
823000
2000
14:00
they weren't very helpful.
281
825000
2000
14:02
So as a result, I had to rely on lip reading a lot,
282
827000
5000
14:07
and I couldn't really hear what people were saying.
283
832000
2000
14:09
When I was 12 years old,
284
834000
2000
14:11
I was one of the first few people in Singapore
285
836000
3000
14:14
who underwent cochlear implantation.
286
839000
3000
14:17
And not long after I got my cochlear implant,
287
842000
4000
14:21
I started learning how to play piano.
288
846000
2000
14:23
And it was absolutely wonderful.
289
848000
2000
14:25
Since then, I've never looked back.
290
850000
2000
14:27
CL: Joseph is phenomenal. He's brilliant.
291
852000
2000
14:29
He is now a medical student at Yale University,
292
854000
2000
14:31
and he's contemplating a surgical career --
293
856000
2000
14:33
one of the first deaf individuals to consider a career in surgery.
294
858000
3000
14:36
There are almost no deaf surgeons anywhere.
295
861000
3000
14:39
And this is really unheard of stuff, and this is all because of this technology.
296
864000
3000
14:42
And the fact that he can play the piano like that
297
867000
2000
14:44
is a testament to his brain.
298
869000
2000
14:46
Truth of the matter is you can play the piano without a cochlear implant,
299
871000
3000
14:49
because all you have to do is press the keys at the right time.
300
874000
2000
14:51
You don't actually have to hear it.
301
876000
2000
14:53
I know he doesn't hear well, because I've heard him do Karaoke.
302
878000
3000
14:56
(Laughter)
303
881000
2000
14:58
And it's one of the most awful things --
304
883000
3000
15:01
heartwarming, but awful.
305
886000
2000
15:03
(Laughter)
306
888000
2000
15:05
And so there is certainly a lot of hope,
307
890000
2000
15:07
but there's a lot more that needs to be done.
308
892000
2000
15:09
So I just want to conclude with the following words.
309
894000
2000
15:11
When it comes to restoration of hearing,
310
896000
2000
15:13
we have certainly come a long way, a remarkably long way.
311
898000
3000
15:16
And we have a much longer way to go
312
901000
3000
15:19
when it comes to the idea of restoring perfect hearing.
313
904000
2000
15:21
And let me tell you right now,
314
906000
2000
15:23
it's fine that we would all be very happy with speech.
315
908000
2000
15:25
But I tell you, if we lost our hearing,
316
910000
2000
15:27
if anyone here suddenly lost your hearing,
317
912000
2000
15:29
you would want perfect hearing back.
318
914000
2000
15:31
You wouldn't want decent hearing, you would want perfect hearing.
319
916000
3000
15:34
Restoration of basic sensory function is critical.
320
919000
3000
15:37
And I don't mean to understate
321
922000
2000
15:39
how important it is to restore basic function.
322
924000
2000
15:41
But it's really restoration of the ability to perceive beauty
323
926000
3000
15:44
where we can get inspiring.
324
929000
2000
15:46
And I don't think that we should give up on beauty.
325
931000
2000
15:48
And I want to thank you for your time.
326
933000
2000
15:50
(Applause)
327
935000
3000
ABOUT THE SPEAKER
Charles Limb - ResearcherCharles Limb is a doctor and a musician who researches the way musical creativity works in the brain.
Why you should listen
Charles Limb is the Francis A. Sooy, MD Professor and Chief of Otology/Neurotology and Skull Base Surgery at the University of California, San Francisco, and he's a Faculty Member at the Peabody Conservatory of Music. He combines his two passions to study the way the brain creates and perceives music. He's a hearing specialist and surgeon at Johns Hopkins who performs cochlear implantations on patients who have lost their hearing. And he plays sax, piano and bass.
In search of a better understanding of how the mind perceives complex auditory stimuli such as music, he's been working with Allen Braun to look at the brains of improvising musicians and study what parts of the brain are involved in the kind of deep creativity that happens when a musician is really in the groove.
Read our Q&A about hip-hop studies with Charles Limb on the TED Blog >>
Plus our quick catchup Q&A at TEDMED 2011 -- including his top 5 songs of all time >>
Read the 2014 paper "Neural Substrates of Interactive Musical Improvisation: An fMRI Study of ‘Trading Fours’ in Jazz" >>
Charles Limb | Speaker | TED.com