TED2012
Jared Ficklin: New ways to see music (with color! and fire!)
Jared Ficklin：看音新法（用色！用火！）
Filmed:
Readability: 4
711,217 views
设计师Jared Ficklin创造了新颖的视觉，通过颜色甚至是火（首次在ted舞台上展示），使得我们能够看得到音乐，用来分析我们对声音的感觉。他简单地举了滑板运动场的例子，展示给我们他是怎样分析那里的声音的。同时，他也告诉我们声音是怎样激发我们的创意的。
Jared Ficklin - Visualizer
In his day job, Jared Ficklin makes user interfaces at frog design. As a hobby, he explores what music looks like ... in light, in shapes, in fire. Full bio
In his day job, Jared Ficklin makes user interfaces at frog design. As a hobby, he explores what music looks like ... in light, in shapes, in fire. Full bio
Double-click the English transcript below to play the video.
00:16
My passions
0
449
1033
我的激情
00:17
are music, technology and making things.
1
1482
3689
就是来自于音乐,科技,以及创造东西
00:21
And it's the combination of these things
2
5171
3183
是所有这些东西的合体
00:24
that has led me to the hobby of sound visualization,
3
8354
2696
使我形成了一个令声音图像化的习惯
00:26
and, on occasion, has led me to play with fire.
4
11050
4078
而且时不时地还带我与火共舞
00:31
This is a Rubens' tube. It's one of many I've made over the years,
5
15128
2377
这是一个鲁本管,这是近几些年来我做的所有东西的其中一个
00:33
and I have one here tonight.
6
17505
1746
今天晚上呢我也带来了一个
00:35
It's about an 8-foot-long tube of metal,
7
19251
1525
这玩意儿大约是由8尺长的金属做成
00:36
it's got a hundred or so holes on top,
8
20776
1335
在它的顶部又有差不多一百个小洞
00:38
on that side is the speaker, and here
9
22111
1753
另一边是个话筒,这块儿
00:39
is some lab tubing, and it's connected to this tank
10
23864
2176
是一些实验用的管子,而且是和这个装满丙烷
00:41
of propane.
11
26040
1601
的容器连接的
00:44
So, let's fire it up and see what it does.
12
29087
3369
好吧,我们现在就把它点燃看看它会做些什么
00:53
So let's play a 550-herz frequency
13
37887
1891
嗯...我们先试试550赫兹的频率吧
00:55
and watch what happens.
14
39778
1515
看看效果会怎么样
00:57
(Frequency)
15
41342
8483
(频率)
01:05
Thank you. (Applause)
16
49825
2713
谢谢. (观众鼓掌)
01:08
It's okay to applaud the laws of physics,
17
52538
1988
我能理解你们为这一物理定律的鼓掌喝彩，
01:10
but essentially what's happening here
18
54526
1456
但是实际发生的是
01:11
-- (Laughter) --
19
55982
1760
(笑声)
01:13
is the energy from the sound via the air and gas molecules
20
57742
4008
通过空气和气体分子产生的声音的能量
01:17
is influencing the combustion properties of propane,
21
61750
2504
在影响丙烷的燃烧性质
01:20
creating a visible waveform,
22
64254
1904
因而创造出一个可视的波段
01:22
and we can see the alternating regions of compression
23
66158
2320
而且我们可以看到不同地区的波段
01:24
and rarefaction that we call frequency,
24
68478
2040
以及空气稀薄的地方我们把它叫频率
01:26
and the height is showing us amplitude.
25
70518
1744
高度告诉我们的是振幅
01:28
So let's change the frequency of the sound,
26
72262
2328
好吧.那让我们改变一下声音的频率
01:30
and watch what happens to the fire.
27
74590
1425
然后再看看火会发生什么变化
01:31
(Higher frequency)
28
76015
10130
{更高的频率)
01:42
So every time we hit a resonant frequency we get a standing wave
29
86145
3350
每回我释放一个共振的频率我们就会有一个驻波
01:45
and that emergent sine curve of fire.
30
89495
1700
以及那个正玄函数图像般的火焰就会出现
01:47
So let's turn that off. We're indoors.
31
91195
1578
好吧我们还是把这关了.我们在室内呢
01:48
Thank you. (Applause)
32
92773
5591
谢谢. (观众鼓掌)
01:54
I also have with me a flame table.
33
98364
2347
我今天还带来了一个火焰桌
01:56
It's very similar to a Rubens' tube, and it's also used
34
100711
1565
它跟鲁本管挺像的,而且它还是用做
01:58
for visualizing the physical properties of sound,
35
102276
2121
将声音的物理性质图像化
02:00
such as eigenmodes, so let's fire it up
36
104397
1968
比如说本微膜,那我们把它点燃吧
02:02
and see what it does.
37
106365
2250
然后看看会发生什么
02:08
Ooh. (Laughter)
38
112292
4468
喔~(笑声)
02:12
Okay. Now, while the table comes up to pressure,
39
116760
2974
好吧.现在,当这个桌子受到到压力
02:15
let me note here that the sound is not traveling
40
119734
1672
我想提醒一下声音不是以完美的直线在运动
02:17
in perfect lines. It's actually traveling in all directions,
41
121406
2746
实际上是在向各个方向去运动
02:20
and the Rubens' tube's a little like bisecting those waves
42
124152
3109
鲁本管有点像通过一条线二分了这些波段
02:23
with a line, and the flame table's a little like
43
127261
1996
而这个火焰桌有点像
02:25
bisecting those waves with a plane,
44
129257
1854
通过一个面二分了这些波段
02:27
and it can show a little more subtle complexity, which is why
45
131111
4000
它可以显示一些微妙的复杂性,这就是为啥
02:31
I like to use it to watch Geoff Farina play guitar.
46
135111
2353
我喜欢用它去看Geoff Farina弹吉他
02:33
(Music)
47
137464
42281
(音乐)
03:15
All right, so it's a delicate dance.
48
179745
1765
好吧,这是个轻妙的舞蹈
03:17
If you watch closely — (Applause)
49
181510
2545
如果你看的近一点--(观众鼓掌)
03:19
If you watch closely, you may have seen
50
184055
2767
如果你看近一点,你可以看到
03:22
some of the eigenmodes, but also you may have seen
51
186822
2472
一些本徵模,不过你还可以看到
03:25
that jazz music is better with fire.
52
189294
4617
爵士乐跟火焰搭配更好
03:29
Actually, a lot of things are better with fire in my world,
53
193911
2010
实际上,在我的世界里,好多东西一跟火焰搭配就更好
03:31
but the fire's just a foundation.
54
195921
2432
不过火焰只不过是个开始
03:34
It shows very well that eyes can hear,
55
198353
1148
它很明确告诉我们眼睛也具有听觉功能，
03:35
and this is interesting to me because
56
199501
1395
我对这个很感兴趣因为
03:36
technology allows us to present sound to the eyes
57
200896
2854
科技允许我们去用眼睛来感受声音
03:39
in ways that accentuate the strength of the eyes
58
203750
2863
从而加强我们眼睛的感受力度
03:42
for seeing sound, such as the removal of time.
59
206613
2697
通过看声音,比如时间的转移
03:45
So here, I'm using a rendering algorithm to paint
60
209310
3384
那么这里呢,我在用一个描写性的算法去画出
03:48
the frequencies of the song "Smells Like Teen Spirit"
61
212694
2463
歌曲"Smell Like Teen Spirit"的频率
03:51
in a way that the eyes can take them in
62
215157
2040
以一种简单的视觉效应，
03:53
as a single visual impression, and the technique
63
217197
2244
进入我们的眼帘，而且这种技术还可以给我们
03:55
will also show the strengths of the visual cortex
64
219441
1973
显示出来视觉皮质在模式观察方面
03:57
for pattern recognition.
65
221414
1616
的优点
03:58
So if I show you another song off this album,
66
223030
1879
如果我给你这首专辑里面另外一首歌,
04:00
and another, your eyes will easily pick out
67
224909
3481
再另外一首,你的眼睛会很轻松地看出
04:04
the use of repetition by the band Nirvana,
68
228390
2928
乐队Nirvana对于重复的使用
04:07
and in the frequency distribution, the colors,
69
231318
1857
通过频率分布和颜色方面也可以看出来，
04:09
you can see the clean-dirty-clean sound
70
233175
3048
你可以看到这个又干净又脏的声音
04:12
that they are famous for,
71
236223
1207
是什么使得它们有名的
04:13
and here is the entire album as a single visual impression,
72
237430
4000
这儿是一个以单独的视觉效应来代表整个专辑
04:17
and I think this impression is pretty powerful.
73
241430
1880
我认为这个效应十分的强大
04:19
At least, it's powerful enough that
74
243310
1714
至少,强大到
04:20
if I show you these four songs,
75
245024
1342
如果我给你看四首歌
04:22
and I remind you that this is "Smells Like Teen Spirit,"
76
246366
2441
而且我提醒你这首是"Smells Like Teen Spirit"
04:24
you can probably correctly guess, without listening
77
248807
2319
你应该能准确地猜到,在不听的情况下,
04:27
to any music at all, that the song
78
251126
1434
这首歌
04:28
a die hard Nirvana fan would enjoy is this song,
79
252560
2294
一定会被疯狂的Nirvana歌迷所享受
04:30
"I'll Stick Around" by the Foo Fighters,
80
254854
2256
Foo Fighters的歌曲"I'll Stick Around"
04:33
whose lead singer is Dave Grohl,
81
257110
2000
他们的主唱是Dave Grohl
04:35
who was the drummer in Nirvana.
82
259110
3778
他是Nirvana的鼓手
04:38
The songs are a little similar, but mostly
83
262888
1300
这些歌曲有点相似,不过大多数来讲
04:40
I'm just interested in the idea that someday maybe
84
264188
1626
我只不过对于有一天我们买这首歌因为它好看
04:41
we'll buy a song because we like the way it looks.
85
265814
4412
这个想法而非常感兴趣
04:46
All right, now for some more sound data.
86
270226
1100
好吧,现在是到一些声音数据的时候了
04:47
This is data from a skate park,
87
271326
2652
这是一个从州立公园的数据
04:49
and this is Mabel Davis skate park
88
273978
2032
这个是Mabel Davis滑冰公园
04:51
in Austin, Texas. (Skateboard sounds)
89
276010
2142
在德克萨斯州的奥斯丁.(滑板的响声)
04:54
And the sounds you're hearing came from eight
90
278152
1374
你听到的声音是从八个
04:55
microphones attached to obstacles around the park,
91
279526
2216
在公园附近障碍上附上的话筒中传来的
04:57
and it sounds like chaos, but actually
92
281742
2184
听起来有点混乱,不过实际上
04:59
all the tricks start with a very distinct slap,
93
283926
3347
这所有的戏法从一个明显拍击开始
05:03
but successful tricks end with a pop,
94
287273
1604
不过成功的戏法以砰然声结束
05:04
whereas unsuccessful tricks
95
288877
1793
不成功的戏法
05:06
more of a scratch and a tumble,
96
290670
1856
以更像是擦伤和绊倒的声音结束
05:08
and tricks on the rail will ring out like a gong, and
97
292526
4010
这些在杆子上的戏法会像锣声一样结束,
05:12
voices occupy very unique frequencies in the skate park.
98
296536
2790
这些声音在这个州立公园都有着独特的频率
05:15
So if we were to render these sounds visually,
99
299326
1938
不过我们要是想把这些声音视觉化的话,
05:17
we might end up with something like this.
100
301264
1407
我们应该得得到这样的东西
05:18
This is all 40 minutes of the recording,
101
302671
2456
这是40分钟的记录
05:21
and right away the algorithm tells us
102
305127
2160
算法立即就告诉我们
05:23
a lot more tricks are missed than are made,
103
307287
2073
失败的戏法要比成功的戏法要多
05:25
and also a trick on the rails is a lot more likely
104
309360
2335
而且在这些栏杆上的戏法更有可能去
05:27
to produce a cheer, and if you look really closely,
105
311695
2872
产生一些欢呼声,如果你非常仔细地看的话,
05:30
we can tease out traffic patterns.
106
314567
1733
我们可以发现关于交通的图案
05:32
You see the skaters often trick in this direction. The obstacles are easier.
107
316300
6087
你可以看到滑板者通常朝这个方向,这些障碍比较简单
05:38
And in the middle of the recording, the mics pick this up,
108
322387
1705
然后在这个记录的中间, 麦克风把这个记录了下来
05:39
but later in the recording, this kid shows up,
109
324092
2804
但是在这记录的后部分,这个家伙出现了,
05:42
and he starts using a line at the top of the park
110
326896
2928
他开始在公园顶部使用一条新的路线
05:45
to do some very advanced tricks on something
111
329824
1802
来表演一些高级的戏法
05:47
called the tall rail.
112
331626
1103
就在这些高摇杆上。
05:48
And it's fascinating. At this moment in time,
113
332729
1872
这非常的有意思.在这个时候,
05:50
all the rest of the skaters turn their lines 90 degrees
114
334601
3503
所有的滑板者都把他们的路线转了90度
05:54
to stay out of his way.
115
338104
1778
从而给他让开了路
05:55
You see, there's a subtle etiquette in the skate park,
116
339882
2543
你可以看到,在这个公园里有个约定俗成的礼仪
05:58
and it's led by key influencers,
117
342425
1600
是由颇具影响力的人带来的，
05:59
and they tend to be the kids who can do the best tricks,
118
344025
3248
他们能够做一些最好的戏法
06:03
or wear red pants, and on this day the mics picked that up.
119
347273
2430
或者穿红裤子,这边麦克风就记录了下来
06:05
All right, from skate physics to theoretical physics.
120
349703
3901
好吧,从滑板物理到理论物理,
06:09
I'm a big fan of Stephen Hawking,
121
353604
1616
我是霍金的大粉丝,
06:11
and I wanted to use all eight hours
122
355220
1336
我想用他在剑桥的八个小时的
06:12
of his Cambridge lecture series to create an homage.
123
356556
2587
讲座来表示我对他的敬意
06:15
Now, in this series he's speaking with the aid of a computer,
124
359143
3064
现在呢,在这段讲座里面,他的演讲是通过电脑助手完成的，
06:18
which actually makes identifying the ends of sentences
125
362207
3104
这样使得辨认句子末尾变得非常简单.
06:21
fairly easy. So I wrote a steering algorithm.
126
365311
3426
因此我写了个操作算法
06:24
It listens to the lecture, and then it uses
127
368737
1960
它一边听讲座,然后它利用
06:26
the amplitude of each word to move a point on the x-axis,
128
370697
2687
每个词的振幅去在X轴上来回移动
06:29
and it uses the inflection of sentences
129
373384
2633
它还利用句子之前的变调
06:31
to move a same point up and down on the y-axis.
130
376017
2154
从而在Y轴上上下移动
06:34
And these trend lines, you can see, there's more questions
131
378171
2774
然后这些指明趋势的线,你可以看到在物理世界中
06:36
than answers in the laws of physics,
132
380945
1870
问题显然比答案要多得多
06:38
and when we reach the end of a sentence,
133
382815
2033
当我们到达一个句子的末尾时,
06:40
we place a star at that location.
134
384848
2335
我们就在那个地方放一颗星星
06:43
So there's a lot of sentences, so a lot of stars,
135
387183
2800
所以呢有很多句子就会有很多星星
06:45
and after rendering all of the audio, this is what we get.
136
389983
2356
之后在放完所有的可听片段后,我们得到了这个
06:48
This is Stephen Hawking's universe.
137
392339
2929
这就是霍金的宇宙
06:51
(Applause)
138
395268
6937
(观众鼓掌)
06:58
It's all eight hours of the Cambridge lecture series
139
402205
2487
全部是在剑桥的八个小时的讲座
07:00
taken in as a single visual impression,
140
404692
1848
由一个单独的视觉效应来表达
07:02
and I really like this image,
141
406540
1757
我非常喜欢这个图片
07:04
but a lot of people think it's fake.
142
408297
1808
不过很多人认为它是假的
07:06
So I made a more interactive version,
143
410105
2344
因此呢我做了个有互动部分的版本
07:08
and the way I did that is I used their position in time
144
412449
5456
我是通过在演讲过程中适当的时间中，
07:13
in the lecture to place these stars into 3D space,
145
417905
2367
将这些星星放置在3D空间里，
07:16
and with some custom software and a Kinect,
146
420272
2401
伴随着一些个性化的软件和一个动作察觉器
07:18
I can walk right into the lecture.
147
422673
2663
我可以走进这个讲座
07:21
I'm going to wave through the Kinect here
148
425336
1800
我现在准备向这个察觉器挥手
07:23
and take control, and now I'm going to reach out
149
427136
1832
然后控制它,然后我们伸手去
07:24
and I'm going to touch a star, and when I do,
150
428968
3239
抓一颗星星,当我这样做的时候
07:28
it will play the sentence
151
432207
1944
它会放出这句话
07:30
that generated that star.
152
434151
1465
就从那个星星里面
07:31
Stephen Hawking: There is one, and only one, arrangement
153
435616
3816
霍金:这有一个,并且只有一个排列
07:35
in which the pieces make a complete picture.
154
439432
2799
在这个排列中,这些片段组成一个全体的图形
07:38
Jared Ficklin: Thank you. (Applause)
155
442231
4148
Jared Ficklin:谢谢 (观众鼓掌)
07:42
There are 1,400 stars.
156
446379
3173
这里面一共有1400颗星星
07:45
It's a really fun way to explore the lecture,
157
449552
1664
这是个很有意思的方式去探索这个讲座
07:47
and, I hope, a fitting homage.
158
451216
1467
并且我希望是一种合适的敬意
07:48
All right. Let me close with a work in progress.
159
452683
5472
好吧.让我用仍进程中的工作来结束这个演讲吧。
07:54
I think, after 30 years, the opportunity exists
160
458155
2983
我认为,30年后,我们有可能
07:57
to create an enhanced version of closed captioning.
161
461138
2104
去创造出字幕的一种改善版本
07:59
Now, we've all seen a lot of TEDTalks online,
162
463242
2119
我们现在在网上可以看到好多TED演讲
08:01
so let's watch one now with the sound turned off
163
465361
2927
因此呢让我们就不带声音去看一个吧
08:04
and the closed captioning turned on.
164
468288
3922
当然我们把字幕打开
08:08
There's no closed captioning for the TED theme song,
165
472210
2146
对于TED主题歌是没有字幕
08:10
and we're missing it, but if you've watched enough of these,
166
474356
2113
因此我们就错过了,不过你已经看得够多的了
08:12
you hear it in your mind's ear,
167
476469
1369
你可以在你心里面听到,
08:13
and then applause starts.
168
477838
2983
然后呢你就会鼓掌
08:16
It usually begins here, and it grows and then it falls.
169
480821
2190
通常是从这开始,然后成长,最后失败
08:18
Sometimes you get a little star applause,
170
483011
1977
有时候你会得到一个小星星的鼓掌
08:20
and then I think even Bill Gates takes a nervous breath,
171
484988
2486
然后我认为即使比尔盖茨也紧张地深吸一口气
08:23
and the talk begins.
172
487474
1690
然后开始讲话
08:25
All right, so let's watch this clip again.
173
489164
5698
好吧,那么就让我们在看一次这个
08:30
This time, I'm not going to talk at all.
174
494862
1256
这次,我不准备说话了
08:32
There's still going to be no audio,
175
496118
1367
依然是没有声音
08:33
but what I am going to do is I'm going to render the sound
176
497485
1904
不过这回我要做的是我准备去使得这个声音
08:35
visually in real time at the bottom of the screen.
177
499389
4316
变得图像化,就在屏幕的最底下
08:39
So watch closely and see what your eyes can hear.
178
503705
2791
因此呢,看仔细了然后看看你的眼睛能听到什么
09:03
This is fairly amazing to me.
179
527880
1880
这个对我来说非常神奇
09:05
Even on the first view, your eyes will successfully
180
529760
3333
即使看第一次,你的眼睛也会成功地
09:08
pick out patterns, but on repeated views,
181
533093
3088
看出一些图案,不过在重复看之后,
09:12
your brain actually gets better
182
536181
1689
你的脑子会对于把图案转化为信息
09:13
at turning these patterns into information.
183
537870
1656
的能力运用地越来越好
09:15
You can get the tone and the timbre
184
539526
1591
你可以感觉到说话人的语气和音色
09:17
and the pace of the speech,
185
541117
1223
以及演讲的速度
09:18
things that you can't get out of closed captioning.
186
542340
2064
一些你从字幕中得不到的东西
09:20
That famous scene in horror movies
187
544404
2184
在恐怖电影中的经典镜头,
09:22
where someone is walking up from behind
188
546588
2648
当有人从后面走来时
09:25
is something you can see,
189
549236
1960
变成了你可以看到的东西
09:27
and I believe this information would be something
190
551196
2704
因此我相信这个东西会成为
09:29
that is useful at times when the audio is turned off
191
553900
2803
一个有用的工具当声音被关掉的时候
09:32
or not heard at all, and I speculate that deaf audiences
192
556703
2941
或者根本无法听到的时候,我还猜测耳聋的观众
09:35
might actually even be better
193
559644
1177
会更擅长看声音
09:36
at seeing sound than hearing audiences.
194
560821
1781
而不是去听观众
09:38
I don't know. It's a theory right now.
195
562602
1498
我也不太清楚.目前为止只是个理论
09:40
Actually, it's all just an idea.
196
564100
1521
实际上,这只不过是个想法
09:41
And let me end by saying that sound moves in all directions,
197
565621
4191
因此在我结束前我说这样一句话吧:声音会向所有的方向移动
09:45
and so do ideas.
198
569812
1977
想法也会。
09:47
Thank you. (Applause)
199
571789
3112
谢谢 (观众鼓掌)
ABOUT THE SPEAKER
Jared Ficklin - VisualizerIn his day job, Jared Ficklin makes user interfaces at frog design. As a hobby, he explores what music looks like ... in light, in shapes, in fire.
Why you should listen
Jared Ficklin is a Senior Principal Design Technologist at frog, where he builds user experiences for clients, playing with interactions including touch and multi-touch, and applying physics to enhance the user experience. A passion for music and making things introduced him to the hobby of sound visualization, which has led him on occasion to play with fire. (As Flash on the Beach puts it, "Jared Ficklin’s sonic experiments stood out for their individuality, drama and casual disregard for health and safety.") Every March in Austin, Texas, Ficklin organizes the frog party, a collective social experiment for a few thousand people attending SXSW Interactive. It's a form of playful R&D for social technology. And he has spent 10 years helping fund, design and build quality free public skateparks for Austin as part of the Austin Public Skatepark Action Committee.
Jared Ficklin | Speaker | TED.com