TED2012
Jared Ficklin: New ways to see music (with color! and fire!)
Jared Ficklin: Novi načini da se glazba vidi (u boji! s vatrom!)
Filmed:
Readability: 4
711,217 views
Dizajner Jared Ficklin kreira divlje vizualizacije koje nam dozvoljavaju da vidimo glazbu, koristeći boje i vatru (prvi put na TED pozornici) kako bi analizirao kako se osjećamo zbog zvuka. On radi kratku digresiju kako bi analizirao zvukove skate parka -- i kako nas zvuk može voditi ka razvitku naše kreativnosti.
Jared Ficklin - Visualizer
In his day job, Jared Ficklin makes user interfaces at frog design. As a hobby, he explores what music looks like ... in light, in shapes, in fire. Full bio
In his day job, Jared Ficklin makes user interfaces at frog design. As a hobby, he explores what music looks like ... in light, in shapes, in fire. Full bio
Double-click the English transcript below to play the video.
00:16
My passions
0
449
1033
Moje strasti
00:17
are music, technology and making things.
1
1482
3689
su glazba, tehnologija i pravljenje stvari.
00:21
And it's the combination of these things
2
5171
3183
I kombinacija ovih stvari
00:24
that has led me to the hobby of sound visualization,
3
8354
2696
dovela me je do hobija vizualizacije zvuka,
00:26
and, on occasion, has led me to play with fire.
4
11050
4078
i, ponekad, dovelo me da se igram s vatrom.
00:31
This is a Rubens' tube. It's one of many I've made over the years,
5
15128
2377
Ovo je Rubenova cijev. To je jedna od mnogih koje sam napravio s godinama
00:33
and I have one here tonight.
6
17505
1746
i imam jednu ovdje večeras.
00:35
It's about an 8-foot-long tube of metal,
7
19251
1525
To je cijev od metala duga 8 stopa,
00:36
it's got a hundred or so holes on top,
8
20776
1335
ima stotinu ili više rupa na vrhu,
00:38
on that side is the speaker, and here
9
22111
1753
i sa strane je zvučnik, i ovdje
00:39
is some lab tubing, and it's connected to this tank
10
23864
2176
imamo cijevi iz laboratorija, povezanih s ovim spremnikom
00:41
of propane.
11
26040
1601
propana.
00:44
So, let's fire it up and see what it does.
12
29087
3369
Pa, upalimo ga da vidimo što radi.
00:53
So let's play a 550-herz frequency
13
37887
1891
Zasvirajmo frekvenciju od 550 herca
00:55
and watch what happens.
14
39778
1515
i pogledajmo što se događa.
00:57
(Frequency)
15
41342
8483
(Frekvencija)
01:05
Thank you. (Applause)
16
49825
2713
Hvala vam. (Pljesak)
01:08
It's okay to applaud the laws of physics,
17
52538
1988
U redu je zapljeskati zakonima fizike,
01:10
but essentially what's happening here
18
54526
1456
ali ono što se zapravo događa
01:11
-- (Laughter) --
19
55982
1760
-- (Smijeh) --
01:13
is the energy from the sound via the air and gas molecules
20
57742
4008
je da energija iz zvuka putem molekula zraka i plina
01:17
is influencing the combustion properties of propane,
21
61750
2504
utječe na zapaljiva svojstva propana,
01:20
creating a visible waveform,
22
64254
1904
stvarajući vidljiv oblik valova,
01:22
and we can see the alternating regions of compression
23
66158
2320
i možemo vidjeti izmjenjujuća područja kompresije
01:24
and rarefaction that we call frequency,
24
68478
2040
i frekvenciju,
01:26
and the height is showing us amplitude.
25
70518
1744
i visinu koja nam pokazuje amplitudu.
01:28
So let's change the frequency of the sound,
26
72262
2328
Dakle, promijenimo frekvenciju zvuka,
01:30
and watch what happens to the fire.
27
74590
1425
i pogledajmo što se događa s vatrom.
01:31
(Higher frequency)
28
76015
10130
(Viša frekvencija)
01:42
So every time we hit a resonant frequency we get a standing wave
29
86145
3350
Tako kad god pogodimo rezonantnu frekvenciju dobijemo stojeći val
01:45
and that emergent sine curve of fire.
30
89495
1700
i tu uzlaznu krivulju vatre.
01:47
So let's turn that off. We're indoors.
31
91195
1578
Isključimo sad to. Nalazimo se unutra.
01:48
Thank you. (Applause)
32
92773
5591
Hvala vam. (Pljesak)
01:54
I also have with me a flame table.
33
98364
2347
Također imam sa sobom i vatreni stol.
01:56
It's very similar to a Rubens' tube, and it's also used
34
100711
1565
Vrlo je sličan Rubensovoj cijevi, i također je rabljen
01:58
for visualizing the physical properties of sound,
35
102276
2121
za vizualizaciju fizičkih osobnosti zvuka,
02:00
such as eigenmodes, so let's fire it up
36
104397
1968
pa upalimo ga
02:02
and see what it does.
37
106365
2250
i vidimo što radi.
02:08
Ooh. (Laughter)
38
112292
4468
Ooh. (Smijeh)
02:12
Okay. Now, while the table comes up to pressure,
39
116760
2974
Okej. Sad, dok stol dolazi do pritiska,
02:15
let me note here that the sound is not traveling
40
119734
1672
samo da napomenem kako zvuk ne putuje
02:17
in perfect lines. It's actually traveling in all directions,
41
121406
2746
u savršenim linijama. On zapravo putuje u svim smjerovima,
02:20
and the Rubens' tube's a little like bisecting those waves
42
124152
3109
i rubensova "cijev" radi disekciju tih valova
02:23
with a line, and the flame table's a little like
43
127261
1996
linijom, a vatreni stol
02:25
bisecting those waves with a plane,
44
129257
1854
radi disekciju tih valova po ravnini,
02:27
and it can show a little more subtle complexity, which is why
45
131111
4000
i može nam pokazati malo suptilne složenosti, zašto
02:31
I like to use it to watch Geoff Farina play guitar.
46
135111
2353
volim koristiti to kako bih gledao Geoff Farinu kako svira gitaru.
02:33
(Music)
47
137464
42281
(Glazba)
03:15
All right, so it's a delicate dance.
48
179745
1765
Dakle, to je složen ples.
03:17
If you watch closely — (Applause)
49
181510
2545
Ako gledate pažljivo --- (Pljesak)
03:19
If you watch closely, you may have seen
50
184055
2767
ako gledate pažljivo, možda ste vidjeli
03:22
some of the eigenmodes, but also you may have seen
51
186822
2472
neke od eigenmodova, ali možda ste vidjeli i to
03:25
that jazz music is better with fire.
52
189294
4617
da je jazz glazba bolja s vatrom.
03:29
Actually, a lot of things are better with fire in my world,
53
193911
2010
Zapravo, puno stvari je bolje s vatrom u mom svijetu,
03:31
but the fire's just a foundation.
54
195921
2432
ali vatra je samo osnova.
03:34
It shows very well that eyes can hear,
55
198353
1148
Pokazuje vrlo dobro da oči mogu čuti,
03:35
and this is interesting to me because
56
199501
1395
i ovo je meni zanimljivo zato što
03:36
technology allows us to present sound to the eyes
57
200896
2854
nam tehnologija dozvoljava da predstavimo zvuk očima
03:39
in ways that accentuate the strength of the eyes
58
203750
2863
na način koji naglašava snagu očiju
03:42
for seeing sound, such as the removal of time.
59
206613
2697
kako bi vidjele zvuk, kao što je izmicanje vremena.
03:45
So here, I'm using a rendering algorithm to paint
60
209310
3384
Dakle, ovdje koristimo algoritam kako bismo naslikali
03:48
the frequencies of the song "Smells Like Teen Spirit"
61
212694
2463
frekvencije pjesme "Smells Like Teen Spirit"
03:51
in a way that the eyes can take them in
62
215157
2040
na način na koji ga oči mogu primiti
03:53
as a single visual impression, and the technique
63
217197
2244
kao jednu vizualnu impresiju, i tehnika
03:55
will also show the strengths of the visual cortex
64
219441
1973
će također pokazati snage vizualnog korteksa
03:57
for pattern recognition.
65
221414
1616
za prepoznavanje uzoraka.
03:58
So if I show you another song off this album,
66
223030
1879
Pa ako vam pokažem još jednu pjesmu s ovog albuma,
04:00
and another, your eyes will easily pick out
67
224909
3481
i još jednu, vaše oći će lako moći razabrati
04:04
the use of repetition by the band Nirvana,
68
228390
2928
korištenje ponavljanja od strane Nirvane,
04:07
and in the frequency distribution, the colors,
69
231318
1857
i u distribuciji frekvencija, u bojama,
04:09
you can see the clean-dirty-clean sound
70
233175
3048
možete vidjeti čisti-prljavi-čisti zvuk
04:12
that they are famous for,
71
236223
1207
po kojem su poznati,
04:13
and here is the entire album as a single visual impression,
72
237430
4000
i ovdje je cijeli album kao jedna vizualna impresija,
04:17
and I think this impression is pretty powerful.
73
241430
1880
i mislim da je ova impresija vrlo moćna.
04:19
At least, it's powerful enough that
74
243310
1714
Barem, dovoljno je jaka kako bi
04:20
if I show you these four songs,
75
245024
1342
ako vam pokažem ove četiri pjesme,
04:22
and I remind you that this is "Smells Like Teen Spirit,"
76
246366
2441
i podsjetim vas da je ovo "Smells Like Teen Spirit,"
04:24
you can probably correctly guess, without listening
77
248807
2319
možete vrlo vjerojatno točno pogoditi, bez slušanja
04:27
to any music at all, that the song
78
251126
1434
glazbe, da će pjesma
04:28
a die hard Nirvana fan would enjoy is this song,
79
252560
2294
u kojoj će uživati pravi fanovi Nirvane je ova pjesma,
04:30
"I'll Stick Around" by the Foo Fighters,
80
254854
2256
"I'll Stick Around" od Foo Fightersa,
04:33
whose lead singer is Dave Grohl,
81
257110
2000
čiji je pjevač Dave Grohl,
04:35
who was the drummer in Nirvana.
82
259110
3778
koji je bio bubnjar u Nirvani.
04:38
The songs are a little similar, but mostly
83
262888
1300
Pjesme su pomalo slične, ali najviše
04:40
I'm just interested in the idea that someday maybe
84
264188
1626
me zanima ideja da ćemo jednog dana možda
04:41
we'll buy a song because we like the way it looks.
85
265814
4412
moći kupiti pjesmu jer nam se sviđa kako izgleda.
04:46
All right, now for some more sound data.
86
270226
1100
U redu, pogledajte sada malo više zvukovnih podataka.
04:47
This is data from a skate park,
87
271326
2652
Ovo je podatak iz skate parka,
04:49
and this is Mabel Davis skate park
88
273978
2032
i ovo je Mabel Davis skate park
04:51
in Austin, Texas. (Skateboard sounds)
89
276010
2142
u Austinu, Texas. (Zvuk skejta)
04:54
And the sounds you're hearing came from eight
90
278152
1374
I zvukovi koje čujete dolaze iz osam
04:55
microphones attached to obstacles around the park,
91
279526
2216
mikrofona spojenih na rampe po parku,
04:57
and it sounds like chaos, but actually
92
281742
2184
i zvuči kao kaos, ali zapravo
04:59
all the tricks start with a very distinct slap,
93
283926
3347
trikovi počinju sa vrlo određenim udarcem,
05:03
but successful tricks end with a pop,
94
287273
1604
ali uspješni trikovi završavaju s pucketanjem,
05:04
whereas unsuccessful tricks
95
288877
1793
gdje neuspješni trikovi
05:06
more of a scratch and a tumble,
96
290670
1856
završe sa grebanjem i udaranjem,
05:08
and tricks on the rail will ring out like a gong, and
97
292526
4010
dok trikovi na šipci zvone kao gong, i
05:12
voices occupy very unique frequencies in the skate park.
98
296536
2790
glasovi su na jedinstvenoj frekvenciji u skate parku.
05:15
So if we were to render these sounds visually,
99
299326
1938
Pa ako bismo vizualno prikazali ove zvukove,
05:17
we might end up with something like this.
100
301264
1407
možda ćemo završiti s nečim kao što je ovo.
05:18
This is all 40 minutes of the recording,
101
302671
2456
Ovo je svih 40 minuta snimke,
05:21
and right away the algorithm tells us
102
305127
2160
i odmah nam algoritam govori
05:23
a lot more tricks are missed than are made,
103
307287
2073
da ima više neuspjelih nego uspjelih trikova,
05:25
and also a trick on the rails is a lot more likely
104
309360
2335
i da će trik na šipci vrlo vjerojatno
05:27
to produce a cheer, and if you look really closely,
105
311695
2872
izazvati poklike, i ako pogledate pažljivo,
05:30
we can tease out traffic patterns.
106
314567
1733
možemo izvući uzorke prometa.
05:32
You see the skaters often trick in this direction. The obstacles are easier.
107
316300
6087
Vidite, skejteri često rade trikove u tom smjeru. Rampe su lakše.
05:38
And in the middle of the recording, the mics pick this up,
108
322387
1705
I usred snimanja, mikrofoni pokupe ovo,
05:39
but later in the recording, this kid shows up,
109
324092
2804
ali kasnije u snimci, ovaj klinac se pojavi,
05:42
and he starts using a line at the top of the park
110
326896
2928
i počinje koristiti smjer na vrhu parka
05:45
to do some very advanced tricks on something
111
329824
1802
kako bi napravio neke napredne trikove na nečem
05:47
called the tall rail.
112
331626
1103
što se zove visoka šipka.
05:48
And it's fascinating. At this moment in time,
113
332729
1872
I to je fascinantno. U ovom trenutku u vremenu,
05:50
all the rest of the skaters turn their lines 90 degrees
114
334601
3503
svi ostali skejteri okreću svoj smjer kretanja za 90 stupnjeva
05:54
to stay out of his way.
115
338104
1778
kako bi mu se maknuli s puta.
05:55
You see, there's a subtle etiquette in the skate park,
116
339882
2543
Vidite, postoji suptilna pristojnost u parku,
05:58
and it's led by key influencers,
117
342425
1600
i vode ju glavni nositelji utjecaja,
05:59
and they tend to be the kids who can do the best tricks,
118
344025
3248
i to su najčešće djeca koja mogu raditi najbolje trikove,
06:03
or wear red pants, and on this day the mics picked that up.
119
347273
2430
ili nose crvene hlače, i ovog dana mikrofoni su to primjetili.
06:05
All right, from skate physics to theoretical physics.
120
349703
3901
Od fizike skejta do teoretske fizike.
06:09
I'm a big fan of Stephen Hawking,
121
353604
1616
Ja sam veliki fan Stephen Hawkinga,
06:11
and I wanted to use all eight hours
122
355220
1336
i htio sam iskoristiti svih osam sati
06:12
of his Cambridge lecture series to create an homage.
123
356556
2587
njegovog predavanja na Cambridgeu kako bih stvorio posvetu.
06:15
Now, in this series he's speaking with the aid of a computer,
124
359143
3064
Sada, u ovoj seriji on govori uz pomoć računala,
06:18
which actually makes identifying the ends of sentences
125
362207
3104
što zapravo omogućuje identifikaciju krajeva rečenica
06:21
fairly easy. So I wrote a steering algorithm.
126
365311
3426
dosta jednostavno. Pa sam stvorio skretajući algoritam.
06:24
It listens to the lecture, and then it uses
127
368737
1960
On sluša predavanje, i onda koristi
06:26
the amplitude of each word to move a point on the x-axis,
128
370697
2687
amplitude svake riječi kako bi pomaknuo točku na x osi,
06:29
and it uses the inflection of sentences
129
373384
2633
i koristi modulaciju rečenica
06:31
to move a same point up and down on the y-axis.
130
376017
2154
kako bi pomaknuo istu točku gore i dolje po y osi.
06:34
And these trend lines, you can see, there's more questions
131
378171
2774
I ove linije, kao što vidite, ostavljaju više pitanja
06:36
than answers in the laws of physics,
132
380945
1870
nego odgovora u zakonima fizike,
06:38
and when we reach the end of a sentence,
133
382815
2033
i kad dođemo do kraja rečenice,
06:40
we place a star at that location.
134
384848
2335
stavljamo zvjezdicu na tu lokaciju.
06:43
So there's a lot of sentences, so a lot of stars,
135
387183
2800
Dakle postoji puno rečenica, pa puno zvijezda,
06:45
and after rendering all of the audio, this is what we get.
136
389983
2356
i nakon renderiranja sveg zvuka, ovo je što dobijemo.
06:48
This is Stephen Hawking's universe.
137
392339
2929
Ovo je svemir Stephena Hawkinga.
06:51
(Applause)
138
395268
6937
(Pljesak)
06:58
It's all eight hours of the Cambridge lecture series
139
402205
2487
Ovo je svih osam sati predavanja sa Cambridgea
07:00
taken in as a single visual impression,
140
404692
1848
prikazanih u jednoj vizualnoj impresiji,
07:02
and I really like this image,
141
406540
1757
i stvarno mi se sviđa ova slika,
07:04
but a lot of people think it's fake.
142
408297
1808
ali mnogo ljudi misli da je ovo lažno.
07:06
So I made a more interactive version,
143
410105
2344
Pa sam stvorio interaktivniju verziju,
07:08
and the way I did that is I used their position in time
144
412449
5456
a to sam učinio tako što sam koristio njihov položaj u vremenu
07:13
in the lecture to place these stars into 3D space,
145
417905
2367
u predavanju kako bih postavio ove zvijezdice u 3D prostoru,
07:16
and with some custom software and a Kinect,
146
420272
2401
i s nešto posebnog softwarea i Kinectom,
07:18
I can walk right into the lecture.
147
422673
2663
mogu ušetati u predavanje.
07:21
I'm going to wave through the Kinect here
148
425336
1800
Mahnut ću kroz Kinect ovdje
07:23
and take control, and now I'm going to reach out
149
427136
1832
i preuzeti kontrolu, i sada ću posegnuti
07:24
and I'm going to touch a star, and when I do,
150
428968
3239
i dodirnuti zvjezdu, i kada to učinim,
07:28
it will play the sentence
151
432207
1944
pustit će rečenicu
07:30
that generated that star.
152
434151
1465
koja je stvorila tu zvjezdu.
07:31
Stephen Hawking: There is one, and only one, arrangement
153
435616
3816
Stephen Hawking: Postoji jedan, i samo jedan, aranžman
07:35
in which the pieces make a complete picture.
154
439432
2799
u kojem dijelovi čine čitavu sliku.
07:38
Jared Ficklin: Thank you. (Applause)
155
442231
4148
Jared Ficklin: Hvala vam. (Pljesak)
07:42
There are 1,400 stars.
156
446379
3173
Postoji 1.400 zvjezda.
07:45
It's a really fun way to explore the lecture,
157
449552
1664
To je zaista zanimljiv način za istraživanje predavanja,
07:47
and, I hope, a fitting homage.
158
451216
1467
i, nadam se, dostojna posveta.
07:48
All right. Let me close with a work in progress.
159
452683
5472
U redu. Dopustite da završim sa radom koji je u tijeku.
07:54
I think, after 30 years, the opportunity exists
160
458155
2983
Mislim, nakon 30 godina, da postoji prilika
07:57
to create an enhanced version of closed captioning.
161
461138
2104
za stvaranje poboljšane verzije zatvorenog titlovanja.
07:59
Now, we've all seen a lot of TEDTalks online,
162
463242
2119
Sad, puno nas je vidjelo puno TED govora online,
08:01
so let's watch one now with the sound turned off
163
465361
2927
pa pogledajmo jedan bez zvuka
08:04
and the closed captioning turned on.
164
468288
3922
i uključenim sustavom zatvorenog titlovanja.
08:08
There's no closed captioning for the TED theme song,
165
472210
2146
Ne postoji zatvoreno titlovanje za TED pjesmu,
08:10
and we're missing it, but if you've watched enough of these,
166
474356
2113
i nedostaje nam, ali ako ste pogledali dovoljno ovoga,
08:12
you hear it in your mind's ear,
167
476469
1369
čujete ju u vašem uhu,
08:13
and then applause starts.
168
477838
2983
i onda pljesak počinje.
08:16
It usually begins here, and it grows and then it falls.
169
480821
2190
Obično počinje ovdje, i raste a zatim pada.
08:18
Sometimes you get a little star applause,
170
483011
1977
Nekad dobijete pljesak male zvjezde,
08:20
and then I think even Bill Gates takes a nervous breath,
171
484988
2486
i onda mislim da čak i Bill Gates nervozno udahne,
08:23
and the talk begins.
172
487474
1690
i govor počne.
08:25
All right, so let's watch this clip again.
173
489164
5698
Dobro, pogledajmo ovaj isječak ponovno.
08:30
This time, I'm not going to talk at all.
174
494862
1256
Ovoga puta, neću uopće govoriti.
08:32
There's still going to be no audio,
175
496118
1367
I dalje neće biti zvuka,
08:33
but what I am going to do is I'm going to render the sound
176
497485
1904
ali ono što ću ja učiniti je prevesti zvuk
08:35
visually in real time at the bottom of the screen.
177
499389
4316
vizualno u realnom vremenu na dnu ekrana.
08:39
So watch closely and see what your eyes can hear.
178
503705
2791
Gledajte pažljivo i vidite što vaše oči mogu čuti.
09:03
This is fairly amazing to me.
179
527880
1880
Ovo je poprilično zadivljuuće za mene.
09:05
Even on the first view, your eyes will successfully
180
529760
3333
Čak i na prvi pogled, oči će uspješno
09:08
pick out patterns, but on repeated views,
181
533093
3088
izabrati uzorke, no u opetovanim gledanjem,
09:12
your brain actually gets better
182
536181
1689
vaš mozak zapravo postaje bolji
09:13
at turning these patterns into information.
183
537870
1656
u pretvaranju ovih uzoraka u informacije.
09:15
You can get the tone and the timbre
184
539526
1591
Možete osjetiti ton i boju zvuka
09:17
and the pace of the speech,
185
541117
1223
i brzinu govora,
09:18
things that you can't get out of closed captioning.
186
542340
2064
stvari koje ne možete dobiti iz zatvorenog titlovanja.
09:20
That famous scene in horror movies
187
544404
2184
Ona poznata scena u horor filmovima
09:22
where someone is walking up from behind
188
546588
2648
gdje netko dolazi straga
09:25
is something you can see,
189
549236
1960
je nešto što možete vidjeti,
09:27
and I believe this information would be something
190
551196
2704
i vjerujem da je ova informacija nešto
09:29
that is useful at times when the audio is turned off
191
553900
2803
što je korisno kada je isključen zvuk
09:32
or not heard at all, and I speculate that deaf audiences
192
556703
2941
ili nije čuo uopće, i pretpostavljam da će gluha publika
09:35
might actually even be better
193
559644
1177
možda biti i bolja
09:36
at seeing sound than hearing audiences.
194
560821
1781
u viđenju zvuka nego publika koja čuje.
09:38
I don't know. It's a theory right now.
195
562602
1498
Ne znam. Za sada je to samo teorija.
09:40
Actually, it's all just an idea.
196
564100
1521
Zapravo, to je sve samo ideja.
09:41
And let me end by saying that sound moves in all directions,
197
565621
4191
I dopustite da završim s tim da se zvuk kreće u svim smjerovima,
09:45
and so do ideas.
198
569812
1977
a tako se kreću i ideje.
09:47
Thank you. (Applause)
199
571789
3112
Hvala vam. (Pljesak)
ABOUT THE SPEAKER
Jared Ficklin - VisualizerIn his day job, Jared Ficklin makes user interfaces at frog design. As a hobby, he explores what music looks like ... in light, in shapes, in fire.
Why you should listen
Jared Ficklin is a Senior Principal Design Technologist at frog, where he builds user experiences for clients, playing with interactions including touch and multi-touch, and applying physics to enhance the user experience. A passion for music and making things introduced him to the hobby of sound visualization, which has led him on occasion to play with fire. (As Flash on the Beach puts it, "Jared Ficklin’s sonic experiments stood out for their individuality, drama and casual disregard for health and safety.") Every March in Austin, Texas, Ficklin organizes the frog party, a collective social experiment for a few thousand people attending SXSW Interactive. It's a form of playful R&D for social technology. And he has spent 10 years helping fund, design and build quality free public skateparks for Austin as part of the Austin Public Skatepark Action Committee.
Jared Ficklin | Speaker | TED.com