TEDxBeaconStreet
Michael Rubinstein: See invisible motion, hear silent sounds
Majkl Rubinštajn (Michael Rubinstein): Vidite nevidljive pokrete, čujte zvuke koji se ne mogu čuti. Zanimljivo? Jezivo? Mi ne možemo da se odlučimo
Filmed:
Readability: 4.1
2,075,056 views
Upoznajte "mikroskop za pokret", video procesor koji snima male promene u pokretu i boji koje je inače nemoguće videti golim okom. Video istraživač Majk Rubinštajn pušta nam snimak za snimkom koji će vas ostaviti bez teksta i tako nam pokazuje kako ova tehnologija može da uhvati puls i otkucaj srca jedne osobe u sasvim običnom video snimku. Pogledajte kako on rekonstruiše razgovor dok pojačava pokrete iz zvučnih talasa koji poskakuju u kesici čipsa. Neverovatno inspirativne i čudnovate upotrebe ove metode koje morate prvo videti da biste uopšte poverovali u njih.
Michael Rubinstein - Research scientist, Google
Computer scientist Michael Rubinstein and his team have developed a "motion microscope" that can show video footage of barely perceivable movements, like breaths and heartbeats. Full bio
Computer scientist Michael Rubinstein and his team have developed a "motion microscope" that can show video footage of barely perceivable movements, like breaths and heartbeats. Full bio
Double-click the English transcript below to play the video.
00:13
So over the past few centuries,
microscopes have revolutionized our world.
microscopes have revolutionized our world.
0
1114
7492
Tokom proteklih nekoliko vekova
mikroskopi su preokrenuli naš svet.
mikroskopi su preokrenuli naš svet.
00:21
They revealed to us a tiny world
of objects, life and structures
of objects, life and structures
1
9036
5216
Otkrili su nam taj mali svet predmeta,
života i struktura
života i struktura
00:26
that are too small for us
to see with our naked eyes.
to see with our naked eyes.
2
14252
2906
koji su isuviše mali
da bismo ih mogli videti golim očima.
da bismo ih mogli videti golim očima.
00:29
They are a tremendous contribution
to science and technology.
to science and technology.
3
17158
3019
Dali su ogroman doprinos
nauci i tehnologiji.
nauci i tehnologiji.
00:32
Today I'd like to introduce you
to a new type of microscope,
to a new type of microscope,
4
20177
3227
Danas bih voleo da vam predstavim
novi tip mikroskopa,
novi tip mikroskopa,
00:35
a microscope for changes.
5
23404
2578
mikroskop za promene.
00:37
It doesn't use optics
like a regular microscope
like a regular microscope
6
25982
2902
Njemu ne treba optika
kao redovnom mikroskopu
kao redovnom mikroskopu
00:40
to make small objects bigger,
7
28884
1997
da male objekte učini većim,
00:42
but instead it uses a video camera
and image processing
and image processing
8
30881
4376
nego koristi video kameru
i procesor slika
i procesor slika
00:47
to reveal to us the tiniest motions
and color changes in objects and people,
and color changes in objects and people,
9
35257
5256
kako bi nam otkrio one najmanje pokrete
i promene u boji predmeta i ljudi,
i promene u boji predmeta i ljudi,
00:52
changes that are impossible
for us to see with our naked eyes.
for us to see with our naked eyes.
10
40513
3842
promene koje je nemoguće videti
golim okom.
golim okom.
00:56
And it lets us look at our world
in a completely new way.
in a completely new way.
11
44355
4120
Tako nam dopušta da vidimo naš svet
na sasvim novi način.
na sasvim novi način.
01:00
So what do I mean by color changes?
12
48475
1910
No, šta ja mislim pod promenom boja?
01:02
Our skin, for example,
changes its color very slightly
changes its color very slightly
13
50385
2832
Naša koža, na primer, neznatno menja boju
01:05
when the blood flows under it.
14
53217
1997
kada krv teče pod njom.
01:07
That change is incredibly subtle,
15
55214
2397
Ta promena je izuzetno suptilna,
01:09
which is why, when you
look at other people,
look at other people,
16
57611
2063
i zato kada gledate ljude,
01:11
when you look at the person
sitting next to you,
sitting next to you,
17
59674
2251
kada pogledate osobu koja sedi pored vas,
01:13
you don't see their skin
or their face changing color.
or their face changing color.
18
61925
3575
ne vidite kako se boje menjaju
na njihovoj koži ili na licu.
na njihovoj koži ili na licu.
01:17
When we look at this video of Steve here,
it appears to us like a static picture,
it appears to us like a static picture,
19
65500
4360
Kada pogledate ovaj snimak sa Stivom,
primetićete da deluje kao statična slika,
primetićete da deluje kao statična slika,
01:21
but once we look at this video
through our new, special microscope,
through our new, special microscope,
20
69860
3860
ali kada pogledamo ovaj video snimljen
našim novim, specijalnim mikroskopom,
našim novim, specijalnim mikroskopom,
01:25
suddenly we see
a completely different image.
a completely different image.
21
73720
2600
odjednom primećujemo sasvim novu sliku.
01:28
What you see here are small changes
in the color of Steve's skin,
in the color of Steve's skin,
22
76320
3930
Ono što vidite ovde su male promene
u boji Stivove kože,
u boji Stivove kože,
01:32
magnified 100 times
so that they become visible.
so that they become visible.
23
80250
4436
uvećane 100 puta kako bi postale vidljive.
01:36
We can actually see a human pulse.
24
84686
3267
Mi zapravo možemo da vidimo ljudski puls.
01:39
We can see how fast
Steve's heart is beating,
Steve's heart is beating,
25
87953
3227
Možemo videti
koliko brzo kuca Stivovo srce
koliko brzo kuca Stivovo srce
01:43
but we can also see the actual way
that the blood flows in his face.
that the blood flows in his face.
26
91180
5355
ali možemo takođe videti i kako krv
zapravo teče u njegovom licu.
zapravo teče u njegovom licu.
01:48
And we can do that not just
to visualize the pulse,
to visualize the pulse,
27
96544
2631
I to možemo uraditi
ne samo da bismo prikazali puls,
ne samo da bismo prikazali puls,
01:51
but also to actually
recover our heart rates,
recover our heart rates,
28
99175
3471
već da bismo, pored toga, videli
01:54
and measure our heart rates.
29
102646
1793
i izmerili otkucaje svog srca.
01:56
And we can do it with regular cameras
and without touching the patients.
and without touching the patients.
30
104439
4453
I to možemo učiniti običnim kamerama,
bez dodirivanja pacijenta.
bez dodirivanja pacijenta.
02:00
So here you see the pulse and heart rate
we extracted from a neonatal baby
we extracted from a neonatal baby
31
108892
5617
Ovde vidite puls i brzinu otkucaja srca
koje smo zabeležili kod novorođene bebe
koje smo zabeležili kod novorođene bebe
02:06
from a video we took
with a regular DSLR camera,
with a regular DSLR camera,
32
114509
2881
u videu koji smo snimili
klasičnom DSLR kamerom,
klasičnom DSLR kamerom,
02:09
and the heart rate measurement we get
33
117390
1816
a brzina otkucaja srca koju smo dobili
02:11
is as accurate as the one you'd get
with a standard monitor in a hospital.
with a standard monitor in a hospital.
34
119206
4811
istovetna je onoj koju bi izmerio
standardni monitor u bolnici.
standardni monitor u bolnici.
02:16
And it doesn't even have to be
a video we recorded.
a video we recorded.
35
124017
2642
A to zapravo ne mora da bude
video koji smo mi snimili.
video koji smo mi snimili.
02:18
We can do it essentially
with other videos as well.
with other videos as well.
36
126659
2995
Mi to možemo raditi i sa drugim snimcima.
02:21
So I just took a short clip
from "Batman Begins" here
from "Batman Begins" here
37
129654
3901
Zato sam uzeo klip iz filma
"Betmen počinje"
"Betmen počinje"
02:25
just to show Christian Bale's pulse.
38
133555
1904
da vam pokažem puls Kristijana Bejla.
02:27
(Laughter)
39
135459
1822
(Smeh)
02:29
And you know, presumably
he's wearing makeup,
he's wearing makeup,
40
137281
2123
I znate, pošto je on
verovatno našminkan,
verovatno našminkan,
02:31
the lighting here is kind of challenging,
41
139404
1953
osvetljenje je ovde pravi izazov,
02:33
but still, just from the video,
we're able to extract his pulse
we're able to extract his pulse
42
141357
2951
ali svejedno, iz ovog videa ipak možemo
izdvojiti njegov puls
izdvojiti njegov puls
02:36
and show it quite well.
43
144308
2018
i pokazati ga prilično uspešno.
02:38
So how do we do all that?
44
146326
1920
Pa, kako to uopšte radimo?
02:40
We basically analyze the changes
in the light that are recorded
in the light that are recorded
45
148246
4598
Mi, zapravo, analiziramo promene svetla
koje se snimaju u svakom pikselu
snimka tokom vremena,
snimka tokom vremena,
02:44
at every pixel in the video over time,
46
152844
2271
02:47
and then we crank up those changes.
47
155115
1798
I onda naglasimo te promene.
02:48
We make them bigger
so that we can see them.
so that we can see them.
48
156913
2162
Uvećamo ih tako da ih možemo videti.
02:51
The tricky part is that those signals,
49
159075
1902
Najteži deo je to što su ti signali,
02:52
those changes that we're after,
are extremely subtle,
are extremely subtle,
50
160977
2933
te promene koje mi tražimo,
neverovatno suptilne,
neverovatno suptilne,
02:55
so we have to be very careful
when you try to separate them
when you try to separate them
51
163910
2779
pa moramo da budemo jako oprezni
dok ih razdvajamo
dok ih razdvajamo
02:58
from noise that always exists in videos.
52
166689
3831
od smetnji iz svih tih snimaka.
03:02
So we use some clever
image processing techniques
image processing techniques
53
170520
2995
Zato koristimo vrlo pametne tehnike
u preradi slika
u preradi slika
03:05
to get a very accurate measurement
of the color at each pixel in the video,
of the color at each pixel in the video,
54
173515
3994
kako bismo dobili najtačniju meru boje
svakog piksela u videu
svakog piksela u videu
03:09
and then the way the color
changes over time,
changes over time,
55
177509
2670
i načina na koji se boja vremenom menja,
03:12
and then we amplify those changes.
56
180179
2693
i tek onda mi pojačamo te promene.
03:14
We make them bigger to create those types
of enhanced videos, or magnified videos,
of enhanced videos, or magnified videos,
57
182872
3980
Uvećavamo ih kako bismo dobili
te unapređene ili uvećane snimke
te unapređene ili uvećane snimke
03:18
that actually show us those changes.
58
186852
2172
koji zapravo pokazuju sve te promene.
03:21
But it turns out we can do that
not just to show tiny changes in color,
not just to show tiny changes in color,
59
189024
4238
Ali, ispostavilo se da tako ne pokazujemo
samo promene u boji
samo promene u boji
03:25
but also tiny motions,
60
193262
2241
već i u malim pokretima,
03:27
and that's because the light
that gets recorded in our cameras
that gets recorded in our cameras
61
195503
3576
jer se svetlo snimljeno našim kamerama
03:31
will change not only if the color
of the object changes,
of the object changes,
62
199079
2810
neće promeniti
samo ako se boja objekta menja,
samo ako se boja objekta menja,
03:33
but also if the object moves.
63
201889
2368
već i kada se objekat pokreće.
03:36
So this is my daughter
when she was about two months old.
when she was about two months old.
64
204257
3636
Ovo je moja ćerka kada je imala
oko dva meseca.
oko dva meseca.
03:39
It's a video I recorded
about three years ago.
about three years ago.
65
207893
2999
Ovaj video sam napravio pre tri godine.
03:42
And as new parents, we all want
to make sure our babies are healthy,
to make sure our babies are healthy,
66
210892
3208
Kao novi roditelji, želimo da budemo
sigurni da su naša deca zdrava,
sigurni da su naša deca zdrava,
03:46
that they're breathing,
that they're alive, of course.
that they're alive, of course.
67
214100
2542
da dišu, da su živa, naravno.
03:48
So I too got one of those baby monitors
68
216642
2142
Pa sam i ja nabavio jedan bebi monitor
03:50
so that I could see my daughter
when she was asleep.
when she was asleep.
69
218784
2469
da bih mogao da gledam svoju ćerku
dok spava.
dok spava.
03:53
And this is pretty much what you'll see
with a standard baby monitor.
with a standard baby monitor.
70
221253
3527
Ovo je otprilike ono što vidite
preko standardnog bebi monitora.
preko standardnog bebi monitora.
03:56
You can see the baby's sleeping, but
there's not too much information there.
there's not too much information there.
71
224780
3682
Možete videti bebu kako spava,
ali nema nekih daljih informacija.
ali nema nekih daljih informacija.
04:00
There's not too much we can see.
72
228474
1604
Ne možemo da vidimo puno toga.
04:02
Wouldn't it be better,
or more informative, or more useful,
or more informative, or more useful,
73
230078
2824
Zar ne bi bilo bolje,
ili informativnije, ili korisnije,
ili informativnije, ili korisnije,
04:04
if instead we could look
at the view like this.
at the view like this.
74
232902
2990
kada bismo mogli da vidimo ovakvu sliku.
04:07
So here I took the motions
and I magnified them 30 times,
and I magnified them 30 times,
75
235892
6356
Zato sam ovde izdvojio pokrete
i uveličao ih 30 puta
i uveličao ih 30 puta
04:14
and then I could clearly see that my
daughter was indeed alive and breathing.
daughter was indeed alive and breathing.
76
242248
3826
i tek tada sam jasno video
da je moja ćerka zaista živa i da diše.
da je moja ćerka zaista živa i da diše.
04:18
(Laughter)
77
246074
2253
(Smeh)
04:20
Here is a side-by-side comparison.
78
248327
1922
Uporedite ova dva snimka.
04:22
So again, in the source video,
in the original video,
in the original video,
79
250249
2483
Dakle, u izvornom, originalnom videu,
04:24
there's not too much we can see,
80
252732
1636
nema puno toga da se vidi,
04:26
but once we magnify the motions,
the breathing becomes much more visible.
the breathing becomes much more visible.
81
254368
3707
ali tek kada uvećamo pokrete,
disanje postaje lako vidljivo.
disanje postaje lako vidljivo.
04:30
And it turns out, there's
a lot of phenomena
a lot of phenomena
82
258075
2070
Na kraju se ispostavilo
da ima puno pojava
da ima puno pojava
04:32
we can reveal and magnify
with our new motion microscope.
with our new motion microscope.
83
260145
3623
koje možemo otkriti i uvećati
sa našim novim mikroskopom za pokrete.
sa našim novim mikroskopom za pokrete.
04:35
We can see how our veins and arteries
are pulsing in our bodies.
are pulsing in our bodies.
84
263768
4564
Možemo videti kako vene i arterije
pulsiraju u našim telima.
pulsiraju u našim telima.
04:40
We can see that our eyes
are constantly moving
are constantly moving
85
268332
2628
Možemo videti kako se naše oči
konstantno kreću
konstantno kreću
04:42
in this wobbly motion.
86
270960
1887
uz ovo drhtanje.
04:44
And that's actually my eye,
87
272847
1509
Ovo je zapravo moje oko,
04:46
and again this video was taken
right after my daughter was born,
right after my daughter was born,
88
274356
3065
i ovaj video je snimljen taman posle
rođenja moje ćerke,
rođenja moje ćerke,
04:49
so you can see I wasn't getting
too much sleep. (Laughter)
too much sleep. (Laughter)
89
277421
4202
pa možete videti da nisam dovoljno spavao.
(Smeh)
(Smeh)
04:53
Even when a person is sitting still,
90
281623
2716
Čak i kada osoba sedi mirno,
04:56
there's a lot of information
we can extract
we can extract
91
284339
2044
ima puno informacija koje možemo dobiti
04:58
about their breathing patterns,
small facial expressions.
small facial expressions.
92
286383
3529
o načinu njenog disanja i izrazima lica.
05:01
Maybe we could use those motions
93
289912
1625
Možda te pokrete možemo iskoristiti
05:03
to tell us something about
our thoughts or our emotions.
our thoughts or our emotions.
94
291537
3154
da saznamo nešto
o našim mislima i emocijama.
o našim mislima i emocijama.
05:06
We can also magnify small
mechanical movements,
mechanical movements,
95
294691
3255
Možemo takođe
uvećati i male mehaničke pokrete,
uvećati i male mehaničke pokrete,
05:09
like vibrations in engines,
96
297946
1555
poput vibracija u motorima,
05:11
that can help engineers detect
and diagnose machinery problems,
and diagnose machinery problems,
97
299501
3692
što može pomoći inžinjerima
pri utvrđivanju mašinskih problema,
pri utvrđivanju mašinskih problema,
05:15
or see how our buildings and structures
sway in the wind and react to forces.
sway in the wind and react to forces.
98
303193
4738
a možemo videti kako se zgrade i građevine
njišu na vetru i kako reaguju na silu.
njišu na vetru i kako reaguju na silu.
05:19
Those are all things that our society
knows how to measure in various ways,
knows how to measure in various ways,
99
307931
4581
Sve su to stvari koje naše društvo zna
da izmeri na različite načine,
da izmeri na različite načine,
05:24
but measuring those motions is one thing,
100
312512
2453
ali meriti te pokrete je jedna stvar,
05:26
and actually seeing those
motions as they happen
motions as they happen
101
314965
2276
zbilja videti kako se ti pokreti prave
05:29
is a whole different thing.
102
317241
2554
je nešto potpuno drugačije.
05:31
And ever since we discovered
this new technology,
this new technology,
103
319795
3041
Otkad smo otkrili ovu novu tehnologiju,
postavili smo naš kod
postavili smo naš kod
05:34
we made our code available online so that
others could use and experiment with it.
others could use and experiment with it.
104
322836
3953
na internet da bi i drugi mogli
da ga koriste i eksperimentišu sa njim.
da ga koriste i eksperimentišu sa njim.
05:38
It's very simple to use.
105
326789
1875
Vrlo je jednostavan.
05:40
It can work on your own videos.
106
328664
2044
Funkcioniše i na vašim privatnim snimcima.
05:42
Our collaborators at Quanta Research
even created this nice website
even created this nice website
107
330708
3193
Naši saradnici iz "Quanta Research"
napravili su ovaj sjajan sajt
napravili su ovaj sjajan sajt
05:45
where you can upload your videos
and process them online,
and process them online,
108
333901
2678
gde možete postaviti svoje snimke
i preraditi ih onlajn.
i preraditi ih onlajn.
05:48
so even if you don't have any experience
in computer science or programming,
in computer science or programming,
109
336579
3816
Pa čak i ako nemate nikakvog iskustva
iz informatike i programiranja,
iz informatike i programiranja,
05:52
you can still very easily experiment
with this new microscope.
with this new microscope.
110
340395
2936
vrlo lako možete eksperimentisati
sa ovim novim mikroskopom.
sa ovim novim mikroskopom.
05:55
And I'd like to show you
just a couple of examples
just a couple of examples
111
343331
2404
I voleo bih da vam pokažem
nekoliko primera
nekoliko primera
05:57
of what others have done with it.
112
345735
2735
onoga šta su drugi napravili sa tim.
06:00
So this video was made by
a YouTube user called Tamez85.
a YouTube user called Tamez85.
113
348470
5317
Dakle, ovaj video je napravio
YouTube korisnik zvani Tamez85.
YouTube korisnik zvani Tamez85.
06:05
I don't know who that user is,
114
353787
1463
Ja ne znam ko je taj korisnik,
06:07
but he, or she, used our code
115
355250
2345
ali on, ili ona, uzeo je naš kod
06:09
to magnify small belly
movements during pregnancy.
movements during pregnancy.
116
357595
3715
i povećao sitne pokrete
u stomaku tokom trudnoće
u stomaku tokom trudnoće
06:13
It's kind of creepy.
117
361310
1602
Pomalo je jezivo.
06:14
(Laughter)
118
362912
1613
(Smeh)
06:16
People have used it to magnify
pulsing veins in their hands.
pulsing veins in their hands.
119
364525
4961
Ljudi su njime uvećavali pulsiranje
vena u njihovim rukama.
vena u njihovim rukama.
06:21
And you know it's not real science
unless you use guinea pigs,
unless you use guinea pigs,
120
369486
3782
Ipak, znate da se ne radi o pravoj nauci
ako ne koristite zamorčad,
ako ne koristite zamorčad,
06:25
and apparently this guinea pig
is called Tiffany,
is called Tiffany,
121
373268
3390
a ovo zamorče se očito zove Tifani,
06:28
and this YouTube user claims
it is the first rodent on Earth
it is the first rodent on Earth
122
376658
2949
a ovaj korisnik na Jutjubu tvrdi
da je ona prvi glodar na Zemlji
da je ona prvi glodar na Zemlji
06:31
that was motion-magnified.
123
379607
2688
čiji su pokreti ovako uvećani.
06:34
You can also do some art with it.
124
382295
2188
Ovako možete praviti i umetnička dela.
06:36
So this video was sent to me
by a design student at Yale.
by a design student at Yale.
125
384483
3018
Ovaj video mi je poslala
studentkinja dizajna sa Jejla.
studentkinja dizajna sa Jejla.
06:39
She wanted to see
if there's any difference
if there's any difference
126
387501
2137
Želela je da vidi ima li razlike u tome
06:41
in the way her classmates move.
127
389638
1522
kako se kreću njene kolege.
06:43
She made them all stand still,
and then magnified their motions.
and then magnified their motions.
128
391160
4209
Svima im je naredila da stoje mirno
i onda uvećala njihove pokrete.
i onda uvećala njihove pokrete.
06:47
It's like seeing
still pictures come to life.
still pictures come to life.
129
395369
3378
To je kao da gledate
kako mrtva priroda oživljava.
kako mrtva priroda oživljava.
06:50
And the nice thing with
all those examples
all those examples
130
398747
2433
Lepa stvar u vezi
sa svim ovim eksperimentima
sa svim ovim eksperimentima
06:53
is that we had nothing to do with them.
131
401180
2296
je to što mi nismo imali ništa sa njima.
06:55
We just provided this new tool,
a new way to look at the world,
a new way to look at the world,
132
403476
3854
Samo smo obezbedili ovu novu alatku,
nov način gledanja na svet,
nov način gledanja na svet,
06:59
and then people find other interesting,
new and creative ways of using it.
new and creative ways of using it.
133
407330
5132
a onda su drugi ljudi našli interesantne,
nove i kreativne načine da ga upotrebe.
nove i kreativne načine da ga upotrebe.
07:04
But we didn't stop there.
134
412462
1764
Ali, nismo tu stali.
07:06
This tool not only allows us
to look at the world in a new way,
to look at the world in a new way,
135
414226
3251
Ova alatka ne samo da nam je dozvolila
da gledamo svet novim očima,
da gledamo svet novim očima,
07:09
it also redefines what we can do
136
417477
2368
nego je redefinisala ono što mi radimo
07:11
and pushes the limits of what
we can do with our cameras.
we can do with our cameras.
137
419845
3181
i pogurala granice onoga što možemo
da učinimo sa našim kamerama.
da učinimo sa našim kamerama.
07:15
So as scientists, we started wondering,
138
423026
2229
Kao naučnici počeli smo da se pitamo,
07:17
what other types of physical phenomena
produce tiny motions
produce tiny motions
139
425255
3785
koje druge fizičke pojave
stvaraju sitne pokrete
stvaraju sitne pokrete
07:21
that we could now use
our cameras to measure?
our cameras to measure?
140
429040
2903
koje sada možemo izmeriti
našim novim kamerama?
našim novim kamerama?
07:23
And one such phenomenon
that we focused on recently is sound.
that we focused on recently is sound.
141
431943
4001
Jedna takva pojava
na koju smo se nedavno fokusirali je zvuk.
na koju smo se nedavno fokusirali je zvuk.
Kao što svi znamo,
zvuk zapravo predstavlja promene
zvuk zapravo predstavlja promene
07:27
Sound, as we all know,
is basically changes
is basically changes
142
435944
2105
07:30
in air pressure that
travel through the air.
travel through the air.
143
438049
2183
u vazdušnom pritisku
koje putuju kroz vazduh.
koje putuju kroz vazduh.
07:32
Those pressure waves hit objects
and they create small vibrations in them,
and they create small vibrations in them,
144
440232
3621
Ti talasi pritiska udaraju o objekte
i stvaraju male vibracije u njima,
i stvaraju male vibracije u njima,
07:35
which is how we hear
and how we record sound.
and how we record sound.
145
443853
2532
i tako mi čujemo i snimamo zvuk.
07:38
But it turns out that sound
also produces visual motions.
also produces visual motions.
146
446385
3668
No, ispostavilo se da zvuk uz to
stvara i vizuelne pokrete.
stvara i vizuelne pokrete.
07:42
Those are motions
that are not visible to us
that are not visible to us
147
450053
2833
Ti pokreti su nama nevidljivi,
07:44
but are visible to a camera
with the right processing.
with the right processing.
148
452886
3001
ali ih naša kamera vidi
kada se dobro podesi.
kada se dobro podesi.
07:47
So here are two examples.
149
455887
1573
Evo vam dva primera.
07:49
This is me demonstrating
my great singing skills.
my great singing skills.
150
457460
2614
Ovde ja demonstriram
svoje sjane glasovne sposobnosti.
svoje sjane glasovne sposobnosti.
07:53
(Singing)
151
461064
1634
(Pevanje)
07:54
(Laughter)
152
462698
1436
(Smeh)
07:56
And I took a high-speed video
of my throat while I was humming.
of my throat while I was humming.
153
464134
2986
Dok sam tako brujao,
snimio sam ubrzani video svog grla.
snimio sam ubrzani video svog grla.
07:59
Again, if you stare at that video,
154
467120
1764
Opet, ako pažljivo pogledate video,
08:00
there's not too much
you'll be able to see,
you'll be able to see,
155
468884
2076
neće biti puno toga
što ćete moći da vidite,
što ćete moći da vidite,
08:02
but once we magnify the motions 100 times,
we can see all the motions and ripples
we can see all the motions and ripples
156
470960
4332
ali kada uvećamo pokrete 100 puta,
možemo videti sve pokrete i talase
možemo videti sve pokrete i talase
08:07
in the neck that are involved
in producing the sound.
in producing the sound.
157
475292
3274
koji učestvuju
u stvaranju zvuka u mom vratu.
u stvaranju zvuka u mom vratu.
08:10
That signal is there in that video.
158
478566
2740
Taj signal je tu u tom snimku.
08:13
We also know that singers
can break a wine glass
can break a wine glass
159
481306
2670
Takođe znamo da pevači
mogu da razbiju čašu za vino
mogu da razbiju čašu za vino
08:15
if they hit the correct note.
160
483976
1463
ako pogode pravu notu.
08:17
So here, we're going to play a note
161
485439
1765
Pa hajde da odsviramo notu
08:19
that's in the resonance
frequency of that glass
frequency of that glass
162
487204
2526
koja je u rezonantnoj frekvenciji te čaše
08:21
through a loudspeaker that's next to it.
163
489730
2048
na zvučniku koji se nalazi pored nje.
08:23
Once we play that note
and magnify the motions 250 times,
and magnify the motions 250 times,
164
491778
4419
Kada odsviramo tu notu
i uvećamo pokrete 250 puta,
i uvećamo pokrete 250 puta,
08:28
we can very clearly see
how the glass vibrates
how the glass vibrates
165
496197
2338
sasvim jasno ćemo videti kako čaša vibrira
08:30
and resonates in response to the sound.
166
498535
3570
i rezonira u odgovoru na zvuk.
08:34
It's not something you're used
to seeing every day.
to seeing every day.
167
502105
2420
To nije nešto što viđate svakog dana.
08:36
But this made us think.
It gave us this crazy idea.
It gave us this crazy idea.
168
504525
3529
Ali ovo nas je nateralo da razmislimo.
Dalo nam je ludačku ideju.
Dalo nam je ludačku ideju.
08:40
Can we actually invert this process
and recover sound from video
and recover sound from video
169
508054
5608
Možemo li zapravo da obrnemo ovaj proces
i izdvojimo zvuk iz snimka
i izdvojimo zvuk iz snimka
08:45
by analyzing the tiny vibrations
that sound waves create in objects,
that sound waves create in objects,
170
513662
4035
analizom malih vibracija
koje zvučni talasi stvaraju u predmetima
koje zvučni talasi stvaraju u predmetima
08:49
and essentially convert those
back into the sounds that produced them.
back into the sounds that produced them.
171
517697
4777
i da ih na kraju konvertujemo
natrag u zvuk koji ih je stvorio?
natrag u zvuk koji ih je stvorio?
08:54
In this way, we can turn
everyday objects into microphones.
everyday objects into microphones.
172
522474
4457
Ovako sasvim obične predmete
možemo pretvoriti u mikrofone.
možemo pretvoriti u mikrofone.
08:58
So that's exactly what we did.
173
526931
2232
I to je upravo ono što smo uradili.
09:01
So here's an empty bag of chips
that was lying on a table,
that was lying on a table,
174
529163
2816
Dakle, ovo je prazna kesica čipsa
koja se nalazi na stolu
koja se nalazi na stolu
09:03
and we're going to turn that
bag of chips into a microphone
bag of chips into a microphone
175
531979
2825
i mi ćemo da pretvorimo
tu kesicu čipsa u mikrofon
tu kesicu čipsa u mikrofon
09:06
by filming it with a video camera
176
534804
1591
tako što ćemo je usnimiti kamerom
09:08
and analyzing the tiny motions
that sound waves create in it.
that sound waves create in it.
177
536395
3228
i analizirati male pokrete
koje zvučni talasi stvaraju u njoj.
koje zvučni talasi stvaraju u njoj.
09:11
So here's the sound
that we played in the room.
that we played in the room.
178
539623
2796
Ovo je zvuk koji smo pustili u toj sobi.
09:14
(Music: "Mary Had a Little Lamb")
179
542419
4434
(Muzika: „Meri je imala malo jagnje“)
09:22
And this is a high-speed video
we recorded of that bag of chips.
we recorded of that bag of chips.
180
550007
3025
A ovo je taj ubrzani video
kesice čipsa koji smo snimili.
kesice čipsa koji smo snimili.
09:25
Again it's playing.
181
553032
1274
Evo ga opet.
09:26
There's no chance you'll be able
to see anything going on in that video
to see anything going on in that video
182
554306
3342
Nema šanse da primetite
da se išta dešava u tom snimku
da se išta dešava u tom snimku
09:29
just by looking at it,
183
557648
1058
dok ga posmatrate,
09:30
but here's the sound we were able
to recover just by analyzing
to recover just by analyzing
184
558706
2984
ali evo zvuka kojeg smo uspeli
da izdvojimo analizom
da izdvojimo analizom
09:33
the tiny motions in that video.
185
561690
2183
malih pokreta u tom istom snimku.
09:35
(Music: "Mary Had a Little Lamb")
186
563873
2809
(Muzika: „Meri je imala malo jagnje“)
09:52
I call it -- Thank you.
187
580985
1486
Ja to zovem - hvala vam.
09:54
(Applause)
188
582471
5225
(Aplauz)
10:01
I call it the visual microphone.
189
589878
2345
Ja to zovem vizuelnim mikrofonom.
10:04
We actually extract audio signals
from video signals.
from video signals.
190
592223
3390
Mi smo, u suštini,
izdvojili audio signale iz video signala.
izdvojili audio signale iz video signala.
10:07
And just to give you a sense
of the scale of the motions here,
of the scale of the motions here,
191
595613
3181
Samo da dobijete uvid u to
o kakvom se nivou pokreta ovde radi,
o kakvom se nivou pokreta ovde radi,
10:10
a pretty loud sound will cause that bag
of chips to move less than a micrometer.
of chips to move less than a micrometer.
192
598799
5336
od prilično glasnog zvuka, kesica čipsa
će se pomeriti manje od mikrometra.
će se pomeriti manje od mikrometra.
10:16
That's one thousandth of a millimeter.
193
604135
2739
To je hiljaditi deo milimetra.
10:18
That's how tiny the motions are
that we are now able to pull out
that we are now able to pull out
194
606874
3561
Toliko su mali pokreti
koje sada možemo da uočimo
koje sada možemo da uočimo
10:22
just by observing how light
bounces off objects
bounces off objects
195
610435
3243
posmatranjem toga kako se svetlo
odbija o predmet,
odbija o predmet,
10:25
and gets recorded by our cameras.
196
613678
2136
što su uspele da zabeleže naše kamere.
10:27
We can recover sounds
from other objects, like plants.
from other objects, like plants.
197
615814
3250
Možemo da izdvojimo zvuk
iz drugih objekata poput biljaka.
iz drugih objekata poput biljaka.
10:31
(Music: "Mary Had a Little Lamb")
198
619064
6316
(Muzika: " Meri je imala malo jagnje")
10:39
And we can recover speech as well.
199
627214
1997
A možemo da izdvojimo i govor.
10:41
So here's a person speaking in a room.
200
629211
2577
Evo jedne osobe koja govori u prostoriji.
10:43
Voice: Mary had a little lamb
whose fleece was white as snow,
whose fleece was white as snow,
201
631788
4203
Glas: „Meri je imala malo jagnje
runa belog kao sneg,
runa belog kao sneg,
10:47
and everywhere that Mary went,
that lamb was sure to go.
that lamb was sure to go.
202
635991
4230
i svuda gde je Meri išla,
jagnje je moralo za njom“
jagnje je moralo za njom“
10:52
Michael Rubinstein: And here's
that speech again recovered
that speech again recovered
203
640221
2759
Majkl Rubinštajn: Opet ću vam pustiti
isti govor, ali ovaj put
isti govor, ali ovaj put
10:54
just from this video
of that same bag of chips.
of that same bag of chips.
204
642980
3274
izdvojen iz istog onog snimka
sa kesicom čipsa.
sa kesicom čipsa.
10:58
Voice: Mary had a little lamb
whose fleece was white as snow,
whose fleece was white as snow,
205
646254
4831
Glas: „Meri je imala malo jagnje
runa belog kao sneg,
runa belog kao sneg,
11:03
and everywhere that Mary went,
that lamb was sure to go.
that lamb was sure to go.
206
651085
4859
i svuda gde je Meri išla,
jagnje je moralo za njom“
jagnje je moralo za njom“
11:07
MR: We used "Mary Had a Little Lamb"
207
655944
2346
MR: Uzeli smo pesmu
„Meri je imala malo jagnje“
„Meri je imala malo jagnje“
11:10
because those are said to be
the first words
the first words
208
658290
2123
zato što se veruje da su to prve reči
11:12
that Thomas Edison spoke
into his phonograph in 1877.
into his phonograph in 1877.
209
660413
4161
koje je Tomas Edison izgovorio
u svoj fonograf 1877. godine.
u svoj fonograf 1877. godine.
11:16
It was one of the first sound
recording devices in history.
recording devices in history.
210
664574
3228
To je bio jedan od prvih aparata
za snimanje zvuka u istoriji.
za snimanje zvuka u istoriji.
11:19
It basically directed the sounds
onto a diaphragm
onto a diaphragm
211
667802
3327
On je u osnovi upućivao zvukove
na dijafragmu
na dijafragmu
11:23
that vibrated a needle that essentially
engraved the sound on tinfoil
engraved the sound on tinfoil
212
671129
4079
koja je vibrirala iglu, a ova je zapravo
urezivala zvuk na list kalaja
urezivala zvuk na list kalaja
11:27
that was wrapped around the cylinder.
213
675208
2275
omotan oko cilindra.
11:29
Here's a demonstration of recording and
replaying sound with Edison's phonograph.
replaying sound with Edison's phonograph.
214
677483
5943
Evo demonstracije snimka i ponovnog
puštanja zvuka sa Edisonovog fonografa.
puštanja zvuka sa Edisonovog fonografa.
11:35
(Video) Voice: Testing,
testing, one two three.
testing, one two three.
215
683426
3020
(Video) Glas: „Test, test, jedan dva tri.
11:38
Mary had a little lamb
whose fleece was white as snow,
whose fleece was white as snow,
216
686446
3413
Meri je imala malo jagnje
runa belog kao sneg,
runa belog kao sneg,
11:41
and everywhere that Mary went,
the lamb was sure to go.
the lamb was sure to go.
217
689859
3669
I svuda gde je Meri išla,
jagnje je moralo za njom.
jagnje je moralo za njom.
11:45
Testing, testing, one two three.
218
693528
2740
Test, test, jedan dva tri.
11:48
Mary had a little lamb
whose fleece was white as snow,
whose fleece was white as snow,
219
696268
4156
Meri je imala malo jagnje
runa belog kao sneg,
runa belog kao sneg,
11:52
and everywhere that Mary went,
the lamb was sure to go.
the lamb was sure to go.
220
700424
5224
I svuda gde je Meri išla,
jagnje je moralo za njom“
jagnje je moralo za njom“
11:57
MR: And now, 137 years later,
221
705648
4017
MR: I sada, 137 godina kasnije,
12:01
we're able to get sound
in pretty much similar quality
in pretty much similar quality
222
709665
4087
u mogućnosti smo da dobijemo zvuk
prilično sličnog kvaliteta
prilično sličnog kvaliteta
12:05
but by just watching objects
vibrate to sound with cameras,
vibrate to sound with cameras,
223
713752
4079
i to samo kada posmatramo kamerom
kako predmeti vibriraju od zvuka,
kako predmeti vibriraju od zvuka,
12:09
and we can even do that when the camera
224
717831
1934
a to možemo postići
čak i kada kamera stoji
čak i kada kamera stoji
12:11
is 15 feet away from the object,
behind soundproof glass.
behind soundproof glass.
225
719765
4234
na 4,5 metra od objekta
iza zvučno izolovanog stakla.
iza zvučno izolovanog stakla.
12:15
So this is the sound that we were
able to recover in that case.
able to recover in that case.
226
723999
3220
Dakle, ovo je zvuk koji smo uspeli
da izdvojimo u ovom slučaju.
da izdvojimo u ovom slučaju.
12:19
Voice: Mary had a little lamb
whose fleece was white as snow,
whose fleece was white as snow,
227
727219
5294
Glas: „Meri je imala malo jagnje
runa belog kao sneg,
runa belog kao sneg,
12:24
and everywhere that Mary went,
the lamb was sure to go.
the lamb was sure to go.
228
732513
4759
I svuda gde je Meri išla,
jagnje je moralo za njom“
jagnje je moralo za njom“
12:29
MR: And of course, surveillance is
the first application that comes to mind.
the first application that comes to mind.
229
737404
3630
MR: Naravno, nadzor
će vam verovatno prvo pasti na pamet.
će vam verovatno prvo pasti na pamet.
12:33
(Laughter)
230
741034
2995
(Smeh)
12:36
But it might actually be useful
for other things as well.
for other things as well.
231
744029
4056
Ali to može biti korisno
i za neke druge stvari.
i za neke druge stvari.
12:40
Maybe in the future, we'll be able
to use it, for example,
to use it, for example,
232
748085
2840
Možda ćemo u budućnosti
moći to da iskoristimo, na primer,
moći to da iskoristimo, na primer,
12:42
to recover sound across space,
233
750925
2252
za izdvajanje zvukova iz svemira,
12:45
because sound can't travel
in space, but light can.
in space, but light can.
234
753177
3576
jer zvuk ne može da putuje svemirom,
ali svetlost može.
ali svetlost može.
12:48
We've only just begun exploring
235
756753
2404
Tek smo počeli da istražujemo
12:51
other possible uses
for this new technology.
for this new technology.
236
759157
3019
druge potencijalne upotrebe
ove tehnologije.
ove tehnologije.
12:54
It lets us see physical processes
that we know are there
that we know are there
237
762176
2832
Omogućava da vidimo fizičke procese
za koje znamo da postoje,
za koje znamo da postoje,
12:57
but that we've never been able
to see with our own eyes until now.
to see with our own eyes until now.
238
765008
3556
ali koje do sada nismo mogli
da vidimo sopstvenim očima.
da vidimo sopstvenim očima.
13:00
This is our team.
239
768564
1204
Ovo je naš tim.
13:01
Everything I showed you today
is a result of a collaboration
is a result of a collaboration
240
769768
2879
Sve što sam vam pokazao danas
je rezultat saradnje
je rezultat saradnje
13:04
with this great group
of people you see here,
of people you see here,
241
772647
2191
fantastičnih ljudi koje vidite ovde,
13:06
and I encourage you and welcome you
to check out our website,
to check out our website,
242
774838
3167
i ohrabrujem vas i pozivam vas
da posetite naš sajt,
da posetite naš sajt,
13:10
try it out yourself,
243
778005
1446
da ga sami isprobate,
13:11
and join us in exploring
this world of tiny motions.
this world of tiny motions.
244
779451
2972
i priključite nam se u istraživanju
ovog sveta malih pokreta.
ovog sveta malih pokreta.
13:14
Thank you.
245
782423
1625
Hvala vam.
13:16
(Applause)
246
784048
1254
(Aplauz)
ABOUT THE SPEAKER
Michael Rubinstein - Research scientist, GoogleComputer scientist Michael Rubinstein and his team have developed a "motion microscope" that can show video footage of barely perceivable movements, like breaths and heartbeats.
Why you should listen
Michael Rubinstein zooms in on what we can't see and mangnifies it by thirty or a hundred times. His "motion microscope," developed at MIT with Microsoft and Quanta Research, picks up on subtle motion and color changes in videos and blows them up for the naked eye to see. The result: fun, cool, creepy videos.
Rubinstein is a research scientist at a new Cambridge-based Google lab for computer vision research. He has a PhD in computer science and electrical engineering from MIT.
Michael Rubinstein | Speaker | TED.com