Michael Rubinstein: See invisible motion, hear silent sounds
Michael Rubinstein: Zobaczyć niewidoczne ruchy, usłyszeć niesłyszalne dźwięki. Wspaniałe czy straszne? Trudno powiedzieć
Computer scientist Michael Rubinstein and his team have developed a "motion microscope" that can show video footage of barely perceivable movements, like breaths and heartbeats. Full bio
Double-click the English transcript below to play the video.
microscopes have revolutionized our world.
of objects, life and structures
to see with our naked eyes.
to science and technology.
to a new type of microscope,
like a regular microscope
tak jak tradycyjny mikroskop,
and image processing
i przetwarzania obrazów,
and color changes in objects and people,
i zmiany w kolorze obiektów i ludzi.
for us to see with our naked eyes.
in a completely new way.
w zupełnie nowy sposób.
changes its color very slightly
look at other people,
sitting next to you,
or their face changing color.
it appears to us like a static picture,
wygląda jak statyczny obraz,
through our new, special microscope,
a completely different image.
in the color of Steve's skin,
so that they become visible.
Steve's heart is beating,
that the blood flows in his face.
to visualize the pulse,
wizualizacji pulsu,
recover our heart rates,
and without touching the patients.
bez dotykania pacjentów.
we extracted from a neonatal baby
with a regular DSLR camera,
with a standard monitor in a hospital.
standardowym sprzętem szpitalnym.
a video we recorded.
film nagrany przez nas.
with other videos as well.
from "Batman Begins" here
he's wearing makeup,
we're able to extract his pulse
ze zwykłego nagrania
in the light that are recorded
so that we can see them.
are extremely subtle,
when you try to separate them
image processing techniques
przetwarzania obrazów,
of the color at each pixel in the video,
koloru każdego piksela w nagraniu,
changes over time,
of enhanced videos, or magnified videos,
mocno przesadzone nagrania,
not just to show tiny changes in color,
nie tylko zmiany koloru,
that gets recorded in our cameras
of the object changes,
wraz z kolorem obiektu,
when she was about two months old.
about three years ago.
to make sure our babies are healthy,
martwią się o zdrowie dzieci,
that they're alive, of course.
when she was asleep.
with a standard baby monitor.
there's not too much information there.
ale nie mamy wielu informacji.
or more informative, or more useful,
at the view like this.
and I magnified them 30 times,
daughter was indeed alive and breathing.
że moja córka żyje i oddycha.
in the original video,
the breathing becomes much more visible.
oddychanie jest wyraźniejsze.
a lot of phenomena
with our new motion microscope.
za pomocą tego mikroskopu.
are pulsing in our bodies.
are constantly moving
right after my daughter was born,
too much sleep. (Laughter)
(Śmiech)
we can extract
small facial expressions.
our thoughts or our emotions.
mechanical movements,
niewielkie ruchy mechaniczne,
and diagnose machinery problems,
problemy techniczne maszyn,
sway in the wind and react to forces.
na wiatr i przeciążenia.
knows how to measure in various ways,
na różne sposoby.
motions as they happen
this new technology,
others could use and experiment with it.
by każdy mógł poeksperymentować.
even created this nice website
stworzyli nawet stronę,
and process them online,
i przetwarzać je online.
in computer science or programming,
with this new microscope.
z tą techniką.
just a couple of examples
a YouTube user called Tamez85.
movements during pregnancy.
brzucha w ciąży.
pulsing veins in their hands.
unless you use guinea pigs,
bez świnek morskich.
is called Tiffany,
it is the first rodent on Earth
że to pierwszy gryzoń na ziemi,
by a design student at Yale.
przez studentkę designu z Yale.
if there's any difference
and then magnified their motions.
a potem wzmocniła ruchy.
still pictures come to life.
all those examples
a new way to look at the world,
nowy sposób patrzenia na świat.
new and creative ways of using it.
i kreatywne sposoby użycia.
to look at the world in a new way,
patrzeć na świat inaczej.
we can do with our cameras.
produce tiny motions
powodują niewielkie ruchy,
our cameras to measure?
that we focused on recently is sound.
is basically changes
travel through the air.
and they create small vibrations in them,
wprawiając je w niewielkie wibracje.
and how we record sound.
i rejestrujemy dźwięki.
also produces visual motions.
produkuje też widzialne ruchy.
that are not visible to us
with the right processing.
są widoczne dla kamery.
my great singing skills.
wspaniałe zdolności wokalne.
of my throat while I was humming.
grdyki podczas śpiewu.
you'll be able to see,
we can see all the motions and ripples
widzimy ruchy i zmarszczki na szyi
in producing the sound.
can break a wine glass
frequency of that glass
and magnify the motions 250 times,
how the glass vibrates
to seeing every day.
It gave us this crazy idea.
Wpadliśmy na szalony pomysł.
and recover sound from video
i odzyskać dźwięk z nagrania,
that sound waves create in objects,
tworzone przez fale na obiektach,
back into the sounds that produced them.
everyday objects into microphones.
można zmienić w mikrofony.
that was lying on a table,
bag of chips into a microphone
that sound waves create in it.
wytworzone przez fale dźwiękowe.
that we played in the room.
we recorded of that bag of chips.
tej paczki czipsów.
to see anything going on in that video
to recover just by analyzing
widoczne na nagraniu.
from video signals.
of the scale of the motions here,
of chips to move less than a micrometer.
że paczka poruszy się o mikrometr.
that we are now able to pull out
bounces off objects
from other objects, like plants.
na przykład z roślinami.
whose fleece was white as snow,
owcę ma, owcę ma,
that lamb was sure to go.
Ach, biała jest jak mgła.
that speech again recovered
of that same bag of chips.
whose fleece was white as snow,
owcę ma, owcę ma,
that lamb was sure to go.
Ach, biała jest jak mgła.
the first words
into his phonograph in 1877.
do fonografu w 1877 roku.
recording devices in history.
nagrań głosu w historii.
onto a diaphragm
engraved the sound on tinfoil
na folii aluminiowej,
replaying sound with Edison's phonograph.
za pomocą fonografu Edisona.
testing, one two three.
whose fleece was white as snow,
owcę ma, owcę ma,
the lamb was sure to go.
Ach, biała jest jak mgła.
whose fleece was white as snow,
owcę ma, owcę ma,
the lamb was sure to go.
Ach, biała jest jak mgła.
in pretty much similar quality
vibrate to sound with cameras,
kamerą oddaloną o kilka metrów,
behind soundproof glass.
able to recover in that case.
whose fleece was white as snow,
owcę ma, owcę ma,
the lamb was sure to go.
Ach, biała jest jak mgła.
the first application that comes to mind.
która się przy tym nasuwa.
for other things as well.
i do czegoś innego.
to use it, for example,
będzie można na przykład
in space, but light can.
ale światło tak.
for this new technology.
that we know are there
o których wiedzieliśmy,
to see with our own eyes until now.
nie widać było gołym okiem.
is a result of a collaboration
jest wynikiem współpracy
of people you see here,
to check out our website,
this world of tiny motions.
odkrywając świat maleńkich ruchów.
ABOUT THE SPEAKER
Michael Rubinstein - Research scientist, GoogleComputer scientist Michael Rubinstein and his team have developed a "motion microscope" that can show video footage of barely perceivable movements, like breaths and heartbeats.
Why you should listen
Michael Rubinstein zooms in on what we can't see and mangnifies it by thirty or a hundred times. His "motion microscope," developed at MIT with Microsoft and Quanta Research, picks up on subtle motion and color changes in videos and blows them up for the naked eye to see. The result: fun, cool, creepy videos.
Rubinstein is a research scientist at a new Cambridge-based Google lab for computer vision research. He has a PhD in computer science and electrical engineering from MIT.
Michael Rubinstein | Speaker | TED.com