Michael Rubinstein: See invisible motion, hear silent sounds
麥可·魯賓斯坦: 看到無法看見的動作,聽見無法聽到的聲音。酷炫?詭異?我們尚不能定論
Computer scientist Michael Rubinstein and his team have developed a "motion microscope" that can show video footage of barely perceivable movements, like breaths and heartbeats. Full bio
Double-click the English transcript below to play the video.
microscopes have revolutionized our world.
顯微鏡對世界產生革命性的影響
of objects, life and structures
物體、生命和結構
to see with our naked eyes.
to science and technology.
to a new type of microscope,
like a regular microscope
and image processing
and color changes in objects and people,
人與物的微小運動和顏色變化
for us to see with our naked eyes.
in a completely new way.
changes its color very slightly
我們的皮膚會產生極細微的顏色變化
look at other people,
sitting next to you,
or their face changing color.
it appears to us like a static picture,
顯示出的是一張靜態的圖片
through our new, special microscope,
a completely different image.
in the color of Steve's skin,
史蒂夫臉部皮膚的微小顏色變化
so that they become visible.
是多麼的快速
Steve's heart is beating,
血液實際上如何流過他的臉部
that the blood flows in his face.
to visualize the pulse,
recover our heart rates,
and without touching the patients.
而不需要觸碰病人
we extracted from a neonatal baby
with a regular DSLR camera,
with a standard monitor in a hospital.
a video we recorded.
with other videos as well.
from "Batman Begins" here
"蝙蝠俠:開戰時刻"裡的一個片段
he's wearing makeup,
we're able to extract his pulse
我們仍能夠取得他的脈搏
in the light that are recorded
so that we can see them.
are extremely subtle,
是非常細微的
when you try to separate them
image processing techniques
of the color at each pixel in the video,
非常精確的顏色辨識
changes over time,
of enhanced videos, or magnified videos,
或是放大的影像
not just to show tiny changes in color,
但後來我們不僅能展示微小的顏色變化
that gets recorded in our cameras
of the object changes,
when she was about two months old.
about three years ago.
to make sure our babies are healthy,
我希望我們的小孩健康
that they're alive, of course.
when she was asleep.
with a standard baby monitor.
差不多就像這樣
there's not too much information there.
但資訊顯現的不多
or more informative, or more useful,
at the view like this.
and I magnified them 30 times,
daughter was indeed alive and breathing.
的確活著而且有呼吸
in the original video,
the breathing becomes much more visible.
呼吸變得更容易觀察
a lot of phenomena
with our new motion microscope.
are pulsing in our bodies.
如何在我們身體裡脈動
are constantly moving
right after my daughter was born,
too much sleep. (Laughter)
(大笑)
we can extract
small facial expressions.
our thoughts or our emotions.
mechanical movements,
and diagnose machinery problems,
sway in the wind and react to forces.
在風吹、地震影響下的晃動
knows how to measure in various ways,
各種不同測量物體的方式
motions as they happen
this new technology,
others could use and experiment with it.
讓其他人能夠使用並測試它
even created this nice website
還架設了一個很好的網站
and process them online,
in computer science or programming,
和寫軟體的經驗
with this new microscope.
just a couple of examples
a YouTube user called Tamez85.
Tamez85 所做的影片
movements during pregnancy.
pulsing veins in their hands.
unless you use guinea pigs,
才叫真的科學
is called Tiffany,
it is the first rodent on Earth
這是世界上第一隻囓齒動物
by a design student at Yale.
耶魯大學設計系的學生寄給我的
if there's any difference
她同學的移動方式是否有所差異
然後放大他們的動作
and then magnified their motions.
still pictures come to life.
all those examples
a new way to look at the world,
一種新的方式去觀察世界
new and creative ways of using it.
有趣、有創意的新方式去使用
to look at the world in a new way,
we can do with our cameras.
produce tiny motions
our cameras to measure?
that we focused on recently is sound.
is basically changes
travel through the air.
and they create small vibrations in them,
and how we record sound.
also produces visual motions.
that are not visible to us
with the right processing.
my great singing skills.
of my throat while I was humming.
我喉嚨的高速影片
you'll be able to see,
we can see all the motions and ripples
in producing the sound.
can break a wine glass
frequency of that glass
and magnify the motions 250 times,
how the glass vibrates
to seeing every day.
It gave us this crazy idea.
給我們一個瘋狂的想法
and recover sound from video
並恢復影像中的聲音嗎?
that sound waves create in objects,
影響物體產生的微小顫動
back into the sounds that produced them.
everyday objects into microphones.
讓所有東西都變成麥克風
that was lying on a table,
bag of chips into a microphone
藉由拍攝將它變成我們的麥克風
而生的細微運動
that sound waves create in it.
that we played in the room.
we recorded of that bag of chips.
to see anything going on in that video
你無法看見影片中發生甚麼事
to recover just by analyzing
from video signals.
of the scale of the motions here,
of chips to move less than a micrometer.
洋芋片包裝袋移動不到一微米
that we are now able to pull out
bounces off objects
from other objects, like plants.
whose fleece was white as snow,
牠的毛和雪一樣白
that lamb was sure to go.
that speech again recovered
這裡是那段話被再次還原
of that same bag of chips.
whose fleece was white as snow,
牠的毛和雪一樣白
that lamb was sure to go.
"Mary Had a Little Lamb"
the first words
into his phonograph in 1877.
recording devices in history.
onto a diaphragm
engraved the sound on tinfoil
replaying sound with Edison's phonograph.
如何錄入和重放
testing, one two three.
whose fleece was white as snow,
羊毛像雪一般白
the lamb was sure to go.
whose fleece was white as snow,
羊毛像雪一般白
the lamb was sure to go.
in pretty much similar quality
vibrate to sound with cameras,
behind soundproof glass.
able to recover in that case.
whose fleece was white as snow,
羊毛像雪一般白
the lamb was sure to go.
the first application that comes to mind.
是第一個被想到的應用方式
for other things as well.
to use it, for example,
in space, but light can.
for this new technology.
that we know are there
to see with our own eyes until now.
is a result of a collaboration
of people you see here,
to check out our website,
歡迎各位看看我們的網站
this world of tiny motions.
ABOUT THE SPEAKER
Michael Rubinstein - Research scientist, GoogleComputer scientist Michael Rubinstein and his team have developed a "motion microscope" that can show video footage of barely perceivable movements, like breaths and heartbeats.
Why you should listen
Michael Rubinstein zooms in on what we can't see and mangnifies it by thirty or a hundred times. His "motion microscope," developed at MIT with Microsoft and Quanta Research, picks up on subtle motion and color changes in videos and blows them up for the naked eye to see. The result: fun, cool, creepy videos.
Rubinstein is a research scientist at a new Cambridge-based Google lab for computer vision research. He has a PhD in computer science and electrical engineering from MIT.
Michael Rubinstein | Speaker | TED.com