English-Video.net comment policy

The comment field is common to all languages

Let's write in your language and use "Google Translate" together

Please refer to informative community guidelines on TED.com

TEDIndia 2009

Pranav Mistry: The thrilling potential of SixthSense technology

Pranav Mistry:第六感技术的惊异潜力

Filmed
Views 16,209,805

在TEDIndia,Pranav Mistry 展示了几项让实体世界和数字世界互动的工具,包括深入检视他的"第六感运算装置",以及划时代的纸"计算机"。在问答中,Mistry 说,他要开放"第六感运算"背后的软件程序代码,让可能性无限延伸。

- Director of research, Samsung Research America
As an MIT grad student, Pranav Mistry invented SixthSense, a wearable device that enables new interactions between the real world and the world of data. Full bio

We grew up
我们生长在
00:15
interacting with the physical objects around us.
和周围物体互动的环境里
00:17
There are an enormous number of them
有很多很多物品,
00:20
that we use every day.
是我们每天都要用到的
00:22
Unlike most of our computing devices,
和大部分计算机软件相比,
00:24
these objects are much more fun to use.
这些实体有趣多了。
00:27
When you talk about objects,
当我们提到物品,
00:30
one other thing automatically comes attached to that thing,
会立即出现和这东西有关的另一件事 --
00:33
and that is gestures:
姿势:
00:36
how we manipulate these objects,
也就是:我们怎么使用这些物品,
00:38
how we use these objects in everyday life.
我们在每日生活中如何使用这些物品
00:40
We use gestures not only to interact with these objects,
我们不只运用不同姿势来使用物体
00:43
but we also use them to interact with each other.
也用来和别人沟通。
00:46
A gesture of "Namaste!", maybe, to respect someone,
合十的姿势,可能是表示尊敬某人
00:48
or maybe --
或者是 --
00:51
in India I don't need to teach a kid that this means
在印度,不必教,小孩都知道这是 --
00:52
"four runs" in cricket.
板球的"4"的意思
00:54
It comes as a part of our everyday learning.
这是我们的生活常识
00:56
So, I am very interested,
所以,我一开始,就很有兴趣
00:59
from the beginning, that how --
想了解, --
01:01
how our knowledge
我们对于
01:03
about everyday objects and gestures,
日常用品和姿势的认知,
01:05
and how we use these objects,
以及,如何把这些物品
01:07
can be leveraged to our interactions with the digital world.
运用在我们和数字世界的沟通上
01:09
Rather than using a keyboard and mouse,
为什么没有键盘和鼠标,
01:12
why can I not use my computer
我就没办法使用计算机?
01:15
in the same way that I interact in the physical world?
为什么和计算机沟通,不能和实体世界沟通一样?
01:18
So, I started this exploration around eight years back,
我的探索从八年前开始
01:21
and it literally started with a mouse on my desk.
从我桌上的鼠标开始
01:24
Rather than using it for my computer,
我不是在计算机屏幕上使用它
01:27
I actually opened it.
而是拆开它,
01:30
Most of you might be aware that, in those days,
你们都知道,在那个年代,
01:33
the mouse used to come with a ball inside,
鼠标里面有个球,
01:35
and there were two rollers
还有两个滚轮,
01:37
that actually guide the computer where the ball is moving,
所以,当鼠标移动时,
01:39
and, accordingly, where the mouse is moving.
滚轮会告诉计算机,球滚动的方向。
01:42
So, I was interested in these two rollers,
我对滚轮有兴趣,
01:44
and I actually wanted more, so I borrowed another mouse from a friend --
但还需要多几个,所以就跟朋友借他的鼠标
01:47
never returned to him --
一直没还他 --
01:50
and I now had four rollers.
这样就有了四个滚轮。
01:52
Interestingly, what I did with these rollers is,
我怎么用这些滚轮呢--
01:54
basically, I took them off of these mouses
基本上,我把它们从鼠标里拿出来
01:57
and then put them in one line.
放在一条在线
02:00
It had some strings and pulleys and some springs.
有线、滑带和弹簧
02:02
What I got is basically a gesture interface device
我做出了一个侦测姿势的接口装置。
02:05
that actually acts as a motion-sensing device
像个动作侦测装置,
02:08
made for two dollars.
成本只要两块美元。
02:12
So, here, whatever movement I do in my physical world
所以,现在,不论我在实体世界做什么,
02:14
is actually replicated inside the digital world
在数字的世界里就会反映出来
02:17
just using this small device that I made, around eight years back,
只要用这个我8年前做的小东西就可以,
02:20
in 2000.
那是2000年。
02:23
Because I was interested in integrating these two worlds,
我对于整合实体和数字世界有兴趣,
02:25
I thought of sticky notes.
我想到便利贴。
02:27
I thought, "Why can I not connect
我想, "何不把
02:29
the normal interface of a physical sticky note
实体便利贴的接口,和
02:32
to the digital world?"
数字便利贴整合在一起?"
02:34
A message written on a sticky note to my mom
在便利贴上写给我妈妈的留言
02:36
on paper
纸条
02:38
can come to an SMS,
可以用简讯传递。
02:39
or maybe a meeting reminder
或是写在纸上的会议通知
02:41
automatically syncs with my digital calendar --
自动和我的数字行事历同步 --
02:43
a to-do list that automatically syncs with you.
待办事项会自动在计算机上同步。
02:45
But you can also search in the digital world,
但你也同时可以在数字环境里搜寻,
02:48
or maybe you can write a query, saying,
或者是,你可以写下问题, 如,
02:51
"What is Dr. Smith's address?"
"史教授的地址?"
02:53
and this small system actually prints it out --
然后这个小系统就把地址打印出来 --
02:55
so it actually acts like a paper input-output system,
这就像是个纸做的输出入系统,
02:57
just made out of paper.
用纸就可以做到.
02:59
In another exploration,
另一项探索是,
03:05
I thought of making a pen that can draw in three dimensions.
我想到用一枝可以画3D效果的笔
03:07
So, I implemented this pen
所以就设计出这支笔
03:10
that can help designers and architects
帮助设计师和建筑师
03:12
not only think in three dimensions,
不只以三度空间思考,
03:14
but they can actually draw
也可以画3D图形
03:16
so that it's more intuitive to use that way.
这样用起来就更直觉多了。
03:18
Then I thought, "Why not make a Google Map,
我又想, "何不做一个实体世界的
03:20
but in the physical world?"
Google地图?"
03:22
Rather than typing a keyword to find something,
不必输入关键词来找东西,
03:24
I put my objects on top of it.
而是放这个东西在地图上。
03:27
If I put a boarding pass, it will show me where the flight gate is.
如果我把登机证放在地图上,它会显示登机口的位置
03:29
A coffee cup will show where you can find more coffee,
放咖啡杯,它会显示咖啡厅的位置,
03:32
or where you can trash the cup.
或垃圾筒的位置.
03:35
So, these were some of the earlier explorations I did because
这些是早期我做的实验,
03:37
the goal was to connect these two worlds seamlessly.
我的目的是紧密衔接这两个世界.
03:40
Among all these experiments,
在这些实验之中,
03:44
there was one thing in common:
有一个共通点:
03:46
I was trying to bring a part of the physical world to the digital world.
我都会把实体的东西带进数字环境里.
03:48
I was taking some part of the objects,
我把物品,
03:52
or any of the intuitiveness of real life,
或生活中,直觉式的东西,
03:55
and bringing them to the digital world,
带进数字世界里,
03:58
because the goal was to make our computing interfaces more intuitive.
目的是让计算机接口更人性化
04:01
But then I realized that we humans
但是后来我了解到
04:04
are not actually interested in computing.
人们对计算机没有兴趣
04:06
What we are interested in is information.
人们有兴趣的是信息。
04:09
We want to know about things.
我们想知道更多事情.
04:12
We want to know about dynamic things going around.
我们想知道周围的各种动态
04:14
So I thought, around last year -- in the beginning of the last year --
所以,大约在去年,去年年初的时候--
04:16
I started thinking, "Why can I not take this approach in the reverse way?"
我开始想, "我何不颠倒我的研究方向呢?"
04:21
Maybe, "How about I take my digital world
或许, "把数字世界的数字信息,
04:24
and paint the physical world with that digital information?"
描画在实体世界里??"
04:27
Because pixels are actually, right now, confined in these rectangular devices
因为这些影像,都被包在这些方方的装置里
04:32
that fit in our pockets.
然后放进口袋里.
04:36
Why can I not remove this confine
我何不把这个形体打破
04:38
and take that to my everyday objects, everyday life
把信息放进日常生活中?
04:41
so that I don't need to learn the new language
这样我也不必学新的、
04:44
for interacting with those pixels?
和这些象素沟通的语言?
04:46
So, in order to realize this dream,
为了实现这个梦想,
04:50
I actually thought of putting a big-size projector on my head.
我真的想过把一个投影机放在我的头上
04:52
I think that's why this is called a head-mounted projector, isn't it?
这就是所谓「投(头)影机」的意思,对吧?!
04:55
I took it very literally,
我照着字面意思做了
04:58
and took my bike helmet,
我把自行车的头盔
05:00
put a little cut over there so that the projector actually fits nicely.
割掉一点,让投影机可以放得进去.
05:02
So now, what I can do --
这样,我可以 --
05:05
I can augment the world around me with this digital information.
在真实世界中用数字讯息环绕我
05:07
But later,
但是,后来
05:11
I realized that I actually wanted to interact with those digital pixels, also.
我想到 我也要和这些计算机像素沟通.
05:13
So I put a small camera over there,
所以我加了一个小摄影机,
05:16
that acts as a digital eye.
当作数位眼睛.
05:18
Later, we moved to a much better,
之后, 我们进一步,做成--
05:20
consumer-oriented pendant version of that,
使用者导向的颈挂式,
05:22
that many of you now know as the SixthSense device.
就是很多人知道的「第六感计算装置」.
05:24
But the most interesting thing about this particular technology
这技术最有趣的地方是
05:27
is that you can carry your digital world with you
你可以把数字世界带着走
05:30
wherever you go.
到任何地方都可以.
05:34
You can start using any surface, any wall around you,
你可以用任何表面或墙壁,
05:36
as an interface.
当成界面.
05:39
The camera is actually tracking all your gestures.
这录像机随时都在侦测你的动作.
05:41
Whatever you're doing with your hands,
不论双手在做什么,
05:44
it's understanding that gesture.
它都知道.
05:46
And, actually, if you see, there are some color markers
还有,你看那些色笔
05:48
that in the beginning version we are using with it.
那是我们早期用的.
05:50
You can start painting on any wall.
可以在任何墙壁上画画.
05:53
You stop by a wall, and start painting on that wall.
可以停在墙壁前面,开始在墙上作画.
05:55
But we are not only tracking one finger, here.
而且我们不只侦测一根手指.
05:58
We are giving you the freedom of using all of both of your hands,
我们让你可以用两只手全部,
06:00
so you can actually use both of your hands to zoom into or zoom out
所以可以用两只手去放大缩小--
06:04
of a map just by pinching all present.
地图,用捏的.
06:07
The camera is actually doing --
录像机 --
06:09
just, getting all the images --
收集所有影像 --
06:12
is doing the edge recognition and also the color recognition
执行动作辨识和颜色辨识
06:13
and so many other small algorithms are going on inside.
有很多小程序在里面跑
06:16
So, technically, it's a little bit complex,
技术上有点复杂,
06:19
but it gives you an output which is more intuitive to use, in some sense.
但是让人可以用的很自然
06:21
But I'm more excited that you can actually take it outside.
我更兴奋的是,可以带到户外去用
06:24
Rather than getting your camera out of your pocket,
不必掏出口袋里的照相机,
06:27
you can just do the gesture of taking a photo
只要一个照相的姿势
06:30
and it takes a photo for you.
它就替你照相了.
06:33
(Applause)
(掌声)
06:35
Thank you.
谢谢.
06:39
And later I can find a wall, anywhere,
拍完之后,我随便找一面墙,
06:41
and start browsing those photos
就开始浏览这些照片
06:43
or maybe, "OK, I want to modify this photo a little bit
或, "我想修改一下这些照片
06:45
and send it as an email to a friend."
然后用电子邮件寄给朋友."
06:47
So, we are looking for an era where
我们面对的世代是 --
06:49
computing will actually merge with the physical world.
与实体世界融合在一起的运算
06:52
And, of course, if you don't have any surface,
如果你没有平面可用,
06:55
you can start using your palm for simple operations.
手掌也可以处理简单的功能.
06:58
Here, I'm dialing a phone number just using my hand.
我在这里只用我的手,拨电话号码.
07:01
The camera is actually not only understanding your hand movements,
摄影机不只了解你手部的动作,
07:07
but, interestingly,
而且,
07:10
is also able to understand what objects you are holding in your hand.
它还知道在你手里拿着的是什么东西.
07:11
What we're doing here is actually --
我们现在正在做的是 --
07:14
for example, in this case,
举个例, 在这里,
07:17
the book cover is matched
这本书的封面
07:19
with so many thousands, or maybe millions of books online,
正在和在线的数以百万计的书封面比对,
07:21
and checking out which book it is.
找寻这是哪一本书.
07:24
Once it has that information,
一旦找到数据,
07:26
it finds out more reviews about that,
它会找到书评,
07:27
or maybe New York Times has a sound overview on that,
或者,可能纽约时报有个有声的简介,
07:29
so you can actually hear, on a physical book,
你就可以, 在实体书上,听到
07:32
a review as sound.
有声的书评.
07:34
("famous talk at Harvard University ...")
("哈佛大学的著名演讲 ...")
07:36
This was Obama's visit last week to MIT.
这是欧巴玛总统上周来MIT的演讲.
07:38
("... and particularly I want to thank two outstanding MIT ...")
("... 我特别要感谢2位MIT ...")
07:42
So, I was seeing the live [video] of his talk, outside, on just a newspaper.
我从报纸上,看到他演讲的实况录像.
07:46
Your newspaper will show you live weather information
你的报纸会给你看动态天气报导
07:51
rather than having it updated -- like, you have to check your computer
不必去更新数据 – 这原本,要上计算机
07:54
in order to do that, right?
才找得到, 是吗?
07:57
(Applause)
(掌声)
07:59
When I'm going back, I can just use my boarding pass
我回印度时, 我只要拿出我的登机证
08:04
to check how much my flight has been delayed,
就可以知道我的班机延误多久,
08:07
because at that particular time,
因为在这种时候,
08:09
I'm not feeling like opening my iPhone,
我不想打开iPhone,
08:11
and checking out a particular icon.
点选某个功能图案.
08:13
And I think this technology will not only change the way --
我相信这个技术不只改变--
08:15
yes. (Laughter)
是的. (笑声)
08:18
It will change the way we interact with people, also,
也会改变我们和别人的交流
08:20
not only the physical world.
不只在实体世界里.
08:22
The fun part is, I'm going to the Boston metro,
好玩的是,我在波士顿的捷运上
08:24
and playing a pong game inside the train
玩踢毽子游戏
08:27
on the ground, right?
在地上玩, 不错吧?
08:30
(Laughter)
(笑声)
08:32
And I think the imagination is the only limit
我相信,当这种技术和实体生活混在一起时
08:33
of what you can think of
想象力是唯一能限制--
08:35
when this kind of technology merges with real life.
我们的东西。
08:37
But many of you argue, actually, that
但很多人会说--
08:39
all of our work is not only about physical objects.
我的工作和实体物品没什么关系.
08:41
We actually do lots of accounting and paper editing
我们做的大多是会计、编辑这类的事
08:44
and all those kinds of things; what about that?
对于这些,你怎么处理?
08:47
And many of you are excited about the next generation tablet computers
很多人很期待新一代的平板计算机
08:49
to come out in the market.
上市
08:53
So, rather than waiting for that,
与其等待
08:55
I actually made my own, just using a piece of paper.
,我干脆自己做一个﹐只用了一张纸
08:57
So, what I did here is remove the camera --
我把录像机上的--
09:00
All the webcam cameras have a microphone inside the camera.
所有网络度影机上都有个麦克风 .
09:02
I removed the microphone from that,
我把麦克风拿下来
09:06
and then just pinched that --
夹在--
09:09
like I just made a clip out of the microphone --
就像是做了个夹式麦克风 --
09:11
and clipped that to a piece of paper, any paper that you found around.
夹在纸上, 随便的一张纸.
09:14
So now the sound of the touch
每当我碰到纸的时候,
09:18
is getting me when exactly I'm touching the paper.
这在纸上接触的声音就会通知计算机.
09:21
But the camera is actually tracking where my fingers are moving.
录像机还在追踪我的手指的移动
09:24
You can of course watch movies.
你当然也可以看电影
09:28
("Good afternoon. My name is Russell ...
("午安,我叫罗素 ...")
09:31
and I am a Wilderness Explorer in Tribe 54.")
("... 我是第54团的荒野探险者.")
09:34
And you can of course play games.
也可以玩游戏.
09:37
(Car engine)
(汽车引擎声)
09:40
Here, the camera is actually understanding how you're holding the paper
摄影机知道你拿纸的方向
09:43
and playing a car-racing game.
就可以玩赛车游戏
09:46
(Applause)
(掌声)
09:48
Many of you already must have thought, OK, you can browse.
很多人早又想到了,可以浏览
09:52
Yeah. Of course you can browse to any websites
对,当然可以浏览任何网站
09:54
or you can do all sorts of computing on a piece of paper
甚至在纸上做各种运算
09:57
wherever you need it.
在任何你需要的地方
10:00
So, more interestingly,
更有趣的是
10:01
I'm interested in how we can take that in a more dynamic way.
我想把这个功能变得更强大一点
10:04
When I come back to my desk I can just pinch that information
当我回到桌上,我可以捏住那个信息,--
10:07
back to my desktop
然后放到我的计算机屏幕上
10:10
so I can use my full-size computer.
这样我就可以用我的桌上计算机
10:12
(Applause)
(掌声)
10:15
And why only computers? We can just play with papers.
为什么要计算机? 用纸也很好玩.
10:17
Paper world is interesting to play with.
纸的世界很好玩.
10:20
Here, I'm taking a part of a document
我把文章的一部分
10:23
and putting over here a second part from a second place --
放在这里, 当成第二部份 --
10:25
and I'm actually modifying the information
然后调整--
10:29
that I have over there.
这里的信息.
10:32
Yeah. And I say, "OK, this looks nice,
好,然后我说, "OK, 这样很好,
10:34
let me print it out, that thing."
我要打印出来."
10:37
So I now have a print-out of that thing, and now --
就有了一份打印文件, 这样 --
10:39
the workflow is more intuitive the way we used to do it
工作流程比我们以前用的方式更人性了
10:41
maybe 20 years back,
像20年前的工作方式,
10:44
rather than now switching between these two worlds.
而不是像现在,要在两个世界里切换
10:47
So, as a last thought,
最后,
10:50
I think that integrating information to everyday objects
我相信把信息和所有对象整合,
10:53
will not only help us to get rid of the digital divide,
不仅可以消灭数字落差、
10:56
the gap between these two worlds,
把两个世界间的鸿沟填满,
11:01
but will also help us, in some way,
还可以帮助我们,
11:03
to stay human,
保有人性,
11:05
to be more connected to our physical world.
让我们和实体世界更连结.
11:07
And it will actually help us not end up being machines
最终会帮助我们,不要变成--
11:13
sitting in front of other machines.
坐在机器前面的另一部机器。
11:16
That's all. Thank you.
就这样. 谢谢.
11:18
(Applause)
(掌声)
11:21
Thank you.
谢谢.
11:35
(Applause)
(掌声)
11:36
Chris Anderson: So, Pranav,
Chris Anderson: 嗯﹐Pranav,
11:39
first of all, you're a genius.
首先,你是个天才.
11:40
This is incredible, really.
这真的太棒了,真的
11:43
What are you doing with this? Is there a company being planned?
你预备怎么做? 你想开个公司吗﹖
11:46
Or is this research forever, or what?
还是一直继续研究下去?还是有其它的打算?
11:49
Pranav Mistry: So, there are lots of companies --
Pranav Mistry: 很多公司 --
11:51
actually sponsor companies of Media Lab --
就是 Medi L b的赞助者 --
11:53
interested in taking this ahead in one or another way.
有兴趣以其它方法继续研究
11:54
Companies like mobile phone operators
像行动通讯公司
11:57
want to take this in a different way than the NGOs in India,
和印度非营利机构的应用方法便不同
11:59
[who] are thinking, "Why can we only have 'Sixth Sense'?
这些机构想 "为什么只有'第六感'?
12:02
We should have a 'Fifth Sense' for missing-sense people
我们应该为残障人士,设置第五感
12:05
who cannot speak.
如,哑巴.
12:07
This technology can be used for them to speak out in a different way
这种技术可以让他们用另一种方式「说」出来
12:08
with maybe a speaker system."
配个喇叭就可以."
12:11
CA: What are your own plans? Are you staying at MIT,
C : 你自己的打算呢? 要留在MIT吗
12:12
or are you going to do something with this?
还是你也要参与这些计划?
12:15
PM: I'm trying to make this more available to people
PM: 我正试着让这技术更广泛的被人们使用
12:16
so that anyone can develop their own SixthSense device,
让大家都能开发自己的"第六感"装置
12:18
because the hardware is actually not that hard to manufacture
因为硬件其实不难制造
12:21
or hard to make your own.
自己做也不难
12:26
We will provide all the open source software for them,
我们会提供开放式程序代码软件给大家
12:28
maybe starting next month.
可能下个月就可以
12:30
CA: Open source? Wow.
C :开放程序代码﹖哇
12:32
(Applause)
(掌声)
12:34
CA: Are you going to come back to India with some of this, at some point?
C : 你会回到印度做这些计划吗?
12:39
PM: Yeah. Yes, yes, of course.
PM: 是,是,当然.
12:42
CA: What are your plans? MIT?
C : 你的计划呢? MIT?
12:44
India? How are you going to split your time going forward?
印度? 未来怎样分配你的时间?
12:46
PM: There is a lot of energy here. Lots of learning.
PM: 这里有很大的能量. 很多东西可以学
12:48
All of this work that you have seen is all about
你刚刚看到的,都是我在
12:51
my learning in India.
印度学的.
12:53
And now, if you see, it's more about the cost-effectiveness:
往成本效益方面去考虑:
12:55
this system costs you $300
这个系统只要300美元
12:58
compared to the $20,000 surface tables, or anything like that.
和2万美元的桌面计算机相比
13:00
Or maybe even the $2 mouse gesture system
或甚至2块美元的鼠标
13:03
at that time was costing around $5,000?
当年可能要价 5,000 美元?
13:06
So, we actually -- I showed that, at a conference, to
不久前,我把这东西展示给
13:09
President Abdul Kalam, at that time,
印度总统看
13:13
and then he said, "OK, we should use this in Bhabha Atomic Research Centre
他说: "我们应该在原子研究所里
13:15
for some use of that."
用这个技术做些研究."
13:18
So I'm excited about how I can bring the technology to the masses
我很期待可以把这些技术带给普罗大众
13:20
rather than just keeping that technology in the lab environment.
而不是把这些技术留在实验室里
13:23
(Applause)
(掌声)
13:26
CA: Based on the people we've seen at TED,
C : 我们在 TED,遇过的人之中
13:30
I would say you're truly one of the two or three
我可以说你是少数2-3个
13:33
best inventors in the world right now.
世界上顶尖的发明家之一
13:34
It's an honor to have you at TED.
TED很荣幸邀你来演讲.
13:36
Thank you so much.
非常感谢.
13:38
That's fantastic.
真是太棒了.
13:40
(Applause)
(掌声)
13:41
Translated by Coco Shen
Reviewed by Zachary Lin Zhao

▲Back to top

About the speaker:

Pranav Mistry - Director of research, Samsung Research America
As an MIT grad student, Pranav Mistry invented SixthSense, a wearable device that enables new interactions between the real world and the world of data.

Why you should listen

When Pranav Mistry was a PhD student in the Fluid Interfaces Group at MIT's Media Lab, he worked with lab director Pattie Maes to create some of the most entertaining and thought-provoking interfaces the world had ever seen. And not just computer interfaces, mind you -- these are ways to help the digital and the actual worlds interface. Imagine: intelligent sticky notes, Quickies, that can be searched and can send reminders; a pen that draws in 3D; and TaPuMa, a tangible public map that can act as Google of physical world. And of course the legendary SixthSense, which is now open sourced

Before his studies at MIT, he worked with Microsoft as a UX researcher; he's a graduate of IIT. Now, as director of research at Samsung Research America, Mistry heads the Think Tank Team, an interdisciplinary group of researchers that hunts for new ways to mix digital informational with real-world interactions. As an example, Mistry launched the company's smartwatch, the Galaxy Gear, in 2013.

More profile about the speaker
Pranav Mistry | Speaker | TED.com