TED2009
Pattie Maes + Pranav Mistry: Meet the SixthSense interaction
派蒂‧梅斯示範“第六感”，能改變市場的隨身科技產品
Filmed:
Readability: 4.4
11,289,293 views
這個示範來自於派蒂‧梅斯在麻省理工學院的媒體實驗室，由帕納‧密絲利主領並在ＴＥＤ倍受矚目。它是一個可戴在身上的裝置，連接投影機能達到與週遭環境作真實互動。想像一下“關鍵報告”的加強版。
Pattie Maes - Researcher
As head of the MIT Media Lab's Fluid Interfaces Group, Pattie Maes researches the tools we use to work with information and connect with one another. Full bioPranav Mistry - Director of research, Samsung Research America
As an MIT grad student, Pranav Mistry invented SixthSense, a wearable device that enables new interactions between the real world and the world of data. Full bio
As head of the MIT Media Lab's Fluid Interfaces Group, Pattie Maes researches the tools we use to work with information and connect with one another. Full bioPranav Mistry - Director of research, Samsung Research America
As an MIT grad student, Pranav Mistry invented SixthSense, a wearable device that enables new interactions between the real world and the world of data. Full bio
Double-click the English transcript below to play the video.
00:12
I've been intrigued by this question
0
0
2000
我一直對這個問題很有興趣
00:14
of whether we could evolve or develop a sixth sense --
1
2000
3000
就是我們能不能夠演變出或發展出第六感。
00:17
a sense that would give us seamless access
2
5000
6000
一種能夠讓我們直接
00:23
and easy access to meta-information
3
11000
3000
且便捷地取得詮釋資訊
00:26
or information that may exist somewhere
4
14000
3000
或現存資料
00:29
that may be relevant to help us make the right decision
5
17000
3000
能夠幫助我們於
00:32
about whatever it is that we're coming across.
6
20000
3000
當下遇到的問題做出正確的決定。
00:35
And some of you may argue,
7
23000
3000
有些人可能會認為
00:38
well, don't today's cell phones do that already?
8
26000
3000
現今的手機不就已經做到這點嗎？
00:41
But I would say no.
9
29000
2000
但我覺得並非如此。
00:43
When you meet someone here at TED --
10
31000
2000
當你在ＴＥＤ與別人會面時─
00:45
and this is the top networking place, of course, of the year --
11
33000
3000
毫無疑問的，這是每年最佳的社交場所─
00:48
you don't shake somebody's hand
12
36000
2000
難道你會與別人握手
00:50
and then say, "Can you hold on for a moment
13
38000
3000
然後說，“你能等一下嗎
00:53
while I take out my phone and Google you?"
14
41000
2000
我要用手機連上Google查詢你?”
00:55
Or when you go to the supermarket
15
43000
4000
或是當你到超級市場
00:59
and you're standing there in that huge aisle
16
47000
2000
站在那個龐大的貨架前
01:01
of different types of toilet papers,
17
49000
3000
面對著各種不同種類的衛生紙，
01:04
you don't take out your cell phone, and open a browser,
18
52000
4000
你不會拿出手機，打開瀏覽器，
01:08
and go to a website to try to decide
19
56000
2000
連上一個網站然後試著決定
01:10
which of these different toilet papers
20
58000
3000
各種不同的衛生紙中
01:13
is the most ecologically responsible purchase to make.
21
61000
3000
哪個購買選擇是最環保的？
01:16
So we don't really have easy access
22
64000
3000
事實上我們無法迅速
01:19
to all this relevant information
23
67000
2000
取得所有相關的資訊，
01:21
that can just help us make optimal decisions
24
69000
3000
來幫助我們做出最適當的決定
01:24
about what to do next and what actions to take.
25
72000
3000
下一步要做什麼，作出什麼行動。
01:27
And so my research group at the Media Lab
26
75000
4000
所以呢，我在媒體實驗室的研究小組
01:31
has been developing a series of inventions
27
79000
4000
正在研發一系列的產品
01:35
to give us access to this information
28
83000
3000
讓我們能取得這些資訊
01:38
in a sort of easy way,
29
86000
2000
利用較簡便的方式，
01:40
without requiring that the user changes any of their behavior.
30
88000
5000
並且不需要使用者改變他的行為。
01:45
And I'm here to unveil
31
93000
2000
我要在這裡展示
01:47
our latest effort,
32
95000
3000
我們最新努力的成果，
01:50
and most successful effort so far,
33
98000
2000
而目前為止最成功的樣品，
01:52
which is still very much a work in process.
34
100000
2000
雖然仍在不斷改進中
01:54
I'm actually wearing the device right now
35
102000
3000
其實我身上正戴著它
01:57
and we've sort of cobbled it together
36
105000
3000
我們利用市面上常見的零件
02:00
with components that are off the shelf --
37
108000
3000
將它組合完成─
02:03
and that, by the way, only cost 350 dollars
38
111000
3000
而且，順道一提，這裝置現在
02:06
at this point in time.
39
114000
2000
的成本只有350美元。
02:08
I'm wearing a camera, just a simple webcam,
40
116000
4000
我佩戴著一個簡單的網路攝影機，
02:12
a portable, battery-powered projection system with a little mirror.
41
120000
6000
和隨身攜帶，使用電池電力並配合鏡子的投影系統。
02:18
These components communicate to my cell phone in my pocket
42
126000
4000
這些裝置連結上我口袋裡的手機
02:22
which acts as the communication and computation device.
43
130000
4000
負責執行通訊以及運算功能。
02:26
And in the video here we see my student Pranav Mistry,
44
134000
4000
在影片裡我們看到我的學生，帕納‧密絲利
02:30
who's really the genius who's been implementing
45
138000
3000
他是設計並完成這個系統
02:33
and designing this whole system.
46
141000
2000
背後的天才。
02:35
And we see how this system
47
143000
2000
我們看的到這個系統
02:37
lets him walk up to any surface
48
145000
4000
讓他走到任何平面前
02:41
and start using his hands to interact with the information
49
149000
4000
使用他的手和投影在面前
02:45
that is projected in front of him.
50
153000
2000
的資訊進行互動。
02:47
The system tracks the four significant fingers.
51
155000
4000
這個系統能追蹤這四隻主要的手指。
02:51
In this case, he's wearing simple marker caps
52
159000
4000
現在，你可能發現
02:55
that you may recognize.
53
163000
2000
他手指上套著一般的奇異筆蓋。
02:57
But if you want a more stylish version
54
165000
2000
但如果你想要比較時髦的版本
02:59
you could also paint your nails in different colors.
55
167000
4000
你也可以把指甲塗上不同顏色。
03:03
And the camera basically tracks these four fingers
56
171000
4000
攝影機基本上能追蹤這四隻手指
03:07
and recognizes any gestures that he's making
57
175000
3000
並且辨識出他的任何手勢
03:10
so he can just go to, for example, a map of Long Beach,
58
178000
5000
舉例而言，他能直接開啟一個長堤的地圖，
03:15
zoom in and out, etc.
59
183000
2000
放大與縮小等等。
03:17
The system also recognizes iconic gestures
60
185000
3000
這個系統還能辨識出具象徵性的手勢
03:20
such as the "take a picture" gesture,
61
188000
3000
例如這個拍照的動作，
03:23
and then takes a picture of whatever is in front of you.
62
191000
3000
它會直接拍下你面前的事物。
03:26
And when he then walks back to the Media Lab,
63
194000
4000
當他走回媒體實驗室後，
03:30
he can just go up to any wall
64
198000
2000
他可以走到任何一面牆前
03:32
and project all the pictures that he's taken,
65
200000
3000
將他拍下的照片投影出來，
03:35
sort through them and organize them,
66
203000
2000
瀏覽它們並且分類管理，
03:37
and re-size them, etc.,
67
205000
2000
放大縮小等等，
03:39
again using all natural gestures.
68
207000
3000
同樣是使用完全自然的手勢。
03:42
So, some of you most likely were here two years ago
69
210000
4000
兩年前你們有些人可能也坐在這裡
03:46
and saw the demo by Jeff Han
70
214000
5000
看過了傑夫‧韓所做的示範
03:51
or some of you may think, "Well, doesn't this look like the Microsoft Surface Table?"
71
219000
3000
或許有些人會覺得，“這不是很像微軟的平面電腦嗎？”
03:54
And yes, you also interact using natural gestures,
72
222000
5000
是的，也是以自然的手勢互動，
03:59
both hands, etc.
73
227000
2000
運用雙手等等。
04:01
But the difference here is that you can use any surface,
74
229000
3000
但它的不同點在於它可以使用在任何平面上，
04:04
you can walk to up to any surface,
75
232000
3000
你可以走到任何平面前，
04:07
including your hand if nothing else is available
76
235000
3000
沒有適合的話自己的手掌也行
04:10
and interact with this projected data.
77
238000
3000
再與這些投影出來的資料進行互動
04:13
The device is completely portable,
78
241000
3000
這裝置是可以隨身攜帶的，
04:16
and can be ...
79
244000
2000
也可以是...
04:18
(Applause)
80
246000
7000
(掌聲)
04:25
So one important difference is that it's totally mobile.
81
253000
4000
所以最重要的不同之處是它完全是流動的。
04:29
Another even more important difference is that in mass production
82
257000
4000
另一項更重要的不同點是量產後
04:33
this would not cost more tomorrow than today's cell phones
83
261000
4000
它的成本不會超過現今的手機
04:37
and would actually not sort of be a bigger packaging --
84
265000
4000
且組裝完成後體積也不會很大─
04:41
could look a lot more stylish
85
269000
2000
看起來會比
04:43
than this version that I'm wearing around my neck.
86
271000
3000
我脖子上掛的版本還要時髦的多。
04:46
But other than letting some of you live out your fantasy
87
274000
6000
除了能讓你們實現跟
04:52
of looking as cool as Tom Cruise in "Minority Report,"
88
280000
4000
湯姆‧克魯斯在“關鍵報告”中一樣酷的夢想，
04:56
the reason why we're really excited about this device
89
284000
4000
真正讓我們對於這個裝置感到非常興奮的是
05:00
is that it really can act as one of these sixth-sense devices
90
288000
6000
它可以達到第六感的功能
05:06
that gives you relevant information
91
294000
3000
能夠給你有關於
05:09
about whatever is in front of you.
92
297000
2000
你面前事物的資訊。
05:11
So we see Pranav here going into the supermarket
93
299000
5000
所以我們看到帕納進入超級市場
05:16
and he's shopping for some paper towels.
94
304000
3000
準備購買一些衛生紙。
05:19
And, as he picks up a product the system can recognize
95
307000
3000
當他拿起一樣產品，系統可以辨識出
05:22
the product that he's picking up,
96
310000
2000
他手上的產品
05:24
using either image recognition or marker technology,
97
312000
4000
利用影像辨識或是標記技術，
05:28
and give him the green light or an orange light.
98
316000
3000
亮起綠燈或是橘燈。
05:31
He can ask for additional information.
99
319000
3000
他能詢問更進一步的資料。
05:34
So this particular choice here
100
322000
4000
所以目前這個選擇
05:38
is a particularly good choice, given his personal criteria.
101
326000
4000
在他自己的標準下，是個很好的選擇
05:42
Some of you may want the toilet paper with the most bleach in it
102
330000
4000
有些人可能想買加入最多漂白劑的衛生紙
05:46
rather than the most ecologically-responsible choice.
103
334000
3000
而不是最環保的選擇。
05:49
(Laughter)
104
337000
3000
(笑聲)
05:52
If he picks up a book in the bookstore,
105
340000
3000
如果他在書店裡拿起一本書，
05:55
he can get an Amazon rating --
106
343000
2000
他能取得亞馬遜書局的評分。
05:57
it gets projected right on the cover of the book.
107
345000
2000
它會直接投影在書的封面上。
05:59
This is Juan's book, our previous speaker,
108
347000
5000
這是朱恩的書，我們的上一位演講者，
06:04
which gets a great rating, by the way, at Amazon.
109
352000
2000
順道一提，這書在亞馬遜書局獲得很好的評分。
06:06
And so, Pranav turns the page of the book
110
354000
3000
另外，當帕納翻閱這本書時
06:09
and can then see additional information about the book --
111
357000
3000
還能看到更多關於這本書的資訊─
06:12
reader comments, maybe sort of information by his favorite critic, etc.
112
360000
7000
讀者評論，他最喜歡的書評給的評語等等。
06:19
If he turns to a particular page
113
367000
2000
如果他翻到特定的一頁
06:21
he finds an annotation by maybe an expert of a friend of ours
114
369000
4000
他能找到我們專業朋友寫的註解
06:25
that gives him a little bit of additional information
115
373000
2000
並給予他和那一頁內容
06:27
about whatever is on that particular page.
116
375000
3000
相關的更多資訊。
06:30
Reading the newspaper --
117
378000
2000
閱讀報紙時─
06:32
it never has to be outdated.
118
380000
3000
它永遠不會是過期的。
06:35
(Laughter)
119
383000
2000
(笑聲)
06:37
You can get video annotations of the event that you're reading about
120
385000
4000
你可以看到與正在閱讀事件相關的影片註解
06:41
You can get the latest sports scores etc.
121
389000
4000
你也能看到最新的體育比賽分數等等。
06:45
This is a more controversial one.
122
393000
3000
這是一個較有爭議性的情況。
06:48
(Laughter)
123
396000
1000
(笑聲)
06:49
As you interact with someone at TED,
124
397000
3000
當你在TED與別人互動時，
06:52
maybe you can see a word cloud of the tags,
125
400000
4000
你或許會看到一團團的標籤
06:56
the words that are associated with that person
126
404000
2000
與那個人相關的字
06:58
in their blog and personal web pages.
127
406000
3000
來自他們的部落格或個人網頁。
07:01
In this case, the student is interested in cameras, etc.
128
409000
5000
在這個例子，這位學生對相機有興趣等等。
07:06
On your way to the airport,
129
414000
2000
在你前往機場的路上，
07:08
if you pick up your boarding pass, it can tell you that your flight is delayed,
130
416000
4000
如果你拿起你的登機證，它可以告訴你飛機誤點了，
07:12
that the gate has changed, etc.
131
420000
3000
或是登機門已更改等等。
07:15
And, if you need to know what the current time is
132
423000
3000
而且如果你需要知道現在的時間
07:18
it's as simple as drawing a watch --
133
426000
4000
答案就是在你的手臂上─
07:22
(Laughter)
134
430000
1000
(笑聲)
07:23
(Applause)
135
431000
1000
(掌聲)
07:24
on your arm.
136
432000
2000
。
07:26
So that's where we're at so far
137
434000
4000
所以我們差不多就是進展到這裡
07:30
in developing this sixth sense
138
438000
4000
研發這個第六感
07:34
that would give us seamless access to all this relevant information
139
442000
4000
能夠直接給予我們關於
07:38
about the things that we may come across.
140
446000
3000
週遭事物的重要資訊。
07:41
My student Pranav, who's really, like I said, the genius behind this.
141
449000
4000
這是我的學生帕納，像我說的，他是這些背後的天才。
07:45
(Applause) (Standing ovation)
142
453000
23000
(掌聲)
08:08
He does deserve a lot of applause
143
476000
3000
他確實應該得到這麼多掌聲
08:11
because I don't think he's slept much in the last three months, actually.
144
479000
4000
因為我知道他這三個月來其實沒有睡多少。
08:15
And his girlfriend is probably not very happy about him either.
145
483000
3000
他的女朋友大概也蠻生氣他的。
08:18
But it's not perfect yet, it's very much a work in progress.
146
486000
5000
但是它現在並非完美，還需要不斷地改進
08:23
And who knows, maybe in another 10 years
147
491000
3000
誰知道呢，或許十年過後
08:26
we'll be here with the ultimate sixth sense brain implant.
148
494000
5000
我們會帶著植入腦內的終極第六感來這裡。
08:31
Thank you.
149
499000
1000
謝謝。
08:32
(Applause)
150
500000
4000
(掌聲)
ABOUT THE SPEAKERS
Pattie Maes - ResearcherAs head of the MIT Media Lab's Fluid Interfaces Group, Pattie Maes researches the tools we use to work with information and connect with one another.
Why you should listen
Pattie Maes was the key architect behind what was once called "collaborative filtering" and has become a key to Web 2.0: the immense engine of recommendations -- or "things like this" -- fueled by other users. In the 1990s, Maes' Software Agents program at MIT created Firefly, a technology (and then a startup sold to Microsoft) that let users choose songs they liked, and find similar songs they'd never heard of, by taking cues from others with similar taste. This brought a sea change in the way we interact with software, with culture and with one another.
Now Maes is working on a similarly boundary-breaking initiative. She founded Fluid Interfaces Group, also part of the MIT Media Lab, to rethink the ways in which humans and computers interact, partially by redefining both human and computer. In Maes' world (and really, in all of ours), the computer is no longer a distinct object, but a source of intelligence that's embedded in our environment. By outfitting ourselves with digital accessories, we can continually learn from (and teach) our surroundings. The uses of this tech -- from healthcare to home furnishings, warfare to supermarkets -- are powerful and increasingly real.
Pattie Maes | Speaker | TED.com
Pranav Mistry - Director of research, Samsung Research America
As an MIT grad student, Pranav Mistry invented SixthSense, a wearable device that enables new interactions between the real world and the world of data.
Why you should listen
When Pranav Mistry was a PhD student in the Fluid Interfaces Group at MIT's Media Lab, he worked with lab director Pattie Maes to create some of the most entertaining and thought-provoking interfaces the world had ever seen. And not just computer interfaces, mind you -- these are ways to help the digital and the actual worlds interface. Imagine: intelligent sticky notes, Quickies, that can be searched and can send reminders; a pen that draws in 3D; and TaPuMa, a tangible public map that can act as Google of physical world. And of course the legendary SixthSense, which is now open sourced
Before his studies at MIT, he worked with Microsoft as a UX researcher; he's a graduate of IIT. Now, as director of research at Samsung Research America, Mistry heads the Think Tank Team, an interdisciplinary group of researchers that hunts for new ways to mix digital informational with real-world interactions. As an example, Mistry launched the company's smartwatch, the Galaxy Gear, in 2013.
Pranav Mistry | Speaker | TED.com