TED Fellows Retreat 2013
James Patten: The best computer interface? Maybe ... your hands
詹姆斯．帕頓: 最好的電腦互動介面？或許是...通過你的手
Filmed:
Readability: 5
1,092,626 views
「電腦有著不可思議的強大功能，在於它極具創意的表達方式」，設計師詹姆斯．帕頓說到。但是現在，我們和電腦產生互動，主要來說，是通過打字和觸控。在這個有趣的演講和演示中，帕頓構建了一個更加通用，更加直接的方式將你的想法和點子帶入數位世界中，將電腦的互動模式從螢幕脫離，帶入你的雙手之中。
James Patten - Interaction designer
James Patten, a TED Fellow, imagines new ways for us to play with computers. Full bio
James Patten, a TED Fellow, imagines new ways for us to play with computers. Full bio
Double-click the English transcript below to play the video.
00:12
A computer is an incredibly powerful means
0
721
2667
電腦有著不可思議的強大功能，
00:15
of creative expression,
1
3388
1654
在於它極具創意的表達方式，
00:17
but for the most part,
2
5042
1571
但是大部份電腦，
00:18
that expression is confined to the screens
3
6613
2165
表達方式僅限於有限的螢幕
00:20
of our laptops and mobile phones.
4
8778
2418
也就是我們的筆電以及手機螢幕。
00:23
And I'd like to tell you a story about
5
11196
2200
我想告訴你一個故事，是關於
00:25
bringing this power of the computer
6
13396
1956
如何將這些強大的電腦
00:27
to move things around and interact with us
7
15352
2370
移動身邊的東西和我們互動，
00:29
off of the screen and into the physical world
8
17722
2913
離開屏幕並且進入現實世界，
00:32
in which we live.
9
20635
1189
也就是我們的生活之中。
00:33
A few years ago, I got a call from
10
21824
1618
幾年前，我接了一個電話，
00:35
a luxury fashion store called Barneys New York,
11
23442
2486
來自一個豪華時尚的商店，叫做巴尼斯紐約，
（巴尼斯紐約：Barneys New York，
一家著名的高檔百貨連鎖店）
（巴尼斯紐約：Barneys New York，
一家著名的高檔百貨連鎖店）
00:37
and the next thing I knew,
12
25928
1264
接下來我了解到的是，
00:39
I was designing storefront kinetic sculptures
13
27192
2693
我當時正在設計
商店展櫥裏動態的雕塑
商店展櫥裏動態的雕塑
00:41
for their window displays.
14
29885
1392
用來放在櫥窗裡展示。
00:43
This one's called "The Chase."
15
31277
1395
這個叫做“追逐”。
00:44
There are two pairs of shoes,
16
32672
1346
這裡有兩雙鞋子，
00:46
a man's pair and a woman's pair,
17
34018
1625
一雙男鞋，一雙女鞋，
00:47
and they play out this slow, tense chase
18
35643
2904
它們進行著這樣的緩慢的，緊張的追逐，
00:50
around the window
19
38547
1278
就在櫥窗當中，
00:51
in which the man scoots up behind the woman
20
39825
2225
男人嘗試迅速的走到女人的身後，
00:54
and gets in her personal space,
21
42050
1573
當他接近她時
00:55
and then she moves away.
22
43623
1935
她卻又走遠了。
00:57
Each of the shoes has magnets in it,
23
45558
1841
每雙鞋子都裝有磁鐵，
00:59
and there are magnets underneath the table
24
47399
2003
並且在平台下面也有磁鐵，
01:01
that move the shoes around.
25
49402
1964
使鞋子能夠移動。
01:03
My friend Andy Cavatorta was building
26
51366
2032
我的朋友安迪卡瓦托達當時正在建造
01:05
a robotic harp for Bjork's Biophilia tour
27
53398
3542
一個機器人豎琴，是為了
碧玉的專輯－自然定律的巡演，
碧玉的專輯－自然定律的巡演，
01:08
and I wound up building the electronics
28
56940
2392
我最後負責設計電路
01:11
and motion control software
29
59332
2189
以及動作來控制軟體，
01:13
to make the harps move and play music.
30
61521
2466
讓這些豎琴能夠演奏音樂。
01:15
The harp has four separate pendulums,
31
63987
2011
豎琴有四個分開的單擺，
01:17
and each pendulum has 11 strings,
32
65998
2126
每一個單擺都有11根琴弦，
01:20
so the harp swings on its axis and also rotates
33
68124
2488
所以每個豎琴在自己的
軸上擺動同時能夠旋轉，
軸上擺動同時能夠旋轉，
01:22
in order to play different musical notes,
34
70612
2203
這樣就能夠演奏出不同的音符，
01:24
and the harps are all networked together
35
72815
2162
並且所有的豎琴
都是通過網絡連在一起，
都是通過網絡連在一起，
01:26
so that they can play the right notes
36
74977
1800
這樣就能讓它們
演奏出正確的音符，
演奏出正確的音符，
01:28
at the right time in the music.
37
76777
2626
同時在正確的時間點演奏。
01:31
I built an interactive chemistry exhibit
38
79403
2424
我建造了一個互動的化學展品，
01:33
at the Museum of Science and Industry in Chicago,
39
81827
2599
在芝加哥的科學工業博物館，
01:36
and this exhibit lets people use physical objects
40
84426
2981
這個展品讓人們可以使用物品
01:39
to grab chemical elements off of the periodic table
41
87407
3036
將化學元素從元素週期表中取出，
01:42
and bring them together to cause
42
90443
1408
然後放在一起，
01:43
chemical reactions to happen.
43
91851
1766
引起化學反應。
01:45
And the museum noticed that people
44
93617
1924
博物館的工作人員發現
01:47
were spending a lot of time with this exhibit,
45
95541
2226
人們會在這個展品上花費大量的時間，
01:49
and a researcher from a science education center
46
97767
3147
一個來自澳大利亞
科學教育中心的研究者
科學教育中心的研究者
01:52
in Australia decided to study this exhibit
47
100914
2805
決定去研究這個展品
01:55
and try to figure out what was going on.
48
103719
2240
並且嘗試找出原因。
01:57
And she found that the physical objects
49
105959
2293
然後她發現這些人們使用的物品
02:00
that people were using were helping people
50
108252
1664
能夠幫助人們去了解
02:01
understand how to use the exhibit,
51
109916
2014
如何使用這樣的一件展品，
02:03
and were helping people learn in a social way.
52
111930
2943
幫助人們透過社會互動去學習。
02:06
And when you think about
it, this makes a lot of sense,
it, this makes a lot of sense,
53
114873
2266
當你開始考慮這個的時候，
這是非常合理的，
這是非常合理的，
02:09
that using specialized physical objects
54
117139
2240
使用一些特別的物品
02:11
would help people use an interface more easily.
55
119379
3272
能夠幫助人們更加容易的
去使用一種介面。
去使用一種介面。
02:14
I mean, our hands and our minds are optimized
56
122651
2839
我的意思是，
我們的雙手以及我們的思維
我們的雙手以及我們的思維
02:17
to think about and interact with tangible objects.
57
125490
3269
會對思考如何接觸
有形的物體進行優化。
有形的物體進行優化。
02:20
Think about which you find easier to use,
58
128759
2062
思考一下你覺得哪個更容易使用，
02:22
a physical keyboard or an onscreen keyboard
59
130821
2319
是物理鍵盤還是螢幕上的觸摸鍵盤
02:25
like on a phone?
60
133140
2100
比如說手機？
02:27
But the thing that struck me
61
135240
1025
但是讓我震驚的是
02:28
about all of these different projects
62
136265
1999
這些不同的案子
02:30
is that they really had to be built from scratch,
63
138264
3117
都是不得不從頭開始，
02:33
down to the level of the electronics
64
141381
1790
然後深入到電子元件
02:35
and the printed circuit boards and
65
143171
1106
以及電路板的層次進行設計，
02:36
all the mechanisms all the way up to the software.
66
144277
2745
最後讓所有的機械通過軟體控制。
02:39
I wanted to create something
67
147022
1762
我想創造一些東西
02:40
where we could move objects
under computer control
under computer control
68
148784
3319
我們可以通過移動
由電腦控制的物體
由電腦控制的物體
02:44
and create interactions around that idea
69
152103
2249
並且圍繞這樣的一個想法
建立出互動關係，
建立出互動關係，
02:46
without having to go through this process
70
154352
2215
而不需要通過這樣的一個流程，
02:48
of building something from scratch
71
156567
1383
也就是每次建造都是從頭開始。
02:49
every single time.
72
157950
1375
02:51
So my first attempt at this
73
159325
1991
所以我的首次嘗試這個
02:53
was at the MIT Media Lab
74
161316
1684
是在麻省理工的媒體實驗室
02:55
with Professor Hiroshi Ishii,
75
163000
1581
和石井裕教授一起，
02:56
and we built this array of
76
164581
1835
我們一起創造了這個由
02:58
512 different electromagnets,
77
166416
2257
512個不同的電磁鐵構成的矩陣，
03:00
and together they were able to move objects around
78
168673
2627
它們能夠讓物體
03:03
on top of their surface.
79
171300
1536
在它們的表面上移動。
03:04
But the problem with this
80
172836
1548
這個存在的問題是
03:06
was that these magnets
81
174384
1656
這些磁鐵
03:08
cost over 10,000 dollars.
82
176040
2160
耗費了超過一萬美元。
03:10
Although each one was pretty small,
83
178200
1666
儘管每一個都是特別的小，
03:11
altogether they weighed so much
84
179866
1709
但是放在一起它們便會特別的重
03:13
that the table that they were on
85
181575
1255
甚至是它們下面的桌子
03:14
started to sag.
86
182830
1558
都會開始下沉。
03:16
So I wanted to build something
87
184388
1332
所以我想創造一些東西
03:17
where you could have this kind of interaction
88
185720
1616
也能產生這樣的一種互動
03:19
on any tabletop surface.
89
187336
2643
即便是在任何一種桌面上。
03:21
So to explore this idea,
90
189979
2081
要實現這樣的一個想法，
03:24
I built an army of small robots,
91
192060
2150
我創造了一小支機器人軍隊，
03:26
and each of these robots has
what are called omni wheels.
what are called omni wheels.
92
194210
2765
其中的每一個機器人
都有一個“全方位”的輪子。
都有一個“全方位”的輪子。
03:28
They're these special wheels
93
196975
1305
這就是這些特別的輪子
03:30
that can move equally easily in all directions,
94
198280
2666
能夠方便的朝任何一個方向移動，
03:32
and when you couple these robots
95
200946
2589
當你連接這些機器人的時候
03:35
with a video projector,
96
203535
1910
通過一個投影機，
03:37
you have these physical tools
97
205445
1808
你可以使用這些工具，
03:39
for interacting with digital information.
98
207253
2900
和數位資訊產生互動。
03:42
So here's an example of what I mean.
99
210153
1842
這裡有一個例子。
03:43
This is a video editing application
100
211995
1922
這是一個影片編緝軟體，
03:45
where all of the controls
101
213917
1486
軟體中所有的控制
03:47
for manipulating the video are physical.
102
215403
2307
以及控制這個影片
都是通過直接控制的。
都是通過直接控制的。
03:49
So if we want to tweak the color,
103
217710
1582
如果我們想旋轉這個顏色，
03:51
we just enter the color mode,
104
219292
1352
我們只需要進入色彩模式，
03:52
and then we get three different dials
105
220644
1296
然後我們就能由三個不同的錶盤
03:53
for tweaking the color,
106
221940
1378
可以通過旋轉來改變顏色，
03:55
or if we want to adjust the audio,
107
223318
1961
或者說我們想改變聲音，
03:57
then we get two different dials
for that, these physical objects.
for that, these physical objects.
108
225279
3341
接著我們就會有兩個錶盤。
04:00
So here the left and right channel stay in sync,
109
228620
2846
在這裏左邊和右邊兩個會保持同步，
04:03
but if we want to, we can override that
110
231466
1743
但是如果我們想，我們是可以調整的，
04:05
by grabbing both of them at the same time.
111
233209
2999
通過同時調節它們兩個。
04:08
So the idea is that we get the speed
112
236208
1928
這樣的想法能夠讓我們快速
04:10
and efficiency benefits of using these physical dials
113
238136
3117
並且高效地操作，並且這些物理錶盤
04:13
together with the flexibility and versatility
114
241253
2790
也同時兼備靈活性和通用性
04:16
of a system that's designed in software.
115
244043
3331
在軟件設計的系統當中。
04:19
And this is a mapping application
116
247374
1935
在這個能夠反應災難發生地點的
04:21
for disaster response.
117
249309
2127
定點地圖軟體中，
04:23
So you have these physical objects
118
251436
1945
你有用這三個物體
04:25
that represent police, fire and rescue,
119
253381
2227
分別代表警察，火警以及救援，
04:27
and a dispatcher can grab them
120
255608
1553
調度員可以通過抓起它們
04:29
and place them on the map
121
257161
1326
並且把它們放在地圖上
04:30
to tell those units where to go,
122
258487
1989
通過這樣告訴他們
應該去地圖上哪個地點，
應該去地圖上哪個地點，
04:32
and then the position of the units on the map
123
260476
2376
接著地圖上的這個地點
04:34
gets synced up with the position
124
262852
1969
便會和現實世界中的地點進行同步。
04:36
of those units in the real world.
125
264821
3627
04:40
This is a video chat application.
126
268448
1612
這是一個影片聊天軟體。
04:42
It's amazing how much emotion you can convey
127
270060
2352
令人震驚地是你會發現
你可以傳達多少表情
你可以傳達多少表情
04:44
with just a few simple movements
128
272412
1213
而且只需要通過操作機器人
04:45
of a physical object.
129
273625
2425
執行幾個簡單地操作。
04:48
With this interface, we open up
a huge array of possibilities
a huge array of possibilities
130
276050
3052
通過這樣的互動方式，
我們創造了很多可能性，
我們創造了很多可能性，
04:51
in between traditional board games
131
279102
2078
介於傳統的棋盤遊戲
04:53
and arcade games,
132
281180
1414
以及街機遊戲之間，
04:54
where the physical possibilities of interaction
133
282594
2547
可能產生的互動模式
04:57
make so many different styles of play possible.
134
285141
3713
可以創造許多不同類型的遊戲體驗。
05:00
But one of the areas that I'm most excited
135
288854
2389
但是之中我最感興趣的是
05:03
about using this platform for
136
291243
1814
這個平台可以應用在
05:05
is applying it to problems that are difficult
137
293057
2543
那些電腦或者人們
無法單獨解決的問題上。
無法單獨解決的問題上。
05:07
for computers or people to solve alone.
138
295600
2254
05:09
One example of those is protein folding.
139
297854
2622
其中一個例子是蛋白質的折疊。
05:12
So here we have an interface
140
300476
1412
這裡有一個互動的例子
05:13
where we have physical handles onto a protein,
141
301888
3514
我們通過對蛋白質增加一些物理端口
05:17
and we can grab those handles
142
305402
1751
然後我們可以通過操作這些物理端口
05:19
and try to move the protein and
try to fold it in different ways.
try to fold it in different ways.
143
307153
2987
嘗試移動並且用不同的方式折疊這些蛋白質。
05:22
And if we move it in a way that
doesn't really make sense
doesn't really make sense
144
310140
3000
如果我們操作的方式是不可能實現的，
05:25
with the underlying molecular simulation,
145
313140
1967
通過後台化學分子的模擬
05:27
we get this physical feedback where we can
146
315107
2202
我們可以得到一些實際的反饋，
05:29
actually feel these physical handles
147
317309
1973
事實上能夠感受到這些物理端口
05:31
pulling back against us.
148
319282
1608
正在阻止我們並朝反方向拉扯。
05:32
So feeling what's going on
149
320890
1531
所以可以感受到
05:34
inside a molecular simulation
150
322421
2239
化學分子的模擬過程當中正在發生什麼，
05:36
is a whole different level of interaction.
151
324660
2946
這是一個完全不同等級的互動方式。
05:39
So we're just beginning to explore
152
327606
2981
所以我們正在開始去
探索什麼是可能發生的，
探索什麼是可能發生的，
05:42
what's possible when we use software
153
330587
2511
當我們我們使用軟體
去控制物體的移動。
去控制物體的移動。
05:45
to control the movement
154
333098
1491
05:46
of objects in our environment.
155
334589
2243
05:48
Maybe this is the computer of the future.
156
336832
2904
可能這就是電腦的未來。
05:51
There's no touchscreen.
157
339736
1616
沒有觸摸屏，
05:53
There's no technology visible at all.
158
341352
2031
沒有任何可視的科技，
05:55
But when we want to have a video chat
159
343383
1844
但是當我們如果想進行視頻聊天的時候，
05:57
or play a game
160
345227
1461
或者玩遊戲，
05:58
or lay out the slides to our next TED Talk,
161
346688
2713
或者編排下一張TED演講的幻燈片，
06:01
the objects on the table come alive.
162
349401
2273
這些桌子上的物體便會活了過來。
06:03
Thank you.
163
351674
1352
謝謝。
06:05
(Applause)
164
353026
2123
（掌聲）
ABOUT THE SPEAKER
James Patten - Interaction designerJames Patten, a TED Fellow, imagines new ways for us to play with computers.
Why you should listen
James Patten is an interaction designer, inventor and visual artist working at the intersection of the physical and digital worlds. Patten is a TED Fellow and the founder and principal of the design firm Patten Studio, where his clients have included Björk, Barneys New York, General Electric, Steelcase and Autodesk. Patten earned his doctorate at the MIT Media Lab where he studied in the Tangible Media Group under Hiroshi Ishii. His work has been exhibited or performed in venues such as the Museum of Modern Art, the Transmediale festival in Berlin, the Museo Guggenheim Bilbao and the Ars Electronica Center in Linz, Austria. Patten's work has been recognized in several international design competitions including the International Design Magazine's Annual Design Review, and the International Design Excellence Awards. Tour his Brooklyn workshop.
James Patten | Speaker | TED.com