TED Fellows Retreat 2013
James Patten: The best computer interface? Maybe ... your hands
詹姆斯 彭定康: 最好的电脑界面是什么呢？也许是你的双手。
Filmed:
Readability: 5
1,092,626 views
詹姆斯 彭定康说：“电脑是创意性表达无比强大的工具。”但是现在，我们和电脑互动方式主要限于打字和敲击。在这个精彩的演说和演示中，彭定康想出了一种更加亲切和物理的方式将你们的思想和点子通过电子世界带入到现实生活中：不再使用电脑屏幕，而是用你的双手亲自体验。
James Patten - Interaction designer
James Patten, a TED Fellow, imagines new ways for us to play with computers. Full bio
James Patten, a TED Fellow, imagines new ways for us to play with computers. Full bio
Double-click the English transcript below to play the video.
就表达创意而言, 电脑的功能
00:12
A computer is an incredibly powerful means
0
721
2667
00:15
of creative expression,
1
3388
1654
难以置信的强大，
00:17
but for the most part,
2
5042
1571
但是绝大多数情况下，
00:18
that expression is confined to the screens
3
6613
2165
那种表达都被限制在了
00:20
of our laptops and mobile phones.
4
8778
2418
我们手机或者笔记本电脑的屏幕上。
00:23
And I'd like to tell you a story about
5
11196
2200
我想跟大家分享一个项目
00:25
bringing this power of the computer
6
13396
1956
这个项目将计算机引入到物理世界
00:27
to move things around and interact with us
7
15352
2370
用计算机来操作我们看得见摸得着的物体
00:29
off of the screen and into the physical world
8
17722
2913
而不是仅仅通过电脑屏幕
00:32
in which we live.
9
20635
1189
进行交互.
00:33
A few years ago, I got a call from
10
21824
1618
几年前，我接到纽约一家
00:35
a luxury fashion store called Barneys New York,
11
23442
2486
名叫纽约芭妮时尚奢侈品店打来的电话，
00:37
and the next thing I knew,
12
25928
1264
那通电话之后,
00:39
I was designing storefront kinetic sculptures
13
27192
2693
我开始为他们的橱窗设计
00:41
for their window displays.
14
29885
1392
动态的陈列品.
00:43
This one's called "The Chase."
15
31277
1395
这个作品叫做“追赶”。
00:44
There are two pairs of shoes,
16
32672
1346
有两双鞋，
00:46
a man's pair and a woman's pair,
17
34018
1625
一双男鞋，一双女鞋
00:47
and they play out this slow, tense chase
18
35643
2904
它们在玻璃周围演示出
00:50
around the window
19
38547
1278
一种慢节奏却激烈地追赶，
00:51
in which the man scoots up behind the woman
20
39825
2225
男人疾走到女人身后
00:54
and gets in her personal space,
21
42050
1573
相距十分近，
00:55
and then she moves away.
22
43623
1935
然后女人很快离开了。
00:57
Each of the shoes has magnets in it,
23
45558
1841
每只鞋内都装有磁铁，
00:59
and there are magnets underneath the table
24
47399
2003
桌下有磁铁
01:01
that move the shoes around.
25
49402
1964
用来移动鞋子。
01:03
My friend Andy Cavatorta was building
26
51366
2032
我一个叫做安迪·卡瓦托尔塔的朋友之前在
01:05
a robotic harp for Bjork's Biophilia tour
27
53398
3542
为 Bjork's Biophilia tour 建造一个机器人竖琴
01:08
and I wound up building the electronics
28
56940
2392
我设计了其中的控制电路
01:11
and motion control software
29
59332
2189
并编写了控制软件
01:13
to make the harps move and play music.
30
61521
2466
去让竖琴移动并演奏音乐。
01:15
The harp has four separate pendulums,
31
63987
2011
这个竖琴有四个分开的摆，
01:17
and each pendulum has 11 strings,
32
65998
2126
每一个摆上有 11 条弦，
01:20
so the harp swings on its axis and also rotates
33
68124
2488
竖琴可以在它的轴上摇摆并旋转
01:22
in order to play different musical notes,
34
70612
2203
来演奏出不同的音符，
01:24
and the harps are all networked together
35
72815
2162
所有的竖琴都相互联网
01:26
so that they can play the right notes
36
74977
1800
这样它们就可以在
01:28
at the right time in the music.
37
76777
2626
正确的时间奏出正确的音符。
01:31
I built an interactive chemistry exhibit
38
79403
2424
我在芝加哥的科学与工业博物馆
01:33
at the Museum of Science and Industry in Chicago,
39
81827
2599
建造的一个互动性的化学展示机器，
01:36
and this exhibit lets people use physical objects
40
84426
2981
这个展示让人们用实际物体
01:39
to grab chemical elements off of the periodic table
41
87407
3036
从元素周期表周抓取元素
01:42
and bring them together to cause
42
90443
1408
并把它们放到一块
01:43
chemical reactions to happen.
43
91851
1766
导致化学反应。
01:45
And the museum noticed that people
44
93617
1924
博物馆注意到，
01:47
were spending a lot of time with this exhibit,
45
95541
2226
人们在这个展品前呆的时间非常久.
01:49
and a researcher from a science education center
46
97767
3147
一位来自澳大利亚科学教育中心
01:52
in Australia decided to study this exhibit
47
100914
2805
的调查者决定研究这个展品
01:55
and try to figure out what was going on.
48
103719
2240
并试图弄清楚为什么。
01:57
And she found that the physical objects
49
105959
2293
她发现这种摸得着的小物件
02:00
that people were using were helping people
50
108252
1664
能够有助于人们去理解
02:01
understand how to use the exhibit,
51
109916
2014
如何操作这个展品,
02:03
and were helping people learn in a social way.
52
111930
2943
并且是以一种互动的(social)的式.
02:06
And when you think about
it, this makes a lot of sense,
it, this makes a lot of sense,
53
114873
2266
通过思考我们能够从中得到很多启发,
02:09
that using specialized physical objects
54
117139
2240
人们更容易通过一个专门设计的
02:11
would help people use an interface more easily.
55
119379
3272
具体的小物件对一个系统进行操作,
02:14
I mean, our hands and our minds are optimized
56
122651
2839
我的意思是，我们的手和大脑
02:17
to think about and interact with tangible objects.
57
125490
3269
已经习惯了感知和操作那些摸得着的物品。
02:20
Think about which you find easier to use,
58
128759
2062
想象一下实物键盘
02:22
a physical keyboard or an onscreen keyboard
59
130821
2319
和手机屏幕键盘
02:25
like on a phone?
60
133140
2100
哪个更好用?
02:27
But the thing that struck me
61
135240
1025
但是在做这些项目的时候
02:28
about all of these different projects
62
136265
1999
最让我感到意外的其实是
02:30
is that they really had to be built from scratch,
63
138264
3117
每个项目都必须从头开始
02:33
down to the level of the electronics
64
141381
1790
从头设计电路
02:35
and the printed circuit boards and
65
143171
1106
印刷和制作电路板
02:36
all the mechanisms all the way up to the software.
66
144277
2745
到控制软件的编写, 都需要从头做.
02:39
I wanted to create something
67
147022
1762
我想创造出一个工具
02:40
where we could move objects
under computer control
under computer control
68
148784
3319
一个跟电脑联网但是可以用手直接控制的东西
02:44
and create interactions around that idea
69
152103
2249
可以用它来实现之前提到的交互过程
02:46
without having to go through this process
70
154352
2215
而不需要每一次都
02:48
of building something from scratch
71
156567
1383
从无到有地
02:49
every single time.
72
157950
1375
重新做一遍.
02:51
So my first attempt at this
73
159325
1991
我的第一次尝试是在
02:53
was at the MIT Media Lab
74
161316
1684
MIT的媒体实验室
02:55
with Professor Hiroshi Ishii,
75
163000
1581
与Hiroshi Ishii教授
02:56
and we built this array of
76
164581
1835
一起做了一个这个样子的
02:58
512 different electromagnets,
77
166416
2257
含有512块不同电磁铁的阵列，
03:00
and together they were able to move objects around
78
168673
2627
它们可以使物体
03:03
on top of their surface.
79
171300
1536
在其表面移动。
03:04
But the problem with this
80
172836
1548
但问题是
03:06
was that these magnets
81
174384
1656
这个设备造价
03:08
cost over 10,000 dollars.
82
176040
2160
超过 1 万美元。
03:10
Although each one was pretty small,
83
178200
1666
即使每一个单元都非常小，
03:11
altogether they weighed so much
84
179866
1709
但是它们合在一起的重量加起来
03:13
that the table that they were on
85
181575
1255
使承放它的桌子
03:14
started to sag.
86
182830
1558
开始摇晃。
03:16
So I wanted to build something
87
184388
1332
所以我想造一个东西
03:17
where you could have this kind of interaction
88
185720
1616
使你可以在桌面上
03:19
on any tabletop surface.
89
187336
2643
就可以有这样的互动。
03:21
So to explore this idea,
90
189979
2081
为了实现我的这个想法,
03:24
I built an army of small robots,
91
192060
2150
我造了一个小的机器人，
03:26
and each of these robots has
what are called omni wheels.
what are called omni wheels.
92
194210
2765
每一个机器人都有万向轮。
03:28
They're these special wheels
93
196975
1305
这些轮子很特别
03:30
that can move equally easily in all directions,
94
198280
2666
可以很容易的往任何方向移动，
03:32
and when you couple these robots
95
200946
2589
当你用投影仪与
03:35
with a video projector,
96
203535
1910
这些机器人相配合的时候，
03:37
you have these physical tools
97
205445
1808
你就拥有了这些物理的工具
03:39
for interacting with digital information.
98
207253
2900
与数码信息相互动。
03:42
So here's an example of what I mean.
99
210153
1842
我来举个例子.
03:43
This is a video editing application
100
211995
1922
这是一个视频编辑软件
03:45
where all of the controls
101
213917
1486
所有的去操纵视频的
03:47
for manipulating the video are physical.
102
215403
2307
方式都是摸得着的。
03:49
So if we want to tweak the color,
103
217710
1582
如果我们想微调颜色，
03:51
we just enter the color mode,
104
219292
1352
我们只需输入颜色的模式，
03:52
and then we get three different dials
105
220644
1296
然后我们便得到不同
03:53
for tweaking the color,
106
221940
1378
调节颜色的转盘，
03:55
or if we want to adjust the audio,
107
223318
1961
如果我们想要调解音频
03:57
then we get two different dials
for that, these physical objects.
for that, these physical objects.
108
225279
3341
我们便得到两个这样的物理转盘。
04:00
So here the left and right channel stay in sync,
109
228620
2846
这里左右通道是同时始终锁定比例的，
04:03
but if we want to, we can override that
110
231466
1743
但是如果我们想要揭开锁定,
04:05
by grabbing both of them at the same time.
111
233209
2999
我们可以双手同时抓住它们。
04:08
So the idea is that we get the speed
112
236208
1928
这个想法的好处在于
04:10
and efficiency benefits of using these physical dials
113
238136
3117
将物理转盘的快捷与高效
04:13
together with the flexibility and versatility
114
241253
2790
跟软件设计的数字系统的灵活与弹性
04:16
of a system that's designed in software.
115
244043
3331
等优点结合起来.
04:19
And this is a mapping application
116
247374
1935
这是一个为应对灾情
04:21
for disaster response.
117
249309
2127
设计的地图软件。
04:23
So you have these physical objects
118
251436
1945
我们设计了一些特殊的小物件
04:25
that represent police, fire and rescue,
119
253381
2227
代表(消防)警察, 火情和被困群众.
04:27
and a dispatcher can grab them
120
255608
1553
一个指挥员可以抓住这些小物件
04:29
and place them on the map
121
257161
1326
将它们放在地图特定位置上
04:30
to tell those units where to go,
122
258487
1989
以此告诉那些人应该往哪里走，
04:32
and then the position of the units on the map
123
260476
2376
然后那些人地图上的位置
04:34
gets synced up with the position
124
262852
1969
与我们设计的小物件在
04:36
of those units in the real world.
125
264821
3627
实际世界上的位置同步。
04:40
This is a video chat application.
126
268448
1612
这是一个视频聊天应用。
04:42
It's amazing how much emotion you can convey
127
270060
2352
用这些物体的点简单动作
04:44
with just a few simple movements
128
272412
1213
就可以表达出很多的情绪
04:45
of a physical object.
129
273625
2425
真的是十分了不起。
04:48
With this interface, we open up
a huge array of possibilities
a huge array of possibilities
130
276050
3052
这种操作方式也为我们打开了新的思路
04:51
in between traditional board games
131
279102
2078
传统棋盘游戏和街机游戏之间
04:53
and arcade games,
132
281180
1414
或许可以有新的结合.
04:54
where the physical possibilities of interaction
133
282594
2547
这种物理的接触方式
04:57
make so many different styles of play possible.
134
285141
3713
能够带来非常多的新的用户体验.
05:00
But one of the areas that I'm most excited
135
288854
2389
然后对于这种的新的交互方式的应用
05:03
about using this platform for
136
291243
1814
我感到最激动的是
05:05
is applying it to problems that are difficult
137
293057
2543
将其利用在解决
05:07
for computers or people to solve alone.
138
295600
2254
人与电脑不能独自解决的问题。
05:09
One example of those is protein folding.
139
297854
2622
其中一个例子就是蛋白折叠。
05:12
So here we have an interface
140
300476
1412
这个例子中我们给
05:13
where we have physical handles onto a protein,
141
301888
3514
给蛋白质装上了物理"把手"
05:17
and we can grab those handles
142
305402
1751
我们可以抓住那些把手
05:19
and try to move the protein and
try to fold it in different ways.
try to fold it in different ways.
143
307153
2987
并试图去移动那些蛋白质并将其以不同的方式堆叠。
05:22
And if we move it in a way that
doesn't really make sense
doesn't really make sense
144
310140
3000
如果我以一个
05:25
with the underlying molecular simulation,
145
313140
1967
不符合分子潜在结构的方式移动它，
05:27
we get this physical feedback where we can
146
315107
2202
我们可以得到一个反馈
05:29
actually feel these physical handles
147
317309
1973
那些物理把手
05:31
pulling back against us.
148
319282
1608
会相反的方向去抵抗。
05:32
So feeling what's going on
149
320890
1531
感受分子
05:34
inside a molecular simulation
150
322421
2239
内部的模拟
05:36
is a whole different level of interaction.
151
324660
2946
是一个完全不同的互动境界。
05:39
So we're just beginning to explore
152
327606
2981
我们刚刚开始探索
05:42
what's possible when we use software
153
330587
2511
使用软件
05:45
to control the movement
154
333098
1491
去操控环境中
05:46
of objects in our environment.
155
334589
2243
现实物体的可能性。
05:48
Maybe this is the computer of the future.
156
336832
2904
也许这是未来的电脑科技。
05:51
There's no touchscreen.
157
339736
1616
没有触摸屏幕。
05:53
There's no technology visible at all.
158
341352
2031
科技可以隐藏在视野之外.
05:55
But when we want to have a video chat
159
343383
1844
但当我们想视频通话
05:57
or play a game
160
345227
1461
或者玩游戏
05:58
or lay out the slides to our next TED Talk,
161
346688
2713
或者展示出一条为 TED 演讲准备的 PPT，
06:01
the objects on the table come alive.
162
349401
2273
桌子上的东西便会活起来。
06:03
Thank you.
163
351674
1352
谢谢。
06:05
(Applause)
164
353026
2123
（掌声）
ABOUT THE SPEAKER
James Patten - Interaction designerJames Patten, a TED Fellow, imagines new ways for us to play with computers.
Why you should listen
James Patten is an interaction designer, inventor and visual artist working at the intersection of the physical and digital worlds. Patten is a TED Fellow and the founder and principal of the design firm Patten Studio, where his clients have included Björk, Barneys New York, General Electric, Steelcase and Autodesk. Patten earned his doctorate at the MIT Media Lab where he studied in the Tangible Media Group under Hiroshi Ishii. His work has been exhibited or performed in venues such as the Museum of Modern Art, the Transmediale festival in Berlin, the Museo Guggenheim Bilbao and the Ars Electronica Center in Linz, Austria. Patten's work has been recognized in several international design competitions including the International Design Magazine's Annual Design Review, and the International Design Excellence Awards. Tour his Brooklyn workshop.
James Patten | Speaker | TED.com