TED2006
Jeff Han: The radical promise of the multi-touch interface
Jeff Han演示他革命性的触摸屏幕
Filmed:
Readability: 3.7
4,787,802 views
Jeff Han展示了一个价格低廉的可扩展的多点触摸和压力感应计算机界面，这可能标志着点击时代的结束。
Jeff Han - Human-computer interface designer
After years of research on touch-driven computer displays, Jeff Han has created a simple, multi-touch, multi-user screen interface that just might herald the end of the point-and-click era. Full bio
After years of research on touch-driven computer displays, Jeff Han has created a simple, multi-touch, multi-user screen interface that just might herald the end of the point-and-click era. Full bio
Double-click the English transcript below to play the video.
今天能来到这里我非常非常激动，
00:24
I'm really excited to be here today.
0
95
1779
00:25
I'll show you some stuff
that's just ready to come out of the lab,
that's just ready to come out of the lab,
1
1898
3102
因为我会马上给大家展示一些刚从实验室新鲜出炉的成果，
毫不夸张，而且我非常高兴你们能第一时间
00:29
literally, and I'm really glad
that you guys
that you guys
2
5024
2776
00:31
are going to be among
the first to see it in person,
the first to see it in person,
3
7824
2472
亲眼看到它，因为我真的，真的认为这将改变
00:34
because I really think this is going
to really change
to really change
4
10320
2489
－真的改变－从此以后我们与机器互动的方式。
00:36
the way we interact
with machines from this point on.
with machines from this point on.
5
12833
2482
现在注意，这是一张从背面投影的工作台。它大约36英尺宽，
00:39
Now, this is a rear-projected
drafting table.
drafting table.
6
15339
2675
00:42
It's about 36 inches wide
7
18038
1222
配备有一个多点触摸感应器。现在注意，一般你们看到的触摸感应器，
00:43
and it's equipped
with a multi-touch sensor.
with a multi-touch sensor.
8
19284
2083
00:45
Normal touch sensors that you see,
9
21391
1644
好比在自动终端机或交互白板上，
00:47
like on a kiosk
or interactive whiteboards,
or interactive whiteboards,
10
23059
2137
只能一次注册一个接触点。
00:49
can only register one point
of contact at a time.
of contact at a time.
11
25220
2583
而这个东西可以让你同时有多个接触点。
00:52
This thing allows you to have
multiple points at the same time.
multiple points at the same time.
12
28137
3715
它们能感应到我的双手，我可以做拨弦的动作，
00:55
They can use both my hands;
I can use chording actions;
I can use chording actions;
13
31876
3314
如果我想的话我可以就这样用十指。
00:59
I can just go right up and use
all 10 fingers if I wanted to.
all 10 fingers if I wanted to.
14
35214
2937
像这样。
01:02
You know, like that.
15
38597
1157
01:03
Now, multi-touch sensing
isn't completely new.
isn't completely new.
16
39778
4543
多点触摸感应不是一项完全新的技术。
像Bill Buxton一些人在80年代就已经小试一把。
01:08
People like Bill Buxton have been
playing around with it in the '80s.
playing around with it in the '80s.
17
44345
3253
但是，我的方法事实上是高分辨率，
01:11
However, the approach I built here
is actually high-resolution,
is actually high-resolution,
18
47622
4028
01:15
low-cost, and probably
most importantly, very scalable.
most importantly, very scalable.
19
51674
2976
低成本，而且可能最重要的，扩展性非常强。
01:19
So, the technology, you know,
20
55000
2337
所以，你知道，这项技术不是最激动人心的，
01:21
isn't the most exciting thing
here right now,
here right now,
21
57361
2446
可能除了它的新发现的易接近性。
01:23
other than probably
its newfound accessibility.
its newfound accessibility.
22
59831
2318
这里真正有意思的是你能借助它做什么，
01:26
What's really interesting here
is what you can do with it
is what you can do with it
23
62173
3525
01:29
and the kind of interfaces
you can build on top of it.
you can build on top of it.
24
65722
2618
和基于它你能建造的那种界面。所以我们来看看。
01:33
So let's see.
25
69141
1136
比如，我们有一个熔岩灯程序在这里。现在，你能看见，
01:35
So, for instance, we have
a lava lamp application here.
a lava lamp application here.
26
71111
4313
01:39
Now, you can see,
27
75448
1702
我能用我的两只手去挤，让泡泡合到一起。
01:41
I can use both of my hands to kind
of squeeze and put the blobs together.
of squeeze and put the blobs together.
28
77174
3429
我能向这个系统注入热量，
01:44
I can inject heat into the system here,
29
80627
2543
或者我能用两个手指把它分开。
01:47
or I can pull it apart
with two of my fingers.
with two of my fingers.
30
83194
2182
它非常的直观；不需要操作指南。
01:49
It's completely intuitive;
there's no instruction manual.
there's no instruction manual.
31
85400
2730
操作界面就好像消失了一样。
01:52
The interface just kind of disappears.
32
88154
1822
01:54
This started out as a screensaver app
33
90000
1920
这个起初是作为屏幕保护程序的，它由实验室里的博士生之一，
01:55
that one of the Ph.D. students
in our lab, Ilya Rosenberg, made.
in our lab, Ilya Rosenberg, made.
34
91944
3047
Ilya Rosenberg做的。但是我觉得它的特性在这里表现得很鲜明。
01:59
But I think its true identity
comes out here.
comes out here.
35
95015
4021
一个多点触摸感应器的优势就在于，你知道，
02:04
Now what's great about a multi-touch
sensor is that, you know,
sensor is that, you know,
36
100153
2923
我可以随便用多少个手指，
02:07
I could be doing this
with as many fingers here,
with as many fingers here,
37
103100
2737
02:09
but of course multi-touch
also inherently means multi-user.
also inherently means multi-user.
38
105861
2978
但是当然多点触摸也自然意味着多用户。
02:12
Chris could be interacting
with another part of Lava,
with another part of Lava,
39
108863
2499
所以Chris可以在这儿摆弄熔岩灯的另一部分，
同时我也在这边玩。 你可以想象一种新的制作雕塑的工具，
02:15
while I play around with it here.
40
111386
1634
02:17
You can imagine
a new kind of sculpting tool,
a new kind of sculpting tool,
41
113044
2096
好像我可以把什么东西预热起来，让它有韧性了，
02:19
where I'm kind of warming something up,
making it malleable,
making it malleable,
42
115164
2979
然后把它冷却下来，固定成一定形态。
02:22
and then letting it cool down
and solidifying in a certain state.
and solidifying in a certain state.
43
118167
3258
02:29
Google should have
something like this in their lobby.
something like this in their lobby.
44
125712
2947
Google应该有像这样的东西在他们的大厅里。（笑声）
02:32
(Laughter)
45
128683
5293
02:38
I'll show you a little more
of a concrete example here,
of a concrete example here,
46
134000
3272
我再给你们看个东西--在它载入同时，我会举一个更具体的小例子
02:41
as this thing loads.
47
137296
1333
这是一个给摄影师的看片的程序。
02:43
This is a photographer's
light-box application.
light-box application.
48
139181
2717
02:45
Again, I can use both of my hands
to interact and move photos around.
to interact and move photos around.
49
141922
3977
再一次，我可以用我双手和照片交互，把照片挪来挪去去。
02:49
But what's even cooler
is that if I have two fingers,
is that if I have two fingers,
50
145923
3555
但是更神奇的是如果我用两个手指，
02:53
I can actually grab a photo and then
stretch it out like that really easily.
stretch it out like that really easily.
51
149502
4130
我可以抓住一张照片并且像这样非常容易地把它放大。
我可以毫不费力地移动，伸缩并且转动。
02:57
I can pan, zoom
and rotate it effortlessly.
and rotate it effortlessly.
52
153656
3466
我可以用我的两只手一起地这样做，
03:01
I can do that grossly
with both of my hands,
with both of my hands,
53
157146
2331
或者我可以只用两个手指，每只手分别一个。
03:03
or I can do it just with two fingers
on each of my hands together.
on each of my hands together.
54
159501
3204
03:06
If I grab the canvas, I can do
the same thing -- stretch it out.
the same thing -- stretch it out.
55
162729
3027
如果我抓住画布，我可以同样地把它放大。
我可以同时按住这个，
03:09
I can do it simultaneously,
holding this down,
holding this down,
56
165780
2159
而且握住另一个，把这个放大像这样。
03:11
and gripping on another one,
stretching this out.
stretching this out.
57
167963
2299
再一次，界面在这里不存在了。
03:14
Again, the interface just disappears here.
58
170286
2228
没有使用说明。这完全是你期望的，
03:16
There's no manual.
59
172538
1033
03:17
This is exactly what you expect,
60
173595
2302
03:19
especially if you haven't interacted
with a computer before.
with a computer before.
61
175921
3055
尤其是如果你从前没有操作过计算机。
03:23
Now, when you have initiatives
like the $100 laptop,
like the $100 laptop,
62
179000
2704
现在，要是你有初级的设备，比如100美元的笔记本电脑
03:25
I kind of cringe at the idea
63
181728
1533
要向大家介绍全新的与以往传统鼠标--窗口操作界面不同的概念，
03:27
of introducing a whole new
generation to computing
generation to computing
64
183285
2577
我挺紧张的
03:29
with this standard
mouse-and-windows-pointer interface.
mouse-and-windows-pointer interface.
65
185886
2738
03:32
This is something that I think
is really the way
is really the way
66
188648
3136
我认为这将真正是我们与计算机交互的方式
03:35
we should be interacting
with machines from now on.
with machines from now on.
67
191808
2641
从今以后。（鼓掌）
03:38
(Applause)
68
194473
6503
03:45
Now, of course, I can bring up a keyboard.
69
201000
2000
当然，我可以打开一个键盘。
03:47
(Laughter)
70
203024
2298
03:52
And I can bring that around,
put that up there.
put that up there.
71
208000
2745
而且我能随意摆放，放在上面这儿。
03:55
Obviously, this is a standard keyboard,
72
211213
1858
很明显，这是一个标准键盘，
但是当然我能缩放它以适合我手的大小。
03:57
but of course I can rescale it
to make it work well for my hands.
to make it work well for my hands.
73
213095
3082
这很重要，因为在当今这个时代没有理由
04:00
That's really important, because
there's no reason in this day and age
there's no reason in this day and age
74
216201
3333
我们应当屈就一个设备。
04:03
that we should be conforming
to a physical device.
to a physical device.
75
219558
2340
那会导致不好的事情，比如肢体劳损。
04:05
That leads to bad things, like RSI.
76
221922
1747
04:07
We have so much technology nowadays
77
223693
2777
我们如今有太多科技而
04:10
that these interfaces
should start conforming to us.
should start conforming to us.
78
226494
4029
这些设备应当开始顺应我们。
04:14
There's so little applied now
to actually improving
to actually improving
79
230547
3977
从这一时刻起运用到改善人机互动
04:18
the way we interact with interfaces
from this point on.
from this point on.
80
234548
2579
少之又少
键盘也许不是个好法子
04:21
This keyboard is probably actually
the really wrong direction to go.
the really wrong direction to go.
81
237151
3191
试想未来随着科技进步
04:24
You can imagine, in the future,
as we develop this kind of technology,
as we develop this kind of technology,
82
240366
3302
04:27
a keyboard that kind of automatically
drifts as your hand moves away,
drifts as your hand moves away,
83
243692
3403
会有一种跟着你的手移动
并能预测你输入的键盘
04:31
and really intelligently anticipates
which key you're trying to stroke.
which key you're trying to stroke.
84
247119
3515
很棒吧？
04:35
So -- again, isn't this great?
85
251477
2293
04:39
(Laughter)
86
255051
1972
观众：你的实验室在哪儿？
04:41
Audience: Where's your lab?
87
257047
1763
04:42
Jeff Han: I'm a research scientist
at NYU in New York.
at NYU in New York.
88
258834
2572
Jeff Han：我是纽约大学的研究员
接下来的是另一种应用程序。我能整出些绒毛球
04:49
Here's an example of another kind of app.
I can make these little fuzz balls.
I can make these little fuzz balls.
89
265341
3635
04:53
It'll remember the strokes I'm making.
90
269000
2334
这些球会记住我的抚摸动作。当然了，我能用双手来做
04:55
Of course I can do it with all my hands.
91
271358
1919
正如你们看到的，这是压力感应的
04:57
It's pressure-sensitive.
92
273301
1291
04:59
What's neat about that is,
93
275905
1556
绝妙的地方是，我已经展示过两指
05:01
I showed that two-finger gesture
that zooms in really quickly.
that zooms in really quickly.
94
277485
2965
迅速放大的功能。因为你不必用现实生活中的工具
05:04
Because you don't have
to switch to a hand tool
to switch to a hand tool
95
280474
2207
或放大镜什么的
05:06
or the magnifying glass tool,
96
282705
1406
你能同时让物体连续成倍放大
05:08
you can just continuously make things
97
284135
2539
05:10
in real multiple scales,
all at the same time.
all at the same time.
98
286698
2354
我能弄出点大东西，但也可以后退再后退
05:13
I can create big things out here,
99
289076
2013
05:15
but I can go back
and really quickly go back
and really quickly go back
100
291113
2098
直到起点，在做出些小不点儿
05:17
to where I started,
and make even smaller things here.
and make even smaller things here.
101
293235
2700
运用到数据可视化领域，这一发明可是非常重要的
05:21
This is going to be really important
102
297271
1887
05:23
as we start getting to things
like data visualization.
like data visualization.
103
299182
3033
比如，Hans Rosling的演讲大家都很喜欢
05:26
For instance, I think
we all enjoyed Hans Rosling's talk,
we all enjoyed Hans Rosling's talk,
104
302239
2667
05:28
and he really emphasized the fact
I've been thinking about for a long time:
I've been thinking about for a long time:
105
304930
3526
他着重讲的内容我也思考过很久
我们有庞大的数据，但却被闲置
05:32
We have all this great data,
106
308480
1351
05:33
but for some reason,
it's just sitting there.
it's just sitting there.
107
309855
2097
我们真没怎么用这些数据。我想愿意有一点
05:35
We're not accessing it.
108
311976
1119
05:37
And one of the reasons why I think that is
109
313119
3523
05:40
will be helped by things like graphics
and visualization and inference tools,
and visualization and inference tools,
110
316666
4716
因为有图像、可视化界面工具
但更重要的是我们会有更好的界面
05:45
but I also think a big part of it
111
321406
1861
05:47
is going to be having better interfaces,
112
323291
2056
能够钻研深 入像这样的数据，但同时仍能保持对整体的宏观性
05:49
to be able to drill down
into this kind of data,
into this kind of data,
113
325371
2240
05:51
while still thinking
about the big picture here.
about the big picture here.
114
327635
2338
05:54
Let me show you another app here.
This is called WorldWind.
This is called WorldWind.
115
330460
2979
现在，让我 向你们展示另一个应用程序。这个程序叫做"世界风"
是NASA研发的。它就像我们都见过的谷歌地球
05:57
It's done by NASA.
116
333463
1139
05:58
We've all seen Google Earth;
117
334626
2830
这就好像是 它的开源码版本。有附加档能够加载
06:01
this is an open-source version of that.
118
337480
1958
06:03
There are plug-ins to be able
to load in different data sets
to load in different data sets
119
339462
3524
NASA多年搜集的各种资料
06:07
that NASA's collected over the years.
120
343010
1799
06:08
As you can see, I can use
the same two-fingered gestures
the same two-fingered gestures
121
344833
2620
但是，如你 所见，我可以使用同样的两指手势
非常迅速的 下潜、进入地球。又一次的，我们看不到操控界面的存在
06:11
to go down and go in really seamlessly.
122
347477
2482
06:13
There's no interface, again.
123
349983
1380
这真的能让 所有人，感觉非常地融入那个环境，而且操作就如同你所预期一般
06:15
It really allows anybody
to kind of go in --
to kind of go in --
124
351387
3271
06:18
and it just does
what you'd expect, you know?
what you'd expect, you know?
125
354682
2963
再一次，在这边你看不到操作接口。接口就这样消失了
06:21
Again, there's just no interface here.
The interface just disappears.
The interface just disappears.
126
357669
3272
06:27
I can switch to different data views.
127
363000
1876
我可以切换 到不同的数据浏览。这就是这个应用程序绝妙的地方。
06:28
That's what's neat about this app here.
128
364900
2194
就像这样。NASA非常的酷。它们有这些超光谱影像
06:31
NASA's really cool.
129
367118
1157
06:32
These hyper-spectral images
are false-colored so you can --
are false-colored so you can --
130
368299
2762
这些影像是 人工成色的，对于决定植物的繁茂程度非常有帮助。让我们回到刚刚那里
06:35
it's really good for determining
vegetative use.
vegetative use.
131
371085
3943
06:39
Well, let's go back to this.
132
375887
1586
地图软件了不起的地方是，
06:44
The great thing
about mapping applications --
about mapping applications --
133
380312
2174
它不只是二维平面，它也可以是三维立体影像。所以再一次，应用多点触控界面，
06:46
it's not really 2D, it's 3D.
134
382510
1490
06:48
So, again, with a multi-point interface,
you can do a gesture like this --
you can do a gesture like this --
135
384024
3492
你可以使用 像这样的手势，所以你可以使画面像这样倾斜，
06:51
so you can be able
to tilt around like that --
to tilt around like that --
136
387540
3437
你知道。不 只是受限于简单的二维平面攀移与移动。
06:55
(Surprised laughter)
137
391001
1874
06:56
It's not just simply relegated
to a kind of 2D panning and motion.
to a kind of 2D panning and motion.
138
392899
3182
我们已经研 发出了这些手势，像这样，只要放入你的两跟手指，
07:00
This gesture is just putting
two fingers down --
two fingers down --
139
396105
2635
它界定了倾 斜的轴线，如此这般我就可以向上或向下任意倾斜。
07:02
it's defining an axis of tilt --
and I can tilt up and down that way.
and I can tilt up and down that way.
140
398764
3653
这是我们在 这边，刚刚想出来的点子，
07:06
We just came up with that on the spot,
141
402441
2078
也许这不是这样做最好的方法，
07:08
it's probably not the right thing to do,
142
404543
1937
但是使用这 种接口，你可以做许多很有趣的事情。
07:10
but there's such interesting things
you can do with this interface.
you can do with this interface.
143
406504
3229
07:15
It's just so much fun
playing around with it, too.
playing around with it, too.
144
411000
2934
就算你什么 都不做，只是玩玩，也会感觉愉快。（笑声）
07:17
(Laughter)
145
413958
1353
最后 一件我想要向你们展示的东西是，
07:19
And so the last thing
I want to show you is --
I want to show you is --
146
415335
2641
07:22
I'm sure we can all think
of a lot of entertainment apps
of a lot of entertainment apps
147
418000
2677
我 确信我们都可以想到很多，你可以利用这个东西所做的
娱乐方面的 应用
07:24
that you can do with this thing.
148
420701
1524
我对于我们 可以利用这东西，所做的创意性应用更感兴趣
07:26
I'm more interested in the creative
applications we can do with this.
applications we can do with this.
149
422249
4050
现在，这边 有一个简单的程序，我可以画曲线。
07:30
Now, here's a simple application here --
I can draw out a curve.
I can draw out a curve.
150
426323
3237
当我将曲线 封闭起来的时候，它就变成一个人偶。
07:35
And when I close it,
it becomes a character.
it becomes a character.
151
431201
3266
07:38
But the neat thing about it
is I can add control points.
is I can add control points.
152
434785
2977
但是有趣的 事情是，我可以增加控制点。
07:41
And then what I can do is manipulate them
with both of my fingers at the same time.
with both of my fingers at the same time.
153
437786
3977
然后我可以 用我双手的手指同时操控它们。
07:45
And you notice what it does.
154
441787
1903
你会注意到 它是怎么做的。
07:48
It's kind of a puppeteering thing,
155
444253
2555
这就像是操 控木偶一般，这边我可以使用
07:50
where I can use as many fingers
as I have to draw and make --
as I have to draw and make --
156
446832
5218
我的十根手指去画出并做出玩偶。
事实上，在 这表象之下需要很多数学运算，
08:02
Now, there's a lot of actual math
going on under here
going on under here
157
458274
2702
08:05
for this to control this mesh
and do the right thing.
and do the right thing.
158
461000
4442
然后它才能 控制这些图案，并正确的反应。
我的意思 是，在这边这个能够操控图案的技术，
08:10
This technique of being able to manipulate
a mesh here, with multiple control points,
a mesh here, with multiple control points,
159
466183
5692
并使用多个 操控点，事实上是属于一种尖端科技
08:15
is actually state of the art.
160
471899
1476
这个技术去 年才在计算器图形学会议上公开，
08:17
It was released at SIGGRAPH last year.
161
473399
1824
但这是我热爱的研究领域的最好范例。
08:19
It's a great example
of the kind of research I really love:
of the kind of research I really love:
162
475247
2770
所有这些需 要使事情做正确，背后的计算机运算。
08:22
all this compute power
to make things do the right things,
to make things do the right things,
163
478041
2799
直觉性的事 情。做如你所预期一模一样的事。
08:24
intuitive things,
to do exactly what you expect.
to do exactly what you expect.
164
480864
2721
08:31
So, multi-touch interaction research
is a very active field right now in HCI.
is a very active field right now in HCI.
165
487000
4658
多点触控互 动研究，现在在人机界面领域非常地活跃。
08:36
I'm not the only one doing it,
a lot of other people are getting into it.
a lot of other people are getting into it.
166
492000
3476
我不是唯一 一个在做这方面研究的，还有很多其它的人也在这领域钻研
而这种技 术，将会让更多人加入这个领域的研究，
08:39
This kind of technology is going to let
even more people get into it,
even more people get into it,
167
495500
3245
我真的非常 期待，跟在场各位接下来几天的互动
08:42
I'm looking forward to interacting
with all of you over the next few days
with all of you over the next few days
168
498769
3492
看看这技 术，将能如何应用在你们所处的领域
08:46
and seeing how it can apply
to your respective fields.
to your respective fields.
169
502285
2537
谢谢。
08:48
Thank you.
170
504846
1158
(鼓掌)
08:50
(Applause)
171
506028
2569
ABOUT THE SPEAKER
Jeff Han - Human-computer interface designerAfter years of research on touch-driven computer displays, Jeff Han has created a simple, multi-touch, multi-user screen interface that just might herald the end of the point-and-click era.
Why you should listen
Jeff Han's intuitive "interface-free" computer displays -- controlled by the touch of fingertips -- will change forever the way you think about computers. At TED 2006, the audience whistled, clapped and gasped audibly as Han demoed (for the first time publicly) his prototype drafting table-cum-touch display, developed at NYU's Courant Institute of Mathematical Sciences. The demo included a virtual lightbox, where he moved photos by fingertip -- as if they were paper on a desk -- flicking them across the screen and zooming in and out by pinching two fingers together, as well as a Google Earth-like map that he tilted and flew over with simple moves.
When the demo hit the web, bloggers and YouTubers made him a bit of a megastar. (His video has been watched more than 600,000 times on YouTube alone; "Amazing," "Incredible" and "Freaking awesome" are the typical responses there. Also: "When can I buy one?") After this legendary demo, Han launched a startup called Perceptive Pixel -- and when he came back to TED2007, he and his team brought an entire interactive wall, where TEDsters lined up to play virtual guitars. His talent and reputation earned him a place on Time Magazine's 2008 list of the world's 100 Most Influential People.
Jeff Han | Speaker | TED.com