TEDxCERN
Sean Follmer: Shape-shifting tech will change work as we know it
肖恩.弗尔默: 新形态科技将改变我们的工作方式
Filmed:
Readability: 4.5
1,541,392 views
如果不再依靠键盘鼠标，我们的世界会是什么样呢？交互设计师肖恩.弗尔默正通过各种设备创建未来，让信息就构建在你的指尖之下。在这次演讲里，你会看到一台3D形态的桌面模型，一支能变成腕带的手机，一个可变形的游戏控制器，还有更多可能改变我们生活和工作的东西。
Sean Follmer - Human-computer interaction researcher and designer
Sean Follmer designs shape-changing and deformable interfaces that take advantage of our natural dexterity and spatial abilities. Full bio
Sean Follmer designs shape-changing and deformable interfaces that take advantage of our natural dexterity and spatial abilities. Full bio
Double-click the English transcript below to play the video.
00:12
We've evolved with tools,
and tools have evolved with us.
and tools have evolved with us.
0
811
3553
人类发明了工具，工具也影响着人类。
1500万年前，
我们的祖先创造了这些掌上刀具，
我们的祖先创造了这些掌上刀具，
00:16
Our ancestors created these
hand axes 1.5 million years ago,
hand axes 1.5 million years ago,
1
4388
5019
00:21
shaping them to not only
fit the task at hand
fit the task at hand
2
9431
3022
它们被打磨得不仅适用于手工活计，
也十分小巧，方便单手操控。
00:24
but also their hand.
3
12477
1468
00:26
However, over the years,
4
14747
1580
然而，随着时间的流逝，
工具变得越来越专业化。
00:28
tools have become
more and more specialized.
more and more specialized.
5
16351
2530
00:31
These sculpting tools
have evolved through their use,
have evolved through their use,
6
19293
3837
这些雕刻工具根据人们的需要不断改变着，
每一种都有与它们的作用相对应的形状。
00:35
and each one has a different form
which matches its function.
which matches its function.
7
23154
3562
它们提高了我们双手的灵活性，
00:38
And they leverage
the dexterity of our hands
the dexterity of our hands
8
26740
2668
使得我们在操纵物品时更加精确。
00:41
in order to manipulate things
with much more precision.
with much more precision.
9
29432
3130
00:45
But as tools have become
more and more complex,
more and more complex,
10
33338
3066
但是当工具变得越来越复杂的同时，
控制它们的方式也变得越来越复杂。
00:48
we need more complex controls
to control them.
to control them.
11
36428
3878
00:52
And so designers have become
very adept at creating interfaces
very adept at creating interfaces
12
40714
4444
因此当今设计师们致力于
开发一些交互方式，
开发一些交互方式，
使你在做一件事的同时
还能调整其他功能，
还能调整其他功能，
00:57
that allow you to manipulate parameters
while you're attending to other things,
while you're attending to other things,
13
45182
3738
比如你在照相的同时
还可以调整焦距
还可以调整焦距
01:00
such as taking a photograph
and changing the focus
and changing the focus
14
48944
2879
或调整光圈。
01:03
or the aperture.
15
51847
1336
01:05
But the computer has fundamentally
changed the way we think about tools
changed the way we think about tools
16
53918
4219
但是计算机的出现
从根本上改变了我们对工具的认识，
从根本上改变了我们对工具的认识，
因为它的计算功能十分强大。
01:10
because computation is dynamic.
17
58161
2014
01:12
So it can do a million different things
18
60564
2151
它可以做各种不同的事情，
也可以运行数量繁多的应用程序。
01:14
and run a million different applications.
19
62739
2349
然而计算机有着它固定的外形，
01:17
However, computers have
the same static physical form
the same static physical form
20
65112
3745
这个外形不会因为运行不同的程序而改变，
01:20
for all of these different applications
21
68881
1936
并且，它和人交互的方式也是不变的。
01:22
and the same static
interface elements as well.
interface elements as well.
22
70841
2777
01:25
And I believe that this
is fundamentally a problem,
is fundamentally a problem,
23
73976
2420
我认为这本身就是一个问题，
因为这样一来我们就无法用双手
去参与和计算机交互的过程，
去参与和计算机交互的过程，
01:28
because it doesn't really allow us
to interact with our hands
to interact with our hands
24
76420
2996
无法体现人体的灵活性。
01:31
and capture the rich dexterity
that we have in our bodies.
that we have in our bodies.
25
79440
3427
01:36
And my belief is that, then,
we must need new types of interfaces
we must need new types of interfaces
26
84026
4536
我的理念是，
一定要开发一些新的交互方式，
一定要开发一些新的交互方式，
能利用人体的这些优秀特性，
01:40
that can capture these
rich abilities that we have
rich abilities that we have
27
88586
3759
能完全适应我们的需要，
01:44
and that can physically adapt to us
28
92369
2370
还能以新的方式与我们互动。
01:46
and allow us to interact in new ways.
29
94763
2250
这就是我之前一直在
MIT媒体实验室，
MIT媒体实验室，
01:49
And so that's what I've been doing
at the MIT Media Lab
at the MIT Media Lab
30
97037
2587
以及现在在斯坦福从事的工作。
01:51
and now at Stanford.
31
99648
1324
01:53
So with my colleagues,
Daniel Leithinger and Hiroshi Ishii,
Daniel Leithinger and Hiroshi Ishii,
32
101901
3611
我和我的同事，
Daniel Leithinger 和 Hiroshi Ishii，
Daniel Leithinger 和 Hiroshi Ishii，
我们一起创造了 inFORM，
01:57
we created inFORM,
33
105536
1389
01:58
where the interface can actually
come off the screen
come off the screen
34
106949
2498
它让交互界面真正意义上脱离了屏幕，
你可以亲手操控它。
02:01
and you can physically manipulate it.
35
109471
2276
你也可以亲眼目睹它的3D形态，
02:03
Or you can visualize
3D information physically
3D information physically
36
111771
2743
并且触摸它感知它，
以全新的方式了解它。
以全新的方式了解它。
02:06
and touch it and feel it
to understand it in new ways.
to understand it in new ways.
37
114538
3514
02:15
Or you can interact through gestures
and direct deformations
and direct deformations
38
123889
4076
你还可以通过手势
直接改变它的形状与它互动，
直接改变它的形状与它互动，
塑造一个数码模型。
02:19
to sculpt digital clay.
39
127989
2297
02:26
Or interface elements can arise
out of the surface
out of the surface
40
134474
3081
组成界面的配件能够从其表面升起，
根据需求变形。
02:29
and change on demand.
41
137579
1372
这样设计的目的是，对每个应用，
02:30
And the idea is that for each
individual application,
individual application,
42
138975
2508
这个界面的外形都可以与这个应用相匹配。
02:33
the physical form can be matched
to the application.
to the application.
43
141507
3300
02:37
And I believe this represents a new way
44
145196
2105
我相信这代表了一种全新的
02:39
that we can interact with information,
45
147325
1950
我们与信息互动的方式，
也就是把它具体化。
02:41
by making it physical.
46
149299
1429
02:43
So the question is, how can we use this?
47
151142
2215
现在问题来了，我们如何应用它呢？
02:45
Traditionally, urban planners
and architects build physical models
and architects build physical models
48
153810
3690
一直以来，城建工作者靠实物模型
来更好的了解城市和建筑的布局。
02:49
of cities and buildings
to better understand them.
to better understand them.
49
157524
2810
02:52
So with Tony Tang at the Media Lab,
we created an interface built on inFORM
we created an interface built on inFORM
50
160358
4215
因此，我们与媒体实验室的Tony Tang一起
创造了一个建立在inFORM上的界面，
创造了一个建立在inFORM上的界面，
使得城市规划者们得以设计和展望整个城市。
02:56
to allow urban planners
to design and view entire cities.
to design and view entire cities.
51
164597
4983
所以现在你可以在它周边走动，
但是它是动态的，是实体的
但是它是动态的，是实体的
03:01
And now you can walk around it,
but it's dynamic, it's physical,
but it's dynamic, it's physical,
52
169604
4257
你还能直接跟它互动。
03:05
and you can also interact directly.
53
173885
1700
你可以从不同的视角观察它，
03:07
Or you can look at different views,
54
175609
1738
比如人口数量或者交通信息，
03:09
such as population or traffic information,
55
177371
2817
但是它被做成了一个实体。
03:12
but it's made physical.
56
180212
1562
03:14
We also believe that these dynamic
shape displays can really change
shape displays can really change
57
182996
3810
我们还相信这些动态形状的展示
会真正改变
会真正改变
人们远程合作的方式。
03:18
the ways that we remotely
collaborate with people.
collaborate with people.
58
186830
2960
当我们面对面工作时，
03:21
So when we're working together in person,
59
189814
2303
我不仅可以看着你的脸，
03:24
I'm not only looking at your face
60
192141
1658
我还可以比划和操纵物品，
03:25
but I'm also gesturing
and manipulating objects,
and manipulating objects,
61
193823
3038
这正是我们利用
像Skype这样的工具时非常难实现的。
像Skype这样的工具时非常难实现的。
03:28
and that's really hard to do
when you're using tools like Skype.
when you're using tools like Skype.
62
196885
3790
03:33
And so using inFORM,
you can reach out from the screen
you can reach out from the screen
63
201905
2986
当使用inFORM时，
你可以触及屏幕以外的东西，
你可以触及屏幕以外的东西，
并且在远距离操控物品。
03:36
and manipulate things at a distance.
64
204915
2112
这些小方块的移动
代表了人类双手的动作，
代表了人类双手的动作，
03:39
So we used the pins of the display
to represent people's hands,
to represent people's hands,
65
207051
3175
03:42
allowing them to actually touch
and manipulate objects at a distance.
and manipulate objects at a distance.
66
210250
4506
使得人们能够真正远程触碰和操作物品。
03:50
And you can also manipulate
and collaborate on 3D data sets as well,
and collaborate on 3D data sets as well,
67
218519
4274
你也可以在3D模型上操作或与人合作，
你可以对它们做手势，也可以摆弄它们。
03:54
so you can gesture around them
as well as manipulate them.
as well as manipulate them.
68
222817
3669
这就让人们可以用比传统工具更多元的方式
03:58
And that allows people to collaborate
on these new types of 3D information
on these new types of 3D information
69
226510
4390
实现在这种新型3D信息上的合作。
04:02
in a richer way than might
be possible with traditional tools.
be possible with traditional tools.
70
230924
3611
04:07
And so you can also
bring in existing objects,
bring in existing objects,
71
235870
2753
你还可以在上面放置一些物品，
它们会在一边被识别出来，
然后把信息传输到另一边。
然后把信息传输到另一边。
04:10
and those will be captured on one side
and transmitted to the other.
and transmitted to the other.
72
238647
3214
或者你让一件东西两边连通，
04:13
Or you can have an object that's linked
between two places,
between two places,
73
241885
2786
比如，我在一边移动一个球，
04:16
so as I move a ball on one side,
74
244695
2084
这个球会在另一边也移动起来。
04:18
the ball moves on the other as well.
75
246803
1927
04:22
And so we do this by capturing
the remote user
the remote user
76
250278
3103
我们通过捕捉操作者的动作来实现这些，
而这由一个可感测空间深度的摄像机完成，
类似微软的Kinect。
类似微软的Kinect。
04:25
using a depth-sensing camera
like a Microsoft Kinect.
like a Microsoft Kinect.
77
253405
2805
04:28
Now, you might be wondering
how does this all work,
how does this all work,
78
256758
3017
现在你也许想知道这一切是如何运作的，
本质上来说，它是把900个线性传动器
04:31
and essentially, what it is,
is 900 linear actuators
is 900 linear actuators
79
259799
3651
全部连通到这些机械联动装置上，
04:35
that are connected to these
mechanical linkages
mechanical linkages
80
263474
2286
好让下面的动作能被传送到
上面的这些方块上来。
上面的这些方块上来。
04:37
that allow motion down here
to be propagated in these pins above.
to be propagated in these pins above.
81
265784
3746
所以跟CERN做的事情比起来，
它其实没有那么复杂，
它其实没有那么复杂，
04:41
So it's not that complex
compared to what's going on at CERN,
compared to what's going on at CERN,
82
269554
3567
但是我们把它做出来确实花费了不少时间。
04:45
but it did take a long time
for us to build it.
for us to build it.
83
273145
2326
我们先做出了一个单独的马达，
04:47
And so we started with a single motor,
84
275495
2255
一个线性传动器，
04:49
a single linear actuator,
85
277774
1415
04:51
and then we had to design
a custom circuit board to control them.
a custom circuit board to control them.
86
279816
3163
然后定制了一个电路板来控制它们。
剩下的就是我们需要做很多同样的装置。
04:55
And then we had to make a lot of them.
87
283003
2052
问题是，当你需要做900件相同的东西时，
04:57
And so the problem with having
900 of something
900 of something
88
285079
3614
你要重复每个制作步骤900次。
05:00
is that you have to do
every step 900 times.
every step 900 times.
89
288717
3120
这意味着我们有大量的工作要做。
05:03
And so that meant that we had
a lot of work to do.
a lot of work to do.
90
291861
2357
因此，我们在媒体实验室
建立了一个小型的“血汗工厂”，
建立了一个小型的“血汗工厂”，
05:06
So we sort of set up
a mini-sweatshop in the Media Lab
a mini-sweatshop in the Media Lab
91
294242
3732
招募了一些本科生，
并说服他们这是在参与“研究”——
并说服他们这是在参与“研究”——
05:09
and brought undergrads in and convinced
them to do "research" --
them to do "research" --
92
297998
3712
（笑声）
05:13
(Laughter)
93
301734
1014
之后便有了在深夜
看着电影，吃着披萨，
看着电影，吃着披萨，
05:14
and had late nights
watching movies, eating pizza
watching movies, eating pizza
94
302772
3018
拧着成千上万的螺丝的场景。
05:17
and screwing in thousands of screws.
95
305814
1828
你们懂的，搞研究嘛。
05:19
You know -- research.
96
307666
1198
（笑声）
05:20
(Laughter)
97
308888
1547
但不管怎样，我们都对inFORM能够带来的
05:22
But anyway, I think that we were
really excited by the things
really excited by the things
98
310459
3318
各种可能性感到十分激动。
05:25
that inFORM allowed us to do.
99
313801
1696
如今，我们越来越多地使用移动设备，
便于出行时交流。
便于出行时交流。
05:27
Increasingly, we're using mobile devices,
and we interact on the go.
and we interact on the go.
100
315521
4200
然而移动设备，就像电脑，
05:31
But mobile devices, just like computers,
101
319745
2679
有很多种不同的用途。
05:34
are used for so many
different applications.
different applications.
102
322448
2311
你可以用它们打电话，
05:36
So you use them to talk on the phone,
103
324783
1993
上网，玩游戏，照相，
05:38
to surf the web, to play games,
to take pictures
to take pictures
104
326800
3156
甚至更多不同的事。
05:41
or even a million different things.
105
329980
1709
但就如之前我提过的，
它们都有相同的外形，
它们都有相同的外形，
05:43
But again, they have the same
static physical form
static physical form
106
331713
2984
对每一个不同的应用来讲都一样。
05:46
for each of these applications.
107
334721
2118
所以，我们想知道如何能将这些
05:48
And so we wanted to know how can we take
some of the same interactions
some of the same interactions
108
336863
3363
为inFORM研发的交互行为
05:52
that we developed for inFORM
109
340250
1683
推广到移动设备上。
05:53
and bring them to mobile devices.
110
341957
1888
05:56
So at Stanford, we created
this haptic edge display,
this haptic edge display,
111
344427
3647
因此在斯坦福，
我们创造了一个触觉边缘显示器。
我们创造了一个触觉边缘显示器。
它是一个有着一排线性传动器的手机，
06:00
which is a mobile device
with an array of linear actuators
with an array of linear actuators
112
348098
3177
这排传动器可以改变形状，
06:03
that can change shape,
113
351299
1347
当你用手机阅读时可以通过感受
它的形状变化了解自己读到哪里了。
它的形状变化了解自己读到哪里了。
06:04
so you can feel in your hand
where you are as you're reading a book.
where you are as you're reading a book.
114
352670
3897
06:09
Or you can feel in your pocket
new types of tactile sensations
new types of tactile sensations
115
357058
3737
它放在口袋里时，你也可以感受到这种新的
比单纯震动更丰富的触感。
06:12
that are richer than the vibration.
116
360819
1802
为方便操作，按钮会从侧面浮出，
06:14
Or buttons can emerge from the side
that allow you to interact
that allow you to interact
117
362645
3235
你可以指定它们的位置。
06:17
where you want them to be.
118
365904
1708
06:21
Or you can play games
and have actual buttons.
and have actual buttons.
119
369334
3397
你也可以在玩游戏时拥有真正的按钮了。
06:25
And so we were able to do this
120
373786
1516
这些能够实现是通过
在显示器内嵌入40个微型线性传动器，
06:27
by embedding 40 small, tiny
linear actuators inside the device,
linear actuators inside the device,
121
375326
4754
让操作者不仅能触摸按钮，
06:32
and that allow you not only to touch them
122
380104
2055
还能反向操纵它们。
06:34
but also back-drive them as well.
123
382183
1904
06:36
But we've also looked at other ways
to create more complex shape change.
to create more complex shape change.
124
384911
4178
为了创造更复杂的形状变化，
我们还研究了其他方式。
我们还研究了其他方式。
我们使用气动装置创造了一个变体设备，
06:41
So we've used pneumatic actuation
to create a morphing device
to create a morphing device
125
389113
3392
使用时可以把它弄成一个电话的形状，
06:44
where you can go from something
that looks a lot like a phone ...
that looks a lot like a phone ...
126
392529
3865
也可以弄成一个腕带随身佩戴。
06:48
to a wristband on the go.
127
396418
2230
06:51
And so together with Ken Nakagaki
at the Media Lab,
at the Media Lab,
128
399720
2839
与媒体实验室的Ken Nakagaki一起，
我们创造了这个新的，高精度的版本，
06:54
we created this new
high-resolution version
high-resolution version
129
402583
2554
它内置一排伺服马达，
使得它可以从一个有交互功能的腕带
使得它可以从一个有交互功能的腕带
06:57
that uses an array of servomotors
to change from interactive wristband
to change from interactive wristband
130
405161
5950
变成一个可触摸输入的设备。
07:03
to a touch-input device
131
411135
3128
再变成一个电话。
07:06
to a phone.
132
414287
1245
（笑声）
07:07
(Laughter)
133
415556
1658
07:10
And we're also interested
in looking at ways
in looking at ways
134
418104
2172
我们还乐于尝试
让用户能真正意义上改变界面的形态，
07:12
that users can actually
deform the interfaces
deform the interfaces
135
420300
2627
把它们打造成自己想要的样子。
07:14
to shape them into the devices
that they want to use.
that they want to use.
136
422951
2888
你可以把它捏成一个游戏手柄，
07:17
So you can make something
like a game controller,
like a game controller,
137
425863
2408
然后系统就会识别它当前的形态，
07:20
and then the system will understand
what shape it's in
what shape it's in
138
428295
2630
从而调整成相应的模式。
07:22
and change to that mode.
139
430949
1619
07:26
So, where does this point?
140
434052
1572
那么，我们这么做的意义何在呢？
这个创意的前景是什么？
07:27
How do we move forward from here?
141
435648
1928
我认为，我们当前所处的
07:29
I think, really, where we are today
142
437600
2595
是一个“物联网”主导的新时代。
07:32
is in this new age
of the Internet of Things,
of the Internet of Things,
143
440219
2754
计算机无处不在——
07:34
where we have computers everywhere --
144
442997
1791
在我们口袋里，挂在墙上，
07:36
they're in our pockets,
they're in our walls,
they're in our walls,
145
444812
2118
在未来五年之内几乎每个你会买的设备里。
07:38
they're in almost every device
that you'll buy in the next five years.
that you'll buy in the next five years.
146
446954
3566
但设想，如果我们暂且不考虑这些设备，
07:42
But what if we stopped
thinking about devices
thinking about devices
147
450544
2881
去关心一下我们的环境呢？
07:45
and think instead about environments?
148
453449
2394
我们如何设计出智能家具，
07:47
And so how can we have smart furniture
149
455867
2512
智能房间，智能的生活环境或城市，
07:50
or smart rooms or smart environments
150
458403
3316
能够完全适应我们实际的生活需求，
07:53
or cities that can adapt to us physically,
151
461743
3092
允许我们以新的方式与他人交互合作，
07:56
and allow us to do new ways
of collaborating with people
of collaborating with people
152
464859
4231
08:01
and doing new types of tasks?
153
469114
2238
实现一些新的功能呢？
因此，在米兰设计周上，
我们展出了TRANSFORM，
我们展出了TRANSFORM，
08:03
So for the Milan Design Week,
we created TRANSFORM,
we created TRANSFORM,
154
471376
3384
它是一个之前展示过的
可变交互界面的桌面版本，
可变交互界面的桌面版本，
08:06
which is an interactive table-scale
version of these shape displays,
version of these shape displays,
155
474784
3824
它可以在其表面上移动物品，比如
08:10
which can move physical objects
on the surface; for example,
on the surface; for example,
156
478632
3183
提醒你拿钥匙。
08:13
reminding you to take your keys.
157
481839
2257
它也可以变形，
以便与你进行其他方式的交流。
以便与你进行其他方式的交流。
08:16
But it can also transform
to fit different ways of interacting.
to fit different ways of interacting.
158
484120
4482
比如，如果你要工作，
08:20
So if you want to work,
159
488626
1317
它会将表面变形成你的工作台。
08:21
then it can change to sort of
set up your work system.
set up your work system.
160
489967
2992
你要拿一个设备过来时，
08:24
And so as you bring a device over,
161
492983
1951
它会设置一个你放设备要用的支撑物，
08:26
it creates all the affordances you need
162
494958
2738
并且塑造一些其他东西帮助你完成工作。
08:29
and brings other objects
to help you accomplish those goals.
to help you accomplish those goals.
163
497720
4800
08:37
So, in conclusion,
164
505139
1561
总的来说，
我真的认为我们要思考一种新的，
从根本意义上不同的
从根本意义上不同的
08:38
I really think that we need to think
about a new, fundamentally different way
about a new, fundamentally different way
165
506724
3999
与计算机互动的方式。
08:42
of interacting with computers.
166
510747
2158
08:45
We need computers
that can physically adapt to us
that can physically adapt to us
167
513551
2954
我们需要计算机完全的适应我们，
而且是以我们期待的方式来适应我们，
08:48
and adapt to the ways
that we want to use them
that we want to use them
168
516529
2601
08:51
and really harness the rich dexterity
that we have of our hands,
that we have of our hands,
169
519154
4547
真正利用我们双手丰富的灵巧度，
以及我们通过把信息实体化去看问题的能力。
08:55
and our ability to think spatially
about information by making it physical.
about information by making it physical.
170
523725
4271
09:00
But looking forward, I think we need
to go beyond this, beyond devices,
to go beyond this, beyond devices,
171
528663
3996
但展望未来时，我认为
我们需要再跨越一步，跨越这些设备
我们需要再跨越一步，跨越这些设备
去认真思考新的方式，我们可以集思广益，
09:04
to really think about new ways
that we can bring people together,
that we can bring people together,
172
532683
3393
把我们的想法传递给这个世界，
09:08
and bring our information into the world,
173
536100
3018
并且考虑如何创造一个
完全适应我们的智能环境，
完全适应我们的智能环境，
09:11
and think about smart environments
that can adapt to us physically.
that can adapt to us physically.
174
539142
3953
我的演讲结束了。
09:15
So with that, I will leave you.
175
543119
1564
非常感谢。
09:16
Thank you very much.
176
544707
1151
（掌声）
09:17
(Applause)
177
545882
3592
ABOUT THE SPEAKER
Sean Follmer - Human-computer interaction researcher and designerSean Follmer designs shape-changing and deformable interfaces that take advantage of our natural dexterity and spatial abilities.
Why you should listen
Sean Follmer is a human-computer interaction researcher and designer. He is an Assistant Professor of Mechanical Engineering at Stanford University, where he teaches the design of smart and connected devices and leads research at the intersection between human-computer interaction (HCI) and robotics.
Follmer received a Ph.D. and a Masters degree from the MIT Media Lab in 2015 and 2011, respectively, and a BS in Engineering from Stanford University. He has worked at Nokia Research and Adobe Research on projects exploring the frontiers of HCI.
Follmer has received numerous awards for his research and design work, including best paper awards and nominations from premier academic conferences in HCI (ACM UIST and CHI), Fast Company Innovation By Design Awards, a Red Dot Design Award and a Laval Virtual Award.
Sean Follmer | Speaker | TED.com