TED2009
David Merrill: Toy tiles that talk to each other
大卫·梅若(David Merrill)：Siftables演示 — 一种会思考的玩具
Filmed:
Readability: 4.4
1,947,080 views
毕业于麻省理工学院的大卫·梅若向我们演示了Siftables--饼干般大小、可以用手随意组合的电脑积木。这款先进的玩具可以算算术、演奏乐曲，还会说话。它会成为新一代的掌上学习机吗？
David Merrill - MIT grad student
David Merrill works on Siftables, tiny computer blocks that interact with each other to make networks (and music). Full bio
David Merrill works on Siftables, tiny computer blocks that interact with each other to make networks (and music). Full bio
Double-click the English transcript below to play the video.
00:12
I want to start out by asking you to think back to when you were a kid,
0
0
2000
首先，我想请大家回忆一下你们在孩提时代
00:14
playing with blocks.
1
2000
2000
玩过的积木。
00:16
As you figured out how to reach out and grasp,
2
4000
2000
当你构思着怎么去搭建积木
00:18
pick them up and move them around,
3
6000
2000
并且去动手操作的时候，
00:20
you were actually learning how to think and solve problems
4
8000
2000
其实是你正在学习怎样思考和解决问题。
00:22
by understanding and manipulating spatial relationships.
5
10000
3000
这即是对物体的空间结构的理解和感知。
00:25
Spatial reasoning is deeply connected
6
13000
3000
理解物体的空间结构非常有助于
00:28
to how we understand a lot of the world around us.
7
16000
2000
我们对很多周围事物的学习。
00:30
So, as a computer scientist
8
18000
2000
因此，作为一个计算机领域的科学家，
00:32
inspired by this utility of our interactions with physical objects --
9
20000
3000
在这种手动思考方式的启发下，
00:35
along with my adviser Pattie, and my collaborator Jeevan Kalanithi --
10
23000
4000
以及在我的导师Pattie和我的合作伙伴Jeevan Kalanithi的帮助下，
00:39
I started to wonder -- what if when we used a computer,
11
27000
3000
我开始思考--要是我们能用一种新型计算机
00:42
instead of having this one mouse cursor that was a like a digital fingertip
12
30000
3000
来代替鼠标移动光标，就好比一种数字化的手指尖
00:45
moving around a flat desktop,
13
33000
2000
在桌面移动--那样会如何呢？
00:47
what if we could reach in with both hands and grasp information physically,
14
35000
4000
要是我们能用手来直接感知信息，
00:51
arranging it the way we wanted?
15
39000
2000
按我们的思路来组合信息--那样会如何呢？
00:53
This question was so compelling that we decided to explore the answer,
16
41000
3000
这样的疑问不断萦绕在我的脑海中，于是我们决定去探寻答案，
00:56
by building Siftables.
17
44000
2000
所以才有了这款Siftables。
00:58
In a nutshell, a Siftable is an interactive computer
18
46000
3000
简单地说，Siftable是一款互动计算机，
01:01
the size of a cookie.
19
49000
2000
体积如饼干般大小。
01:03
They're able to be moved around by hand,
20
51000
2000
Siftables可以用手随意移动，
01:05
they can sense each other, they can sense their motion,
21
53000
2000
每块Siftable可以互相感知彼此的移动，
01:07
and they have a screen and a wireless radio.
22
55000
3000
每块Siftable还有显示屏和无线电装置。
01:10
Most importantly, they're physical,
23
58000
2000
最重要的是，每块Siftable都是独立的，
01:12
so like the blocks, you can move them just by reaching out and grasping.
24
60000
3000
就像积木一样，可以随意搭配。
01:15
And Siftables are an example of a new ecosystem
25
63000
3000
而且Siftables代表了一种新的生态系统
01:18
of tools for manipulating digital information.
26
66000
2000
--即数字化信息的操作工具。
01:20
And as these tools become more physical,
27
68000
3000
这种操作工具更加独立，
01:23
more aware of their motion, aware of each other,
28
71000
2000
更加灵敏，能彼此感知，
01:25
and aware of the nuance of how we move them,
29
73000
2000
感知任何细微的移动，
01:27
we can start to explore some new and fun interaction styles.
30
75000
3000
所以我们可以使用这种工具尝试一些新的有趣的互动。
01:30
So, I'm going to start with some simple examples.
31
78000
2000
现在，我就来演示一些简单的。
01:32
This Siftable is configured to show video,
32
80000
3000
这块Siftable有映像配置，
01:35
and if I tilt it in one direction, it'll roll the video this way;
33
83000
2000
如果我把它向一侧倾斜，那么它所显示的画面也朝这边倾斜，
01:37
if I tilt it the other way it rolls it backwards.
34
85000
3000
如果我把它朝反方向倾斜，那么图像也朝反方向倾斜。
01:40
And these interactive portraits are aware of each other.
35
88000
3000
而且这些Siftables能互相感知。
01:43
So if I put them next to each other, they get interested.
36
91000
3000
如果把它们一个挨一个摆好，有趣的现象就会发生。
01:46
If they get surrounded, they notice that too,
37
94000
4000
如果把它们随意一堆，他们也会察觉到，
01:50
they might get a little flustered.
38
98000
2000
那就会有点儿混乱。
01:52
And they can also sense their motion and tilt.
39
100000
4000
它们还能感知彼此的移动和倾斜。
01:56
One of the interesting implications on interaction, we started to realize,
40
104000
5000
我们发现一个有趣的互动--
02:01
was that we could use everyday gestures on data,
41
109000
2000
我们可以通过一些常用的手势和Siftables进行互动，
02:03
like pouring a color the way we might pour a liquid.
42
111000
3000
比如象倒液体那样把颜色从一块Siftable倒入另一块Siftable.
02:06
So in this case, we've got three Siftables configured to be paint buckets
43
114000
4000
我们来看这个演示，这有三块设置成油漆桶模式的Siftables,
02:10
and I can use them to pour color into that central one,
44
118000
3000
我们可以把这些桶里的颜色倒入中间的那个，
02:13
where they get mixed.
45
121000
2000
把颜色混在一起.
02:15
If we overshoot, we can pour a little bit back.
46
123000
3000
如果倒多了，可以再倒回去一些。
02:19
There are also some neat possibilities for education,
47
127000
3000
Siftables还有学习机的功能，
02:22
like language, math and logic games
48
130000
2000
可以用来学语言、算算术等--
02:24
where we want to give people the ability to try things quickly,
49
132000
2000
我们希望通过这些功能让学习变得快捷，
02:26
and view the results immediately.
50
134000
3000
更快看到结果。
02:29
So here I'm --
51
137000
2000
这也是我来这里展示Siftables的原因--
02:31
(Applause)
52
139000
2000
（掌声）
02:33
This is a Fibonacci sequence that I'm making with a simple equation program.
53
141000
4000
这是我用一个简单方程式做成的斐波那契数列。
02:37
Here we have a word game that's kind of like a mash-up between Scrabble and Boggle.
54
145000
4000
Siftables还可以玩拼字游戏--一种Scrabble和Boggle混搭的拼字游戏。
02:41
Basically, in every round
55
149000
2000
这种拼字游戏的玩法大致如下，
02:43
you get a randomly assigned letter on each Siftable,
56
151000
2000
你随意拿一块带有字母的Siftable,
02:45
and as you try to make words it checks against a dictionary.
57
153000
3000
当你把几块带有字母的Siftables拼在一起组成单词时，Siftables会在字典里自动查找单词。
02:48
Then, after about 30 seconds, it reshuffles,
58
156000
3000
大约30秒后Siftables会自动根据正确的单词拼写顺序改变原来显示的字母，组成正确的单词，
02:51
and you have a new set of letters and new possibilities to try.
59
159000
3000
你还可以尝试用其他的字母拼出新的单词。
02:54
(Applause)
60
162000
1000
（掌声）
02:55
Thank you.
61
163000
1000
谢谢大家。
02:56
(Applause)
62
164000
2000
（掌声）
02:58
So these are some kids that came on a field trip to the Media Lab,
63
166000
2000
现在，屏幕上显示的是一些孩子正在Media Lab 里参与Siftables的试用体验，
03:00
and I managed to get them to try it out, and shoot a video.
64
168000
3000
我把孩子们的体验过程拍了下来。
03:10
They really loved it.
65
178000
2000
孩子们非常喜欢Siftables。
03:12
And, one of the interesting things about this kind of application
66
180000
3000
而且有趣的是在玩这个拼字游戏的时候
03:15
is that you don't have to give people many instructions.
67
183000
3000
我们并不需要向他们解释什么。
03:18
All you have to say is, "Make words,"
68
186000
2000
只要跟他们说这是个“拼字”游戏时，
03:20
and they know exactly what to do.
69
188000
2000
他们就知道该怎么做了。
03:22
So here's another few people trying it out.
70
190000
2000
现在屏幕上显示的是另一些人在体验Siftables。
03:31
That's our youngest beta tester, down there on the right.
71
199000
3000
右下角这位是年龄最小的体验者。
03:36
Turns out, all he wanted to do was to stack the Siftables up.
72
204000
5000
他只是想把Siftables堆在一起。
03:42
So to him, they were just blocks.
73
210000
3000
在他看来，Siftables只是积木。
03:46
Now, this is an interactive cartoon application.
74
214000
3000
现在屏幕上显示的是一种动画功能的互动尝试。
03:49
And we wanted to build a learning tool for language learners.
75
217000
5000
我们希望Siftables能成为学习语言的帮手。
03:54
And this is Felix, actually.
76
222000
2000
画面上的这个孩子叫Felix。
03:57
And he can bring new characters into the scene,
77
225000
2000
他能把一些新元素添加到动画图像上，
03:59
just by lifting the Siftables off the table that have that character shown on them.
78
227000
4000
他所做的就是把桌上的Siftables拿起来朝着动画图像投一下影，就可以把这些新元素加到动画上了。
04:03
Here, he's bringing the sun out.
79
231000
3000
看，他把太阳加上去了。
04:07
Video: The sun is rising.
80
235000
2000
视频：太阳升起来了。
04:09
David Merrill: Now he's brought a tractor into the scene.
81
237000
3000
大卫·梅若：现在他把拖拉机加上去了。
04:13
Video: The orange tractor.
82
241000
2000
视频：橙色的拖拉机。
04:15
Good job! Yeah!
83
243000
2000
做的不错！
04:18
DM: So by shaking the Siftables and putting them next to each other
84
246000
3000
把Siftables朝动画图像晃一下就可以把新元素加到画面上
04:21
he can make the characters interact --
85
249000
2000
他把新元素加上去了--
04:23
Video: Woof!
86
251000
1000
视频：狗吠声
04:24
DM: inventing his own narrative.
87
252000
2000
梅若：他在编写属于他的动画故事。
04:26
Video: Hello!
88
254000
1000
视频：你好！
04:27
DM: It's an open-ended story,
89
255000
2000
梅若：这是个开放式结局的故事，
04:29
and he gets to decide how it unfolds.
90
257000
2000
他在计划怎样展开故事情节。.
04:34
Video: Fly away, cat.
91
262000
2000
视频：猫坐着热气球飞走了。
04:42
DM: So, the last example I have time to show you today
92
270000
3000
梅若：下面我要给大家进行最后一个展示
04:45
is a music sequencing and live performance tool
93
273000
2000
这个功能可以编排、演奏音乐
04:47
that we've built recently,
94
275000
2000
是我们最近研发的，
04:49
in which Siftables act as sounds
95
277000
3000
Siftables的这种功能体现在声音方面，
04:52
like lead, bass and drums.
96
280000
2000
能发出像超载音、贝斯及鼓的声音。
04:54
Each of these has four different variations,
97
282000
2000
每个模块有四档可供调节，
04:56
you get to choose which one you want to use.
98
284000
2000
任君选择。
04:58
And you can inject these sounds into a sequence
99
286000
3000
你可以把声音模块的Siftable里的声音加入编辑模块的Siftable
05:01
that you can assemble into the pattern that you want.
100
289000
3000
按你喜欢的方式。
05:04
And you inject it by just bumping up the sound Siftable against a sequence Siftable.
101
292000
4000
加入声音只需把声音模块靠近编辑模块。
05:08
There are effects that you can control live, like reverb and filter.
102
296000
4000
还有类似混响器、滤声器作用的Siftable模块。
05:12
You attach it to a particular sound and then tilt to adjust it.
103
300000
3000
把这类模块靠近声音模块就可以调整声音了。
05:15
And then, overall effects like tempo and volume
104
303000
3000
接下来，可以用控制总体节奏和音量的Siftable模块
05:18
that apply to the entire sequence.
105
306000
2000
靠近编辑模块的Siftable来调整节奏和音量。
05:20
So let's have a look.
106
308000
2000
我们来看一下。
05:22
Video: (Music)
107
310000
2000
视频：（音乐）
05:24
DM: We'll start by putting a lead
108
312000
2000
梅若：开始先把超载音
05:26
into two sequence Siftables, arrange them into a series,
109
314000
5000
注入两个编辑模块，
05:31
extend it, add a little more lead.
110
319000
2000
再加一些超载音。
05:34
Now I put a bass line in.
111
322000
2000
现在加入贝斯音。
05:36
Video: (Music)
112
324000
5000
视频：（音乐）
05:41
DM: Now I'll put some percussion in.
113
329000
2000
梅若：现在加入一些打击乐器的声音。
05:43
Video: (Music)
114
331000
5000
视频：（音乐）
05:48
DM: And now I'll attach the filter to the drums, so I can control the effect live.
115
336000
3000
梅若：现在把滤声模块靠近鼓声模块，这样可以调整声音。
05:51
Video: (Music)
116
339000
2000
视频：（音乐）
05:53
DM: I can speed up the whole sequence
117
341000
2000
梅若：我来把节奏加快些
05:55
by tilting the tempo one way or the other.
118
343000
3000
只需把节奏模块靠近编辑模块。
05:58
Video: (Music)
119
346000
2000
视频：（音乐）
06:00
DM: And now I'll attach the filter to the bass for some more expression.
120
348000
3000
梅若：现在再把滤声模块靠近贝斯模块滤声。
06:03
Video: (Music)
121
351000
5000
视频：（音乐）
06:08
DM: I can rearrange the sequence while it plays.
122
356000
3000
梅若：在音乐演奏的过程中还可以重新编排。
06:11
So I don't have to plan it out in advance, but I can improvise,
123
359000
2000
所以并不需要提前编排，而是在演奏时随时改编，
06:13
making it longer or shorter as I go.
124
361000
2000
可长可短。
06:16
And now, finally, I can fade the whole sequence out
125
364000
3000
最后，我来结束整个演奏，
06:19
using the volume Siftable, tilted to the left.
126
367000
3000
用音量模块靠近编辑模块，用左边这个档。
06:22
(Applause)
127
370000
5000
（掌声）
06:27
Thank you.
128
375000
2000
谢谢大家。
06:29
So, as you can see,
129
377000
3000
正如大家看到的，
06:32
my passion is for making new human-computer interfaces
130
380000
3000
我的理想就是研发一款新型的能够人机互动的媒介
06:35
that are a better match to the ways our brains and bodies work.
131
383000
3000
更好地配合人体大脑的运作。
06:38
And today, I had time to show you one point in this new design space,
132
386000
4000
今天，我在这给大家展示了Siftable，
06:42
and a few of the possibilities that we're working to bring out of the laboratory.
133
390000
3000
我们的后续研究正在实验室中进行。
06:45
So the thought I want to leave you with
134
393000
2000
我想跟大家交流的想法就是
06:47
is that we're on the cusp of this new generation of tools
135
395000
3000
我们在研发新一代尖端科技产品
06:50
for interacting with digital media
136
398000
3000
--可以和数字媒体接轨的科技产品，
06:53
that are going to bring information into our world
137
401000
3000
它将给世界带来变化
06:56
on our terms.
138
404000
2000
这样的革新在我们这一代就会看到。
06:58
Thank you very much.
139
406000
1000
非常感谢大家。
06:59
I look forward to talking with all of you.
140
407000
2000
我期待着和大家共同探讨。
07:01
(Applause)
141
409000
2000
（掌声）
ABOUT THE SPEAKER
David Merrill - MIT grad studentDavid Merrill works on Siftables, tiny computer blocks that interact with each other to make networks (and music).
Why you should listen
David Merrill is currently the VP of Product at 3D Robotics, where he builds new, easy-to-use flying robots. He was formerly president and co-founder of Sifteo, a San Francisco startup spun out of his research at the MIT Media Lab. This research helped build an award-winning physical+digital play system and catalog of unique games. He also directed HW and SW on Sifteo products.
David constantly tinkers with next-generation technologies to make physical+digital tools that give people new powers (for good).
He is a human-computer interaction expert, frequent public speaker and aerial photography enthusiast. David's work has been featured by MoMA, the Disocvery Channel, Popular Science and Wired.
His main interest now is the Siftables project, the subject of his TEDTalk, on which he works with Jeevan Kalanithi. In another field of inquiry, Merrill is looking at ways to access digital information in the wider world, when we are away from a traditional computer.
A musician himself, Merril also has a deep interest in new musical interfaces. His Adaptive Music Controller is an instrument that learns its player (rather than the player learning the instrument). And working musicians should check out his AudioPint, a portable case that consolidates instruments, effects and audio processors into a gig-safe rugged housing.
David Merrill | Speaker | TED.com