ABOUT THE SPEAKER
Katherine Kuchenbecker - Mechanical engineer
Katherine Kuchenbecker works on incorporating the sense of touch directly into virtual objects. Imagine being able to feel textures on your digital screens.

Why you should listen

Could technology be more touchy feely? Mechanical engineer Katherine Kuchenbecker answers this question with a resounding ‘yes.’ Kuchenbecker researches the design, control and performance of robotic systems that enable a user to touch virtual objects and distant environments as though they were real and within reach. These interfaces combine electromechanical sensors, actuators and computer control, allowing for technology that can fool the human sense of touch, otherwise known as ‘haptics.’

Imagine a tablet computer that lets you feel fabrics and textures, robotic surgical tools that let doctors use their incredibly well-honed sense of touch, video games that allow you to feel hits and computer programs that teach you the movements of a sport. By researching these areas -- as well as applications in stroke rehabilitation and assistance for the blind -- Kuchenbecker seeks to improve our understanding of touch and uncover new opportunities to use it in interactions between humans, computers and machines.

An assistant professor at the University of Pennsylvania, Kuchenbecker has been named to the Popular Science Brilliant 10. She is also an avid photographer, and played volleyball at Stanford for two seasons.

More profile about the speaker
Katherine Kuchenbecker | Speaker | TED.com
TEDYouth 2012

Katherine Kuchenbecker: The technology of touch

Filmed:
671,551 views

As we move through the world, we have an innate sense of how things feel -- the sensations they produce on our skin and how our bodies orient to them. Can technology leverage this? In this fun, fascinating TED-Ed lesson, learn about the field of haptics, and how it could change everything from the way we shop online to how dentists learn the telltale feel of a cavity.
- Mechanical engineer
Katherine Kuchenbecker works on incorporating the sense of touch directly into virtual objects. Imagine being able to feel textures on your digital screens. Full bio

Double-click the English transcript below to play the video.

00:14
I'm a mechanical机械 engineering工程 professor教授
0
14745
1943
我是宾夕法尼亚大学的
00:16
at the University大学 of Pennsylvania宾夕法尼亚,
1
16712
1645
一名机械工程教授
00:18
and my favorite喜爱 hobby爱好 is photography摄影.
2
18381
2959
我的爱好是摄影
00:21
And as I travel旅行 around the world世界,
3
21364
1785
当我环游世界的时候
00:23
I love taking服用 photographs照片 like these,
4
23173
2152
我喜欢像这样照相
00:25
so I can remember记得 all
the beautiful美丽 and interesting有趣 things
5
25349
2919
这样我就可以记住我所有见到的
00:28
that I've seen看到.
6
28292
1278
美丽有趣的事物
00:29
But what I can't do is record记录 and share分享
7
29594
3676
但是我没办法做到的是记录和分享
00:33
how these objects对象 feel to touch触摸.
8
33294
3349
这些东西摸起来是什么感觉
00:36
And that's kind of surprising奇怪,
9
36667
1540
而这也是一种会令人惊讶的感觉
00:38
because your sense of touch触摸
is really important重要.
10
38231
2265
因为你的触觉真的非常重要
00:40
It's involved参与 in every一切 physical物理
interaction相互作用 you do every一切 day,
11
40520
2870
在你每天做的每一个身体的互动,
00:43
every一切 manipulation操作 task任务,
anything you do in the world世界.
12
43414
2550
每一个控制的动作,在这世界上你做的任何事情中
都有触觉的参与
00:45
So the sense of touch触摸
is actually其实 pretty漂亮 interesting有趣.
13
45988
2507
因此,触觉是很非常有趣的
00:48
It has two main主要 components组件.
14
48519
1642
它有两个主要组成要素
00:50
The first is tactile sensations感觉,
15
50185
2337
第一个是触感
00:52
things you feel in your skin皮肤.
16
52546
2090
是你皮肤感受到的感觉
00:54
And the second第二 is kinesthetic动觉 sensations感觉.
17
54660
2258
第二个是运动觉
00:56
This has to do with the position位置
of your body身体 and how it's moving移动,
18
56942
3190
而这与你的身体的位置,如何移动
01:00
and the forces军队 you encounter遭遇.
19
60156
1571
以及你所受的外力有关
01:01
And you're really good at incorporating结合
20
61751
1897
并且你很擅长
01:03
both of these types类型 of sensations感觉 together一起
21
63672
2206
结合这两者的感觉
01:05
to understand理解 the physical物理 interactions互动
you have with the world世界
22
65902
2980
去理解你和这个世界之间的互动
01:08
and understand理解 as you touch触摸 a surface表面:
23
68906
1825
和当你触摸到一个表面时
01:10
is it a rock, is it a cat,
is it a bunny兔子, what is it?
24
70755
3039
明白它是一个石块,还是一只猫,或是一个兔子,
它是什么呢?
01:13
And so, as an engineer工程师,
25
73818
2240
因此,作为一个工程师
01:16
I'm really fascinated入迷
26
76082
1392
我对此很着迷
01:17
and I have a lot of respect尊重
for how good people are with their hands.
27
77498
3309
并且我对人们拥有一双手是多么好
感到很敬佩
01:20
And I'm intrigued好奇 and curious好奇
28
80831
1902
同时我被勾起了好奇心
01:22
about whether是否 we could
make technology技术 better
29
82757
2411
关于我们是否可以让科技更好
01:25
by doing a better job工作 at leveraging借力
30
85192
1698
通过在用触觉影响人的能力方面
01:26
the human人的 capability能力
with the sense of touch触摸.
31
86914
2122
做得更好
01:29
Could I improve提高 the interfaces接口
to computers电脑 and machines
32
89060
2933
我能否优化电脑和机器的界面
01:32
by letting出租 you take
advantage优点 of your hands?
33
92017
2573
通过让你运用你的双手的优势
01:34
And indeed确实, I think we can,
34
94614
1565
确实,我认为我们可以
01:36
and that's at the core核心
of a field领域 called haptics触觉,
35
96203
2592
而那就是力触觉领域的核心
01:38
and this is the area that I work in.
36
98819
1730
同时这也是我工作的领域
01:40
It's all about interactive互动
touch触摸 technology技术.
37
100573
2345
它就是交互是触摸技术
01:42
And the way it works作品 is,
38
102942
1153
它的原理
01:44
as you move移动 your body身体 through通过 the world世界,
39
104119
2505
就像是你在这个世界中移动你的肢体
01:46
if, as an engineer工程师, I can make a system系统
that can measure测量 that motion运动,
40
106648
3284
如果,作为 一个工程师,
我可以制造一个可以测量那个动作,
01:49
and then present当下 to you
sensations感觉 over time
41
109956
2530
并在之后再将触觉传感给你的系统
01:52
that kind of make sense,
42
112510
1244
那感觉就可以被感知到了
01:53
that match比赛 up with what you might威力 feel
in the real真实 world世界,
43
113778
2674
它与你在真实世界可能会有的感觉一致
01:56
I can fool傻子 you into thinking思维
you're touching接触 something
44
116476
2544
我可以骗你让你以为你正在触摸某物
01:59
even though虽然 there's nothing there.
45
119044
1685
尽管那什么都没有
02:00
So here are three examples例子
46
120753
1616
好了,这有三个例子
02:02
and these are all doneDONE
from research研究 in my lab实验室 at Penn佩恩.
47
122393
3110
这些都是在我在宾大的实验室里的研究中完成
02:05
The first one is all about that same相同
problem问题 that I was showing展示 you:
48
125527
3257
第一个就是关于我刚向你们展示过的一个问题
02:08
how can we capture捕获 how objects对象 feel
49
128808
1967
我们如何能够捕获到对物体的感觉
02:10
and recreate重建 those experiences经验?
50
130799
1997
然后再现那些感觉
02:12
So the way we solve解决 this problem问题
51
132820
1999
所以我们解决这个问题的方法是
02:14
is by creating创建 a hand-held手持式 tool工具
52
134843
2065
通过制造一个便携的工具
02:16
that has many许多 different不同 sensors传感器 inside.
53
136932
1872
这里面有很多不同的传感器
02:18
It has a force sensor传感器, so we can tell
how hard you're pushing推动;
54
138828
3352
它有一个力传感器,所以我们可以了解到你的推力有多大
02:22
it has motion运动 tracking追踪, so we can tell
exactly究竟 where you've moved移动 it;
55
142204
3308
它有一个运动跟踪器,
所以我们可以准确了解到你将它移到了哪里
02:25
and it has a vibration振动 sensor传感器,
an accelerometer加速度计, inside,
56
145536
2690
它还有一个震动传感器,一个加速计在里面
02:28
that detects检测 the shaking发抖
back and forth向前 of the tool工具
57
148250
2442
它可以察觉到这个工具的前后震动
02:30
that lets让我们 you know
that's a piece of canvas帆布
58
150716
2032
这可以让你知道那个东西是一块帆布
02:32
and not a piece of silk or something else其他.
59
152772
2022
不是一块丝绸或其他什么东西
02:34
Then we take the data数据 we record记录
from these interactions互动.
60
154818
2639
然后我们获取这些交互传感器中记录的数据
02:37
Here's这里的 ten seconds of data数据.
61
157481
1294
这是十秒的记录
02:38
You can see how the vibrations振动
get larger and smaller,
62
158799
2885
你可以看到这些震动是如何随着你的运动
02:41
depending根据 on how you move移动.
63
161708
1476
变大或变小
02:43
And we make a mathematical数学的
model模型 of those relationships关系
64
163208
2743
接着我们对这些关系建立数学模型
02:45
and program程序 them into a tablet片剂 computer电脑
65
165975
2419
并将它们编程写入平板电脑中
02:48
so that when you take the stylus唱针
66
168418
1564
因此当你拿着这个尖笔
02:50
and go and touch触摸 the screen屏幕,
67
170006
1429
去触摸这个屏幕时
02:51
that voice-coil语音线圈 actuator执行器
in the white白色 bracket托架
68
171459
2830
那个在白色托架中的音圈制动器
02:54
plays播放 vibrations振动 to give you the illusion错觉
69
174313
2267
产生震动让你产生
02:56
that you're touching接触 the real真实 surface表面,
70
176604
2030
你正在触摸物体真正的表面的错觉
02:58
just like if you touched感动, dragged
back and forth向前, on the real真实 canvas帆布.
71
178658
3269
就好比像你在触碰,前后拉拽真正的帆布
03:01
We can create创建 very compelling引人注目 illusions幻想.
72
181951
1941
我们可以创造非常强烈的幻觉
03:03
We can do this for all kinds of surfaces
and it's really a lot of fun开玩笑.
73
183916
3570
我们可以使所有种类的表面实现这个
它真的非常有意思
03:07
We call it haptographyhaptography --
haptic触觉 photography摄影.
74
187510
3917
我们称之为触觉反馈技术--触觉的摄影术
03:11
And I think it has potential潜在
benefits好处 in all sorts排序 of areas
75
191451
2780
并且我认为它在各种领域都有潜在的价值
03:14
like online线上 shopping购物,
maybe interactive互动 museum博物馆 exhibits展品,
76
194255
2706
比如线上购物,又或许是互动博物馆
03:16
where you're not supposed应该
to touch触摸 the precious珍贵 artifacts文物,
77
196985
2754
在那里你不被允许触摸珍贵的艺术品
03:19
but you always want to.
78
199763
1376
但你总是想去碰
03:21
The second第二 example I want to tell you
about comes from a collaboration合作 I have
79
201163
3678
我想为你讲述的第二个例子
03:24
with Dr博士. Margrit玛格丽特 MaggioMaggio
at the Penn佩恩 Dental牙齿 School学校.
80
204865
2342
是来自我和宾大牙科学院
Margrit Maggio医生的一个合作成果
03:27
Part部分 of her job工作 is to teach
dental牙齿 students学生们
81
207231
2015
她工作的一部分是教牙科的学生
03:29
how to tell where in a patient's耐心 mouth
there are cavities.
82
209270
2782
如何知道在病人的口中哪有龋洞
03:32
Of course课程 they look at X-raysX射线,
83
212076
1521
当然他们会看X光
03:33
but a large part部分 of this clinical临床 judgment判断
comes from what they feel
84
213621
3250
但是这样的临床诊断的一大部分是来自他们的感觉
03:36
when they touch触摸 your teeth
with a dental牙齿 explorer探险者.
85
216895
2366
当他们用牙探针触碰你的牙齿时
03:39
You've all had this happen发生,
they go across横过.
86
219285
2008
你们都经历过这个,这很普遍
03:41
What they're feeling感觉 for is if the tooth齿
is really hard, then it's healthy健康,
87
221317
3543
如果这个牙齿是非常坚硬的他们感觉到的是什么,
那说明它很健康
03:44
but if it's kind of soft柔软的 and sticky,
88
224884
1746
但如果它是软的并且黏糊糊的
03:46
that's a signal信号 that the enamel搪瓷
is starting开始 to decay衰变.
89
226654
2504
那是牙釉质蛀蚀的标识
03:49
These types类型 of judgments判断 are hard
for a new dental牙齿 student学生 to make,
90
229182
3221
做出这些种类的判断对一个新牙科学生来说是困难的
03:52
because they haven't没有 touched感动
a lot of teeth yet然而.
91
232427
2258
因为他们还没有触碰过很多的牙齿
03:54
And you want them to learn学习 this
before they start开始 practicing
92
234709
2838
而你想要他们在为真正的病人实践之前
03:57
on real真实 human人的 patients耐心.
93
237571
1160
掌握这些
03:58
So what we do is add an accelerometer加速度计
on to the dental牙齿 explorer探险者,
94
238755
4286
所以我们做的是在牙探针中加入一个加速计
04:03
and then we record记录 what Dr博士. MaggioMaggio feels感觉
95
243065
1933
然后我们将Maggio医生触碰不同的拔出的牙齿时
04:05
as she touches触摸 different不同 extracted提取 teeth.
96
245022
2170
所感知的内容记录下来
04:07
And we can play it back for you as a video视频
97
247216
2763
然后我们将它用视频的形式给你播放
04:10
with a touch触摸 track跟踪 --
98
250003
1653
通过一个触碰跟踪--
04:11
not just a sound声音 track跟踪,
but also a touch触摸 track跟踪,
99
251680
2219
不仅是一个声音跟踪,也是一个触碰跟踪
04:13
that you can feel by holding保持
that repeating重复 tool工具.
100
253923
2326
你就可以通过拿着那个重复工具来感知
04:16
You feel the same相同 things the dentist牙医
felt when they did the recording记录,
101
256273
3293
你可以感觉到牙医做记录时和他一样的感觉
04:19
and practice实践 making制造 judgments判断.
102
259590
1441
并练习做出判断
04:21
So here's这里的 a sample样品 one.
103
261055
1162
这有一个样本
04:22
Here's这里的 a tooth齿 that looks容貌
kind of suspicious可疑, right?
104
262241
2489
这有一个牙齿它看起来有些可疑,对吗?
04:24
It has all those brown棕色 stains.
105
264754
2524
它有很多的棕色污渍
04:27
You might威力 be thinking思维, "We should
definitely无疑 put a filling填充 in this tooth齿."
106
267302
3483
你可能会认为,
“很明显我们应该放一些填充物在这个牙齿里”
04:30
But if you pay工资 attention注意 to how it feels感觉,
107
270809
1960
但是如果你注意到了它的触感是什么样的
04:32
all the surfaces of this tooth齿
are hard and healthy健康,
108
272793
2634
这个牙齿的所有表面都是坚硬并且健康的
04:35
so this patient患者 does not need a filling填充.
109
275451
2259
所以这个病人不需要填补牙齿
04:37
And these are exactly究竟 the kind
of judgments判断 doctors医生 make every一切 day
110
277734
3123
这些的确是医生每天都要做的判断
04:40
and I think this technology技术
we've我们已经 invented发明 has a lot of potential潜在
111
280881
3072
我认为我们已经发明的这个技术
04:43
for many许多 different不同 things in medical
training训练, because it's really simple简单
112
283977
3451
在医疗训练中的不同处有很多的潜能,
因为它真的很简单
04:47
and it does a great job工作 at recreating再创造
what people feel through通过 tools工具.
113
287452
3546
并且它在再现人们通过工具得到的感觉方面做得非常好
04:51
I think it could also help make games游戏
more interactive互动 and fun开玩笑
114
291022
3020
我想它还可以让游戏更加具有互动性和有趣
04:54
and more realistic实际
in the sensations感觉 that you feel.
115
294066
2577
并且在你的感觉上更加真实
04:56
The last example I want to tell you about
is again about human人的 movement运动.
116
296667
3629
我想讲的最后一个例子还是关于人的动作
05:00
So if any of you have ever learned学到了 sports体育,
117
300320
2000
如果你们都曾学习过体育运动
05:02
how do you get good
at something like surfing冲浪?
118
302344
2263
你是如何熟练掌握像冲浪这样的运动的呢?
05:04
You practice实践.
119
304631
1151
你练习
05:05
You practice实践 some more and more, right?
120
305806
1862
你一次又一次地去练习,对吗?
05:07
Making制造 small corrections更正,
maybe getting得到 some input输入 from a coach教练,
121
307692
3069
做一些小的改正,可能是从教练那得到一些建议
05:10
learning学习 how to improve提高 your motions运动.
122
310785
1776
学习如何改进你的动作
05:12
I think we could use computers电脑
123
312585
1462
我认为我们可以使用电脑
05:14
to help make that process处理
more efficient高效 and more fun开玩笑.
124
314071
2596
来让那个过程更加高效并且更加有趣
05:16
And so here, for example,
if I have six different不同 arm movements运动
125
316691
2960
举个例子,这就是如果我有六个不同的手臂摆动
05:19
that I want you to learn学习,
126
319675
1196
需要你去学习
05:20
you come into my lab实验室 at Penn佩恩
and try out our system系统.
127
320895
3376
你来到我在宾大的实验室然后试用我们的系统
05:24
We use a KinectKinect的 to measure测量 your motions运动,
we show显示 graphics图像 on the screen屏幕,
128
324295
3459
我们用一个Kinect(XBOX360体感周边外设)来测量
你的动作,我们在屏幕上展示图片
05:27
and then we also give you touch触摸 cues线索,
129
327778
2093
然后我们还会给你一些触碰提示
05:29
haptic触觉 feedback反馈 on your arm,
130
329895
1588
触觉反馈在你的手臂上
05:31
delivered交付 by these haptic触觉 arm bands
which哪一个 have motors马达 inside,
131
331507
3360
通过这些里面有电动机的触觉臂带来传递,
05:34
and guide指南 you as you move移动.
132
334891
1571
并且在你运动的时候引导你
05:36
So, if we put it together一起,
133
336486
1266
所以,如果我们把它放到一起
05:37
as you're trying to track跟踪 this motion运动,
134
337776
2325
当你正在尝试跟踪这个动作时,
05:40
if you deviate偏离 -- say, maybe,
your arm is a little too high --
135
340125
3164
如果你偏离了--假设,可能是,你的手高了一点点--
05:43
we turn on the motors马达
right there on the skin皮肤
136
343313
2109
我们把在这皮肤上的电动机打开
05:45
to let you know you should move移动 down,
137
345446
1771
来让你知道你应该向下移一点
05:47
almost几乎 like a coach教练 gently平缓 guiding主导 you
138
347241
1862
就很像一个教练温柔地指导你
05:49
and helping帮助 you master
these movements运动 more quickly很快
139
349127
2891
帮助你更快地掌握这些动作
05:52
and make more precise精确 corrections更正.
140
352042
1849
和做些更加精确的改正
05:53
We developed发达 this system系统
for use in stroke行程 rehabilitation复原,
141
353915
2762
我们为在中风康复中的使用开发了这个系统
05:56
but I think there are a lot
of applications应用,
142
356701
2304
但我认为它还有很多的应用
05:59
like maybe dance舞蹈 training训练
or all sorts排序 of sports体育 training训练 as well.
143
359029
4210
比如可能是舞蹈训练或是各种各样的体育训练
06:03
So now you know a little bit
about the field领域 of haptics触觉,
144
363263
2716
那么现在关于触觉这个领域你们了解了一点
06:06
which哪一个 I think you'll你会 hear more
about in the coming未来 years年份.
145
366003
2702
关于这些,我想你们在将来的几年中会听到更多
06:08
I've shown显示 you three examples例子.
146
368729
1430
我已经向你们展示了三个例子了
06:10
I just want to take a moment时刻
147
370183
1351
我只是想花些时间
06:11
to acknowledge确认 the great students学生们
who work with me in my lab实验室 at Penn佩恩
148
371558
3208
来感谢那些在宾大实验室里和我一起工作的很棒的学生们
06:14
and my collaborators合作者.
149
374790
1151
以及我的合作者
06:15
They're a great group.
150
375965
1157
他们是一个非常棒的团队
06:17
I also want to thank you
for your kind attention注意.
151
377146
2898
我还想感谢你们的关注
06:20
(Applause掌声)
152
380068
3002
(掌声)
Translated by Silas Lee
Reviewed by Jiawei Ni

▲Back to top

ABOUT THE SPEAKER
Katherine Kuchenbecker - Mechanical engineer
Katherine Kuchenbecker works on incorporating the sense of touch directly into virtual objects. Imagine being able to feel textures on your digital screens.

Why you should listen

Could technology be more touchy feely? Mechanical engineer Katherine Kuchenbecker answers this question with a resounding ‘yes.’ Kuchenbecker researches the design, control and performance of robotic systems that enable a user to touch virtual objects and distant environments as though they were real and within reach. These interfaces combine electromechanical sensors, actuators and computer control, allowing for technology that can fool the human sense of touch, otherwise known as ‘haptics.’

Imagine a tablet computer that lets you feel fabrics and textures, robotic surgical tools that let doctors use their incredibly well-honed sense of touch, video games that allow you to feel hits and computer programs that teach you the movements of a sport. By researching these areas -- as well as applications in stroke rehabilitation and assistance for the blind -- Kuchenbecker seeks to improve our understanding of touch and uncover new opportunities to use it in interactions between humans, computers and machines.

An assistant professor at the University of Pennsylvania, Kuchenbecker has been named to the Popular Science Brilliant 10. She is also an avid photographer, and played volleyball at Stanford for two seasons.

More profile about the speaker
Katherine Kuchenbecker | Speaker | TED.com

Data provided by TED.

This site was created in May 2015 and the last update was on January 12, 2020. It will no longer be updated.

We are currently creating a new site called "eng.lish.video" and would be grateful if you could access it.

If you have any questions or suggestions, please feel free to write comments in your language on the contact form.

Privacy Policy

Developer's Blog

Buy Me A Coffee