TED2018
Yasmin Green: How technology can fight extremism and online harassment
雅斯敏 · 格林: 科技如何对抗极端主义和线上骚扰
Filmed:
Readability: 4.6
2,460,759 views
科技能让人更安全，远离暴力极端主义，审查制度和迫害的威胁吗？在这场发人深省的演说中，科技专家雅斯敏 · 格林详细描述了“Jigsaw”组织 (Alphabet Inc.旗下的一个单位，由包括谷歌在内的许多公司组成) 所开创的项目，用以对抗极端主义和线上骚扰。它给予评论者语言上的即时反馈，来增加对话的空间。“如果我们认为能够建立一个与人性阴暗面绝缘的网络，那就错了，”格林说，“我们必须全身心投入，找到解决方案来克服人类自身的种种问题。”
Yasmin Green - Geopolitical technologist
Yasmin Green is the director of research and development for Jigsaw, a unit within Alphabet Inc. focused on solving global security challenges through technology. Full bio
Yasmin Green is the director of research and development for Jigsaw, a unit within Alphabet Inc. focused on solving global security challenges through technology. Full bio
Double-click the English transcript below to play the video.
00:13
My relationship with the internet
reminds me of the setup
reminds me of the setup
0
1131
4411
我与互联网的关系，使我想起
恐怖片的老套情节。
00:17
to a clichéd horror movie.
1
5566
1833
幸福快乐的家庭乔迁新居，
00:19
You know, the blissfully happy family
moves in to their perfect new home,
moves in to their perfect new home,
2
7867
4386
憧憬着他们美好的未来，
00:24
excited about their perfect future,
3
12277
2281
00:26
and it's sunny outside
and the birds are chirping ...
and the birds are chirping ...
4
14582
3521
窗外阳光明媚，鸟儿嘤嘤成韵...
突然，电影的气氛变得阴暗起来。
00:30
And then it gets dark.
5
18857
1839
阁楼传来阵阵嘈杂的声响。
00:32
And there are noises from the attic.
6
20720
2348
我们这才意识到，那间美好的
新房子，其实问题重重。
新房子，其实问题重重。
00:35
And we realize that that perfect
new house isn't so perfect.
new house isn't so perfect.
7
23092
4345
2006年，当我开始在谷歌工作的时候，
00:40
When I started working at Google in 2006,
8
28485
3131
00:43
Facebook was just a two-year-old,
9
31640
1767
脸书刚刚推出两年，
推特还未问世。
00:45
and Twitter hadn't yet been born.
10
33431
2012
00:47
And I was in absolute awe
of the internet and all of its promise
of the internet and all of its promise
11
35848
4410
我对互联网和它给予的承诺充满赞叹。
它承诺让我们
关系更亲密，变得更聪明，
00:52
to make us closer
12
40282
1437
00:53
and smarter
13
41743
1296
并给予我们更多自由。
00:55
and more free.
14
43063
1214
00:57
But as we were doing the inspiring work
of building search engines
of building search engines
15
45265
3714
但是当我们开始进行这项
鼓舞人心的工作，开发搜索引擎，
鼓舞人心的工作，开发搜索引擎，
视频分享和社交网络，
01:01
and video-sharing sites
and social networks,
and social networks,
16
49003
2886
01:04
criminals, dictators and terrorists
were figuring out
were figuring out
17
52907
4304
罪犯，独裁者和恐怖分子，
也找到了相同的平台，来攻击我们。
01:09
how to use those same
platforms against us.
platforms against us.
18
57235
3202
01:13
And we didn't have
the foresight to stop them.
the foresight to stop them.
19
61417
2455
我们并未预见到这一点，
因而对此毫无抵抗力。
因而对此毫无抵抗力。
01:16
Over the last few years, geopolitical
forces have come online to wreak havoc.
forces have come online to wreak havoc.
20
64746
5099
过去几年里，地缘政治势力
开始在网络上肆虐。
开始在网络上肆虐。
作为反击，
01:21
And in response,
21
69869
1169
在谷歌的支持下，我和几位同事
成了一个名叫“Jigsaw”的新组织，
成了一个名叫“Jigsaw”的新组织，
01:23
Google supported a few colleagues and me
to set up a new group called Jigsaw,
to set up a new group called Jigsaw,
22
71062
4778
我们肩负重任，去维护人们的安全，
让大众免受暴力极端主义，
让大众免受暴力极端主义，
01:27
with a mandate to make people safer
from threats like violent extremism,
from threats like violent extremism,
23
75864
4596
01:32
censorship, persecution --
24
80484
2078
审查制度和迫害的威胁——
我对这些威胁深有体会，
因为我在伊朗出生，
因为我在伊朗出生，
01:35
threats that feel very personal to me
because I was born in Iran,
because I was born in Iran,
25
83186
4117
在暴力革命的余波中，我离开了伊朗。
01:39
and I left in the aftermath
of a violent revolution.
of a violent revolution.
26
87327
2929
01:43
But I've come to realize
that even if we had all of the resources
that even if we had all of the resources
27
91525
4346
但我逐渐意识到，
即便我们拥有世界上
所有科技公司的资源，
所有科技公司的资源，
01:47
of all of the technology
companies in the world,
companies in the world,
28
95895
2858
01:51
we'd still fail
29
99595
1230
我们仍然会失败，
01:53
if we overlooked one critical ingredient:
30
101586
2948
如果我们忽视那个决定性的因素：
01:57
the human experiences of the victims
and perpetrators of those threats.
and perpetrators of those threats.
31
105653
5789
带来这些威胁的犯罪分子
和受害群众背后的经历。
和受害群众背后的经历。
02:04
There are many challenges
I could talk to you about today.
I could talk to you about today.
32
112935
2736
我今天可以和各位谈很多
我们所面临的挑战。
我们所面临的挑战。
不过我打算只着重于两点。
02:07
I'm going to focus on just two.
33
115695
1504
02:09
The first is terrorism.
34
117623
2079
其一是恐怖主义。
02:13
So in order to understand
the radicalization process,
the radicalization process,
35
121563
2557
为了了解那种激进的过程，
我们同数十名暴力极端主义的
前成员进行了接触。
前成员进行了接触。
02:16
we met with dozens of former members
of violent extremist groups.
of violent extremist groups.
36
124144
4287
02:21
One was a British schoolgirl,
37
129590
2483
其中有一位英国的女学生，
02:25
who had been taken off of a plane
at London Heathrow
at London Heathrow
38
133049
3699
在伦敦希思罗机场，被迫下飞机，
因为她打算到叙利亚加入ISIS组织。
02:28
as she was trying to make her way
to Syria to join ISIS.
to Syria to join ISIS.
39
136772
4692
02:34
And she was 13 years old.
40
142281
1931
当时她只有13岁。
02:37
So I sat down with her and her father,
and I said, "Why?"
and I said, "Why?"
41
145792
4625
我同她和她父亲坐下来谈话，
我问到：“你为什么要这么做？”
我问到：“你为什么要这么做？”
她说：
02:42
And she said,
42
150441
1717
“我看到了叙利亚的生活写照，
02:44
"I was looking at pictures
of what life is like in Syria,
of what life is like in Syria,
43
152182
3639
我以为我会住进伊斯兰的迪斯尼乐园。”
02:47
and I thought I was going to go
and live in the Islamic Disney World."
and live in the Islamic Disney World."
44
155845
3510
02:52
That's what she saw in ISIS.
45
160527
2084
这是她所看到ISIS组织。
02:54
She thought she'd meet and marry
a jihadi Brad Pitt
a jihadi Brad Pitt
46
162635
3492
她觉得，她会邂逅并嫁给
圣战分子中的布拉德 · 皮特，
圣战分子中的布拉德 · 皮特，
02:58
and go shopping in the mall all day
and live happily ever after.
and live happily ever after.
47
166151
3058
整天在商场购物，
从此过上幸福快乐的生活。
从此过上幸福快乐的生活。
03:02
ISIS understands what drives people,
48
170977
2824
ISIS组织对于驾驭人心了如指掌，
他们为每一位聆听者
精心策划了要传递的信息。
精心策划了要传递的信息。
03:05
and they carefully craft a message
for each audience.
for each audience.
49
173825
3544
03:11
Just look at how many languages
50
179122
1511
光看他们的营销材料
03:12
they translate their
marketing material into.
marketing material into.
51
180657
2273
被译成了多少种语言，便能一目了然。
03:15
They make pamphlets,
radio shows and videos
radio shows and videos
52
183677
2661
他们还制作小册子，广播节目和影片，
不但有英语和阿拉伯语，
03:18
in not just English and Arabic,
53
186362
1973
还有德语，俄语，法语，
土耳其语，库尔德语，
土耳其语，库尔德语，
03:20
but German, Russian,
French, Turkish, Kurdish,
French, Turkish, Kurdish,
54
188359
4767
03:25
Hebrew,
55
193150
1672
希伯来语
03:26
Mandarin Chinese.
56
194846
1741
和汉语。
03:29
I've even seen an ISIS-produced
video in sign language.
video in sign language.
57
197309
4192
我甚至看到了ISIS组织
制作的手语视频。
制作的手语视频。
03:34
Just think about that for a second:
58
202605
1884
想想吧，ISIS组织耗费了
这么多时间和精力，
这么多时间和精力，
03:36
ISIS took the time and made the effort
59
204513
2308
做出种种行为
以确保他们的信息
能够传达给残障人士。
能够传达给残障人士。
03:38
to ensure their message is reaching
the deaf and hard of hearing.
the deaf and hard of hearing.
60
206845
3804
03:45
It's actually not tech-savviness
61
213143
2144
其实ISIS组织赢得人心与信赖，
03:47
that is the reason why
ISIS wins hearts and minds.
ISIS wins hearts and minds.
62
215311
2595
并非因为他们精通科技。
03:49
It's their insight into the prejudices,
the vulnerabilities, the desires
the vulnerabilities, the desires
63
217930
4163
事实上，他们洞悉力很强，
深知他们试图接触的人
深知他们试图接触的人
所拥有的偏见，脆弱和欲望，
03:54
of the people they're trying to reach
64
222117
1774
因此才能实现其目的。
03:55
that does that.
65
223915
1161
03:57
That's why it's not enough
66
225718
1429
这就为什么
对网络平台来说，把焦点放在
移除他们的招募材料上是远远不够的。
移除他们的招募材料上是远远不够的。
03:59
for the online platforms
to focus on removing recruiting material.
to focus on removing recruiting material.
67
227171
4239
04:04
If we want to have a shot
at building meaningful technology
at building meaningful technology
68
232518
3581
如果我们想要尝试建立有意义的技术，
04:08
that's going to counter radicalization,
69
236123
1874
用以打击激进主义，
04:10
we have to start with the human
journey at its core.
journey at its core.
70
238021
2979
我们就必须从人心着手。
04:13
So we went to Iraq
71
241884
2187
因此，我们去了伊拉克，
04:16
to speak to young men
who'd bought into ISIS's promise
who'd bought into ISIS's promise
72
244095
2831
和年轻人交谈，他们深信ISIS组织
关于英勇与正义的承诺，
04:18
of heroism and righteousness,
73
246950
3191
04:22
who'd taken up arms to fight for them
74
250165
1847
曾为ISIS组织斗争，
接着，他们在目睹ISIS组织
04:24
and then who'd defected
75
252036
1338
04:25
after they witnessed
the brutality of ISIS's rule.
the brutality of ISIS's rule.
76
253398
3021
统治的残忍无情后，选择变节。
04:28
And I'm sitting there in this makeshift
prison in the north of Iraq
prison in the north of Iraq
77
256880
3192
在伊拉克北部的临时监狱中，
我面见了一位年仅23岁，
在变节前受过自杀式炸弹训练的
在变节前受过自杀式炸弹训练的
04:32
with this 23-year-old who had actually
trained as a suicide bomber
trained as a suicide bomber
78
260096
4550
04:36
before defecting.
79
264670
1552
年轻人。
04:39
And he says,
80
267080
1158
他说，
04:41
"I arrived in Syria full of hope,
81
269119
3220
“我满怀希望来到叙利亚，
04:44
and immediately, I had two
of my prized possessions confiscated:
of my prized possessions confiscated:
82
272363
4365
但马上，我被没收了
两项最重要的东西：
两项最重要的东西：
我的护照和手机。”
04:48
my passport and my mobile phone."
83
276752
2933
04:52
The symbols of his physical
and digital liberty
and digital liberty
84
280140
2406
从他到达叙利亚的那刻，象征他人身自由
04:54
were taken away from him on arrival.
85
282570
1760
和电子自由的东西，就被剥夺了。
04:57
And then this is the way he described
that moment of loss to me.
that moment of loss to me.
86
285248
3510
接着，他向我描述了那个迷失的时刻。
05:01
He said,
87
289356
1586
他说，
“在《猫和老鼠》中，
05:02
"You know in 'Tom and Jerry,'
88
290966
2329
05:06
when Jerry wants to escape,
and then Tom locks the door
and then Tom locks the door
89
294192
3103
当杰瑞想要逃脱时，汤姆总是锁上门，
并吞下钥匙，
05:09
and swallows the key
90
297319
1156
05:10
and you see it bulging out
of his throat as it travels down?"
of his throat as it travels down?"
91
298499
3551
还可以从外观看出钥匙
沿着汤姆的喉咙下滑，记得吗？
沿着汤姆的喉咙下滑，记得吗？
05:14
And of course, I really could see
the image that he was describing,
the image that he was describing,
92
302446
3153
当然，我完全想象得到
他所描绘的那种画面，
他所描绘的那种画面，
也完全能体会到他想要传达的感受，
05:17
and I really did connect with the feeling
that he was trying to convey,
that he was trying to convey,
93
305623
3661
05:21
which was one of doom,
94
309308
2021
一种在劫难逃的感觉，
05:23
when you know there's no way out.
95
311353
1789
当你知道无路可走了。
05:26
And I was wondering:
96
314551
1289
我很纳闷：
05:28
What, if anything,
could have changed his mind
could have changed his mind
97
316644
2682
在他离开家的那天，是否有任何东西
05:31
the day that he left home?
98
319350
1240
有可能改变他的想法？
所以我问：
05:32
So I asked,
99
320614
1250
05:33
"If you knew everything that you know now
100
321888
3178
“如果你当时知晓现在面临的苦难，
05:37
about the suffering
and the corruption, the brutality --
and the corruption, the brutality --
101
325090
3051
腐败和残酷的状况——
在你离开家的那天就知道，
05:40
that day you left home,
102
328165
1415
05:41
would you still have gone?"
103
329604
1679
你还会选择离开吗？“
05:43
And he said, "Yes."
104
331786
1711
他说：“会的。“
05:45
And I thought, "Holy crap, he said 'Yes.'"
105
333846
2282
我心想：“我的天啊，他尽然说‘会’。”
05:48
And then he said,
106
336694
1219
接着他说：
“我那时被完全洗脑了，
05:49
"At that point, I was so brainwashed,
107
337937
3001
05:52
I wasn't taking in
any contradictory information.
any contradictory information.
108
340962
3244
没有接受任何与之矛盾的信息。
05:56
I couldn't have been swayed."
109
344744
1555
没人能动摇我的决心。“
05:59
"Well, what if you knew
everything that you know now
everything that you know now
110
347235
2527
“好吧，如果在你离开的六个月前，
就已知道现在发生的事情呢？”
06:01
six months before the day that you left?"
111
349786
2098
06:05
"At that point, I think it probably
would have changed my mind."
would have changed my mind."
112
353345
3131
“我想那时我可能会改变心意。”
06:10
Radicalization isn't
this yes-or-no choice.
this yes-or-no choice.
113
358138
3397
极端激进并不是一道选择题。
06:14
It's a process, during which
people have questions --
people have questions --
114
362007
2977
它是人充满疑惑时的一个过程，
06:17
about ideology, religion,
the living conditions.
the living conditions.
115
365008
3776
关于思想意识，宗教信仰，和生活条件。
人们会在网上寻求答案，
06:20
And they're coming online for answers,
116
368808
2766
这就为我们提供了接触他们的机会。
06:23
which is an opportunity to reach them.
117
371598
1917
06:25
And there are videos online
from people who have answers --
from people who have answers --
118
373905
3014
有答案的人在网上提供影片——
06:28
defectors, for example,
telling the story of their journey
telling the story of their journey
119
376943
2876
比如，叛逃者讲述他们
投入和摆脱暴力的
投入和摆脱暴力的
心路历程；
06:31
into and out of violence;
120
379843
1583
06:33
stories like the one from that man
I met in the Iraqi prison.
I met in the Iraqi prison.
121
381450
3487
就像伊拉克监狱那名男子的故事。
06:37
There are locals who've uploaded
cell phone footage
cell phone footage
122
385914
2590
有当地人会上传手机影片，
06:40
of what life is really like
in the caliphate under ISIS's rule.
in the caliphate under ISIS's rule.
123
388528
3503
呈现在ISIS组织统治下，
穆斯林的生活状态。
穆斯林的生活状态。
06:44
There are clerics who are sharing
peaceful interpretations of Islam.
peaceful interpretations of Islam.
124
392055
3735
有教会圣职人士分享关于
伊斯兰教的和平诠释。
伊斯兰教的和平诠释。
但你们知道吗？
06:48
But you know what?
125
396830
1150
这些人通常并不具备ISIS组织
那样高超的营销本领。
那样高超的营销本领。
06:50
These people don't generally have
the marketing prowess of ISIS.
the marketing prowess of ISIS.
126
398004
3020
06:54
They risk their lives to speak up
and confront terrorist propaganda,
and confront terrorist propaganda,
127
402049
4532
他们冒着生命危险，
与恐怖主义宣传对质，
与恐怖主义宣传对质，
不幸的是，他们无法接触到
06:58
and then they tragically
don't reach the people
don't reach the people
128
406605
2211
最需要听到他们声音的人。
07:00
who most need to hear from them.
129
408840
1682
07:03
And we wanted to see
if technology could change that.
if technology could change that.
130
411173
2612
我们想试试看，
科技是否能够改变这一点。
科技是否能够改变这一点。
07:06
So in 2016, we partnered with Moonshot CVE
131
414205
4183
所以在2016年，我们与
Moonshot CVE合作，
Moonshot CVE合作，
07:10
to pilot a new approach
to countering radicalization
to countering radicalization
132
418412
3180
试着采用新方案打击激进主义，
07:13
called the "Redirect Method."
133
421616
1780
该方法名叫“重新定向法。”
07:16
It uses the power of online advertising
134
424453
3012
它利用线上广告的力量，
在摇摆不的人们和
ISIS组织的信息之间搭建桥梁，
ISIS组织的信息之间搭建桥梁，
07:19
to bridge the gap between
those susceptible to ISIS's messaging
those susceptible to ISIS's messaging
135
427489
4514
那些可靠的声音揭露了
大量信息的真面目。
大量信息的真面目。
07:24
and those credible voices
that are debunking that messaging.
that are debunking that messaging.
136
432027
3760
07:28
And it works like this:
137
436633
1150
它是这样运作的：
当有人在寻找极端主义的材料——
07:29
someone looking for extremist material --
138
437807
1961
07:31
say they search
for "How do I join ISIS?" --
for "How do I join ISIS?" --
139
439792
2990
比如，搜索 “我如何
能加入ISIS组织？”——
能加入ISIS组织？”——
07:34
will see an ad appear
140
442806
2476
就会看见一则广告出现，
07:37
that invites them to watch a YouTube video
of a cleric, of a defector --
of a cleric, of a defector --
141
445306
4882
邀请他们观看圣职人士和变节人员
在Youtube网站上的视频——
在Youtube网站上的视频——
那些拥有真实答案的人的心声。
07:42
someone who has an authentic answer.
142
450212
2310
07:44
And that targeting is based
not on a profile of who they are,
not on a profile of who they are,
143
452546
3623
这个方法锁定目标的方式，
不是依据他们的个人资料，
不是依据他们的个人资料，
07:48
but of determining something
that's directly relevant
that's directly relevant
144
456193
3053
而是由与询问和质疑
直接相关的经历来决定。
07:51
to their query or question.
145
459270
1708
07:54
During our eight-week pilot
in English and Arabic,
in English and Arabic,
146
462122
2842
在用英语和阿拉伯语
进行的八周试验中，
进行的八周试验中，
07:56
we reached over 300,000 people
147
464988
3279
我们接触了超过30万
对圣战组织表现出兴趣或者同情的人。
08:00
who had expressed an interest in
or sympathy towards a jihadi group.
or sympathy towards a jihadi group.
148
468291
5545
08:06
These people were now watching videos
149
474626
2264
这些人现在观看的影片，
08:08
that could prevent them
from making devastating choices.
from making devastating choices.
150
476914
3340
能预防他们做出毁灭性的选择。
08:13
And because violent extremism
isn't confined to any one language,
isn't confined to any one language,
151
481405
3727
因为暴力极端主义
并不局限于任何一种语言，
并不局限于任何一种语言，
08:17
religion or ideology,
152
485156
1804
宗教和思想，
“重新定向法”现已在全球实施，
08:18
the Redirect Method is now
being deployed globally
being deployed globally
153
486984
3501
保护大家上网时不被
暴力的意识形态诱惑，
暴力的意识形态诱惑，
08:22
to protect people being courted online
by violent ideologues,
by violent ideologues,
154
490509
3804
不论是伊斯兰教，白人至上主义
08:26
whether they're Islamists,
white supremacists
white supremacists
155
494337
2596
或者其他暴力极端主义，
08:28
or other violent extremists,
156
496957
2103
我们的目标是给他们机会，去聆听那些
08:31
with the goal of giving them the chance
to hear from someone
to hear from someone
157
499084
2873
旅程另一端的人怎么说；
08:33
on the other side of that journey;
158
501981
2091
08:36
to give them the chance to choose
a different path.
a different path.
159
504096
2839
帮助他们去选择不一样的人生道路。
08:40
It turns out that often the bad guys
are good at exploiting the internet,
are good at exploiting the internet,
160
508749
5980
结果表明，恶人通常擅长利用网络，
08:46
not because they're some kind
of technological geniuses,
of technological geniuses,
161
514753
3744
并不是因为他们是科技天才，
而是因为他们理解什么能引人注意。
08:50
but because they understand
what makes people tick.
what makes people tick.
162
518521
2985
08:54
I want to give you a second example:
163
522855
2369
我再举个例子：
08:58
online harassment.
164
526019
1391
网络骚扰。
09:00
Online harassers also work
to figure out what will resonate
to figure out what will resonate
165
528629
3363
线网络骚扰者也致力于发掘能够
与他人引起共鸣的事物。
09:04
with another human being.
166
532016
1615
但他们的目的不是
像ISIS组织一样招募人，
像ISIS组织一样招募人，
09:05
But not to recruit them like ISIS does,
167
533655
3110
而是给他人带来痛苦。
09:08
but to cause them pain.
168
536789
1275
09:11
Imagine this:
169
539259
1342
想象一下这个状况：
09:13
you're a woman,
170
541347
1659
你是个女人，
09:15
you're married,
171
543030
1413
已婚，
有一个孩子。
09:16
you have a kid.
172
544467
1154
09:18
You post something on social media,
173
546834
1784
你在社交媒体上发表了一篇文章，
在评论中，有人说你会被强暴，
09:20
and in a reply,
you're told that you'll be raped,
you're told that you'll be raped,
174
548642
2886
09:24
that your son will be watching,
175
552577
1560
你的儿子
会在何时何地被监视。
09:26
details of when and where.
176
554825
1856
09:29
In fact, your home address
is put online for everyone to see.
is put online for everyone to see.
177
557148
3143
事实上，所有人都能在网上
搜索到你的家庭地址。
搜索到你的家庭地址。
09:33
That feels like a pretty real threat.
178
561580
2007
那种威胁的感觉十分真实。
09:37
Do you think you'd go home?
179
565113
1656
你觉得你还会回家吗？
09:39
Do you think you'd continue doing
the thing that you were doing?
the thing that you were doing?
180
567999
3048
你觉得你会对此无动于衷吗？
09:43
Would you continue doing that thing
that's irritating your attacker?
that's irritating your attacker?
181
571071
3220
你会继续做惹恼了
攻击你的人的那件事吗？
攻击你的人的那件事吗？
09:48
Online abuse has been this perverse art
182
576016
3096
网络欺凌已经变成了
一种变态的艺术，
一种变态的艺术，
09:51
of figuring out what makes people angry,
183
579136
3468
发掘让人愤怒，
09:54
what makes people afraid,
184
582628
2132
让人害怕，
让人们失去安全感的事物，
09:56
what makes people insecure,
185
584784
1641
09:58
and then pushing those pressure points
until they're silenced.
until they're silenced.
186
586449
3067
然后给他们施压，
直至他们永远保持沉默。
直至他们永远保持沉默。
10:02
When online harassment goes unchecked,
187
590333
2304
当线上骚扰者肆意妄为时，
言论自由就会被扼杀。
10:04
free speech is stifled.
188
592661
1667
10:07
And even the people
hosting the conversation
hosting the conversation
189
595196
2127
即使是主持对话的人，
也举手投降并宣布到此为止，
10:09
throw up their arms and call it quits,
190
597347
1834
把他们的留言区以及论坛全部关闭。
10:11
closing their comment sections
and their forums altogether.
and their forums altogether.
191
599205
2957
这意味着我们其实失去了在网上
10:14
That means we're actually
losing spaces online
losing spaces online
192
602186
2849
让思想碰撞与交流的空间。
10:17
to meet and exchange ideas.
193
605059
1987
10:19
And where online spaces remain,
194
607939
2163
在网络剩下的空间里，
10:22
we descend into echo chambers
with people who think just like us.
with people who think just like us.
195
610126
4470
我们被困在了“回音室”，只和
想法一致的人聚在一起。
想法一致的人聚在一起。
10:27
But that enables
the spread of disinformation;
the spread of disinformation;
196
615688
2499
但那会导致虚假信息的传播；
这会更加促成两极分化。
10:30
that facilitates polarization.
197
618211
2184
10:34
What if technology instead
could enable empathy at scale?
could enable empathy at scale?
198
622508
5269
反之，如果能用科技产生大量共鸣呢？
10:40
This was the question
that motivated our partnership
that motivated our partnership
199
628451
2486
这驱使我们
与谷歌反虐待小组，
10:42
with Google's Counter Abuse team,
200
630961
1819
维基百科，
10:44
Wikipedia
201
632804
1178
和《纽约时报》这类报刊合作。
10:46
and newspapers like the New York Times.
202
634006
1934
10:47
We wanted to see if we could build
machine-learning models
machine-learning models
203
635964
2876
我们想要看看是否可以获悉
机器学习的模型来理解
语言所造成的情感影响。
语言所造成的情感影响。
10:50
that could understand
the emotional impact of language.
the emotional impact of language.
204
638864
3606
10:55
Could we predict which comments
were likely to make someone else leave
were likely to make someone else leave
205
643062
3610
我们能否推测一下，
什么样的评论最可能让人
什么样的评论最可能让人
逃离网络聊天？
10:58
the online conversation?
206
646696
1374
11:00
And that's no mean feat.
207
648515
3887
这个问题很难回答。
对人工智能来说，
11:04
That's no trivial accomplishment
208
652426
1566
能完成这些并非理所当然。
11:06
for AI to be able to do
something like that.
something like that.
209
654016
2563
想想这两个例子，
11:08
I mean, just consider
these two examples of messages
these two examples of messages
210
656603
3729
我上周可能收到的信息。
11:12
that could have been sent to me last week.
211
660356
2224
11:15
"Break a leg at TED!"
212
663517
1879
“祝TED演讲顺利！”
11:17
... and
213
665420
1164
以及
“我会在TED现场打断你的腿。”
11:18
"I'll break your legs at TED."
214
666608
2126
(笑声)
11:20
(Laughter)
215
668758
1246
你们是人，
11:22
You are human,
216
670028
1513
所以能够明显感受到
两句话意思的不同，
两句话意思的不同，
11:23
that's why that's an obvious
difference to you,
difference to you,
217
671565
2210
即使字句基本一致。
11:25
even though the words
are pretty much the same.
are pretty much the same.
218
673799
2224
但对于人工智能来说，
要对模型进行一定的训练，
要对模型进行一定的训练，
11:28
But for AI, it takes some training
to teach the models
to teach the models
219
676047
3079
才能辨析那些不同之处。
11:31
to recognize that difference.
220
679150
1571
创建能分辨差异的人工智能，
其美妙之处在于，
其美妙之处在于，
11:32
The beauty of building AI
that can tell the difference
that can tell the difference
221
680745
3245
11:36
is that AI can then scale to the size
of the online toxicity phenomenon,
of the online toxicity phenomenon,
222
684014
5050
人工智能可以大规模
防治网络毒害现象，
防治网络毒害现象，
为了实现这一目标，
我们打造了名叫“观点”的技术。
我们打造了名叫“观点”的技术。
11:41
and that was our goal in building
our technology called Perspective.
our technology called Perspective.
223
689088
3287
11:45
With the help of Perspective,
224
693056
1427
在“观点”的帮助下，
以《纽约时报》为例，
11:46
the New York Times, for example,
225
694507
1583
他们增加了线上讨论的空间。
11:48
has increased spaces
online for conversation.
online for conversation.
226
696114
2487
11:51
Before our collaboration,
227
699005
1310
在与我们合作前，
他们的文章只有约10%的开放评论。
11:52
they only had comments enabled
on just 10 percent of their articles.
on just 10 percent of their articles.
228
700339
4305
11:57
With the help of machine learning,
229
705495
1644
在机器学习的协助下，
这个数字增加到了30%。
11:59
they have that number up to 30 percent.
230
707163
1897
涨了两倍，
12:01
So they've tripled it,
231
709084
1156
这项合作才刚刚开始而已。
12:02
and we're still just getting started.
232
710264
1917
12:04
But this is about way more than just
making moderators more efficient.
making moderators more efficient.
233
712872
3461
但这绝不仅仅是让版主更有效率而已。
12:10
Right now I can see you,
234
718076
1850
现在，我可以看见你们，
12:11
and I can gauge how what I'm saying
is landing with you.
is landing with you.
235
719950
3294
我可以估量我的用词
将对你们产生怎样的影响。
将对你们产生怎样的影响。
12:16
You don't have that opportunity online.
236
724370
1879
线上并没有这样的机会。
12:18
Imagine if machine learning
could give commenters,
could give commenters,
237
726558
3635
想象一下，在网友打字的时候，
12:22
as they're typing,
238
730217
1162
如果机器学习能够
12:23
real-time feedback about how
their words might land,
their words might land,
239
731403
3347
对他们的话语可能造成的影响
提供即时的反馈，会如何。
提供即时的反馈，会如何。
12:27
just like facial expressions do
in a face-to-face conversation.
in a face-to-face conversation.
240
735609
3024
就像面对面交谈时的脸部表情。
12:32
Machine learning isn't perfect,
241
740926
1842
机器学习并不完美，
它仍然会犯许多的错误。
12:34
and it still makes plenty of mistakes.
242
742792
2394
但如果我们能够打造
12:37
But if we can build technology
243
745210
1557
12:38
that understands the emotional
impact of language,
impact of language,
244
746791
3293
理解语言中的情感影响力的技术，
我们就能建立更多的同理心。
12:42
we can build empathy.
245
750108
1460
那就意味着，我们可以让两人进行对话，
12:43
That means that we can have
dialogue between people
dialogue between people
246
751592
2425
即使他们所属的政治体系不同，
12:46
with different politics,
247
754041
1816
世界观不同，
12:47
different worldviews,
248
755881
1216
价值观不同。
12:49
different values.
249
757121
1246
12:51
And we can reinvigorate the spaces online
that most of us have given up on.
that most of us have given up on.
250
759359
4775
我们可以让大多数人已经
放弃的网络空间得到复苏。
放弃的网络空间得到复苏。
12:57
When people use technology
to exploit and harm others,
to exploit and harm others,
251
765857
3785
当人们利用科技剥削和伤害他人时，
他们靠着人类的恐惧与脆弱，肆意掠夺。
13:01
they're preying on our human fears
and vulnerabilities.
and vulnerabilities.
252
769666
3642
13:06
If we ever thought
that we could build an internet
that we could build an internet
253
774461
3508
如果我们想当然，认为能够建立一个
和人性阴暗面绝缘的网络，
13:09
insulated from the dark side of humanity,
254
777993
2578
那就大错特错了。
13:12
we were wrong.
255
780595
1184
13:14
If we want today to build technology
256
782361
2270
现如今，如果我们想要发展
能够克服当前所面临的挑战的科技，
13:16
that can overcome
the challenges that we face,
the challenges that we face,
257
784655
3127
13:19
we have to throw our entire selves
into understanding the issues
into understanding the issues
258
787806
4043
就必须全身心投入，深刻理解问题，
13:23
and into building solutions
259
791873
1893
进而找到解决方法，
13:25
that are as human as the problems
they aim to solve.
they aim to solve.
260
793790
3782
来克服人类自身的种种问题。
13:30
Let's make that happen.
261
798071
1513
让我们一起实现它吧。
13:31
Thank you.
262
799924
1150
谢谢大家！
13:33
(Applause)
263
801098
3277
(掌声)
ABOUT THE SPEAKER
Yasmin Green - Geopolitical technologistYasmin Green is the director of research and development for Jigsaw, a unit within Alphabet Inc. focused on solving global security challenges through technology.
Why you should listen
Yasmin Green is the director of research and development for Jigsaw, a unit within Alphabet Inc. (formerly Google Ideas), focused on using tech tools to make the world safer, both on and offline. She has experience leading projects in some of the world’s toughest environments, including Iran, Syria, the UAE and Nigeria. In 2012, she led a multi-partner coalition to launch Against Violent Extremism, the world's first online network of former violent extremists and survivors of terrorism. Based on her own interviews with ISIS defectors and jailed recruits, last year Yasmin launched the Redirect Method, a new deployment of targeted advertising and video to confront online radicalization.
Green is a senior advisor on innovation to Oxford Analytica, a member of the Aspen Cyber Strategy Group, and until 2015 co-chaired the European Commission's Working Group on Online Radicalization. She was named one of Fortune's "40 Under 40" most influential young leaders in 2017, and in 2016 she was named one of Fast Company's "Most Creative People in Business."
Yasmin Green | Speaker | TED.com