ABOUT THE SPEAKER
Amit Sood - Technologist
As the director of Google's Cultural Institute and Art Project, Amit Sood leads the effort to bring cultural artifacts from museums, archives and foundations onto the web in extraordinary detail.

Why you should listen

Amit Sood is the director of Google's Cultural Institute. He and his team work on making art and culture accessible and engaging for everyone. They have partnered with over 1,000 museums, archives and other institutions from more than 70 countries to bring our shared heritage onto the web and connect them with people through new technologies. Most recently they have been experimenting with combining art with machine learning algorithms and other advanced technologies to create new ways to explore our cultures.

More profile about the speaker
Amit Sood | Speaker | TED.com
TED2016

Amit Sood: Every piece of art you've ever wanted to see -- up close and searchable

Filmed:
1,108,918 views

What does a cultural Big Bang look like? For Amit Sood, director of Google's Cultural Institute and Art Project, it's an online platform where anyone can explore the world's greatest collections of art and artifacts in vivid, lifelike detail. Join Sood and Google artist in residence Cyril Diagne in a mind-bending demo of experiments from the Cultural Institute and glimpse the exciting future of accessibility to arts and culture.
- Technologist
As the director of Google's Cultural Institute and Art Project, Amit Sood leads the effort to bring cultural artifacts from museums, archives and foundations onto the web in extraordinary detail. Full bio

Double-click the English transcript below to play the video.

00:12
The world is filled
with incredible objects
0
878
3525
00:16
and rich cultural heritage.
1
4427
1928
00:19
And when we get access to them,
2
7283
2136
00:21
we are blown away, we fall in love.
3
9443
2384
00:24
But most of the time,
4
12652
1597
00:26
the world's population is living
without real access to arts and culture.
5
14273
4792
00:31
What might the connections be
when we start exploring our heritage,
6
19946
5353
00:37
the beautiful locations
and the art in this world?
7
25323
3207
00:41
Before we get started
in this presentation,
8
29427
2774
00:44
I just want to take care
of a few housekeeping points.
9
32225
2975
00:47
First, I am no expert in art or culture.
10
35651
3348
00:51
I fell into this by mistake,
but I'm loving it.
11
39023
2726
00:54
Secondly, all of what
I'm going to show you
12
42356
2996
00:57
belongs to the amazing museums,
archives and foundations
13
45376
3965
01:01
that we partner with.
14
49365
1426
01:02
None of this belongs to Google.
15
50815
1856
01:05
And finally, what you see behind me
16
53235
3189
01:08
is available right now
on your mobile phones,
17
56448
3351
01:11
on your laptops.
18
59823
1174
01:13
This is our current platform,
where you can explore
19
61021
2404
01:15
thousands of museums
and objects at your fingertips,
20
63449
3411
01:18
in extremely high-definition detail.
21
66884
2511
01:21
The diversity of the content
is what's amazing.
22
69419
2893
01:24
If we just had European paintings,
23
72336
2169
01:26
if we just had modern art,
24
74529
1731
01:28
I think it gets a bit boring.
25
76284
1802
01:30
For example, this month,
we launched the "Black History" channel
26
78110
3859
01:33
with 82 curated exhibitions,
27
81993
2589
01:36
which talk about arts and culture
in that community.
28
84606
3566
01:40
We also have some
amazing objects from Japan,
29
88196
3623
01:43
centered around craftsmanship,
called "Made in Japan."
30
91843
4104
01:47
And one of my favorite exhibitions,
31
95971
3127
01:51
which actually is the idea of my talk,
32
99122
2405
01:53
is -- I didn't expect to become
a fan of Japanese dolls.
33
101551
3863
01:57
But I am, thanks to this exhibition,
34
105438
3164
02:00
that has really taught me
about the craftsmanship
35
108626
3485
02:04
behind the soul of a Japanese doll.
36
112135
2122
02:06
Trust me, it's very exciting.
37
114281
2228
02:08
Take my word for it.
38
116533
1348
02:09
So, moving on swiftly.
39
117905
2009
02:11
One quick thing I wanted
to showcase in this platform,
40
119938
2832
02:14
which you can share with your kids
and your friends right now,
41
122794
2935
02:17
is you can travel to all these
amazing institutions virtually, as well.
42
125753
4256
02:22
One of our recent ideas was with
The Guggenheim Museum in New York,
43
130033
3586
02:25
where you can get a taste
of what it might feel like
44
133643
3358
02:29
to actually be there.
45
137025
1151
02:30
You can go to the ground floor
46
138200
1767
02:31
and obviously, most of you,
I assume, have been there.
47
139991
2689
02:34
And you can see the architectural
masterpiece that it is.
48
142704
2737
02:37
But imagine this accessibility
for a kid in Bombay
49
145465
3094
02:40
who's studying architecture,
50
148583
1720
02:42
who hasn't had a chance
to go to The Guggenheim as yet.
51
150327
3055
02:45
You can obviously look at objects
in the Guggenheim Museum,
52
153406
3085
02:48
you can obviously get into them
and so on and so forth.
53
156515
2718
02:51
There's a lot of information here.
54
159257
1875
02:53
But this is not the purpose
of my talk today.
55
161156
3849
02:57
This exists right now.
56
165543
1766
02:59
What we now have are the building blocks
to a very exciting future,
57
167333
3926
03:03
when it comes to arts and culture
58
171283
1715
03:05
and accessibility to arts and culture.
59
173022
2611
03:07
So I am joined today onstage
by my good friend and artist in residence
60
175657
4468
03:12
at our office in Paris, Cyril Diagne,
61
180149
2343
03:14
who is the professor of interactive design
62
182516
2129
03:16
at ECAL University
in Lausanne, Switzerland.
63
184669
2637
03:19
What Cyril and our team
of engineers have been doing
64
187330
2614
03:21
is trying to find these connections
and visualize a few of these.
65
189968
3135
03:25
So I'm going to go quite quick now.
66
193127
1813
03:26
This object you see
behind me -- oh, just clarification:
67
194964
3602
03:30
Always, seeing the real thing is better.
68
198590
1951
03:32
In case people think
I'm trying to replicate the real thing.
69
200565
2863
03:35
So, moving on.
70
203452
1207
03:37
This object you see behind me
is the Venus of Berekhat Ram.
71
205155
3516
03:40
It's one of the oldest
objects in the world,
72
208695
2076
03:42
found in the Golan Heights
around 233,000 years ago,
73
210795
3174
03:45
and currently residing
at the Israel Museum in Jerusalem.
74
213993
3129
03:49
It is also one of the oldest
objects on our platform.
75
217146
2621
03:52
So let's zoom.
76
220322
1346
03:53
We start from this one object.
77
221692
1765
03:55
What if we zoomed out
78
223986
2536
03:58
and actually tried to experience
our own cultural big bang?
79
226546
4506
04:03
What might that look like?
80
231076
1578
04:05
This is what we deal with on a daily basis
at the Cultural Institute --
81
233474
3657
04:09
over six million cultural artifacts
curated and given to us by institutions,
82
237155
4962
04:14
to actually make these connections.
83
242141
1946
04:16
You can travel through time,
84
244111
1399
04:17
you can understand more
about our society through these.
85
245534
3511
04:21
You can look at it
from the perspective of our planet,
86
249069
4400
04:25
and try to see how
it might look without borders,
87
253493
2635
04:28
if we just organized art and culture.
88
256152
2671
04:30
We can also then plot it by time,
89
258847
2228
04:33
which obviously, for the data geek
in me, is very fascinating.
90
261099
4080
04:37
You can spend hours
looking at every decade
91
265203
3386
04:40
and the contributions
in that decade and in those years
92
268613
3316
04:43
for art, history and cultures.
93
271953
2333
04:46
We would love to spend hours
showing you each and every decade,
94
274310
3379
04:49
but we don't have the time right now.
95
277713
1861
04:51
So you can go on your phone
and actually do it yourself.
96
279598
3259
04:54
(Applause)
97
282881
3462
04:58
But if you don't mind
and can hold your applause till later,
98
286367
3102
05:01
I don't want to run out of time,
99
289493
1548
05:03
because I want to show you
a lot of cool stuff.
100
291065
2199
05:05
So, just very quickly:
101
293288
1500
05:06
you can move on from here
to another very interesting idea.
102
294812
3986
05:10
Beyond the pretty picture,
103
298822
1711
05:12
beyond the nice visualization,
104
300557
1789
05:14
what is the purpose, how is this useful?
105
302370
2327
05:16
This next idea comes
from discussions with curators
106
304721
4729
05:21
that we've been having at museums,
107
309474
1635
05:23
who, by the way, I've fallen in love with,
108
311133
2023
05:25
because they dedicate their whole life
to try to tell these stories.
109
313180
3194
05:28
One of the curators told me,
"Amit, what would it be like
110
316398
2931
05:31
if you could create
a virtual curator's table
111
319353
2479
05:33
where all these six million objects
112
321856
2303
05:36
are displayed in a way for us
to look at the connections between them?"
113
324183
4403
05:40
You can spend a lot of time, trust me,
looking at different objects
114
328610
4029
05:44
and understanding where they come from.
115
332663
1953
05:46
It's a crazy Matrix experience.
116
334640
2208
05:48
(Laughter)
117
336872
1014
05:49
Just moving on,
118
337910
1286
05:51
let's take the world-famous
Vincent Van Gogh,
119
339220
3171
05:54
who is very well-represented
on this platform.
120
342415
3715
05:58
Thanks to the diversity
of the institutions we have,
121
346154
2776
06:00
we have over 211 high-definition,
amazing artworks by this artist,
122
348954
5704
06:06
now organized in one beautiful view.
123
354682
3747
06:10
And as it resolves,
and as Cyril goes deeper,
124
358453
2973
06:13
you can see all the self-portraits,
125
361450
2209
06:15
you can see still life.
126
363683
1425
06:17
But I just wanted to highlight
one very quick example,
127
365132
2603
06:19
which is very timely:
128
367759
1688
06:21
"The Bedroom."
129
369471
1311
06:22
This is an artwork
where three copies exist --
130
370806
2301
06:25
one at the Van Gogh Museum in Amsterdam,
131
373131
2330
06:27
one at the Orsay in Paris
132
375485
1987
06:29
and one at the Art Institute of Chicago,
133
377496
1934
06:31
which, actually, currently
is hosting a reunion
134
379454
2503
06:33
of all three artworks physically,
135
381981
1775
06:35
I think only for the second time ever.
136
383780
2137
06:37
But, it is united digitally and virtually
for anybody to look at
137
385941
4919
06:42
in a very different way,
138
390884
1921
06:44
and you won't get pushed
in the line in the crowd.
139
392829
3033
06:47
So let's take you and let's travel
through "The Bedroom" very quickly,
140
395886
4742
06:52
so you can experience what we are doing
for every single object.
141
400652
3587
06:56
We want the image to speak
as much as it can
142
404263
3451
06:59
on a digital platform.
143
407738
1644
07:01
And all you need is an internet
connection and a computer
144
409406
3147
07:04
(Applause)
145
412577
4338
07:08
And, Cyril, if you can go deeper, quickly.
146
416939
2558
07:11
I'm sorry, this is all live,
147
419521
1484
07:13
so you have to give Cyril
a little bit of --
148
421029
2435
07:16
and this is available for every object:
149
424401
2060
07:18
modern art, contemporary art,
Renaissance -- you name it,
150
426485
2715
07:21
even sculpture.
151
429224
1187
07:23
Sometimes, you don't know
what can attract you
152
431802
3595
07:27
to an artwork or to a museum
or to a cultural discovery.
153
435421
5228
07:32
So for me, personally,
it was quite a challenge
154
440673
2742
07:35
because when I decided to make this
my full-time job at Google,
155
443439
3222
07:38
my mother was not very supportive.
156
446685
2603
07:41
I love my mother,
157
449312
1247
07:42
but she thought I was wasting my life
with this museum stuff.
158
450583
2999
07:45
And for her, a museum is what
you do when you go on vacation
159
453606
3312
07:48
and you tick-mark and it's over, right?
160
456942
1967
07:50
And it took around four and a half years
161
458933
2531
07:53
for me to convince my lovely Indian mother
162
461488
2214
07:55
that actually, this is worthwhile.
163
463726
1653
07:57
And the way I did it was,
I realized one day that she loves gold.
164
465403
3441
08:00
So I started showing her all objects
that have the material gold in them.
165
468868
5575
08:06
And the first thing my mom asks me is,
166
474467
2651
08:09
"How can we buy these?"
167
477142
2428
08:11
(Laughter)
168
479594
1818
08:13
And obviously, my salary is not that high,
169
481436
3142
08:16
so I was like, "We can't
actually do that, mom.
170
484602
2378
08:19
But you can explore them virtually."
171
487004
2111
08:21
And so now my mom -- every time
I meet her, she asks me,
172
489139
3419
08:24
"Any more gold, any more silver
in your project? Can you show me?"
173
492582
3466
08:28
And that's the idea
I'm trying to illustrate.
174
496072
2174
08:30
It does not matter how you get in,
175
498270
2138
08:32
as long as you get in.
176
500432
1362
08:33
Once you get in, you're hooked.
177
501818
1610
08:35
Moving on from here very quickly,
178
503452
2349
08:37
there is kind of a playful idea, actually,
179
505825
2849
08:40
to illustrate the point of access,
180
508698
1635
08:42
and I'm going to go
quite quickly on this one.
181
510357
2422
08:44
We all know that seeing the artwork
in person is amazing.
182
512803
5407
08:50
But we also know
that most of us can't do it,
183
518234
2583
08:52
and the ones that can afford
to do it, it's complicated.
184
520841
2758
08:55
So -- Cyril, can we load
up our art trip, what do we call it?
185
523623
3807
08:59
We don't have a good name for this.
186
527454
1762
09:01
But essentially, we have
around 1,000 amazing institutions,
187
529240
4971
09:06
68 countries.
188
534235
1167
09:07
But let's start with Rembrandt.
189
535426
1700
09:09
We might have time for only one example.
190
537150
2242
09:11
But thanks to the diversity,
191
539416
2229
09:13
we've got around 500 amazing
Rembrandt object artworks
192
541669
3904
09:17
from 46 institutions and 17 countries.
193
545597
2269
09:19
Let's say that on your next vacation,
194
547890
2552
09:22
you want to go see
every single one of them.
195
550466
2050
09:24
That is your itinerary,
196
552540
1334
09:25
you will probably travel
53,000 kilometers,
197
553898
3654
09:29
visit around, I think, 46 institutions,
198
557576
2587
09:32
and just FYI, you might release
10 tons of CO2 emissions.
199
560187
4191
09:36
(Laughter)
200
564402
1463
09:37
But remember, it's art,
201
565889
1473
09:39
so you can justify it,
perhaps, in some way.
202
567386
2665
09:42
Moving on swiftly from here,
203
570837
1922
09:44
is something a little bit
more technical and more interesting.
204
572783
2935
09:47
All that we've shown you so far
uses metadata to make the connections.
205
575742
4937
09:52
But obviously we have
something cool nowadays
206
580703
2110
09:54
that everyone likes to talk about,
which is machine learning.
207
582837
2912
09:57
So what we thought is,
let's strip out all the metadata,
208
585773
3074
10:00
let's look at what machine learning can do
209
588871
3612
10:04
based purely on visual recognition
of this entire collection.
210
592507
4323
10:08
What we ended up with
is this very interesting map,
211
596854
4193
10:13
these clusters that have
no reference point information,
212
601071
4310
10:17
but has just used visuals
to cluster things together.
213
605405
3965
10:21
Each cluster is an art to us
by itself of discovery.
214
609394
3582
10:25
But one of the clusters we want
to show you very quickly
215
613000
2663
10:27
is this amazing cluster of portraits
216
615687
2652
10:30
that we found from museums
around the world.
217
618363
2402
10:32
If you could zoom in
a little bit more, Cyril.
218
620789
2183
10:34
Just to show you, you can
just travel through portraits.
219
622996
3832
10:38
And essentially, you can do nature,
you can do horses
220
626852
2774
10:41
and clusters galore.
221
629650
1756
10:44
When we saw all these portraits,
222
632309
1548
10:45
we were like, "Hey, can we do
something fun for kids,
223
633881
3652
10:49
or can we do something playful
224
637557
1682
10:51
to get people interested in portraits?"
225
639263
2025
10:53
Because I haven't really seen
226
641312
2180
10:55
young kids really excited
to go to a portrait gallery.
227
643516
3367
10:59
I wanted to try to figure something out.
228
647357
1932
11:01
So we created something
called the portrait matcher.
229
649313
2467
11:03
It's quite self-explnatory,
230
651804
1317
11:05
so I'm just going to let Cyril
show his beautiful face.
231
653145
2738
11:07
And essentially what's happening is,
with the movement of his head,
232
655907
4132
11:12
we are matching different portraits
around the world from museums.
233
660063
4167
11:16
(Applause)
234
664254
2196
11:29
And I don't know about you,
235
677445
1706
11:31
but I've shown it to my nephew and sister,
236
679175
2016
11:33
and the reaction is just phenomenal.
237
681215
1849
11:35
All they ask me is,
"When can we go see this?"
238
683088
2706
11:39
And by the way, if we're nice,
239
687492
1573
11:41
maybe, Cyril, you can smile
and find a happy one?
240
689089
2821
11:44
Oh, perfect.
241
692696
1398
11:46
By the way, this is not rehearsed.
242
694118
1988
11:48
Congrats, Cyril. Great stuff. Oh wow.
243
696474
2580
11:51
OK, let's move on; otherwise,
this will just take the whole time.
244
699078
3476
11:54
(Applause)
245
702578
1718
11:56
So, art and culture
can be fun also, right?
246
704320
2580
11:59
For our last quick experiment --
247
707900
3397
12:03
we call all of these "experiments" --
248
711321
1763
12:05
our last quick experiment
comes back to machine learning.
249
713108
2889
12:08
We show you clusters, visual clusters,
250
716021
2841
12:10
but what if we could ask the machine
to also name these clusters?
251
718886
4901
12:15
What if it could automatically tag
them, using no actual metadata?
252
723811
4753
12:20
So what we have is this kind of explorer,
253
728588
4100
12:24
where we have managed to match,
I think, around 4,000 labels.
254
732712
3611
12:28
And we haven't really
done anything special here,
255
736347
3164
12:31
just fed the collection.
256
739535
1658
12:33
And we found interesting categories.
257
741217
1770
12:35
We can start with horses,
a very straightforward category.
258
743011
2905
12:37
You would expect to see
that the machine has put
259
745940
2299
12:40
images of horses, right?
260
748263
1741
12:42
And it has, but you also notice,
right over there,
261
750028
3442
12:45
that it has a very abstract image
262
753494
2079
12:47
that it has still managed to recognize
and cluster as horses.
263
755597
3195
12:50
We also have an amazing head
in terms of a horse.
264
758816
3690
12:54
And each one has the tags
as to why it got categorized in this.
265
762530
4002
12:58
So let's move to another one
which I found very funny and interesting,
266
766556
3974
13:02
because I don't understand
how this category came up.
267
770554
2491
13:05
It's called "Lady in Waiting."
268
773069
1750
13:06
If, Cyril, you do it very quickly,
269
774843
2612
13:09
you will see that we have
these amazing images
270
777479
3542
13:13
of ladies, I guess, in waiting or posing.
271
781045
2761
13:15
I don't really understand it.
272
783830
1446
13:17
But I've been trying to ask
my museum contacts,
273
785300
2240
13:19
you know, "What is this?
What's going on here?"
274
787564
2245
13:21
And it's fascinating.
275
789833
1612
13:23
Coming back to gold very quickly,
276
791469
2689
13:26
I wanted to search for gold
277
794182
1563
13:27
and see how the machine
tagged all the gold.
278
795769
2102
13:29
But, actually, it doesn't tag it as gold.
279
797895
2080
13:32
We are living in popular times.
280
800320
1515
13:33
It tags it as "bling-bling."
281
801859
2103
13:35
(Laughter)
282
803986
1814
13:39
I'm being hard on Cyril,
because I'm moving too fast.
283
807200
2921
13:42
Essentially, here you have
all the bling-bling
284
810145
2627
13:44
of the world's museums organized for you.
285
812796
3161
13:47
And finally, to end this talk
and these experiments,
286
815981
3516
13:51
what I hope you feel after this talk
is happiness and emotion.
287
819521
3317
13:54
And what would we see
when we see happiness?
288
822862
2439
13:57
If we actually look at all the objects
289
825325
3159
14:00
that have been tagged under "happiness,"
290
828508
1944
14:02
you would expect happiness, I guess.
291
830476
3064
14:05
But there was one that came up
that was very fascinating and interesting,
292
833564
6103
14:11
which was this artwork
by Douglas Coupland,
293
839691
4375
14:16
our friend and artist
in residence as well,
294
844090
2095
14:18
called, "I Miss My Pre-Internet Brain."
295
846209
2261
14:20
I don't know why the machine feels like
it misses its pre-Internet brain
296
848494
3615
14:24
and it's been tagged here,
297
852133
1270
14:25
but it's a very interesting thought.
298
853427
1914
14:27
I sometimes do miss my pre-Internet brain,
299
855365
2183
14:29
but not when it comes to exploring
arts and culture online.
300
857572
3000
14:32
So take out your phones,
take out your computers,
301
860596
2313
14:34
go visit museums.
302
862933
1157
14:36
And just a quick call-out
to all the amazing archivists,
303
864114
2679
14:38
historians, curators,
304
866817
1384
14:40
who are sitting in museums,
preserving all this culture.
305
868225
2772
14:43
And the least we can do is get
our daily dose of art and culture
306
871021
3318
14:46
for ourselves and our kids.
307
874363
1331
14:47
Thank you.
308
875718
1153
14:48
(Applause)
309
876895
10641

▲Back to top

ABOUT THE SPEAKER
Amit Sood - Technologist
As the director of Google's Cultural Institute and Art Project, Amit Sood leads the effort to bring cultural artifacts from museums, archives and foundations onto the web in extraordinary detail.

Why you should listen

Amit Sood is the director of Google's Cultural Institute. He and his team work on making art and culture accessible and engaging for everyone. They have partnered with over 1,000 museums, archives and other institutions from more than 70 countries to bring our shared heritage onto the web and connect them with people through new technologies. Most recently they have been experimenting with combining art with machine learning algorithms and other advanced technologies to create new ways to explore our cultures.

More profile about the speaker
Amit Sood | Speaker | TED.com