TEDGlobal 2012
Matt Mills: Image recognition that triggers augmented reality
Filmed:
Readability: 3.5
2,675,029 views
Matt Mills and Tamara Roukaerts demonstrate Aurasma, a new augmented reality tool that can seamlessly animate the world as seen through a smartphone. Going beyond previous augmented reality, their "auras" can do everything from making a painting talk to overlaying live news onto a printed newspaper.
Double-click the English transcript below to play the video.
00:16
So wouldn't it be amazing if our phones
0
1067
2723
00:19
could see the world in the same way that we do,
1
3790
2398
00:22
as we're walking around being able
2
6188
1926
00:24
to point a phone at anything,
3
8114
2199
00:26
and then have it actually recognize images and objects
4
10313
2095
00:28
like the human brain, and then be able to pull in information
5
12408
2770
00:31
from an almost infinite library of knowledge
6
15178
2999
00:34
and experiences and ideas.
7
18177
2113
00:36
Well, traditionally that was seen as science fiction,
8
20290
2087
00:38
but now we've moved to a world
9
22377
1150
00:39
where actually this has become possible.
10
23527
2331
00:41
So the best way of explaining it is to just show it.
11
25858
2595
00:44
What you can see over here is Tamara,
12
28453
1605
00:45
who is holding my phone that's now plugged in.
13
30058
1815
00:47
So let me start with this.
14
31873
1936
00:49
What we have here is a painting
15
33809
1568
00:51
of the great poet Rabbie Burns,
16
35377
2256
00:53
and it's just a normal image,
17
37633
1817
00:55
but if we now switch inputs over to the phone,
18
39450
2391
00:57
running our technology, you can see
19
41841
2225
00:59
effectively what Tamara's seeing on the screen,
20
44066
2342
01:02
and when she points at this image,
21
46408
1553
01:03
something magical happens.
22
47961
2217
01:06
(Laughter) (Bagpipes)
23
50178
4362
01:10
(Bagpipes) (Applause)
24
54540
2608
01:13
(Bagpipes)
25
57148
6880
01:19
Voice: Now simmer blinks on flowery braes ...
26
64043
1783
01:21
Matt Mills: Now, what's great about this is,
27
65826
1625
01:23
there's no trickery here.
28
67451
1812
01:25
There's nothing done to this image.
29
69263
2636
01:27
And what's great about this is the technology's
30
71899
3025
01:30
actually allowing the phone to start to see and understand
31
74924
2575
01:33
much like how the human brain does.
32
77499
2130
01:35
Not only that, but as I move the object around,
33
79629
2503
01:38
it's going to track it and overlay that content seamlessly.
34
82132
6039
01:44
Again, the thing that's incredible about this is
35
88171
2037
01:46
this is how advanced these devices have become.
36
90208
2186
01:48
All the processing to do that was actually done
37
92394
2128
01:50
on the device itself.
38
94522
2466
01:52
Now, this has applications everywhere,
39
96988
2051
01:54
whether in things like art in museums, like you just saw,
40
99039
3715
01:58
or in the world of, say, advertising, or print journalism.
41
102754
3255
02:01
So a newspaper becomes out of date as soon as it's printed.
42
106009
3401
02:05
And here is this morning's newspaper,
43
109410
1992
02:07
and we have some Wimbledon news, which is great.
44
111402
2178
02:09
Now what we can do is point at the front of the newspaper
45
113580
2965
02:12
and immediately get the bulletin.
46
116545
2096
02:14
Voice: ... To the grass, and it's very important that you adapt
47
118641
3231
02:17
and you, you have to be flexible, you have to be willing
48
121872
2396
02:20
to change direction at a split second,
49
124268
2521
02:22
and she does all that. She's won this title.
50
126789
2982
02:25
MM: And that linking of the digital content
51
129771
3185
02:28
to something that's physical is what we call an aura, and
52
132956
2429
02:31
I'll be using that term a little bit as we go through the talk.
53
135385
2367
02:33
So, what's great about this is it isn't just a faster,
54
137752
3292
02:36
more convenient way to get information in the real world,
55
141044
2820
02:39
but there are times when actually using this medium
56
143864
2519
02:42
allows you to be able to display information in a way
57
146383
2332
02:44
that was never before possible.
58
148715
2115
02:46
So what I have here is a wireless router.
59
150830
2839
02:49
My American colleagues have told me I've got to call it a router,
60
153669
3265
02:52
so that everyone here understands — (Laughter) —
61
156934
1820
02:54
but nonetheless, here is the device.
62
158754
3445
02:58
So now what I can do is, rather than getting the instructions
63
162199
3070
03:01
for the device online, I can simply point at it,
64
165269
2606
03:03
the device is recognized, and then --
65
167875
4572
03:08
Voice: Begin by plugging in the grey ADSL cable.
66
172447
3112
03:11
Then connect the power. Finally, the yellow ethernet cable.
67
175559
5471
03:16
Congratulations. You have now completed setup.
68
181030
3356
03:20
(Laughter) MM: Awesome. Thank you.
69
184386
2166
03:22
(Applause)
70
186552
3110
03:25
The incredible work that made that possible was done
71
189662
2978
03:28
here in the U.K. by scientists at Cambridge,
72
192640
2838
03:31
and they work in our offices,
73
195478
1785
03:33
and I've got a lovely picture of them here.
74
197263
1528
03:34
They couldn't all be on stage, but we're going to
75
198791
1759
03:36
bring their aura to the stage, so here they are.
76
200550
3698
03:43
They're not very animated. (Laughter)
77
207955
1924
03:45
This was the fourth take, I'm told. (Laughter)
78
209879
4268
03:50
Okay. So, as we're talking about Cambridge,
79
214147
3465
03:53
let's now move on to technical advancements,
80
217612
2361
03:55
because since we started putting this technology
81
219973
2167
03:58
on mobile phones less than 12 months ago,
82
222140
4115
04:02
the speed and the processing in these devices
83
226255
2054
04:04
has grown at a really phenomenal rate,
84
228309
2400
04:06
and that means that I can now take cinema-quality
85
230709
2254
04:08
3D models and place them in the world around me,
86
232963
3210
04:12
so I have one over here.
87
236173
2184
04:14
Tamara, would you like to jump in?
88
238357
3685
04:19
(Music)
89
243765
2829
04:22
(Dinosaur roaring) (Laughter)
90
246594
5007
04:27
MM: I should leap in.
91
251601
2177
04:29
(Music) (Dinosaur roaring)
92
253778
3777
04:33
(Applause)
93
257555
5149
04:38
So then, after the fun, comes the more emotional side
94
262704
2440
04:41
of what we do, because effectively, this technology
95
265144
2456
04:43
allows you to see the world through someone's eyes,
96
267600
2392
04:45
and for that person to be able to take a moment in time
97
269992
2913
04:48
and effectively store it and tag it to something physical
98
272905
3133
04:51
that exists in the real world.
99
276038
1977
04:53
What's great about this is, the tools to do this are free.
100
278015
2521
04:56
They're open, they're available to everyone within our application,
101
280536
3128
04:59
and educators have really got on board with the classrooms.
102
283664
3682
05:03
So we have teachers who've tagged up textbooks,
103
287346
2374
05:05
teachers who've tagged up school classrooms,
104
289720
2040
05:07
and a great example of this is a school in the U.K.
105
291760
2173
05:09
I have a picture here from a video, and we're now going to play it.
106
293933
3008
05:14
Teacher: See what happens. (Children talking) Keep going.
107
298372
7740
05:22
Child: TV. (Children react)
108
306112
3913
05:25
Child: Oh my God.
109
310025
1380
05:27
Teacher: Now move it either side. See what happens.
110
311405
2554
05:29
Move away from it and come back to it.
111
313959
3412
05:33
Child: Oh, that is so cool.
112
317371
3145
05:36
Teacher: And then, have you got it again?
113
320516
2887
05:39
Child: Oh my God! How did you do that?
114
323403
4408
05:43
Second child: It's magic.
115
327811
2732
05:46
(Laughter) MM: (Laughs) So, it's not magic.
116
330543
3573
05:50
It's available for everyone to do,
117
334116
1767
05:51
and actually I'm going to show you how easy it is to do
118
335883
1885
05:53
by doing one right now.
119
337768
1289
05:54
So, as sort of — I'm told it's called a stadium wave,
120
339057
2756
05:57
so we're going to start from this side of the room
121
341813
1317
05:59
on the count of three, and go over to here.
122
343130
1950
06:00
Tamara, are you recording?
123
345080
1383
06:02
Okay, so are you all ready?
124
346463
1884
06:04
One, two, three. Go!
125
348347
2199
06:06
Audience: Whooooooo!
126
350546
3625
06:10
MM: Fellows are really good at that. (Laughs) (Laughter)
127
354171
3434
06:13
Okay. Now we're going to switch back
128
357605
1697
06:15
into the Aurasma application,
129
359302
1821
06:17
and what Tamara's going to do is tag that video that we just
130
361123
3385
06:20
took onto my badge, so that I can remember it forever.
131
364508
6039
06:26
Now, we have lots of people who are doing this already,
132
370547
3305
06:29
and we've talked a little bit about the educational side.
133
373852
2258
06:32
On the emotional side, we have people who've
134
376110
2150
06:34
done things like send postcards and Christmas cards
135
378260
3072
06:37
back to their family with little messages on them.
136
381332
3226
06:40
We have people who have, for example,
137
384558
2229
06:42
taken the inside of the engine bay of an old car
138
386787
2057
06:44
and tagged up different components within an engine,
139
388844
2465
06:47
so that if you're stuck and you want to find out more,
140
391309
2279
06:49
you can point and discover the information.
141
393588
2561
06:52
We're all very, very familiar with the Internet.
142
396149
3070
06:55
In the last 20 years, it's really
143
399219
2850
06:57
changed the way that we live and work,
144
402069
1894
06:59
and the way that we see the world, and what's great is,
145
403963
3032
07:02
we sort of think this is the next paradigm shift,
146
406995
2314
07:05
because now we can literally take the content
147
409309
3407
07:08
that we share, we discover, and that we enjoy
148
412716
3196
07:11
and make it a part of the world around us.
149
415912
2372
07:14
It's completely free to download this application.
150
418284
1826
07:16
If you have a good Wi-Fi connection or 3G,
151
420110
2734
07:18
this process is very, very quick.
152
422844
1265
07:20
Oh, there we are. We can save it now.
153
424109
1913
07:21
It's just going to do a tiny bit of processing
154
426022
2236
07:24
to convert that image that we just took
155
428258
2121
07:26
into a sort of digital fingerprint,
156
430379
1904
07:28
and the great thing is, if you're a professional user,
157
432283
2033
07:30
-- so, a newspaper -- the tools are pretty much identical
158
434316
2680
07:32
to what we've just used to create this demonstration.
159
436996
2494
07:35
The only difference is that you've got the ability
160
439490
1712
07:37
to add in links and slightly more content. Are you now ready?
161
441202
2677
07:39
Tamara Roukaerts: We're ready to go.
162
443879
1052
07:40
MM: Okay. So, I'm told we're ready, which means
163
444931
2206
07:43
we can now point at the image, and there you all are.
164
447137
2419
07:45
MM on video: One, two, three. Go!
165
449556
6395
07:51
MM: Well done. We've been Aurasma. Thank you.
166
455951
2349
07:54
(Applause)
167
458300
5634
ABOUT THE SPEAKERS
Matt Mills - TechnologistMatt Mills comes from Aurasma, a startup that makes augmented-reality technology for mobile phones.
Why you should listen
Augmented reality is the process of adding layers of information onto the world we see, viewable only through technology. In this space, the Aurasma Lite app uses a smartphone and camera to lay "auras"--3D images, games, animations--onto real-world places. Point your phone at a movie poster on the street and launch a trailer; point at a building to pull up an interactive map... or create your own "aura" and upload it to the virtual space for anyone to see. Matt Mills and Tamara Roukaerts both joined Aurasma when it launched in June 2011.
They say: "This is the next step on from simply browsing the internet because now the digital content we discover, create and share can be woven seamlessly in to the world around us."
Matt Mills | Speaker | TED.com
Tamara Roukaerts -
Tamara Roukaerts is head of marketing at Aurasma, working to build an augmented-reality lens via smartphones.
Why you should listen
Tamara joined Aurasma at its launch in June 2011 as Head of Marketing, having previously led marketing at venture-backed start-up Light Blue Optics for four years. Prior to that, she earned her high-tech stripes working for the Cambridge-MIT Institute - a $100 million joint venture between the University of Cambridge and the Massachusetts Institute of Technology. Tamara started her career working in advertising for Saatchi & Saatchi and has a Masters degree from Oxford University.
Tamara Roukaerts | Speaker | TED.com