sponsored links
TED2016

Alex Kipman: A futuristic vision of the age of holograms

February 18, 2016

Explore a speculative digital world without screens in this fanciful demo, a mix of near reality and far-future possibility. Wearing the HoloLens headset, Alex Kipman demos his vision for bringing 3D holograms into the real world, enhancing our perceptions so that we can touch and feel digital content. Featuring Q&A with TED's Helen Walters.

Alex Kipman - Inventor
With his latest invention, HoloLens, Kinect creator Alex Kipman has opened a virtual holographic universe for users to explore -- and he may have changed the face of computing forever. Full bio

sponsored links
Double-click the English subtitles below to play the video.
Thousands of years from now,
00:12
we'll look back at the first
century of computing
00:14
as a fascinating but very peculiar time --
00:18
the only time in history where humans
were reduced to live in 2D space,
00:22
interacting with technology
as if we were machines;
00:27
a singular, 100-year period
in the vastness of time
00:31
where humans communicated,
00:37
were entertained and managed their lives
00:39
from behind a screen.
00:42
Today, we spend most of our time
tapping and looking at screens.
00:44
What happened to interacting
with each other?
00:50
I don't know about you, but I feel limited
00:54
inside this 2D world
of monitors and pixels.
00:57
And it is this very limitation
01:01
and my desire to connect with people
01:03
that inspires me as a creator.
01:06
Put simply: I want
to create a new reality,
01:08
a reality where technology brings
us infinitely closer to each other,
01:11
a reality where people, not devices,
01:17
are the center of everything.
01:20
I dream of a reality where technology
senses what we see, touch and feel;
01:22
a reality where technology
no longer gets in our way,
01:29
but instead embraces who we are.
01:32
I dream of technology
01:36
on a human path.
01:38
We have all experienced technology
01:40
that enables people
to act more like people,
01:42
products that enable natural interactions,
voice controls or biometrics.
01:46
This is the next step in the evolution.
01:55
This is Microsoft HoloLens,
01:59
the first fully untethered
holographic computer.
02:01
Devices like this will bring
3D holographic content
02:05
right into our world,
02:09
enhancing the way we experience life
02:11
beyond our ordinary range of perceptions.
02:13
Now, I'm not thinking
about a distant future.
02:17
I'm talking about today.
02:21
We are already seeing
car companies like Volvo
02:23
designing cars differently with HoloLens;
02:26
universities like Case Western
redefining the way medical students learn;
02:29
and my personal favorite,
02:34
NASA is using HoloLens
to let scientists explore planets
02:36
holographically.
02:41
Now, this is important.
02:43
By bringing holograms into our world,
02:46
I'm not just talking about a new device
or a better computer.
02:48
I'm talking about freeing ourselves
from the 2D confines
02:52
of traditional computing.
02:58
Put it this way:
03:01
temporally adjusted, we're like
cave people in computer terms.
03:02
We've barely discovered charcoal
03:07
and started drawing
the first stick figures in our cave.
03:09
Now, this is the perspective
I apply to my work every single day.
03:14
And now for the next few minutes,
03:19
I invite all of you to apply
the same perspective
03:21
to the journey ahead of us.
03:26
Now, as I put this HoloLens on,
03:31
let me explain the setup a little bit.
03:34
It's probably the most risky demo
we have ever done on any stage
03:36
with HoloLens,
03:41
and I can't think of a better place
to do it than here at TED.
03:43
Momentarily, I am going
to be seeing holograms
03:47
right on this stage,
03:50
just as clearly as I can see all of you.
03:52
Now at the same time,
we have also this special camera
03:54
that just walked in onstage
03:58
so that all of you can share
in this experience with me
03:59
up on all the monitors.
04:03
So let's start our journey.
04:05
And what better place
to begin our journey,
04:07
than in the computer cave of 2D.
04:09
Let's explore the world
all around us with this new lens,
04:14
and understand the computer world
from a brand new perspective.
04:19
The computer universe
is both marvelous and primitive.
04:23
It's a universe based on causality.
04:28
As developers, we dream
the different causes
04:31
and then we program the different effects.
04:35
Double click on an icon, that's a cause.
04:37
Open an application, that's an effect.
04:41
Now when we compare this
to our physical universe,
04:45
it is overly constraining,
04:49
because our universe is not digital.
04:51
Our universe is analog.
04:54
Our universe doesn't think
in terms of zero or one,
04:56
true or false, or black or white.
05:01
We exist in a world
governed by quantum physics,
05:04
a universe of zero and one
both at the same time,
05:08
a reality based on infinite
probabilities and shades of gray.
05:13
You can see how these two worlds collide.
05:19
So why are screens so pervasive
in our analog life?
05:23
We see screens from the moment we wake up,
05:30
to the moment we fall asleep.
05:32
Why?
05:34
I think it's because computers
give us superpowers.
05:36
Within the digital universe,
we have the power to displace space
05:40
and the power to displace time.
05:43
It doesn't matter if you're using
technology for entertainment,
05:46
productivity or communication.
05:49
Think of it this way:
05:52
let's all go home tonight
05:53
and watch our favorite show on television.
05:55
This is theater -- time
and space displaced.
05:58
As soon as I'm done with this TED Talk,
06:02
I'm going to immediately call
my lovely family in Seattle.
06:04
That's displacement of space.
06:11
Now, these are such great superpowers
06:13
that we put up with
the two-dimensional limitations
06:16
of our current digital world.
06:19
But what if we didn't have to?
06:20
What if we could have
these same digital powers
06:23
in our world?
06:26
You can already see glimmers of this,
06:29
but I believe our children's children
06:32
will grow up in a world
devoid of 2D technology.
06:34
It's remarkable to dream of this world,
06:39
a world where technology
truly understands us --
06:42
where we live, work and communicate --
06:46
with tools that enhance
the human experience,
06:49
not machines that limit our humanity.
06:52
So how do we get there?
06:58
For me, the answer required
looking at the problem
07:01
from a different perspective.
07:05
It required sensing the world
from the perspective of a machine.
07:08
If you're a machine trying
to sense our world,
07:14
how would you actually
break the problem down?
07:17
You'd probably try to classify things
07:20
as a human,
07:23
an environment
07:26
or an object.
07:28
But how would that machine
then interact with reality?
07:31
And I can think of three ways.
07:36
First, as a machine,
07:38
I would observe or I would input reality.
07:40
Speech recognition
and biometric authentication
07:45
are great examples of a machine
interacting with humans
07:48
from an input perspective.
07:51
Secondly, as a machine,
07:54
I could place digital information,
or output information,
07:56
into reality.
08:01
Holograms are examples of a machine
interacting with an environment
08:03
from an output perspective.
08:08
Finally, as a machine,
08:10
I could exchange energy
with the world via haptics.
08:12
Now, imagine being able to feel
the temperature of a virtual object,
08:17
or better yet, imagine pushing a hologram
08:22
and having it push you back
with equal force.
08:25
With this perspective,
08:29
we are able to collapse reality
into a simple matrix.
08:31
Now here's a secret:
08:35
as an engineer, I get really excited
08:37
anytime I can reduce
something to the matrix.
08:39
From self-driving cars
08:42
to smartphones
08:44
to this holographic computer on my head,
08:46
machines are becoming capable
of understanding our world.
08:48
And they are starting to interact with us
08:53
in significantly more personal ways.
08:55
Now, imagine having granular control
09:00
over everything in the world.
09:03
Move the dial one way,
09:06
and you get reality.
09:10
Move the dial the other way,
09:13
and you get virtual reality.
09:17
Now, imagine dialing
your entire environment
09:21
between virtual and real worlds.
09:26
I love it down here.
09:34
Now, imagine if I could look at all of you
09:36
and dial from real humans into elves.
09:39
When technology truly
understands our world,
09:44
it will again transform
the ways we interact,
09:47
the ways we work and the ways we play.
09:51
Less than half a century ago,
09:59
two courageous men landed on the moon,
10:01
using computers that were less powerful
than the phones in your pockets.
10:04
Six hundred million humans watched them
10:08
on grainy, black-and-white televisions.
10:12
And the world?
10:15
The world was mesmerized.
10:16
Now imagine how our children
and their children
10:19
will experience the continued
exploration of space
10:24
with technology
that understands this world.
10:28
We already live in a world where
real-time universal translators exist.
10:33
And I can squint, and I can already
see holographic telepresence
10:37
in our near future.
10:43
In fact, since we've been lucky
with our demo so far,
10:44
let's try doing something else
even more crazy.
10:48
I invite you to experience,
10:50
for the first time anywhere in the world,
10:53
here on the TED stage,
10:56
a real-life holographic teleportation,
10:59
between me and my friend,
Dr. Jeffrey Norris,
11:03
from NASA's Jet Propulsion Laboratory.
11:07
Finger crossed. Hi, Jeff.
11:10
Jeff Norris: Hey, Alex.
11:14
Alex Kipman: Phew! That worked.
How are you doing today, Jeff?
11:15
(Applause)
11:18
JN: Doing great. I had an awesome week.
11:20
AK: So, can you tell us a little bit,
Jeff, about where you are?
11:22
JN: Well, I'm actually in three places.
11:28
I'm standing in a room across the street,
11:31
while I'm standing on this stage with you,
11:33
while I'm standing on Mars,
a hundred million miles away.
11:36
AK: Wow, a hundred million
miles away. This is crazy!
11:41
Can you tell us a little bit more
about where all this data
11:45
from Mars is coming from?
11:48
JN: Absolutely.
11:51
This is a precise
holographic replica of Mars,
11:53
built from data captured
by the Curiosity Mars Rover,
11:57
that I can explore as easily
as a place on Earth.
12:00
Humans are natural explorers.
12:04
We can instantly
understand an environment,
12:08
just by being present in it.
12:10
We've built tools like our Mars Rover
12:13
to extend our vision
and lengthen our reach.
12:15
But for decades,
12:19
we've explored from a seat
behind screens and keyboards.
12:21
Now, we're leaping over all of that,
12:26
over the giant antennas
and the relay satellites
12:29
and the vastness between worlds
12:32
to take our first steps on this landscape
as if we were truly there.
12:34
Today, a group of scientists
on our mission
12:41
are seeing Mars as never before --
12:43
an alien world made
a little more familiar,
12:47
because they're finally exploring it
as humans should.
12:50
But our dreams don't have to end
with making it just like being there.
12:55
When we dial this real world
to the virtual,
12:59
we can do magical things.
13:02
We can see in invisible wavelengths
13:04
or teleport to the top of a mountain.
13:07
Perhaps someday, we'll feel the minerals
in a rock just by touching it.
13:10
We're taking the first steps.
13:16
But we want the whole world
to join us in taking the next,
13:18
because this is not a journey for a few,
13:22
but for all of us.
13:25
AK: Thank you Jeff, this was amazing.
13:28
Thank you so much for joining us
on the TED stage today.
13:30
(Applause)
13:32
JN: Thank you Alex, bye bye.
13:39
AK: Bye, Jeff.
13:42
(Applause)
13:50
I dream about this future
13:57
every single day.
14:00
I take inspiration from our ancestors.
14:03
We used to live in tribes
where we interacted,
14:06
communicated and worked together.
14:09
We are all beginning to build technology
that will enable us to return
14:12
to the humanity that brought us
where we are today --
14:17
technology that will let us stop living
inside this 2D world
14:21
of monitors and pixels,
14:26
and let us start remembering
what it feels like
14:28
to live in our 3D world.
14:33
It's a phenomenal time to be human.
14:37
Thank you.
14:41
(Applause)
14:43
Helen Walters: Thanks so much.
I have some questions.
14:48
AK: OK.
14:50
HW: So there's been
some talk in the press.
14:51
And I'll just ask you straight,
then we have a straight answer.
14:54
There's been talk about the difference
between the demos
14:57
and the reality of the commercial product.
15:00
Talk about this field of view issue.
15:02
Is this type of experience what someone
who buys the product will get?
15:04
AK: It's a great question,
15:08
Or, said better, this is a question
we've been receiving
15:10
in the media for possibly the last year.
15:13
If you do your research,
I haven't answered that question.
15:16
I've purposely ignored it,
15:18
because ultimately,
it's the wrong question to ask.
15:20
That's the equivalent of me showing
holograms to someone for the first time,
15:23
and you then saying,
"What's the size of your television?"
15:29
The field of view for the product
is almost irrelevant.
15:33
What we should be talking about
is the density of lights,
15:36
or radiance, that shows up.
15:39
Better said, what the angular resolution
is of the things that you see.
15:41
So from that perspective, what you saw --
15:45
you know, the camera
is wearing a HoloLens.
15:47
So even if I wanted to cheat, I can't.
15:49
HW: But the camera has a different lens
on it than our eye. Right?
15:51
AK: The camera has a fish-eye lens on it.
15:54
It's seeing a much wider view
than the human eye is.
15:57
So if you think about the points of light
that show up radially
16:00
from the vision of the camera,
16:05
which is the thing that matters:
16:06
how many points of light
can I get in a given volume?
16:08
That's the same as I get
on this HoloLens as I will on that one.
16:10
Now, this camera sees
a much wider view of the world, right?
16:15
HW: Jesus Christ!
16:20
(Laughter)
16:21
AK: He did show up!
I told you he'd show up.
16:22
Come this way.
16:24
(Laughter)
16:25
HW: Oh, shit.
16:27
AK: And there's holographic Jeff Norris.
16:29
HW: I knew something was happening,
but I really wasn't sure what.
16:32
AK: So in short: to be super crisp,
16:35
the camera that you see on the screen
has a wider field of view
16:37
than the human eye.
16:40
But the angular resolution
of the holograms that you see,
16:41
the points of light per unit of area,
16:44
are actually the same.
16:48
HW: So you spent -- Jeff,
I'll get to you in a minute --
16:50
so you spent a lot of time
mapping the stage --
16:53
AK: That's right.
16:57
HW: So help me out here:
16:59
if I buy a HoloLens and have it at home,
17:00
I don't need to map my apartment, right?
17:02
AK: The HoloLens maps in real time
at about five frames per second,
17:04
with this technology
that we call spatial mapping.
17:08
So in your home, as soon as you put it on,
17:10
holograms will start showing up,
and you'll start placing them
17:13
and they'll start learning your home.
17:15
In a stage environment where we're trying
to get something on my head
17:17
to communicate with something over there
17:21
with all of the wireless connectivity
that usually brings all conferences down,
17:23
we don't take the risk
of trying to do this live.
17:27
So what we do is pre-map the stage
at five frames per second
17:31
with the same spatial-mapping technology
17:34
that you'll use with the product at home,
17:36
and then we store it,
17:38
so that when there's shenanigans
of wireless in an environment like this,
17:40
between the camera's HoloLens
and the one on my head,
17:43
we don't have things disappear.
17:46
Because ultimately, the holograms
are coming from this HoloLens,
17:48
and that one is just viewing the HoloLens.
17:51
So if I lose connectivity,
17:53
you would stop seeing
beautiful things on the screen.
17:55
HW: And it was beautiful.
17:58
Um ... Jeff?
17:59
JN: Yes?
18:02
HW: Hi.
18:04
AK: I'll take a step back.
18:07
HW: So Jeff, you were on Mars,
18:08
you were here, you were
in a room across the street.
18:11
Tell me more about the fact that,
with holograms, you have sight
18:14
but you don't have touch,
you don't have smell.
18:18
Is this scientifically useful now?
18:21
That's my question for a hologram.
18:24
JN: Thanks for the question.
18:26
Absolutely, I believe
that these technologies
18:28
are scientifically useful right now,
18:31
and that's why we're using them
in multiple parts of our work at NASA.
18:33
So we're using it to improve
the ways that we explore Mars.
18:37
We're also using it for our astronauts
on the space station.
18:41
We're even using it now to design
18:45
the next generation of our spacecraft.
18:47
HW: Amazing. OK, Jeff, please go away.
Thank you very much.
18:50
(Laughter)
18:53
Alex, really, that was amazing.
Thank you so much.
18:55
AK: Thank you.
18:59
HW: Thank you. Thank you.
19:00
(Applause)
19:01

sponsored links

Alex Kipman - Inventor
With his latest invention, HoloLens, Kinect creator Alex Kipman has opened a virtual holographic universe for users to explore -- and he may have changed the face of computing forever.

Why you should listen

In 2001, after graduating from RIT, Technical Fellow and inventor Alex Kipman joined Microsoft. In 2008 he created Kinect, the motion controller that revolutionized gaming and became the fastest-selling consumer device of all time, selling one million units on its first day of release.

Now Kipman has unveiled HoloLens, a jaw dropping device that turns everyday environments into interactive holographic worlds, mixing digital content right into our world. In addition to marking Microsoft's first foray into HMDs, HoloLens has the potential to turn computing as we know it inside out

sponsored links

If you need translations, you can install "Google Translate" extension into your Chrome Browser.
Furthermore, you can change playback rate by installing "Video Speed Controller" extension.

Data provided by TED.

This website is owned and operated by Tokyo English Network.
The developer's blog is here.