sponsored links
TEDGlobal 2010

Peter Molyneux: Meet Milo, the virtual boy

July 9, 2010

Peter Molyneux demos Milo, a hotly anticipated video game for Microsoft's Kinect controller. Perceptive and impressionable like a real 11-year-old, the virtual boy watches, listens and learns -- recognizing and responding to you.

Peter Molyneux - Game changer
The head of Microsoft's European games division, Peter Molyneux is building an astonishing new "virtual friend" who interacts with you. Full bio

sponsored links
Double-click the English subtitles below to play the video.
When I saw a piece of technology called Kinect --
00:16
it was called Natal -- I was inspired,
00:19
and I thought for a moment,
00:22
maybe it's possible
00:24
to address that one problem of storytelling,
00:26
to create a character
00:29
which seemed alive,
00:32
which noticed me,
00:34
that could look me in the eyes
00:36
and feel real,
00:38
and sculpt a story about our relationship.
00:40
And so a year ago,
00:43
I showed this off
00:46
at a computer show called E3.
00:48
And this was a piece of technology
00:51
with someone called Claire interacting with this boy.
00:53
And there was a huge row online
00:56
about, "Hey, this can't be real."
00:59
And so I waited till now
01:02
to have an actual demo
01:04
of the real tech.
01:06
Now, this tech incorporates
01:08
three big elements.
01:10
The first is a Kinect camera,
01:12
which will be out in November,
01:14
some incredible AI
01:17
that was hidden in the dusty vaults,
01:19
collecting dust
01:22
in Microsoft,
01:24
plus our quite crude
01:26
attempts at AI
01:28
at a company called Lionhead,
01:30
mixing all those things together
01:33
just to get to this one simple idea:
01:35
to create a real, living
01:38
being in a computer.
01:41
Now, I'll be honest with you
01:43
and say that most of it
01:46
is just a trick,
01:48
but it's a trick that actually works.
01:50
So why don't we go over and have
01:53
a look at the demo now.
01:55
This is Dimitri.
01:57
Dimitri, just waggle your arm around.
01:59
Now, you notice he's sitting.
02:02
There are no controllers,
02:04
no keyboards,
02:06
or mice,
02:08
or joysticks, or joypads.
02:10
He is just going to use
02:13
his hand, his body and his voice,
02:15
just like humans interact with their hands, body and voice.
02:18
So let's move forward.
02:21
You're going to meet Milo for the first time.
02:23
We had to give him a problem
02:27
because when we first created Milo,
02:29
we realized that he came across as a little bit of a brat,
02:31
to be honest with you.
02:33
He was quite a know-it-all,
02:35
and he wanted to kind of make you laugh.
02:37
So the problem we introduced to him was this:
02:39
he's just moved house.
02:41
He's moved from London
02:43
to New England, over in America.
02:45
His parents are too busy
02:48
to listen to his problems,
02:50
and that's when he starts almost conjuring you up.
02:52
So here he is
02:55
walking through the grass.
02:57
And you're able to interact with his world.
02:59
The cool thing is, what we're doing
03:02
is we're changing the mind
03:05
of Milo constantly.
03:07
That means no two people's Milos
03:09
can be the same.
03:12
You're actually sculpting a human being here.
03:14
So, he's discovering the garden.
03:19
You're helping him discover the garden
03:21
by just pointing out these snails.
03:23
Very simple at the start.
03:27
By the way, if you are a boy, it's snails;
03:29
if you're a girl, it's butterflies
03:32
because what we found was that girls hate snails.
03:35
(Laughter)
03:38
So remember, this is the first time you've met him,
03:44
and we really want to draw you in and make you more curious.
03:47
His face, by the way,
03:52
is fully AI-driven.
03:54
We have complete control over his blush responses,
03:56
the diameter of his nostrils
03:59
to denote stress.
04:02
We actually do something called body matching.
04:04
If you're leaning forward,
04:06
he will try and slightly change
04:08
the neuro-linguistic nature of his face,
04:10
because we went out with this strong idea:
04:13
how can we make you believe that something's real?
04:15
Now we've used the hand.
04:18
The other thing to use is your body.
04:20
Why not just, instead of pushing left and right
04:23
with a mouse or with a joypad,
04:26
why not use your body just to lean on the chair --
04:29
again, relaxed?
04:31
You can lean back,
04:33
but the camera will change its perspective
04:35
depending on which way you're looking.
04:37
So Dimitri's now going to use --
04:41
he's used his hand; he's used his body.
04:43
He's now going to use the other thing which is essential,
04:45
and that's his voice.
04:48
Now, the thing about voice is,
04:50
our experience with voice recognition
04:52
is pretty awful, isn't it?
04:54
It never works.
04:56
You order an airline ticket; you end up in Timbuktu.
04:58
So we've tackled that problem,
05:02
and we've come up with a solution, which we'll see in a second.
05:04
Milo: I could just squish it.
05:07
Peter Molyneux: What are you going to do, Dimitri?
05:09
Female Voice: Squashing a snail may not seem important,
05:11
but remember, even this choice
05:13
will affect how Milo develops.
05:15
Do you want Milo to squash it?
05:18
When you see the microphone,
05:20
say ... (PM: Squash.) ... yes to decide.
05:22
Dimitri: Go on, Milo. Squash it.
05:24
PM: No. That's the wrong thing to do.
05:27
Now look at his response.
05:29
He said, "Go on, Milo. Squash it."
05:31
What we're using there is,
05:34
we're using something, a piece of technology called Tellme.
05:36
It's a company that Microsoft acquired some years ago.
05:38
We've got a database of words which we recognize.
05:41
We pick those words out.
05:43
We also reference that
05:45
with the tonation database
05:47
that we build up of Dimitri's voice,
05:49
or the user's voice.
05:52
Now we need to have a bit more engagement,
05:54
and again, what we can do
05:57
is we can look at the body.
05:59
And we'll do that in a second.
06:01
Milo: I wonder how deep it is.
06:03
Deep.
06:13
PM: Okay. So what we're going to do now
06:16
is teach Milo to skim stones.
06:18
We're actually teaching him.
06:21
It's very, very interesting
06:23
that men, more than women,
06:25
tend to be more competitive here.
06:27
They're fine with teaching Milo for the first few throws,
06:30
but then they want to beat Milo,
06:33
where women,
06:35
they're more nurturing about this.
06:37
Okay, this is skimming stones.
06:43
How do you skim stones?
06:45
You stand up,
06:48
and you skim the stone.
06:51
It's that simple.
06:53
Just recognizing your body,
06:55
recognizing the body's motions, the tech,
06:57
understanding that you've gone
06:59
from sitting down to standing up.
07:01
Again, all of this is done
07:04
in the way us humans do things,
07:06
and that's crucially important
07:08
if we want Milo to appear real.
07:11
Female Voice: See if you can inspire him to do any better.
07:13
Try hitting the boat.
07:21
Milo: Ahhh. So close.
07:25
PM: That's Dimitri at his most competitive.
07:33
Now beaten an 11-year-old child. Well done.
07:35
Milo: Okay.
07:39
PM: So, Milo's being called back in by his parents,
07:42
giving us time to be alone
07:45
and to help him out.
07:47
Basically -- the bit that we missed at the start --
07:49
his parents had asked him to clean up his room.
07:51
And we're going to help him with this now.
07:54
But this is going to be an introduction,
07:56
and this is all about the deep psychology that we're trying to use.
07:58
We're trying to introduce you
08:01
to what I believe is the most wonderful part,
08:03
you being able to talk
08:06
in your natural voice to Milo.
08:08
Now, to do that, we needed a set up,
08:11
like a magician's trick.
08:13
And what we did was,
08:15
we needed to give Milo this big problem.
08:17
So as Dimitri
08:19
starts tidying up,
08:22
you can overhear a conversation
08:24
that Milo's having with his parents.
08:26
Milo's Mom: Oh, you've got gravy all over the floor. (Milo: I didn't mean to!)
08:28
Milo's Mom: That carpet is brand new.
08:30
PM: So he's just spilled
08:32
a plate of sausages on the floor,
08:34
on the brand-new carpet.
08:36
We've all done it as parents; we've all done it as children.
08:38
Now's a chance for Dimitri
08:41
to kind of reassure and calm Milo down.
08:43
It's all been too much for him.
08:45
He's just moved house. He's got no friends.
08:47
Now is the time
08:50
when we open that portal
08:52
and allow you to talk to Milo.
08:54
Female Voice: Why don't you try saying something encouraging
08:57
to cheer Milo up.
09:00
Dimitri: Come on, Milo. You know what parents are like.
09:02
They're always getting stressed.
09:04
Milo: What do they want to come here for anyway?
09:08
We don't know anyone.
09:12
Dimitri: Well, you've got a new school to go to.
09:15
You're going to meet loads of cool, new friends.
09:17
Milo: I just really miss my old house, that's all.
09:22
Dimitri: Well, this is a pretty awesome house, Milo.
09:28
You've got a cool garden to play in and a pond.
09:30
Milo: It was good skimming stones.
09:37
This looks nice.
09:47
You cleaned up my room.
09:50
Thanks.
09:52
PM: So after three-quarters of an hour,
09:54
he recognizes you.
09:56
And I promise you, if you're sitting in front of this screen,
09:58
that is a truly wonderful moment.
10:01
And we're ready now
10:04
to tell a story about his childhood and his life,
10:06
and it goes on,
10:08
and he has, you know, many adventures.
10:10
Some of those adventures are a little bit dark or on the darker side.
10:12
Some of those adventures are wonderfully encouraging --
10:15
he's got to go to school.
10:17
The cool thing is
10:19
that we're doing as well:
10:21
as you interact with him,
10:23
you're able to put things into his world; he recognizes objects.
10:25
His mind is based in a cloud.
10:28
That means Milo's mind,
10:31
as millions of people use it,
10:33
will get smarter and cleverer.
10:35
He'll recognize more objects
10:37
and thus understand more words.
10:39
But for me,
10:41
this is a wonderful opportunity
10:43
where technology, at last, can be connected with,
10:45
where I am no longer restrained
10:48
by the finger I hold in my hand --
10:50
as far as a computer game's concerned --
10:52
or by the blandness of not being noticed
10:54
if you're watching a film or a book.
10:56
And I love those revolutions,
10:59
and I love the future that Milo brings.
11:02
Thank you very much indeed.
11:04
(Applause)
11:06

sponsored links

Peter Molyneux - Game changer
The head of Microsoft's European games division, Peter Molyneux is building an astonishing new "virtual friend" who interacts with you.

Why you should listen

Game geeks have been buzzing about Project Natal for, seemingly, ever -- Microsoft's now-in-development gaming device that goes the Wii one better by allowing your whole body to become the joystick, using touchless, visual-recognition interface technology. What kind of game will be played on this immersive new equipment? Peter Molyneux is working on one that redefines the whole notion of "game" -- Milo.

Milo is a little boy (there's also to be a little girl, Kate) who quite simply acts like a little boy, learning your name, talking with you, going on walks around the lake. It's an immersive, slightly uncanny experience, as seen in the single year-old demo that's still blowing minds on YouTube. Molyneux himself is a game-industry legend who has created many titles. In 1997 he founded Lionhead Studios, makers of Fable, a role-playing game. Microsoft bought Lionhead in 2006, and will release the much-anticipated Fable III in the fall.

The original video is available on TED.com
sponsored links

If you need translations, you can install "Google Translate" extension into your Chrome Browser.
Furthermore, you can change playback rate by installing "Video Speed Controller" extension.

Data provided by TED.

This website is owned and operated by Tokyo English Network.
The developer's blog is here.