16:09
TEDGlobal 2013

Raffaello D'Andrea: The astounding athletic power of quadcopters

Filmed:

In a robot lab at TEDGlobal, Raffaello D'Andrea demos his flying quadcopters: robots that think like athletes, solving physical problems with algorithms that help them learn. In a series of nifty demos, D'Andrea show drones that play catch, balance and make decisions together -- and watch out for an I-want-this-now demo of Kinect-controlled quads.

- Autonomous systems pioneer
Raffaello D'Andrea explores the possibilities of autonomous technology by collaborating with artists, engineers and entrepreneurs. Full bio

So what does it mean for a machine to be athletic?
00:23
We will demonstrate the concept of machine athleticism
00:26
and the research to achieve it
00:29
with the help of these flying machines called quadrocopters,
00:31
or quads, for short.
00:34
Quads have been around for a long time.
00:38
The reason that they're so popular these days
00:40
is because they're mechanically simple.
00:42
By controlling the speeds of these four propellers,
00:44
these machines can roll, pitch, yaw,
00:46
and accelerate along their common orientation.
00:49
On board are also a battery, a computer,
00:52
various sensors and wireless radios.
00:55
Quads are extremely agile, but this agility comes at a cost.
00:59
They are inherently unstable, and they need some form
01:03
of automatic feedback control in order to be able to fly.
01:06
So, how did it just do that?
01:16
Cameras on the ceiling and a laptop
01:19
serve as an indoor global positioning system.
01:21
It's used to locate objects in the space
01:23
that have these reflective markers on them.
01:26
This data is then sent to another laptop
01:28
that is running estimation and control algorithms,
01:30
which in turn sends commands to the quad,
01:32
which is also running estimation and control algorithms.
01:34
The bulk of our research is algorithms.
01:41
It's the magic that brings these machines to life.
01:44
So how does one design the algorithms
01:48
that create a machine athlete?
01:50
We use something broadly called model-based design.
01:52
We first capture the physics with a mathematical model
01:55
of how the machines behave.
01:58
We then use a branch of mathematics
02:00
called control theory to analyze these models
02:03
and also to synthesize algorithms for controlling them.
02:05
For example, that's how we can make the quad hover.
02:09
We first captured the dynamics
02:12
with a set of differential equations.
02:14
We then manipulate these equations with the help
02:16
of control theory to create algorithms that stabilize the quad.
02:18
Let me demonstrate the strength of this approach.
02:23
Suppose that we want this quad to not only hover
02:29
but to also balance this pole.
02:31
With a little bit of practice,
02:34
it's pretty straightforward for a human being to do this,
02:36
although we do have the advantage of having
02:38
two feet on the ground
02:40
and the use of our very versatile hands.
02:41
It becomes a little bit more difficult
02:44
when I only have one foot on the ground
02:47
and when I don't use my hands.
02:49
Notice how this pole has a reflective marker on top,
02:52
which means that it can be located in the space.
02:55
(Applause)
03:04
You can notice that this quad is making fine adjustments
03:10
to keep the pole balanced.
03:13
How did we design the algorithms to do this?
03:15
We added the mathematical model of the pole
03:19
to that of the quad.
03:21
Once we have a model of the combined quad-pole system,
03:22
we can use control theory to create algorithms for controlling it.
03:25
Here, you see that it's stable,
03:30
and even if I give it little nudges,
03:32
it goes back to the nice, balanced position.
03:34
We can also augment the model to include
03:40
where we want the quad to be in space.
03:41
Using this pointer, made out of reflective markers,
03:44
I can point to where I want the quad to be in space
03:47
a fixed distance away from me.
03:49
The key to these acrobatic maneuvers is algorithms,
04:07
designed with the help of mathematical models
04:10
and control theory.
04:13
Let's tell the quad to come back here
04:15
and let the pole drop,
04:17
and I will next demonstrate the importance
04:19
of understanding physical models
04:20
and the workings of the physical world.
04:23
Notice how the quad lost altitude
04:37
when I put this glass of water on it.
04:39
Unlike the balancing pole, I did not include
04:41
the mathematical model of the glass in the system.
04:44
In fact, the system doesn't even know that the glass of water is there.
04:46
Like before, I could use the pointer to tell the quad
04:49
where I want it to be in space.
04:52
(Applause)
04:55
Okay, you should be asking yourself,
05:05
why doesn't the water fall out of the glass?
05:07
Two facts: The first is that gravity acts
05:09
on all objects in the same way.
05:12
The second is that the propellers are all pointing
05:15
in the same direction of the glass, pointing up.
05:17
You put these two things together, the net result
05:20
is that all side forces on the glass are small
05:23
and are mainly dominated by aerodynamic effects,
05:25
which as these speeds are negligible.
05:28
And that's why you don't need to model the glass.
05:35
It naturally doesn't spill no matter what the quad does.
05:37
(Applause)
05:50
The lesson here is that some high-performance tasks
05:57
are easier than others,
06:01
and that understanding the physics of the problem
06:03
tells you which ones are easy and which ones are hard.
06:05
In this instance, carrying a glass of water is easy.
06:08
Balancing a pole is hard.
06:10
We've all heard stories of athletes
06:14
performing feats while physically injured.
06:15
Can a machine also perform
06:18
with extreme physical damage?
06:19
Conventional wisdom says that you need
06:22
at least four fixed motor propeller pairs in order to fly,
06:24
because there are four degrees of freedom to control:
06:28
roll, pitch, yaw and acceleration.
06:30
Hexacopters and octocopters, with six and eight propellers,
06:33
can provide redundancy,
06:36
but quadrocopters are much more popular
06:37
because they have the minimum number
06:39
of fixed motor propeller pairs: four.
06:41
Or do they?
06:44
If we analyze the mathematical model of this machine
07:01
with only two working propellers,
07:04
we discover that there's an unconventional way to fly it.
07:06
We relinquish control of yaw,
07:19
but roll, pitch and acceleration can still be controlled
07:21
with algorithms that exploit this new configuration.
07:24
Mathematical models tell us exactly when
07:33
and why this is possible.
07:36
In this instance, this knowledge allows us to design
07:38
novel machine architectures
07:40
or to design clever algorithms that gracefully handle damage,
07:42
just like human athletes do,
07:46
instead of building machines with redundancy.
07:48
We can't help but hold our breath when we watch
07:52
a diver somersaulting into the water,
07:54
or when a vaulter is twisting in the air,
07:57
the ground fast approaching.
07:58
Will the diver be able to pull off a rip entry?
08:00
Will the vaulter stick the landing?
08:03
Suppose we want this quad here
08:05
to perform a triple flip and finish off
08:06
at the exact same spot that it started.
08:09
This maneuver is going to happen so quickly
08:11
that we can't use position feedback to correct the motion during execution.
08:13
There simply isn't enough time.
08:17
Instead, what the quad can do is perform the maneuver blindly,
08:19
observe how it finishes the maneuver,
08:23
and then use that information to modify its behavior
08:25
so that the next flip is better.
08:28
Similar to the diver and the vaulter,
08:30
it is only through repeated practice
08:32
that the maneuver can be learned and executed
08:34
to the highest standard.
08:36
(Applause)
08:46
Striking a moving ball is a necessary skill in many sports.
08:51
How do we make a machine do
08:54
what an athlete does seemingly without effort?
08:56
(Applause)
09:15
This quad has a racket strapped onto its head
09:22
with a sweet spot roughly the size of an apple, so not too large.
09:25
The following calculations are made every 20 milliseconds,
09:28
or 50 times per second.
09:31
We first figure out where the ball is going.
09:33
We then next calculate how the quad should hit the ball
09:36
so that it flies to where it was thrown from.
09:38
Third, a trajectory is planned that carries the quad
09:41
from its current state to the impact point with the ball.
09:46
Fourth, we only execute 20 milliseconds' worth of that strategy.
09:49
Twenty milliseconds later, the whole process is repeated
09:53
until the quad strikes the ball.
09:56
(Applause)
10:07
Machines can not only perform dynamic maneuvers on their own,
10:10
they can do it collectively.
10:13
These three quads are cooperatively carrying a sky net.
10:15
(Applause)
10:28
They perform an extremely dynamic
10:33
and collective maneuver
10:36
to launch the ball back to me.
10:38
Notice that, at full extension, these quads are vertical.
10:40
(Applause)
10:48
In fact, when fully extended,
10:50
this is roughly five times greater than what a bungee jumper feels
10:52
at the end of their launch.
10:55
The algorithms to do this are very similar
11:03
to what the single quad used to hit the ball back to me.
11:05
Mathematical models are used to continuously re-plan
11:09
a cooperative strategy 50 times per second.
11:11
Everything we have seen so far has been
11:16
about the machines and their capabilities.
11:18
What happens when we couple this machine athleticism
11:20
with that of a human being?
11:23
What I have in front of me is a commercial gesture sensor
11:25
mainly used in gaming.
11:29
It can recognize what my various body parts
11:30
are doing in real time.
11:32
Similar to the pointer that I used earlier,
11:34
we can use this as inputs to the system.
11:36
We now have a natural way of interacting
11:39
with the raw athleticism of these quads with my gestures.
11:41
(Applause)
12:22
Interaction doesn't have to be virtual. It can be physical.
12:35
Take this quad, for example.
12:39
It's trying to stay at a fixed point in space.
12:41
If I try to move it out of the way, it fights me,
12:44
and moves back to where it wants to be.
12:48
We can change this behavior, however.
12:52
We can use mathematical models
12:55
to estimate the force that I'm applying to the quad.
12:57
Once we know this force, we can also change the laws of physics,
13:00
as far as the quad is concerned, of course.
13:03
Here the quad is behaving as if it were
13:07
in a viscous fluid.
13:10
We now have an intimate way
13:14
of interacting with a machine.
13:16
I will use this new capability to position
13:18
this camera-carrying quad to the appropriate location
13:21
for filming the remainder of this demonstration.
13:23
So we can physically interact with these quads
13:36
and we can change the laws of physics.
13:38
Let's have a little bit of fun with this.
13:41
For what you will see next, these quads
13:43
will initially behave as if they were on Pluto.
13:45
As time goes on, gravity will be increased
13:48
until we're all back on planet Earth,
13:51
but I assure you we won't get there.
13:53
Okay, here goes.
13:55
(Laughter)
14:05
(Laughter)
14:34
(Applause)
14:37
Whew!
14:41
You're all thinking now,
14:46
these guys are having way too much fun,
14:48
and you're probably also asking yourself,
14:50
why exactly are they building machine athletes?
14:52
Some conjecture that the role of play in the animal kingdom
14:56
is to hone skills and develop capabilities.
14:58
Others think that it has more of a social role,
15:01
that it's used to bind the group.
15:03
Similarly, we use the analogy of sports and athleticism
15:05
to create new algorithms for machines
15:08
to push them to their limits.
15:11
What impact will the speed of machines have on our way of life?
15:13
Like all our past creations and innovations,
15:16
they may be used to improve the human condition
15:19
or they may be misused and abused.
15:22
This is not a technical choice we are faced with;
15:24
it's a social one.
15:26
Let's make the right choice,
15:28
the choice that brings out the best in the future of machines,
15:29
just like athleticism in sports
15:32
can bring out the best in us.
15:33
Let me introduce you to the wizards behind the green curtain.
15:36
They're the current members of the Flying Machine Arena research team.
15:39
(Applause)
15:42
Federico Augugliaro, Dario Brescianini, Markus Hehn,
15:47
Sergei Lupashin, Mark Muller and Robin Ritz.
15:50
Look out for them. They're destined for great things.
15:53
Thank you.
15:54
(Applause)
15:56
Translated by Joseph Geni
Reviewed by Morton Bast

▲Back to top

About the Speaker:

Raffaello D'Andrea - Autonomous systems pioneer
Raffaello D'Andrea explores the possibilities of autonomous technology by collaborating with artists, engineers and entrepreneurs.

Why you should listen

Raffaello D'Andrea combines academics, business, and the arts to explore the capabilities of autonomous systems. As part of his research as professor of dynamic systems and control at the Swiss Federal Institute of Technology (ETH Zürich), he and his collaborators enchant viewers with works like the self-destructing, self-assembling Robotic Chair, or the Balancing Cube that can perch itself on its corners.

D’Andrea and his team created the Flying Machine Arena to test the gravity-defying abilities of their athletic flying robots. Building on research in the Flying Machine Arena, ETH Zürich partnered with its spin-off company Verity Studios and with Cirque du Soleil to create “Sparked,” a short film showcasing the unexpected airborne dexterity of quadcopters. D’Andrea is the co-founder of Kiva Systems, a robotics company that develops intelligent automated warehouse systems and that was acquired by Amazon in 2012.

More profile about the speaker
Raffaello D'Andrea | Speaker | TED.com