sponsored links
TEDGlobal 2005

Steven Levitt: Surprising stats about child carseats

July 12, 2005

Steven Levitt shares data that shows car seats are no more effective than seatbelts in protecting kids from dying in cars. However, during the question and answer session, he makes one crucial caveat.

Steven Levitt - Economist
Steven Levitt's eye-opening Freakonomics took economic theory into the real world of suburban parenting and urban drug gangs, turning conventional wisdom upside-down. Full bio

sponsored links
Double-click the English subtitles below to play the video.
Once upon a time, there was a dread disease that afflicted children.
00:18
And in fact, among all the diseases that existed in this land,
00:23
it was the worst. It killed the most children.
00:27
And along came a brilliant inventor, a scientist,
00:30
who came up with a partial cure for that disease.
00:33
And it wasn't perfect. Many children still died,
00:36
but it was certainly better than what they had before.
00:40
And one of the good things about this cure was that it was free,
00:43
virtually free, and was very easy to use.
00:49
But the worst thing about it was that you couldn't use it
00:51
on the youngest children, on infants, and on one-year-olds.
00:54
And so, as a consequence, a few years later,
00:58
another scientist -- perhaps maybe this scientist
01:00
not quite as brilliant as the one who had preceded him,
01:02
but building on the invention of the first one --
01:06
came up with a second cure.
01:08
And the beauty of the second cure for this disease
01:11
was that it could be used on infants and one-year-olds.
01:14
And the problem with this cure was it was very expensive,
01:18
and it was very complicated to use.
01:23
And although parents tried as hard as they could to use it properly,
01:24
almost all of them ended up using it wrong in the end.
01:28
But what they did, of course, since it was so complicated and expensive,
01:32
they only used it on the zero-year-olds and the one-year-olds.
01:35
And they kept on using the existing cure that they had
01:38
on the two-year-olds and up.
01:41
And this went on for quite some time. People were happy.
01:42
They had their two cures. Until a particular mother,
01:44
whose child had just turned two, died of this disease.
01:47
And she thought to herself, "My child just turned two,
01:52
and until the child turned two, I had always used
01:56
this complicated, expensive cure, you know, this treatment.
02:00
And then the child turned two, and I started using
02:05
the cheap and easy treatment, and I wonder" --
02:06
and she wondered, like all parents who lose children wonder --
02:09
"if there isn't something that I could have done,
02:11
like keep on using that complicated, expensive cure."
02:13
And she told all the other people, and she said,
02:17
"How could it possibly be that something
02:20
that's cheap and simple works as well as something
02:22
that's complicated and expensive?"
02:25
And the people thought, "You know, you're right.
02:27
It probably is the wrong thing to do to switch
02:29
and use the cheap and simple solution."
02:31
And the government, they heard her story and the other people,
02:34
and they said, "Yeah, you're right, we should make a law.
02:37
We should outlaw this cheap and simple treatment
02:40
and not let anybody use this on their children."
02:42
And the people were happy. They were satisfied.
02:45
For many years this went along, and everything was fine.
02:47
But then along came a lowly economist, who had children himself,
02:50
and he used the expensive and complicated treatment.
02:55
But he knew about the cheap and simple one.
03:02
And he thought about it, and the expensive one
03:04
didn't seem that great to him. So he thought,
03:06
"I don't know anything about science, but I do know something about data,
03:09
so maybe I should go and look at the data
03:12
and see whether this expensive and complicated treatment
03:14
actually works any better than the cheap and simple one."
03:18
And lo and behold, when he went through the data,
03:21
he found that it didn't look like the expensive, complicated
03:23
solution was any better than the cheap one,
03:26
at least for the children who were two and older --
03:29
the cheap one still didn't work on the kids who were younger.
03:31
And so, he went forth to the people and he said,
03:34
"I've made this wonderful finding:
03:38
it looks as if we could just use the cheap and simple solution,
03:40
and by doing so we could save ourselves 300 million dollars a year,
03:43
and we could spend that on our children in other ways."
03:46
And the parents were very unhappy, and they said,
03:48
"This is a terrible thing, because how can the cheap and easy thing
03:52
be as good as the hard thing?" And the government was very upset.
03:54
And in particular, the people who made this expensive solution
03:58
were very upset because they thought,
04:01
"How can we hope to compete with something that's essentially free?
04:03
We would lose all of our market."
04:06
And people were very angry, and they called him horrible names.
04:08
And he decided that maybe he should leave the country
04:11
for a few days, and seek out some more intelligent,
04:14
open-minded people in a place called Oxford,
04:18
and come and try and tell the story at that place.
04:21
And so, anyway, here I am. It's not a fairy tale.
04:24
It's a true story about the United States today,
04:28
and the disease I'm referring to is actually
04:30
motor vehicle accidents for children.
04:33
And the free cure is adult seatbelts, and the expensive cure --
04:36
the 300-million-dollar-a-year cure -- is child car seats.
04:42
And what I'd like to talk to you about today
04:46
is some of the evidence why I believe this to be true:
04:48
that for children two years old and up,
04:51
there really is no real benefit -- proven benefit -- of car seats,
04:53
in spite of the incredible energy
04:58
that has been devoted toward expanding the laws
05:03
and making it socially unacceptable
05:06
to put your children into seatbelts. And then talk about why --
05:08
what is it that makes that true?
05:13
And then, finally talk a little bit about a third way,
05:14
about another technology, which is probably better than anything we have,
05:17
but which -- there hasn't been any enthusiasm for adoption
05:20
precisely because people are so enamored
05:23
with the current car seat solution. OK.
05:25
So, many times when you try to do research on data,
05:28
it records complicated stories -- it's hard to find in the data.
05:31
It doesn't turn out to be the case when you look at seatbelts versus car seats.
05:35
So the United States keeps a data set
05:38
of every fatal accident that's happened since 1975.
05:40
So in every car crash in which at least one person dies,
05:43
they have information on all of the people.
05:46
So if you look at that data -- it's right up on the National Highway
05:48
Transportation Safety Administration's website --
05:51
you can just look at the raw data,
05:53
and begin to get a sense of the limited amount of evidence
05:55
that's in favor of car seats for children aged two and up.
05:59
So, here is the data. Here I have, among two- to six-year-olds --
06:02
anyone above six, basically no one uses car seats,
06:06
so you can't compare -- 29.3 percent of the children who are unrestrained
06:08
in a crash in which at least one person dies, themselves die.
06:14
If you put a child in a car seat, 18.2 percent of the children die.
06:18
If they're wearing a lap-and-shoulder belt, in this raw data,
06:23
19.4 percent die. And interestingly, wearing a lap-only seatbelt,
06:25
16.7 percent die. And actually, the theory tells you
06:30
that the lap-only seatbelt's got to be worse
06:32
than the lap-and-shoulder belt. And that just reminds you
06:35
that when you deal with raw data, there are hundreds
06:36
of confounding variables that may be getting in the way.
06:38
So what we do in the study is -- and this is just presenting
06:41
the same information, but turned into a figure to make it easier.
06:46
So the yellow bar represents car seats,
06:49
the orange bar lap-and-shoulder, and the red bar lap-only seatbelts.
06:52
And this is all relative to unrestrained --
06:56
the bigger the bar, the better. Okay.
06:58
So, this is the data I just showed, OK?
06:59
So the highest bar is what you're striving to beat.
07:01
So you can control for the basic things, like how hard the crash was,
07:04
what seat the child was sitting in, etc., the age of the child.
07:08
And that's that middle set of bars.
07:12
And so, you can see that the lap-only seatbelts
07:14
start to look worse once you do that.
07:17
And then finally, the last set of bars,
07:19
which are really controlling for everything
07:21
you could possibly imagine about the crash,
07:24
50, 75, 100 different characteristics of the crash.
07:26
And what you find is that the car seats and the lap-and-shoulder belts,
07:29
when it comes to saving lives, fatalities look exactly identical.
07:32
And the standard error bands are relatively small around these estimates as well.
07:36
And it's not just overall. It's very robust
07:40
to anything you want to look at.
07:43
One thing that's interesting: if you look at frontal-impact crashes --
07:45
when the car crashes, the front hits into something --
07:48
indeed, what you see is that the car seats look a little bit better.
07:51
And I think this isn't just chance.
07:55
In order to have the car seat approved,
07:57
you need to pass certain federal standards,
07:58
all of which involve slamming your car into a direct frontal crash.
08:01
But when you look at other types of crashes, like rear-impact crashes,
08:06
indeed, the car seats don't perform as well.
08:08
And I think that's because they've been optimized to pass,
08:11
as we always expect people to do,
08:13
to optimize relative to bright-line rules
08:15
about how affected the car will be.
08:17
And the other thing you might argue is,
08:21
"Well, car seats have got a lot better over time.
08:22
And so if we look at recent crashes --
08:24
the whole data set is almost 30 years' worth of data --
08:27
you won't see it in the recent crashes. The new car seats are far, far better."
08:29
But indeed, in recent crashes the lap-and-shoulder seatbelts,
08:31
actually, are doing even better than the car seats.
08:35
They say, "Well, that's impossible, that can't be."
08:38
And the line of argument, if you ask parents, is,
08:41
"But car seats are so expensive and complicated,
08:43
and they have this big tangle of latches,
08:46
how could they possibly not work better than seatbelts
08:49
because they are so expensive and complicated?"
08:52
It's kind of an interesting logic,
08:54
I think, that people use. And the other logic, they say,
08:57
"Well, the government wouldn't have told us [to] use them
09:00
if they weren't much better."
09:02
But what's interesting is the government telling us to use them
09:04
is not actually based on very much.
09:06
It really is based on some impassioned pleas of parents
09:08
whose children died after they turned two,
09:11
which has led to the passage of all these laws -- not very much on data.
09:14
So you can only get so far, I think, in telling your story
09:18
by using these abstract statistics.
09:22
And so I had some friends over to dinner, and I was asking --
09:24
we had a cookout -- I was asking them what advice they might have for me
09:29
about proving my point. They said, "Why don't you run some crash tests?"
09:32
And I said, "That's a great idea."
09:36
So we actually tried to commission some crash tests.
09:38
And it turns out that as we called around to the independent
09:40
crash test companies around the country,
09:45
none of them wanted to do our crash test
09:48
because they said, some explicitly, some not so explicitly,
09:50
"All of our business comes from car seat manufacturers.
09:54
We can't risk alienating them by testing seatbelts relative to car seats."
09:56
Now, eventually, one did. Under the conditions of anonymity,
10:00
they said they would be happy to do this test for us --
10:04
so anonymity, and 1,500 dollars per seat that we crashed.
10:07
And so, we went to Buffalo, New York,
10:12
and here is the precursor to it.
10:14
These are the crash test dummies,
10:16
waiting for their chance to take the center stage.
10:18
And then, here's how the crash test works.
10:21
Here, they don't actually crash the entire car, you know --
10:23
it's not worth ruining a whole car to do it.
10:26
So they just have these bench seats,
10:29
and they strap the car seat and the seatbelt onto it.
10:30
So I just wanted you to look at this.
10:32
And I think this gives you a good idea of why parents think
10:34
car seats are so great. Look at the kid in the car seat.
10:36
Does he not look content, ready to go,
10:38
like he could survive anything? And then, if you look at the kid in back,
10:41
it looks like he's already choking before the crash even happens.
10:43
It's hard to believe, when you look at this, that
10:46
that kid in back is going to do very well when you get in a crash.
10:49
So this is going to be a crash
10:51
where they're going to slam this thing forward into a wall
10:53
at 30 miles an hour, and see what happens. OK?
10:56
So, let me show you what happens.
10:59
These are three-year-old dummies, by the way.
11:01
So here -- this is the car seat. Now watch two things:
11:04
watch how the head goes forward,
11:06
and basically hits the knees -- and this is in the car seat --
11:08
and watch how the car seat flies around, in the rebound, up in the air.
11:10
The car seat's moving all over the place.
11:15
Bear in mind there are two things about this.
11:17
This is a car seat that was installed by someone
11:19
who has installed 1,000 car seats, who knew exactly how to do it.
11:22
And also it turned out these bench seats
11:25
are the very best way to install car seats.
11:26
Having a flat back makes it much easier to install them.
11:29
And so this is a test that's very much rigged in favor of the car seat,
11:32
OK? So, that kid in this crash fared very well.
11:35
The federal standards are
11:38
that you have to score below a 1,000
11:40
to be an approved car seat on this crash,
11:42
in some metric of units which are not important.
11:44
And this crash would have been about a 450.
11:48
So this car seat was actually an above-average car seat
11:51
from Consumer Reports, and did quite well.
11:53
So the next one. Now, this is the kid, same crash,
11:55
who is in the seatbelt. He hardly moves at all, actually,
11:58
relative to the other child. The funny thing is,
12:03
the cam work is terrible because they've only set it up
12:06
to do the car seats, and so, they actually don't even have a way
12:09
to move the camera so you can see the kid that's on the rebound.
12:11
Anyway, it turns out that those two crashes, that actually
12:13
the three-year-old did slightly worse. So, he gets about a 500
12:17
out of -- you know, on this range -- relative to a 400 and something.
12:21
But still, if you just took that data from that crash
12:25
to the federal government, and said, "I have invented a new car seat.
12:28
I would like you to approve it for selling,"
12:31
then they would say, "This is a fantastic new car seat, it works great.
12:34
It only got a 500, it could have gotten as high up as a 1,000."
12:37
And this seatbelt would have passed with flying colors
12:39
into being approved as a car seat.
12:42
So, in some sense, what this is suggesting
12:44
is that it's not just that people are setting up their car seats wrong,
12:46
which is putting children at risk. It's just that, fundamentally,
12:49
the car seats aren't doing much.
12:51
So here's the crash. So these are timed at the same time,
12:53
so you can see that it takes much longer with the car seat --
12:55
at rebound, it takes a lot longer --
12:57
but there's just a lot less movement for child who's in the seatbelt.
12:59
So, I'll show you the six-year-old crashes as well.
13:03
The six-year-old is in a car seat, and it turns out
13:05
that looks terrible, but that's great. That's like a 400, OK?
13:10
So that kid would do fine in the crash.
13:15
Nothing about that would have been problematic to the child at all.
13:16
And then here's the six-year-old in the seatbelt,
13:20
and in fact, they get exactly within, you know,
13:23
within one or two points of the same. So really, for the six-year-old,
13:25
the car seat did absolutely nothing whatsoever.
13:29
That's some more evidence, so in some sense --
13:33
I was criticized by a scientist, who said, "You could never publish
13:36
a study with an n of 4," meaning those four crashes.
13:40
So I wrote him back and I said, "What about an n of 45,004?"
13:42
Because I had the other 45,000 other real-world crashes.
13:46
And I just think that it's interesting that the idea
13:48
of using real-world crashes, which is very much something
13:52
that economists think would be the right thing to do,
13:54
is something that scientists don't actually, usually think --
13:56
they would rather use a laboratory,
13:58
a very imperfect science of looking at the dummies,
14:01
than actually 30 years of data of what we've seen
14:03
with children and with car seats.
14:07
And so I think the answer to this puzzle
14:10
is that there's a much better solution out there,
14:14
that's gotten nobody excited because everyone
14:17
is so delighted with the way car seats are presumably working.
14:20
And if you think from a design perspective,
14:24
about going back to square one, and say,
14:27
"I just want to protect kids in the back seat."
14:29
I don't there's anyone in this room who'd say,
14:31
"Well, the right way to start would be,
14:33
let's make a great seat belt for adults.
14:34
And then, let's make this really big contraption
14:37
that you have to rig up to it in this daisy chain."
14:39
I mean, why not start -- who's sitting in the back seat anyway except for kids?
14:42
But essentially, do something like this,
14:45
which I don't know exactly how much it would cost to do,
14:48
but there's no reason I could see
14:50
why this should be much more expensive than a regular car seat.
14:51
It's just actually -- you see, this is folding up -- it's behind the seat.
14:53
You've got a regular seat for adults, and then you fold it down,
14:57
and the kid sits on top, and it's integrated.
14:59
It seems to me that this can't be a very expensive solution,
15:01
and it's got to work better than what we already have.
15:05
So the question is, is there any hope for adoption of something like this,
15:08
which would presumably save a lot of lives?
15:13
And I think the answer, perhaps, lies in a story.
15:15
The answer both to why has a car seat been so successful,
15:19
and why this may someday be adopted or not,
15:23
lies in a story that my dad told me, relating to when he was a doctor
15:26
in the U.S. Air Force in England. And this is a long time ago:
15:30
you were allowed to do things then you can't do today.
15:33
So, my father would have patients come in
15:35
who he thought were not really sick.
15:39
And he had a big jar full of placebo pills that he would give them,
15:42
and he'd say, "Come back in a week, if you still feel lousy."
15:46
OK, and most of them would not come back,
15:49
but some of them would come back.
15:50
And when they came back, he, still convinced they were not sick,
15:52
had another jar of pills. In this jar were huge horse pills.
15:56
They were almost impossible to swallow.
16:01
And these, to me, are the analogy for the car seats.
16:03
People would look at these and say, "Man, this thing is so big
16:07
and so hard to swallow. If this doesn't make me feel better,
16:11
you know, what possibly could?"
16:13
And it turned out that most people wouldn't come back,
16:16
because it worked. But every once in a while,
16:18
there was still a patient convinced that he was sick,
16:21
and he'd come back. And my dad had a third jar of pills.
16:26
And the jar of pills he had, he said,
16:29
were the tiniest little pills he could find,
16:31
so small you could barely see them.
16:34
And he would say, listen, I know I gave you that huge pill,
16:36
that complicated, hard-to-swallow pill before,
16:38
but now I've got one that's so potent,
16:42
that is really tiny and small and almost invisible.
16:44
It's almost like this thing here, which you can't even see."
16:46
And it turned out that never,
16:49
in all the times my dad gave out this pill, the really tiny pill,
16:51
did anyone ever come back still complaining of sickness.
16:54
So, my dad always took that as evidence
16:57
that this little, teeny, powerful pill
17:00
had the ultimate placebo effect. And in some sense, if that's the right story,
17:04
I think integrated car seats you will see, very quickly,
17:08
becoming something that everyone has. The other possible conclusion
17:10
is, well, maybe after coming to my father three times,
17:14
getting sent home with placebos, he still felt sick,
17:17
he went and found another doctor.
17:19
And that's completely possible. And if that's the case,
17:21
then I think we're stuck with conventional car seats for a long time to come.
17:23
Thank you very much.
17:26
(Applause)
17:27
(Audience: I just wanted to ask you, when we wear seatbelts
17:31
we don't necessarily wear them just to prevent loss of life,
17:33
it's also to prevent lots of serious injury.
17:36
Your data looks at fatalities. It doesn't look at serious injury.
17:38
Is there any data to show that child seats
17:42
are actually less effective, or just as effective as seatbelts
17:44
for serious injury? Because that would prove your case.)
17:47
Steven Levitt: Yeah, that's a great question. In my data, and in another data set
17:49
I've looked at for New Jersey crashes,
17:52
I find very small differences in injury.
17:55
So in this data, it's statistically insignificant differences
17:59
in injury between car seats and lap-and-shoulder belts.
18:01
In the New Jersey data, which is different,
18:05
because it's not just fatal crashes,
18:06
but all crashes in New Jersey that are reported,
18:09
it turns out that there is a 10 percent difference in injuries,
18:11
but generally they're the minor injuries.
18:14
Now, what's interesting, I should say this as a disclaimer,
18:16
there is medical literature that is very difficult to resolve with this other data,
18:18
which suggests that car seats are dramatically better.
18:23
And they use a completely different methodology that involves --
18:27
after the crash occurs, they get from the insurance companies
18:29
the names of the people who were in the crash,
18:32
and they call them on the phone,
18:34
and they asked them what happened.
18:35
And I really can't resolve, yet,
18:36
and I'd like to work with these medical researchers
18:39
to try to understand how there can be these differences,
18:41
which are completely at odds with one another.
18:44
But it's obviously a critical question.
18:47
The question is even if -- are there enough serious injuries
18:50
to make these cost-effective? It's kind of tricky.
18:53
Even if they're right, it's not so clear
18:56
that they're so cost-effective.
18:58

sponsored links

Steven Levitt - Economist
Steven Levitt's eye-opening Freakonomics took economic theory into the real world of suburban parenting and urban drug gangs, turning conventional wisdom upside-down.

Why you should listen

With his 2005 book Freakonomics (co-authored with Stephen Dubner, a writer who profiled him for the New York Times), Steven Levitt carried hardcore economic method into the squishy real world and produced a pop-culture classic. Freakonomics is both an economics textbook and a series of cautionary tales about the fallacy of conventional wisdom. Levitt examines the links between real-world events, and finds many instances where the data simply doesn't back up popular belief.

He asks provocative questions: If selling crack is so lucrative, why do dealers live with their mothers? Does parental doting really improve children's test scores? Did New York City's crime rate really drop because of police tactics (or population trends)? His controversial answers stir debate, and sometimes backlash.

Read Steven Levitt's Reddit AMA >>

The original video is available on TED.com
sponsored links

If you need translations, you can install "Google Translate" extension into your Chrome Browser.
Furthermore, you can change playback rate by installing "Video Speed Controller" extension.

Data provided by TED.

This website is owned and operated by Tokyo English Network.
The developer's blog is here.