Hidden Brain - The Halo Effect
Episode Date: October 19, 2021In 1978, Judy, Lyn and Donna Ulrich were driving to a volleyball game when their Ford Pinto was hit from behind by a van. The Pinto caught fire, and the three teenagers died. This week, we revisit a 2...020 episode with a former Ford insider who played a key role in weighing the risks associated with the Pinto. And we consider what his story tells us about a question we all face: is it possible to fairly evaluate our past actions when we know how things turned out? If you like our work, please consider supporting it! See how you can help at support.hiddenbrain.org. And to learn more about human behavior and ideas that can improve your life, subscribe to our newsletter at news.hiddenbrain.org.
Transcript
Discussion (0)
From NPR, this is Hidden Brain, I'm Shankar Vedantam.
It's a summer evening in Northern Indiana.
Three teenagers are in their car, headed to a church sponsored volleyball game.
It's 1978.
The three Ulrich girls, sisters Judy and Lynn and their cousin Donna,
drive down US-33 in a Ford Pinter.
Judy is behind the wheel. She's 18, a recent high school graduate. Two years older than her little sister Lynn. Donna is also 18.
Around 6.30, Judy slows down. She's worried she might have left the cap to the gas tank on the trunk. She puts on her hazard
lights. A few seconds behind the pinto on the same road, Roger Dugger is driving a Chevy van.
He is looking for a cigarette pack on the floor. When he looks up, the slowing pinto is right in front of him. He's going about 50 miles per hour, and he doesn't have time to stop.
At first, Roger doesn't think the crash is that bad.
Then, he smells gasoline.
Later, reporters will recount testimony from a third driver who saw what happened.
There was a puff of flame about 12 to 18 inches long at the rear of the car.
Almost immediately, the pinto explodes into flames.
He said it was like a large napalm bomb going up.
Is it creamed down the highway and finally came to a stop. It was burning all the way.
The eyewitness gets out of his car with a fire extinguisher and runs over to see if he can help.
But he said the temperature and the heat was so intense that it was too hot to stay close to the car for very long.
By the time the first state trooper arrives, the pinto is scorched.
Inside the car, Lin and Donna are dead.
Judy is outside alive, but badly injured.
She's taken to a burned unit at a nearby hospital.
She lives for about nine more hours.
Before she dies, Judy tells the police what happened.
She also asks the nurse if her sister and cousin are okay.
The nurse tells her they lived.
Six months later, Judy and Lynn's mother
get something in the mail from the Ford Motor Company.
It's a recall notice for the car her daughters were killed in.
The Ford Pinto.
Today, we speak to a Ford insider who has asked himself a painful question.
Should he have done more to get the Pinto off the road?
Certain circles on the certifiable villain,
guilty of not protecting innocent, unsuspecting
people, driving a patently dangerous car.
This week on Hidden Brain, the minefield of hindsight bias.
While knowing how something turned out, shapes the way we think about everything that came
before it, and the insidious effect this has on our lives.
Our story today starts with long ago events,
but it's not really about the past.
It's about how, in the present, we think about the past, about the profound bias that
shapes such thinking and the effect this bias has on our lives.
We begin in 1970.
The American car industry was dominated by a handful of major companies.
There was General Motors, there was Chrysler, and there was another big one.
Ford. There was General Motors, there was Chrysler, and there was another big one.
Ford.
What makes Mustang number one?
Prisonality.
Elephants.
For a new decade.
The 1970 Thunderbird.
Ford, the wagon master.
But the new decade marked the end of an era of carefree
car buying in America.
of an era of carefree car buying in America.
The country was shedding its innocence. Young men were being drafted into the Vietnam War,
and the Nixon administration would soon be marred by scandal.
Two books, Rachel Carson's Silent Spring,
and Ralph Nader's unsafe at any any speed were in the zeitgeist.
More and more, cars were seen no longer as a symbol of freedom, but as a social problem.
American car companies felt on the siege from federal regulations at home and competition
from abroad.
Consumers were turning away from American cars to Mercedes-Benz's from Germany,
sleek jaguars from Britain, and small, fuel-efficient Toyota's and Honda's from Japan.
In 1969 alone, one million cars were imported into the United States.
If American car companies wanted to keep up, they needed to match what their competitors
were offering.
Ford's answer was an inexpensive, fuel-efficient, subcompact car, the Pinto.
This is an advertisement introducing the car.
It shows a fall, presumably a Pinto horse, alone in a field.
The horse gets to its feet and gallops around a banana yellow Ford Pinto car.
The commercial introduces a slogan for the car that would only become ironic later on.
The little carefree car.
Ford's president at the time, Leia Eccocca, had pushed for the Pinto when he was still a
vice president of the company.
He was set to have called the car, his baby.
The company codenamed the car his baby. The company codenamed the car Phoenix. Again, the irony of this
nickname would not be evident until much later. To boost gas mileage and reduce costs, the
Pinto had a stripped down minimalist design. Cars usually have a steel frame that supports
the engine, the transmission, the wheels and so on, and a body that goes on top of that. But the Pinto had just one piece. The body was the frame.
Executives at Ford were said to have mandated that their employees build a car that weighed
2000 pounds and cost 2000 dollars. Then, in 1973, something happened that made the Pinto a bonafide winner for Ford.
The OPEC nations have decided to cut oil production by 5% and continue cutting their oil production by an additional 5% each successive month until Israel withdraws from occupied-hour blends.
And the rights of Palestinian refugees is restored.
In October, the Organization of Petroleum Exporting Countries, OPEC,
slapped an embargo on oil ship to the United States.
The move was in response to US support of Israel during the 1973 Arab-Israeli war.
Soon, they were major oil shortages in the United States.
The price of gas skyrocketed.
Because of the fuel shortage, General Motors has ordered additional layoffs
affecting thousands of workers.
President Nixon even announced a new limit on interstate highway speeds.
I have called upon all the American people to drive their cars at 50 miles per hour. Interstate Highway Speeds. maybe a little longer to make the trip to see your mother-in-law. Maybe that wasn't a good idea. You wouldn't mind taking a little longer.
The oil crisis disrupted American life in ways that ranged from the serious to the absurd.
There's a governor who's wearing long johns, there's a professor in Georgia who says that
if we change the whole television schedule, make it earlier, people will go to bed earlier and save lights.
And a Michigan restaurant man wants his customers to ride horseback to dinner and he says,
if they do, he'll might throw in a bucket of oats with the meal.
All of this meant that Americans started to covet small, cheap cars with excellent gas
mileage, like the Ford Pinto.
Sales took off and the Pinto became crucial to Ford's bottom line.
But the decade that followed would not end well for Ford or the rest of the US car industry.
For the Pinto, its PR troubles began with a recall campaign led by Ralph Nader and a series of journalism exposés.
The most widely referenced of these was a 1977 feature in the magazine Mother Jones.
The article told the story of a woman and her 13-year-old passenger who suffered a fiery,
rear-end crash involving a pinto. The woman was killed and the boy was severely burned.
The mother-john's reporter, Mark Dawi, claimed this was not an isolated incident.
We estimate that 500 men and women and children have burned to death in Pinto's over the past
six years who would not have been seriously injured if the car had not burst into flames. That number, at least 500 deaths since 1971, or slightly more than 80 deaths on average
per year, has been hotly debated.
At the time, NPR reported that Ford said the number was pure exaggeration. In 1975, there were 848 deaths associated with passenger car accidents in which fires also
occurred in some parts of the vehicle.
Only 12 of these 848 reported fatalities involved occupants of pentose.
Later, Ford would say pentose had been involved in 35 cases of rear-impact fires.
Those fires, the company said, resulted in 23 burn injuries and 21 deaths.
An investigation by the National Highway Traffic Safety Administration came up with similar
numbers, 24 burns and 27 fatalities. Today, it's still unclear how many people died or were injured in these crashes.
Mark Dauy made other charges against the company too.
He wrote that Ford had rushed the Pinto into production, coming up with a new model in
just over two years, when that process usually took closer to 3.5 years. That shortened time frame, he wrote, had consequences.
For one, because of the accelerated schedule, crash testing happened after the basic design
was pretty much set. According to the Mother Jones story, these tests revealed that the Pinto was vulnerable in low-speed rear end crashes.
Over the years, multiple news organizations, including NPR, have highlighted potential problems with the Pinto's design.
Instead of installing the tank to the front of the rear axle where the car's back wheels were mounted,
it was placed behind the axle. There is virtually no crush area between the back of the car and the back of the gas tank.
Just a few inches of damage to the back end of the car brings the metal of the car or
the object that's producing the impact right up against the gas tank.
Some have argued that the Pinto's design wasn't much different from that of other small cars
being produced by American car companies. But there was one feature that made the Pinto stand out
from the herd, the studs. They're up at the top of the tank. They are again directly ahead of the
splash pan on the back of the car with no protection whatsoever. They're one of the first things
that actually gets hit,
but they're designed in such a manner that as they bend forward,
they can be pushed through the rear of the gas tank,
rupturing the tank.
These were bolts that protruded from the rear axle,
menacingly close to the low-hanging fuel tank.
If a pinter was hit from behind, even at low speed,
these bolts could poke holes in the fuel tank.
If that happened, oil could spill out and ignite at the smallest spark.
One lawyer called the studs, can openers.
The final charge that marked how he made against Ford had to do with the company Memo that
came to be infamous.
The memo laid out a cost-benefit analysis showing that fuel leakage in certain crashes
could potentially be prevented with alterations that would cost about $11 per car.
But the analysis determined that the cost of implementing these changes would not outweigh
quote, expected benefits. Here, the word benefit meant the potential for
lives saved and injuries avoided. In making its calculations, Ford valued a human life
at about $200,000, a number borrowed from a report by the National Highway Traffic Safety
Administration. The memo did not refer specifically to the Pinto. The calculations likely included all American cars.
Regardless, Mark Dauy's coverage of the memo painted a picture of Ford as a company that
was willing to prioritize profits over safety.
The 1991 movie class action is based in part on the story of the Pinto.
It depicts a car company making a cost-benefit analysis.
You have a defective part.
You make a decision whether to replace that part
in a recall or suffer the consequences of a lawsuit,
whichever's cheaper.
Is that correct?
Ford faced a slew of civil lawsuits
relating to Pinto rear end collisions.
There was even a criminal trial.
In Indiana Ford was indicted for three felony counts of reckless homicide for the accident
that killed Judy, Lynn and Donna Ulrich, the three teenagers whose story we heard at
the top of the episode.
Ford was found not guilty, but the Pinto never really recovered its reputation.
The car would go on to become the butt of jokes everywhere, in movies, on late-night TV,
and in cartoons on newspaper editorial pages.
In May of 1978, a federal agency issued an initial determination that the Pinto's fuel system
was defective. The National Highways Traffic Safety Commission yesterday issued a tentative finding that 1,930,000
Ford Pintos and Mercury Bobcats may be dangerous.
Not long after, Ford agreed to voluntarily recall one and a half million Pintos.
The story of the Fort Pinto, seen from the vantage point of today, is almost a parable.
It's seen as a warning sign about the risks of hubris and averis.
But as I said, our story today is not about the Pinto.
It's not about relitigating what Ford knew and when. It's about how we think about the past.
When we come back, what psychology reveals about the mind of a Ford insider who voted
not to recall the Pintel and is now haunted by the choices he made.
Denny Joya came of age during an era of big changes in the United States.
I was marching for civil rights, for women's rights, and against the attitude of big business
at the time.
He had long hair and wanted to make the world a better place. He started with
the classes in his MBA program. I was the guy who would speak up and saying,
shouldn't we account for the employees or the customers in this situation?
In 1972, Denny cut his hair and took his first corporate job with the Ford Motor Company.
He loved cars and he thought by becoming an insider, he might be able to shape Ford for
the better.
I decided, with intent, to try to change this lumbering behemoth from the inside out.
He rose quickly at Ford, propelled by his expertise and his competitive spirit. About a year in, he was
just 26. Denny became Ford's recall coordinator. So you were 26 and you were playing a role to
basically decide where the cars get recalled? I mean, that's astonishing.
Never occurred to me that it was astonishing, but yeah, I guess it was.
I was rather low in the hierarchy, but it was an extraordinarily powerful position in the
sense that if I picked up the phone and called anybody and identified myself as Danny
Joya from the recall office, people jumped. And it got to be pretty interesting to watch people who were ranked much higher than I
was in the organization, leap to fulfill my every need.
But that was the nature of the job.
And it was a very important job.
I had to track everything that might become a recall.
And so I started a file on everything,
and the information for those files came from field reports.
Ford had a series of field engineers,
as I recall, the R2 in every state, and their job was to fill out a sheet
identifying a potential problem, and they would send it to me.
Denny would pour through crash reports, looking for patterns of something going wrong over
and over again.
Breaks failing, wheels falling off, axles detaching and startling drivers, he had
to keep a file on everything. But he was always on the lookout for two specific things.
I had two criteria for deciding what should be a recall. One was what I called traceable
cause. Something had to be breaking. I mean, I'm an engineer. You can't just engage
in magical thinking because somebody somewhere says that there's a problem. You have to have
evidence. So I had to have documentation that something was breaking and I had to see
a pattern of failures. I never went to recall unless I had at least 20.
In other words, he needed more than anecdotes.
He needed data.
If he had evidence and could identify a pattern, then he would put the case up for a vote,
to recall or not to recall.
There were five people in his office, and everyone got a vote.
If they voted to recall, he would send the case up to a high-level executive committee
that would make the final decision.
If the committee agreed with Denny's group, he would then initiate a recall.
By the time Denny became Ford's recall coordinator, the Pinto had been on the market for about
three years.
In retrospect, we know so much about the Pinto that Denny did not know in the early
1970s.
We know it would soon become one of the most hated cars in America, the subject of journalistic
and federal investigations, and eventually a national recall.
At each 26, Denny did not know any of that. Nor he says
did he know about any of the early crash tests or design flaws that were later detailed
in the Mother Jones Exposé. To the Denny of 1973, the Pinto was just another car that came
up from time to time in reports. Early on, the Pinto wasn't even really on his radar
until I got a filled out field report
that was different from any I had ever seen.
That had photographs stapled front and back
from an engineer and he said to me,
I spent all day on this God-for-sacant car. I can't find a thing wrong with it, except
that it's a tin can. By which he meant, it's a little car, got hit by a big car, it lit
up, what did you expect?
The car had caught fire in a collision. Now, Danny had an incident, but still no cause, and definitely no pattern.
So he did what he always did.
He started a file on the pinto and began to track it.
Danny took his job as recall coordinator seriously. When he first started in the role, he would wake up at night
and stare at his bedroom ceiling, worried that he might have made a decision that day that hurt
someone. That feeling eventually went away. It had to. You can't have emotions rise to the
surface if you're going to be an effective recall coordinator. You've got to get over
that. How do you get over having an emotional response to somebody? Somebody dying in one
of your products? Well, it's not easy, but you do it.
Not long after he started his file on the Pinto, Denny had an encounter that challenged
his efforts to stay focused on the data rather than his feelings.
It happened in a company warehouse that Ford Insiders called the Chamber of Horrors.
That's where all the horrible pieces came that had broken and often hurt or killed somebody. I was out there one day when I saw a burned out
pinto off in the corner under a tarp. I don't know if you've ever seen a burned
out car. I have not. No. Everything's melted. All the
upholstery is gone, burned away. The paint is burned off, the wiring is melted,
the glass is melted, the steering wheel is melted.
And when you learn that that car was actually a death vehicle,
it will turn your stomach.
Still, when he got back to the office and looked in his Pinto file, he only had five cases
involving rear end fires.
He had no identifiable cause or pattern.
In other words, he was nowhere near his usual standard for recommending the case for a recall
vote.
But he decided to do it anyway.
So despite my training, when I saw that car,
and despite the fact that I only had five field reports,
I nonetheless put it on the docket for a vote.
And when you brought it up to the five-person committee,
was there a robust argument?
Was there a discussion?
Did people just sort of roll their eyes at you?
What would actually happen?
Oh, I could have's a good description.
Yes, they roll their eyes at me.
Why are we doing this?
Because you had an emotional response to seeing a burned out
Pinto, that's, that's not good enough.
We got to have data.
How many you got?
What's the pattern?
That's not a pattern. Those could
all be outliers. If you're an engineer, you have to think that way.
Now, there's actually, you know, you can criticize this, but you can also say this is actually
the correct way to think, because of course anecdotally, things happen all the time that
are idiosyncratic to a particular car or a particular situation, the weather conditions might be bad, something happens.
And if you basically base your judgments on one case,
I mean, presumably we'd be recalling every car off the road,
because every car is probably going to have some
idiosyncratic case where something goes wrong, no?
Oh, absolutely.
Now, now think about this.
We're looking at a car that has been built in the cheapest way
possible. And given that it's a cheap vehicle, you can identify 50 things that
cost five to ten dollars to fix. If you want to take a blanket approach and fix
everything, suddenly you've got a car that nobody's willing to buy.
That's not okay, especially in an era when the only thing people are buying is a Pinto.
When it came down to a vote, Denny's office elected 5-0, not to recall.
Even Denny voted against himself.
Even Denny voted against himself. It wasn't until about a year later that Denny says something strange happened.
Denny says that one day in 1974 he walked into his office and saw a report lying upside down on his desk.
It turned out to be an old engineering report from 1970, the early days of the Pinto,
that showed why the cars were catching fire. By now, you can probably guess the culprits,
the low-hanging fuel tank, and the studs that could rupture the tank like a can opener.
It was what I call a slap-your-for-head moment, because it revealed that the Pinto's rear
axle was an off-the-shelf component, which is to say it was used in some other application
by the Ford Motor Company.
That application was the Ford of Europe Capri.
That car was more complicated.
It had anchor points, called studs, on the rear axle to which suspension arms were attached.
But when it was used in the Pinto, they didn't need those suspension arms, so they deleted
them.
But they did not delete the studs to which the suspension arms were attached.
The bolts were intended for a different kind of car with a different design.
So what happened when the car was hit from behind at the federally mandated speed of 50 kilometers or 31
miles an hour. The fuel tank got pushed and got punctured by these four studs
that were protruding. Wow. If the accident was anywhere over 25 miles an hour,
it ripped the fuel filler neck out, sprayed gasoline all over the place,
including into the rear seats. If there's a spark anywhere in
the vicinity, it's going to light up. Secondly, if it's anything over 25 miles an hour,
it's going to, it's going to accordion the car. The doors get pinned shut. So you're trapped in a car that is just exploded into a
fireball and you cannot get out. My God. This is a very ugly accident.
Today, Denny says he still does not know who put the engineering report on his desk.
But in 1974, he knew what he had to do.
He called Ford's executive committee overseeing recalls.
And I said, in effect, get ready. We've got a big one coming.
Denny says Ford decided to see how the Pinto compared to other cars in the industry.
According to Denny, Ford bought some competitor cars with layout similar to the Pinto,
but without the start problem, and tested them.
And what they found was the average speed at which those cars fuel tanks would rupture.
Was about 27. half miles an hour.
Wait, almost the same.
Pretty close.
25 versus 27 and a half.
So what do you do now?
Let me put you in the position
of being the recall coordinator.
How would you vote?
Would you vote to spend $30 million for two and a half miles an hour?
Now it leads to a really interesting dilemma because when you hear these numbers, you can
get sucked in.
You can go, the math doesn't add up.
And yes, human lives are at stake, but what's the value that should prevail here?
So if it's a values-based decision, of course you recall.
Of course you recall.
But if it's a business decision,
do you spend $30 million for two and a half
miles an hour when the cars that have a problem are not statistically significantly different
from the cars that don't? I don't know what to do.
Still, Denny had to make a decision and for the second time, he voted
not to recall the Pinto.
Denny left Ford in 1975. Three years later, Ford admitted there was a problem and recalled the car.
When we look back at moments in our lives that turned out badly, it can be easy to say
what we might have done differently.
We zero in on the moment things went wrong and say, that's what did it.
That's the moment I would go back and change.
In hindsight, it all seems like common sense.
But what if it isn't so simple?
What if these thoughts say less about the past and more about us, about the comfort we
seek in dealing with a chaotic and unpredictable world?
Stay with us. When something good happens, we tend to think that everything that led up to it
was also good. If a rocket launch is successful, then we assume all the preparation and engineering that
went into it must have been handled well too. And when something bad happens, let's say a plane crashes or a company goes bankrupt,
our first question usually is, who messed up? Hidden in this question is an assumption many of us make.
If there's a bad outcome, then the processes that led up to it must have been flawed too.
So when we think about the fiery accident that killed the three Ulrich girls in 1978, it's
easy to look at someone like Denny Joyer and say, there must have been something in his
recall process that was rotten.
Some big failure or misstep that he could and should have prevented.
But an engineer at On Sociologist Duncan Watts says we shouldn't jump to that conclusion
so quickly.
He says this
way of thinking reveals something fundamental about the way we often fail to
understand the past and plan for the future. To explain this idea, Duncan tells a
story about another car crash. This is a terrible story and I picked it because it's a
terrible story. This time instead of a Ford Pinto, the car is a minivan.
It's the summer of 2001 in Brooklyn.
Joseph Gray is wrapping up an overnight shift at the precinct where he works as a police officer.
I was actually supposed to be golf that day and it was kind of like overcast and drizzling a little bit in the morning.
This is Steve from an interview Joseph Gray did a few years later with a statin island advance.
When Joseph's golf plans are cancelled...
He decided to have a couple of beers with his colleagues.
We wound up in a bar and then, you know, that was that.
And a couple of beers turns into 12, 13, 15 beers, he spends all day drinking and then he
gets in his mini van and he drives home. So he's well, well, over the limit, more than double
the legal limit. And on the way home, he has the terrible accident. I remember going to hit the brakes as soon as I saw somebody
able to buy that and just to lay.
He runs a red light and he hits a young family.
These next details are hard to describe.
Maria Herrera and her 16-year-old sister are crossing the street.
They are killed instantly. Maria's four-year-old sister, crossing the street. They are killed instantly.
Maria's four-year-old son is with them.
His body is dragged 100 feet under the Minivan's bumper.
Maria is also eight months pregnant.
Later, her child is delivered by Cesarean section,
but he doesn't survive.
Joseph Gray is a face of a criminal trial and he is just, you know, understandably demonized
by the media, by the family of the victim, by her husband.
Eventually, Joseph receives a maximum sentence of 15 years.
At the time, a lot of people felt that wasn't long enough, like Joseph was getting off easy.
What punishment could possibly be severe enough for such a terrible accident?
But pay attention to this word, accident.
We want to think that this incident was caused by Joseph Grey's recklessness, and of course,
it was.
But what's harder to think about are all the other things that had to happen for the
accident to occur.
What if it hadn't been raining that morning and Joseph Gray went golfing instead of to
the bar?
What if he went to the bar and got drunk, but the bartender had told him he couldn't
drive and called him a cab?
What if he had started driving, but got stopped
before he hit the Herrera family?
Let's imagine that everything that happened happened,
except that two minutes before he had the accident,
Joseph Gray got pulled over by another police officer.
What do you think would have happened?
He would have been one of these people who gets caught with a high
alcohol level driving and people say, oh, that's really bad. You shouldn't do that.
And you know, you should maybe you should lose your license for six months and
you should do some community service or, you know, pay a fine. But nobody would say,
you're a murderer. You're a monster. In this scenario where Joseph Gregg gets
pulled over before he can hurt anyone,
there's nothing in his behavior that is any different. He behaves exactly the same way he did in
the real-life scenario when he killed Maria and her family. Of course, when Joseph decided to get
behind the wheel after so many beers, he made it much more likely that something bad would happen.
But in the hypothetical situation where no one gets hurt, it's not because Joseph decided
not to drink and drive.
In this other world, he would have behaved in exactly the same irresponsible way.
And nobody would think that he should go to jail for 20 years.
Or else, if they do, then there's a lot of people who should be going to jail for 20 years.
Anybody who's texting while driving or anybody who's had a few drinks too many, anybody who's distracted,
all of these people are potentially going to kill somebody.
And there's some other random thing out there that is determining whether something bad happens or not. This idea that outcomes might in part be random and the result of
good luck or bad luck can make us uncomfortable. When something happens good or bad, we are
powerfully motivated to see the hand of intentionality and purpose.
This bad thing happened because that bad person did something.
Take that away from us and we are left not just with the terror of randomness, but the
terror of meaninglessness.
People associate randomness with an absence of meaning and I've often actually gotten
this response from people
when I sort of walk them through this logic,
they sort of look at me with this tired expression
on their face and say, then nothing means anything, right?
And I sort of find that to be a strange response
because meaning is something that we create.
The world doesn't create meaning. The world just does whatever the world does.
We're the ones who decide what it means.
So if you randomly get on a plane or get bumped onto a different flight one day
and the person you sit next to becomes your spouse,
that will be a tremendously meaningful event, right, in your life.
But it's still random.
In a complex world, random things are bound to happen all the time.
Most are mundane, some are delightful, a few are heartbreaking.
We are mostly okay when the random shapes the mundane, the traffic light turns red
as I pull up at the intersection. But when it comes to good things, and especially when it comes
to bad things, the notion that wonderful and terrible things happen for no reason leaves us
dissatisfied, uneasy. I ask Duncan why he thinks this is. The short answer is I don't know. My best guess is
that it's extremely adaptive to believe that you understand the world, right? That you want to think
that you know what's going to happen because that means you can get out of bed, you can take action,
you can invest in the future. And I think that's probably where it comes from, is that it's just a sort of adaptive
response to the uncertainty of the world.
Duncan is not saying that Joseph Grace punishment was too harsh or too lenient.
He's saying that because we know what happened to the Herrera family, it changes
how we think about Joseph Gray's actions. Yes, we might be willing to concede that many
random things had to happen for the tragedy to occur, but we prefer to ignore them when
we make our calculus of right and wrong. We focus on Joseph Gray's negligence because
it gives us a feeling of control.
We can do something about Joseph Gray.
We can lock him up and throw away the key.
We can't do anything about all the other random stuff, and that's terrifying.
The same thing could be said of the Fort Pinto.
Once something terrible has occurred,
it becomes nearly impossible to look back on the actions of the people involved, with any sense of dispassion.
Our psychological defense systems demand a tidy explanation.
We shrink away from anything that suggests messiness, randomness, uncertainty.
randomness, uncertainty.
It's possible there was negligence or wrongdoing at Ford. Over the years, some have claimed that Ford didn't intentionally make a dangerous car,
while others have argued that the early Pinto crash test revealed that executives at Ford
knew the Pinto was a dangerous car even
before it left the assembly line.
We reached out to Ford for comment and they declined our request.
But our story isn't about the executives at Ford and what they did or did not know.
It's about Denny Joyer, a mid-level employee who says he did not know about the Pinto's fuel tank problem until he
discovered the mysterious report on his desk in 1974.
Up until that moment, and through the end of his tenure at Ford in 1975, Denny followed
a clear process for deciding whether to recall cars.
Since the company couldn't initiate a recall every time something went wrong with any car
on the road, it needed a system for determining if a problem was a real problem or just a fluke.
If Denny wanted to recommend a recall, he needed to be able to show two things,
evidence that something was broken and a pattern of failure.
The Pinto never rose to that standard.
Denny sent up red flags about the car twice, but both times he looked at the evidence himself
and voted not to recall.
You might hear this and think we're letting Denny off the hook.
Maybe Denny should have resigned in protest when he saw the burned out Pinto in the company
warehouse.
Or maybe he should have blown the whistle to the media when the mysterious report turned
up on his desk.
Or maybe he should have just voted to recall the Pinto even if it meant ignoring his
standard.
That last thought has plagued Denny himself.
In certain circles I'm a certifiable villain guilty of not protecting innocent, unsuspecting
people, driving a patently dangerous car.
This is tape from a voice memo Denny sent us in 2019.
It was in response to a callout seeking stories from listeners who felt haunted by something
in their past.
Am I haunted by something in their past. the right thing, and voted not to recall the pinto.
Denny's conscience is heavy with the same question that Duncan Watts is asking.
Just because the outcome was bad, does that mean that Denny did the wrong thing, back when
he was at Ford?
Do the terrible deaths of the three Ulrich girls mean that Denny's criteria for instigating
a recall were
bad. Or is it possible that sometimes bad things happen even when good people are doing
their best? This is very hard to accept psychologically. Bad outcomes cast a halo around everything
that came before them and it's next to impossible to see through the halo to reality.
Duncan Watts again.
So the halo effect shows up in lots of circumstances
where, you know, for example, people who are good-looking
tend to be rated as more intelligent than people
who are not good-looking.
Even though looks and intelligence have nothing to do with each other,
that is just something that our human psychology does.
And the same thing is true for success and failure.
So if a company is successful, we look at the things that it's doing and we say,
well, those must be really good things, right?
Those are good processes. Now that good leadership, good teamwork, good communication,
good vision, good execution. And if the same company is not successful, we say, oh, all those things are bad.
This halo effect really is very deep and profound and hard to shake, right?
We think we're evaluating a process that led to some outcome, but really we're just reflecting the outcome itself.
And this really gets in the way of evaluating processes.
The story of Danny Joya is more than just a story about a car company and a defective car.
It's a story about how we think about the past and what that means for how we think about
the future.
When we look back, our minds create stories that explain how events came about.
We trace bad things to bad people, good things to good people.
We already know how things turned out, so it's easy to
telepart the good guys from the bad guys. But notice how this breaks down when we
think not of the past, but of the future. Now, we don't have the final outcome to
guide our conclusions. Now, things look confusing. Messy. Random. Just like now,
everybody's saying, well, of course, we had a pandemic. You
know, people were warning about it. If only we'd paid attention to them. We would have
stopped this, right? So we really, we have this view that whether we explicitly say it
or not, that, you know, there is this thread that goes from the past into the future.
We think that there is this one trajectory that the world is going to take.
And if only we were smart enough, we could somehow know what thread that is.
And that is wrong.
And there is no thread.
There is just sort of an infinite cloud of possibilities. The future
has not been created yet.
What did that infinite cloud of possibilities look like to Denny in 1974? Let's try to
time travel back to the Ford recall office that year. Denny is looking through his files
on Ford's various vehicles. He looks a little tired, maybe from another sleepless night worrying about work. As we watch him,
perhaps he opens his file on the pinto. We can tell it's bothering him,
but it has not yet risen to a standard for recommending a recall.
So he closes the file and gets back to his other work.
This younger Denny does not know what we know,
that the file he just put away will be the beginning of a long and terrible ordeal.
Of course, even in our imaginary time machine,
it's difficult to ignore what we already know.
Even Denny, who lived through it, has trouble getting back in his 27-year-old head.
So if you were to go back in time right now to make that decision over again based on
the data that you're telling me, if you could just go back with your, with, with more maturity
and experience, but not necessarily the knowledge of how things turned out for Ford, would you
vote differently?
The honest answer is I don't know.
I told Duncan Watts about the Fort Pinto story, and shared with him Denny's intuition.
Denny's a situation where he knows something terrible has happened, but the techniques and
rules he had to detect problems
did not alert him that there was a problem.
So he's not quite sure right now
whether to abandon his rules or to accept that
sometimes good rules lead to bad consequences.
If you accept the process that they had at the time
as the right process, then I think I agree with him, right? Like, you know, it's very hard for him to
to unlearn what he knows now, but you know, he can't for sure say that he would have made a
different decision because he believes that they had a good process. And it just happens to be a
good process that didn't work in that particular case. All of this begs a question. How much do we really understand about the past? How much
can we understand? According to Duncan, not much. That's why he advocates for something called
epistemic humility. We should be humble about what we think we know and even humble about what we think we know, and even humble about what we can know.
And I think that if we just were more comfortable
with not knowing the answers to things,
we would be less confident about the answers
that we come up with,
and we would be less inclined to make confident predictions
based on really
shaky assumptions, right?
And I believe that would help us to avoid some particularly damaging overreaches associated
with hubris.
But where does that leave us?
What do we do once we realize we don't know as much about the past as we think we do.
In a world shaped by epistemic humility, we would commission reports and launch congressional
inquiries not just when things go wrong, but also when they go right.
We would see that good outcomes can sometimes be produced by bad systems.
We would ask how we can fix problems that haven't happened.
We might also be more humble when it comes to confident conclusions when things go wrong.
Yes, it's easy, pleasurable even, to blame our political opponents or our rivals when
tragedy strikes. But it would be more honest to acknowledge that the choices that led to bad outcomes were made in the context of confusion and doubt.
The uncertainty we all experience when we think about the future, that same confusion was experienced by Kat Shuknecht and Parth Shah. It was edited by Tara Boyle and
Raina Cohen. Our team includes Laura Quarral, Jenny Schmidt and Thomas Liu. Engineering support from Joshua Noah.
Our unsung hero this week is Erin Register.
Erin is an associate project manager at NPR,
but her business cards should probably read
person who makes things happen.
Erin is the person who brings together different teams
from across NPR to make sure the launch of new shows
and other big projects go smoothly.
Her job is one part hurting cats, one part people management, both difficult tasks that
she handled beautifully.
Thanks so much for everything you've done to help us at Hidden Brain, Erin.
For more Hidden Brain, you can follow us on Facebook and Twitter. If you liked this episode, please be sure to share it with a friend.
I'm Shankar Vedantam, and this is NPR.
you