Hidden Brain - Playing Favorites
Episode Date: June 9, 2020If we do a favor for someone we know, we think we've done a good deed. What we don't tend to ask is: Who have we harmed by treating this person with more kindness than we show toward others? This week..., in the second of our two-part series on moral decision-making, we consider how actions that come from a place of love can lead to a more unjust world.
Transcript
Discussion (0)
From NPR, this is Hidden Brain, I'm Shankar Vedantam.
If you had to choose a romantic partner,
would you pick someone who was equally wonderful to everyone,
including you, or someone who was especially wonderful to you?
It's a question that fascinates Lalene Anik.
I am an assistant professor at University of Virginia in
Stardin School of Business. Lalene and her colleague, Ryan Ryan Hauser ran a set of studies to figure out if people want
a partner whose equal opportunity in their attention or someone who reserved special treatment
for them.
What we find in the paper is people want to be treated uniquely.
The urge to be treated special was so strong that people were willing to pay a price for
it.
Take the example of a birthday message.
Imagine that your partner writes a Facebook message that is long and beautiful.
But there's a catch.
Your partner writes this sort of long, birthday message all the time for everyone.
If this message goes to everybody, people say, I don't want that beautiful, thoughtful
message.
Just tell me one line or that says, happy birthday.
Why would people care so much about being singled out?
That they'd accept an inferior message.
If my partner sends me a beautiful message, that's a world in which she or he gives it
to everybody else.
And that pie might be bigger but it is divided
into multiple parts and I think people have the feeling that they're getting less.
In the other world where they send me a short, almost curt or cold message but they don't
do that for everybody else that means that the whole pie, although it might be smaller,
it is mine.
But it is all for me.
So many of us want our partners to give us the whole pie. We expect our loved ones to make us the center of their lives and we expect to do the same
in return.
Showering favors on those we love doesn't just feel natural.
It feels like something to celebrate.
Our Facebook and Instagram feeds are chock full of people describing how they've put
their loved ones on a pedestal.
But what we fail to notice is that our impulse to give special treatment to those closest
to us can have terrible moral consequences.
Last week, we looked at how few of us actually live by the maximum that everyone is equal.
Today, we try to understand why we struggle to put that value into practice
and how actions that come from a place of love can lead to a more unjust world.
The sins of playing favorites this week on Hidden Brain.
Maserine Banaji has been studying the psychology of discrimination for a long time.
Her first article on the topic came out in 1993 and she's published hundreds of research
papers since then.
She's also helped to develop the implicit association test, which millions of people
have used to identify their unconscious biases.
Given how deeply she's thought about the ways we treat others, you might think it would
take a lot to alter her views about discrimination.
But Mauserine's understanding of how bias plays out was radically reshaped by two words.
Professor Kaplan.
Those words marked a turning point in a story she first heard many years ago. The story was about Mazarene's friend and colleague, Carla Kaplan.
Carla and Mazarene are now both professors and Massachusetts,
Carla at Northeastern University and Mazarene at Harvard.
But at the time, they both taught at Yale.
Carla was this absolutely brilliant young woman,
articulate beyond measure, gifted writer,
a professor of English.
But she also had these wonderful other hobbies.
I mean, she was a quilter, and you would often see her
sitting in the back of a lecture
like a little Madame de Farge, you know, sitting there quilting away
while she listened to a talk on what an 18th century literature.
Despite working in different departments,
the two of them got to know each other because they shared a characteristic that was unusual for professors in the 1980s.
They were women.
In the late 1980s, young women who looked like us could only be two kinds of people.
If they dressed like us, they looked like undergraduates.
And if they dressed nicer, they typically wore administrative assistance.
The few female professors on campus regularly crossed paths.
That's what happened to Miserine and Carla.
And we got to know each other, which is how I learned about the story of her hand.
One night, Carla lost her grip on a crystal bowl she was washing.
The bowl hit the sink and shattered.
The jagged edge of this bowl cut her hand from the middle of the palm to her wrist.
Carla's kitchen floor looked like a Jackson Pollock canvas.
Her blood was splattered everywhere.
Her boyfriend patched up her hand with some bandages.
He rushed her over to the emergency room.
The attending doctor was very attentive to her,
and kept reassuring her that she would be fine.
Carla and her boyfriend tried to get the doctor to understand
how important it was for Carla to preserve the dexterity in her hand.
They explained that she was a quilter. Quilting requires fine finger movement,
and they hoped that this stitching up would actually allow her
to have all of her sensitivity back in her hands
and were assured that indeed that would happen.
And there was no reason to think in that moment
that she wasn't receiving anything but the best treatment.
But Carla was about to discover that she was not getting the best treatment possible.
A volunteer at the hospital happened to pass by, recognized Carla and said,
Professor Kaplan, what are you doing here?
The doctor froze.
He asked Carla, your professor at Yale?
Upon confirming that information rushed Carla off to a different part of the building.
The best hand specialist in New England was called and with a bunch of other doctors
operated on her hand for several hours into the night. It was far more extensive surgery than Carla would have received in the emergency room.
The work on the finer nerves of her hand is what would have taken the incredibly longer
time.
And then I also believe that there was greater attention to the cosmetic part of it.
Carla was grateful to receive such careful attention, but her gratitude was overshadowed
by another feeling.
She was appalled.
Carla was just stunned that her being a quilter was not sufficient to get her the treatment
that she should have gotten, but that being a professor did.
And somehow it must be that the doctor did not feel compelled by the
quilter story in the same way as he was compelled by a
two-word phrase Yale professor.
When Maserine reflected on the story, it rattled her understanding of bias, the very focus of her career.
Had Carla's doctor in the ER refused to perform surgery on her because of her race, or gender, or some other characteristic,
Maserine would have immediately considered what happened to be discrimination.
We all would.
But Carla was not denied anything.
The emergency room doctor was kind, attentive, and competent.
Carla was not treated worse than any other patient.
The point of the Carla story is to focus not so much on a negative thing that the doctor did, something
where he, withheld some basic level attention to her.
What we are speaking about here are acts of helping which are things that go above and beyond
what we typically do.
The moral problem at the heart of Carla's story was not an act of hate, but an act of special kindness.
What Carla got went above and beyond the ordinary. She received VIP treatment, and it made a huge difference.
It's hard for me to think that a patch up job in an ER that required sewing up
sewing up versus fine-grained surgery that goes on for hours is really not going to have some substantial impact on the person's life.
Maserid realized that a definition of discrimination is too narrow to capture this type of harm.
We really measure prejudice in the old fashioned way by looking for acts of commission.
What do I do?
Do I go across a town to burn down the church of somebody who's not from my
denomination?
That I can recognize as prejudice.
But when we don't act, that's acceptable.
It's understandable that we rarely feel outraged when someone gets treated better.
We don't see the harm because the harm is invisible. It's directed at
people who don't get the VIP treatment. But those people were not in the ER with
Carla. They didn't know what they were missing. If you haven't benefited from
this type of treatment, you might have suspicions that favoritism is
costing you opportunities, but it's often hard to pinpoint
what you're losing.
You don't know what would have happened if someone had recommended you for a job because
you both went to the same university.
Or how your career would have changed if you had been invited to a private party were important
company business god discussed.
For Mazareen, the experience that Carla described in the hospital was
like a curtain being pulled back. Carla suddenly got to see what it was like to
be treated the same as everyone else and what it was like to be treated as
someone special. Carla Kaplan and Professor Kaplan each got a glimpse of what
life was like for the other person.
It made Mazarin reflect on her own behavior.
I go through life having no clue that the people around me are the ones I'm helping,
unless I pause and ask the question, how do I wish to do this?
Do I intend to help one type of person over another?
Mazarin can think of instances when she is favored people
because they shared something in common with her.
Like the time I write her ass to interview her for a story.
I typically oblige, but I asked her who she was writing for
and when she told me, I said, I don't think,
I'll do the interview because I did not hold the magazine
she was writing for in high esteem.
I didn't think it presented psychology
in a terribly favorable way or as a science.
And I told her that.
And as she was departing, she said, on the phone,
she said, I used to be a student at Yale
when you were there and even though I didn't take a course
with you, I do remember hearing about your work.
And the next words out of my mouth were,
OK, come on over, I'll talk to you.
You know, what happened to my highfalutin principles
that I ought not to talk to in magazine
that does not represent my field accurately.
And so on.
That little bit of in-group information,
the fact that she and I had shared a zip code for four years
was sufficient to make me override my decision.
This type of behavior, of course, is pervasive.
It's why people want to go to elite schools.
It's not just for the education, it's for the network.
I actually think that this is not only very much pervasive,
but that it often appears in the context
of doing something good.
We interpret these acts of prejudice
as acts of generosity and kindness.
Carlos' doctor felt a connection to her
because of their common affiliation,
and he pulled out all the stops to help.
He probably went home that day, feeling proud.
I think that kind of act of helping towards people with whom we have some shared group identity
is really the modern way in which discrimination likely happens.
Favouriteism, of course, is not the only way that discrimination happens.
Current news events show us that other forms of prejudice are alive and well.
But favoritism flies under the radar, despite having serious moral consequences.
I think it absolutely does in a world in which we believe, I think, with our good intentions, that when certain groups of people suffer,
or when terrible things happen to them, that those are of their own making.
Let's say you listen to the story and decide you won't play favorites anymore.
That's admirable, but...
It's not easy, in most cases in life, to say, where is that zero-level, neutral behavior?
Where if I do that, I'm not discriminating.
When we come back, what would it look like if we treated everyone the same?
The honest.
Yeah, I would... I would sacrifice him.
Stay with us.
This is Hidden Brain, I'm Shankar Vedanta.
Favourites is the unnoticed form of discrimination
that many of us have experienced in one way or another.
We may have gotten a job interview
because the hiring manager went to the same university. We may have done a
favor for someone because we have friends in common. But there are people who are not only able to
notice their impulse toward favoritism, they're able to override it. Dylan Matthews is one of those people.
His journey to this moral stance had unusual beginnings.
It started with sarcasm and vindictiveness
and wanting to annoy someone when I thought it was funny.
It's probably worth noting that Dylan was in middle school at the time.
We had this school project for social studies
where we had to write about a threat to the world.
And normal people would do like, world hunger or HIV-AIDS or something.
And my friend Teresa, who then was a very devout Catholic, did the philosophy of Peter Singer,
because I think she had heard her dad complaining about Peter Singer
and this guy who wanted to abort infants or something.
Peter Singer, the philosopher that Dylan's friend despised was the same
philosopher we spoke to in our last episode. And because I was 12 or 13 and a jerk, I went out
and bought a Peter Singer book and would read it in front of her as much as I could. And I found
much of it persuasive. So I stopped eating meat was the first thing I did. But there was also an essay
in there called Femin Affluence and Morality, which was written during the the big Galley War in
1971 and was an argument that people in rich countries have a moral obligation to give to people
in poor countries when doing that doesn't cost them much for their standard of living.
If you missed our last episode, Peter Singer's philosophical position is known as Utilitarianism.
In essence, it asks how we can increase the greatest amount of happiness and well-being
for the greatest number of people.
In a famous thought experiment, Peter asks you to imagine coming by a drowning child
in a pond.
Let's say saving the child means ruining the suit
you are wearing and it costs $200.
Most people say they would rather save the child
than save their suit.
If that's the case, Peter says,
why not write a check for $200
to a charitable organization that can save a child's life
on the other side of the planet?
The analogy was not donating in those circumstances is like if you see a child drowning in a pond and you don't jump in because you don't want a dirty or suit.
When Dylan first read the start experiment, he was still a student and didn't have income to donate.
When he finally started working and had money to spare, the drowning
child in the pond was still in the back of his mind. With that in the back of my
head I wanted to donate some of it and I happened upon a group called Givewell
that recommended highly effective charities for people who wanted to sort of
save as many lives as possible giving their charitable giving. He eventually
found his way into effective altruism, a movement that Peter Singer helped to inspire.
The aim of effective altruism is to do the most good possible for others.
That means using evidence and reason rather than doing what feels good or is intuitively appealing.
Given his involvement in this movement, it's not a surprise that several years ago, Dylan
found himself attracted to someone who takes ethics as seriously as he does, someone who
has a sense of duty to others who's willing to give until it hurts.
I'm Hannah Grouch-Beglie.
What is surprising is that Hannah's moral framework is very different from
Dylan's. I was raised to really think about the person who's in front of you and
to think about your family members, to think about your friends, and to think about
how can I put them first, how can I always be there for them, and then you know
extending that to how can we make our neighborhood better, how can we make our city better? Hannah learned these values from her parents as they went about
their daily routines. My parents always prioritized dinner time, but, you know, no matter how busy they were
with their careers, we always sat down and at least had dinner together. Dillon and Hannah's different moral frameworks
became evident on their very first date.
They met at a bar in Washington, DC.
I remember it was a problem because they don't serve food
and so we got a little tipsy.
Yeah, we had too many cocktails and we now have to soak them up.
Like all couples on a first date, they flurred.
Of course, being Dillon and Hannah,
their flirting took the
form of a debate about moral philosophy. We were having this debate over, is it more
important to just sort of maximize happiness in the world or whatever sort of thing you
want to maximize, you should maximize it and therefore every action should follow from there.
Dylan believed it was essential not to play favorites. If you want to maximize happiness
in the world, you have to treat everyone's happiness as equally important. It doesn't
matter whether someone happens to live on your block or is even a member of your family.
Their happiness should not matter more than the happiness of someone who lives across the world.
Which I thought was wild and insane.
Dylan told Hannah he deliberately chose charities that could maximize the well-being of the greatest number of people. There's usually men giving to charities that work with the poorest of the poor,
to organizations, for example, that provide bed nets to prevent malaria.
Dylan did not donate to pet projects and causes.
And I am very much not that kind of thinker and was much more focused on
how do we save a particular community
or how do we help certain groups of individuals.
Hannah found it difficult to understand how you could turn your back on a neighbor
to help someone who lives in a place you've never seen.
The differences in their opinions could have driven them apart.
Instead, it became an energizing force. The differences in their opinions could have driven them apart.
Instead, it became an energizing force.
That was sort of part of the original spark was that we were able to have those debates.
Dylan did not expect Hannah to recalibrate her moral compass to match his.
Nor did Hannah think Dylan would do that for her.
We both have immense respect for each other's passions and political opinions and desires
about how to be a good person in the world and sometimes we disagree about what the best
path on that is.
But the real test came a few months into their relationship.
I think that it became more difficult for me when it became more concrete, which was
six months into our relationship.
Dylan had decided to donate one of his kidneys to a stranger.
Dylan said, I want to do this, I want to start the process.
His logic was straightforward.
There are people who are dying and one of them needs a kidney and this will go to one of them.
So as you're thinking about this, you're basically saying,
I have a functioning organ in my body that I want to give to somebody else who I don't know.
Yeah.
That does not strike you at all as being an unusual thing to say.
I understand that it is an unusual thing to say,
being in the world and having talked about this
with people who find it to be an unusual thing to say.
But I didn't need it.
It's a functioning organ, but I wasn't doing anything for me.
To Dylan, not giving away his kidney
was like hoarding food he'd never eat while others were hungry.
Hannah saw it differently.
There were moments when I was very scared that this person who I was starting to love was going to potentially put themselves in a great deal of danger.
It is a very safe procedure, but I'm not a doctor, so you tell me, oh, you're
gonna remove a major organ. Elective surgery, I don't understand why you would do that.
Hannah would have struggled less if Dylan's father needed a kidney and Dylan was a match.
But having a major organ extracted for a stranger? It was very clear to me that this was non-negotiable,
that this was gonna happen.
I think the question was, am I gonna be here for that?
Dylan went ahead with the surgery,
and Hannah was there for him.
The surgery itself took almost four hours,
and that was just four hours in my life
that I had no idea whether or not Dylan was okay or not.
She got little sleep that night
as she made sure Dylan had someone advocating for his needs
around the clock.
The first few days of recovery were rough.
Dylan's experience was recorded by the new site, Vox.
He's a staff writer there.
Good, I'm good. I've only thrown up once so far. So there's that and they have a bunch of exercises they
have to do. In the video, Dylan blows into a plastic tube. And went back to work two weeks after the surgery. He Still pretty painful, but not super painful.
Dylan went back to work two weeks after the surgery.
He wrote an article for Vox with a title, Why I gave my kidney to a stranger and why you
should consider doing it too.
His article and the video helped publicize this unusual form of altruism.
Some readers told him that they were inspired
to donate a kidney because of his peace.
He was honored at a ceremony for kidney donors.
The award he received that night
sits on a bookshelf in Dylan and Hannah's living room.
It is this very heavy metal brick
that says American hero hero Dylan Matthews. I did not find that
embarrassing at all then. It's from the National Kidney Registry and it was very
kind of them to give it to Dylan. It's pretty it's hefty. It's one of the
better opalists I've ever seen in my life.
Dylan and Hannah's differences are fascinating,
because they both have entirely compelling visions
of what it is to be a moral person.
These visions clash with one another.
I was curious how they think about a famous moral dilemma
known as a trolley problem.
You've probably heard it before, but if not,
here's a summary from someone who has studied
the problem extensively.
I'm Joshua Green.
I'm a professor in the psychology department
at Harvard University, and I study moral decision-making
and high-level cognition.
Joshua says the trolley problem has achieved
the status of legend.
The trolley problem has become a kind of beam.
So much so, it's even featured on Network TV.
It's on the show The Good Place, which explores questions and moral philosophy.
Oh God, Michael, what did you do?
I made the trolley problem real so we could see how the ethics would actually play out.
There are five workers on this track and one over there. Here in the levers to switch the tracks.
Take a choice.
This is the classic version of it.
A trolley or a train is hottling down a track.
Its brakes are shot and it cannot be stopped.
The trolley is headed towards five people,
but you can hit a switch that will turn it onto a sidetrack where only kill
one person. And the question is, is it okay to hit the switch to minimize the loss of life?
Is it okay to kill one innocent person to save the lives of five innocent people?
Many people find the moral dilemma painful, but will tell you, yes, if saving five people
means unintentionally killing one, then it's the
right thing to do.
But there's a way to make the dilemma not just hard, but excruciating.
What if the one person whose life you have to sacrifice is someone you know, someone you
love? someone you love. I have joked that I think if you were in the horrible situation
in which, you know, the five people who are on this trolley track
are about to be killed, and the only way to save them
is to kill your own child, that Dylan would kill his own child
in order to save those five people.
Because he has this very, I think, rational approach
to morality, the child is one life.
Five people's lives are more than that one child.
I would save the child.
I would easily kill five people on behalf of my own child.
I know that, and I'm not a mother.
I just know that that's the kind of mother I would be.
I would kill the chick. Yeah, I wouldn't even question it.
Like, it's five against one. I would probably kill myself after out of grief and so it would be five against two.
But yeah, no, that's not a hard problem for me.
Like, those people are all the heroes of their own stories and they all have loved ones who love them as much as I love the kid.
And it seems obscene to me to treat my attachment as paramount of their attachments in their lives.
Yeah, I just have totally different intuitions about that from a piano.
I couldn't resist asking the two of them to consider a scenario that's even closer to home.
This is still hypothetical, but it's a little less hypothetical given that you don't actually have a kid right now.
Let's say it was five people in one track and it was Hannah on the other track.
What would you do?
Be honest.
Yeah, I would, I would sacrifice Hannah.
I love Hannah very much.
I would have a lot of very tense conversations
with their parents afterwards.
I don't think John and Val would be in my life for much longer.
Let me pose the same hypothetical to you now.
So let's say it was five and it's not a child on the other track,
but it was Dylan on the other track. What would you do? Well, I might kill Dylan because I would
know that's what he wanted. I would never forgive you. Yeah, if I killed five people and he was alive,
he'd be very mad at me. So I think I think I would sacrifice him, but I think it would be hard.
I think a split second decision I would save, because I think, you know, my instinct
is to protect my loved ones.
I told Joshua Green about Dylan and Hannah.
He noticed something revealing about their responses to the thought experiment.
She's still acknowledged that what he would do is rational, in a sense, that's the word
she used, right?
It wasn't that she didn't understand it.
It's just that she didn't understand how that could get more weight than those basic
human and mammalian feelings.
And he said, yeah, I would probably sacrifice my child and then I would kill myself out
of anguish
So it's not that he doesn't feel it. It's that he's willing to override it And he worries in that hypothetical that he could maybe override it in the moment
But couldn't override it for the rest of his life in which case he'd rather end his life
so I think there's actually
There is some mutual understanding there despite the fact that in the end, the balance
tips one way for one of them and the other way for the other.
When we come back, how these different moral frameworks are reflected inside the brain.
Stay with us.
This is Hidden Brain, I'm Shankar Vedantam.
Favouritism is deeply ingrained in us. Most of us don't question our impulse to favor
our inner circle because we view such behavior
as kind and generous.
We believe such acts make us a good friend or a trusted partner.
But some people, like Dylan Matthews, treat those they know and strangers with the same
commitment and care.
I admire Dylan greatly for his willingness to give up his kidney for a stranger, but
I wouldn't do that.
This again is psychologist Joshua Green. Joshua knows that while many of us may admire Dylan,
most of us, like Hannah, tend to favor those we know. We don't feel morally compelled to help
strangers, in the same way we'd help someone we love. And our whole society is structured around the idea
that our lives are defined by these emotionally durable and meaningful personal relationships.
There's an evolutionary reason for this.
Over thousands of years, humans who favored those close to them had an advantage.
They could cooperate and such
cooperation allowed them to outcompete others. Morality is fundamentally about
cooperation. It's a suite of psychological capacities that enable us to
cooperate to have teamwork, right? And so, you know, basic rules like don't lie,
don't cheat, don't steal, those are rules that make it possible for people to live together.
Whether in a village or a family.
The most basic form of cooperation
is cooperation between individuals who are genetically related.
And what's really going on there is that the gene
that is in both of your bodies is essentially saying
same gene here and there, you should be treating each other as a like,
or at least not as too different. You know, genes that encode for caring about the individuals who
share your genes and therefore have a copy of that gene, those genes are more likely to spread,
right? So the most basic kind of cooperation is cooperation based on genetic relatedness and then the next level up is based on the kind of
reciprocity in a direct face-to-face sort of way. So this is you know friends you share food with each other
You'd have each other's backs when going into battle take care of each other's children take care of each other or you know
When you're sick that's what friends are for right and
Everybody is likely to do better if they have other people that they can cooperate with.
You can imagine the circle of cooperation,
expanding even further.
You get out to different levels where there might be people
who you don't know personally,
but you have some kind of connection with.
That is you're a member of the same religion
or you're a member of the same country
or you have some other kinds of shared connections
or interests, or you're a friend of my friend, or a friend of a friend of my friend, right?
Then, you know, those are more symbolically marked. It's not based on your experience with
that person, but what you have encoded about them in a more abstract kind of way.
There's a simple image you can use to picture this.
As the philosopher Peter Singer put it,
we live in these moral concentric circles. If you're a complete narcissist, it's just you at the
middle, right? And then when we ring out as your family and your closest friends and then people
who you're more acquainted with, people who are in a, you know, perhaps part of your town,
your village, and then broader connections with people, even people who are strangers,
but are connected to you in some way.
And so in some sense, the most basic question
that anyone has to answer is, how big is my us?
What is the range of humans or beings even that I care about?
Dylan's circle of Care is very large. It's basically the entire world.
Hannah's Circle is much smaller.
It's her family, her community, her city.
Few of us operate solely with either of these frameworks.
We move back and forth.
Joshua compares these different moral frameworks to settings on a camera.
Think about photography, especially if you're kind of a weak amateur photographer like me.
So the camera that I've used for years has these nice automatic settings.
So if I want to take a picture of a mountain from a mile away, then I put it in landscape setting
and click, point and shoot, and I've got a pretty good picture of a mountain
from far away, or it has portrait mode
and dark mode, et cetera, right?
And the idea is that the manufacturer has thought
into advance, you know, what are the kinds of things
that people need to do all the time?
We're just gonna set up these pre-programmed responses
for those things, and that's what people use most of the time,
and that's what I do.
Occasionally, I get ambitious and will want to do something fancy and maybe have something
slightly out of focus and off to the side and who knows, right?
And so there you put the camera in manual mode, and that allows you to adjust the F-stop
and everything else by hand.
There are benefits to having both of these camera modes. It allows you to navigate the trade-off between efficiency and flexibility or reliability and
an inflexibility.
That is, if I try to do all those different things that I might do for portraits and landscapes,
by hand, I might make a mistake and I'm trying to do this quickly.
It's much better to have a point and shoot setting.
But you can't do everything you might want to do with point in shoot settings, and that's why the manual mode is great.
And in the same way, we humans have gut reactions, we have feelings, we have habits.
In a familiar kind of situation, you don't even have to think or reason about it when it's
something that's just obviously a terrible thing to do.
And that's good.
You want to have that kind of efficiency and sturdiness in your everyday basic moral judgment.
But then, sometimes life is complicated,
and sometimes there are difficult trade-offs,
and then that's when you wanna shift into manual mode.
Joshua finds this analogy helpful
because it answers a question that people tend to ask,
which moral framework is better?
And the answer is neither is better.
It depends on what you're trying to do.
If you're trying to do something quickly, fast, and fairly routine, then you want the
automatic settings.
And if you're trying to do something more complicated and you're out of your usual
element or trying to do something new, then you want the manual mode.
And I think it's the same thing with moral thinking that when it comes to the ethics of everyday life, the basic things that everybody should
know not to do, the lying, stealing, cheating kinds of things, we want to have automatic settings
that just say, nope, nope, nope, nope, nope, can't do that. But then when we're making
difficult decisions, decisions where on the one hand something might feel wrong or break
some kind of rule, but on the other hand, it could mean
more people will die if you do the thing that seems like the ordinarily right thing to do.
Then you want to be able to weigh those things against each other and that is exactly what our brains do.
Joshua and other researchers have found that different parts of the brain are at work when by using our manual mode and our
automatic mode.
When people are specifically engaging the utilitarian reasoning you see increased activity in a part
of the brain called the dorsal lateral prefrontal cortex.
It's part of a network in our brain that's the home of hard thinking and self-control.
Like if you're trying to remember a long string of numbers or something like that or
if you're trying to remember a long string of numbers or something like that, or if you're resisting an impulse.
The automatic mode engages a different part of the brain.
Part of the brain called the amygdala, which is a kind of early warning, attention directing system that says something's going on here, maybe bad, you've got to pay attention to this. And so if you see a snake, for example, before you even realize what you've seen at a sort of conceptual level, your brain is already responding with that
flash of, whoa, something, something you need to pay attention to there.
Joshua has used dilemmas like the trolley problem to understand what happens when we shift between
the two modes. The most revealing scenarios hit the two modes against one another.
One of these scenarios, the dilemma of the crying baby.
This is kind of a horrible case.
And I think when I first started thinking about this, it was before I had kids, and now
that I have kids, it's like even more horrible to think about.
But this is modeled after some stories that people told
about what happened in World War II.
And the other story is that people are hiding
in a basement and the enemy soldiers are outside.
And there's a baby that starts to cry.
And if the soldiers hear the baby,
they'll find everybody and they'll kill everybody,
including the baby, is it morally acceptable
to smother the baby in order to save everybody else, knowing
that the baby would die anyway if you didn't do anything.
Compared to the standard version of the Charlie problem, the crying baby case ramps up the
stakes.
One, it's your own child, as opposed to a stranger, and at least the way the story is described,
the child's going to die anyway if you don't do that.
And so that's something that also seems to matter.
That is, in general, people are more willing to say that it's okay to do the horrible thing
in the name of the greater good if the horrible thing involves hurting somebody who would
end up being harmed anyway.
If you give people brain scans as they consider such dilemmas, you can almost see different
parts of their minds
wrestle with something that feels viscerally wrong but logically correct.
When people have to make and all things considered judgment where they are not told to just think
about your feelings or just think about the consequences, but instead try to weigh those
things against each other, you see increased activity in a part of the brain called the
adventure medial prefrontal cortex.
This part of the brain integrates these two different types of decision-making.
It's like these different weights get added up and the scale tips one way or another
and that's how we decide what to do.
We told you a second ago that one system for moral reasoning is not better than the other.
That's true, but not always.
There are situations in our modern world
for which the fast, intuitive system in our heads
is not well designed.
This system was not designed for a world
in which we no longer live in tribes
where the people who live near us
don't always look like us.
They were not designed for a time
when we're capable of helping people
on the other side of the world.
When Dylan thinks about the balance
between these modes of moral reasoning,
his mind jumps to cases where loyalty and love
cause real harm.
One example, he says,
are the ways in which some men
have responded to concerns about sexual misconduct.
There have been a lot of stories of the nature of,
hey, I'm a guy in media or politics or entertainment.
I've heard rumors about this guy friend of mine
being awful toward women for the last few years.
I'm not going to say anything because I feel like
he's a good guy and he deserves better than for me
to stick my neck out and get into his business.
That's about a lot of things.
That's about endemic misogyny and depression
and accountability, but I think it's also about
men placing loyalty before other virtues.
And in a family context, I've had some experience of people acting like the fact that we are
family and loyal to each other means they can get away with anything and that no one will
judge them because they're family and we stick together no matter what. And I think in those cases, my attitude
and the attitude of people close to me is,
no, you don't get to do that.
That there are limits and we're not going to stick by
no matter what.
I think the sum total of all of our small partialities
has added up to a lot of injustices in a lot of cases.
That doesn't mean loyalties of that thing always like
You should be loyal to people. It's worth being loyal to but I think the
The worth being loyal to part is sometimes unexamined
Even those of us who recognize the problem with favoritism may find that actually doing something about it is simply too hard
Suddenly we have to account for every decision. If we spend $200 on our child's birthday
party, we've chosen not to spend that $200 saving a poor child in a faraway country.
We have to reckon with what this means. The life of that far away child matters less
than the happiness of the one who lives in our house.
Spending money on family or friends or ourselves
can feel like extravagances
when there's so much deprivation in the world.
Dylan agrees that you can go too far
in putting other people's needs first.
He believes that giving to others needs to be sustainable.
I've made the judgment that I'm not going to beat myself up for giving 10% rather than
50% of my income.
Hannah also has a say in this, and not just when it comes to how they give away money.
Well, I guess the liver is one example.
Yeah, it's remembering the...
You wanted to donate a liver?
Yeah, the...
The liver?
Yeah, the liver is a lot.
You tell us the liver.
You don't have to liver, so...
He does not have to liver.
So, after Dylan donated his kidney,
we were invited to this very nice gala in New York
that sort of celebrates kidney donors.
This is the same gala
where Dylan was given the award that's on his bookshelf, the one that says American Hero.
We were sat at this table with maybe like four or five other kidney donors and their spouses,
almost all of whom were men. The guys start talking and they start talking about how now that they've donated the kidney,
what they're thinking about is donating the liver.
There's one guy in particular who's like,
I'm just gonna do a small piece, so it's for a baby.
Yeah, that if you donate liver to a child,
you don't have to donate the entire organ,
you just have to donate a little piece of it
because it will grow.
And so then also you can do this multiple times
because your own liver will grow back
and then you could cut a little piece off of it
and donate that.
And the guys are all like,
yeah, that sounds great.
I've been thinking about this.
It's amazing.
It felt like skateboarders,
like talking to someone who's trying to new trick
they had never tried before.
We're like, that's sweet, man.
And all of the spouses are like,
absolutely not.
I refuse to do this again. [♪ Music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing in background, music playing organs to strangers. What I call deep pragmatism. He compares his approach to dieting.
You can imagine you're physiologically optimal diet,
but that's not the best diet for you
if you're never going to stick to it, right?
The best diet for you is the diet that you're most likely
to stick with.
I think of being a moral person, even though it's
a much more serious issue than dieting,
it's the same, that's the deep pragmatist perspective, is to remember that you're operating
within the limits of your own psychology.
What does it take to care for people beyond those in our inner circle?
It requires us to ask the same question that Joshua raised earlier.
How big is my us?
What is the range of humans or beings even that I care about?
We're capable of expanding the range of people who fit in our us.
Maserin Banaji, the psychologist, has experienced this herself.
During the tsunami that hit Japan,
it took me two seconds to write to my colleague in Japan
because I know somebody who lives there and had spent time with me in graduate school.
I wrote a check immediately to the Red Cross
and all of those actions happened.
And this was in some foreign part of the world
that in the lives of my grandparents and parents,
somebody in Japan would simply not have been
a person associated with them.
So now that Tsusumu is a part of my in-group,
the fact that he lived so far away
didn't matter to the act of helping.
Maserine sees what happened
as a parable about what modern societies make possible.
They give us the opportunity to include people from the out group into the in group.
But expanding the size of your us through friendships has limits.
There were other disasters Maserine did not respond to because she did not feel a personal
connection.
And it did make me wonder about having rules
for how I might do this that are not based on what
tugs at the heartstrings, but rather where
the need is the greatest and in a more neutral way.
Joshua says there is a simple way
for people to try and expand their circles of connection.
The number one thing that people who have disposable income can do is make a donation to
an organization like the Against Malaria Foundation.
If you condone $3,000, odds are you can save someone's life.
That's not an exaggeration.
And if you and 10 other people can each give $300, you can save someone's life.
Or 100 other people will each give $30.
Those are real things that ordinary mortal people can do
Joshua thinks about something he heard from the philosopher Will McCaskill
If you ran into a burning building and saved somebody's life that would be you know
What if the defining moments of your life and you remember that for the rest of your life and other people would remember you
buy it. But most people, you know, who earn a decent professional salary, you could say
at least one or two lives every year and not even think much about it. I mean, it's mind-boggling
that we have this power and yet it's absolutely true. As humans, we come programmed with an immense capacity for love and loyalty.
We also have the capacity to see the entire world as our family.
Both of these systems can produce immense good and both have made her shortcomings.
Like a skilled photographer who changes her settings,
depending on the photo she wants to take,
we would be wise to choose our moral settings deliberately.
This episode was produced by Reina Cohen and Thomas Liu. It was edited by Tara Boyle, Kat Shuknecht and Parthas Shah.
Our team includes Jenny Schmidt, Laura Quarelle and Lu Shikwaba.
Engineering support from Gilly Moon and Joshua Noah.
Our Ransang hero this week is John Lansing.
John is NPR CEO.
He recently came on the job only to find himself dealing with the effects of a global pandemic
and a very intense new cycle.
John has steered NPR these past few months with great empathy.
He comes across his honest, kind and direct. Exactly the qualities
you want to see in a leader. It doesn't hurt that he's also a fan of Hidden Brain.
This episode was the second in a two-part series on moral decision making. If you missed the first, it's called justifying the means.
For more Hidden Brain, you can follow us on Facebook and Twitter. If you like this
episode, please share it with a friend or better yet, with a stranger.
I'm having fun imagining our future kid was mean to this and maybe like I didn't know you yet buddy it's not personal. I'll explain to him why we're staying away
from trains.
I'll explain to him why we're staying away from trains. I'm Shankar Vedantam, and this is NPR.