No Stupid Questions - 188. Why Do Kids Today Get So Many A’s?

Episode Date: March 24, 2024

Is grade inflation on the rise? How much does your G.P.A. matter in the long run? And when did M.I.T., of all places, become “the cool university”? SOURCES:Scott Hugo, housing justice attorney at... Oakland City Attorney’s Office.Bob Ladouceur, former head football coach at De La Salle High School.Jon Marcus, writer at The Hechinger Report.Amelia Nierenberg, Connecticut correspondent for The New York Times. James Pennebaker, professor emeritus of psychology at the University of Texas at Austin.Stuart Rojstaczer, writer and former professor of geophysics at Duke University. RESOURCES:"Making the (Letter) Grade: The Incentive Effects of Mandatory Pass/Fail Courses," by Kristin Butcher, Patrick J. McEwan, and Akila Weerapana (Education Finance and Policy, 2023)."To Help New Students Adapt, Some Colleges Are Eliminating Grades," by Jon Marcus (NPR from Hechinger Report, 2023)."Grade Inflation Continues to Grow in the Past Decade," by Edgar I. Sanchez and Raeal Moore (ACT Research, 2022)."Why Good Teaching Evaluations May Reward Bad Teaching: On Grade Inflation and Other Unintended Consequences of Student Evaluations," by Wolfgang Stroebe (Perspectives on Psychological Science, 2016)."Grade Inflation at American Colleges and Universities," by Stuart Rojstaczer (GradeInflation.com, 2016).Chasing Perfection: The Principles Behind Winning Football the De La Salle Way, by Bob Ladouceur and Neil Hayes (2015)."Daily Online Testing in Large Classes: Boosting College Performance while Reducing Achievement Gaps," by James W. Pennebaker, Samuel D. Gosling, and Jason D. Ferrell (PLOS One, 2013). EXTRAS:"Higher Education Is Broken. Can It Be Fixed?" by People I (Mostly) Admire (2023)."Freakonomics Radio Goes Back to School," series by Freakonomics Radio (2022).

Transcript
Discussion (0)
Starting point is 00:00:00 Does not compute. I'm Angela Duckworth. I'm Mike Mon. And you're listening to No Stupid Questions. Today on the show, do we place too much emphasis on grades? How much of college is trying to get a perfect GPA and how much of it is actual learning? Mike, there's a question from a listener named Ali that strikes close to the heart for me, and I'm going to read it to you. All right.
Starting point is 00:00:45 Dear NSQ, at the risk of sounding like a super grumpy adult, help me understand why is academic grade inflation on the rise? So I have to say that, as you know, my daughters, Amanda and Lucy, are in college, and I am shocked at how many A's. It's sort of like it's raining A's. That's because you are their mother.
Starting point is 00:01:09 No, but you know what? I'm saying this not just because of their own transcripts, which by the way are not entirely A's, but they'll ask me to review the resumes of their friends because they're all on the job market. And the first one I get and I'm like, holy smokes, this kid's gotten practically all A's and A minuses.
Starting point is 00:01:28 But then I get the next one and the next one, and then I'm like, wait, is everybody getting A's and A minuses? Or are you guys just really good at picking your friends? But I'm guessing you've seen the headlines, right? Oh, for sure. Like there was that article about Yale recently in the New York Times.
Starting point is 00:01:44 Yes, an amazing article by Amelia Nirenberg that came out in December of 2023 that showed that nearly 80% of all the grades given to undergraduates at Yale were A's or A minuses. And Yale maybe is an outlier, but maybe not, I guess, is what we're saying. I don't think it's an outlier. I think there is some statistic about Harvard. Right. 79% of all grades given to undergraduates over the 20 to 21 school year were A's or A minuses at Harvard. And a decade earlier, it was 60%. So it's gone from 60% to 79% in 10 years.
Starting point is 00:02:21 I mean, the question of whether grade inflation is a thing or are we being lured by one or two salient examples? I was forwarded that very article that you're talking about by many people. So I did what I always do, which is I went and looked at the research literature. I was like, go to Google Scholar. So I found this research report that was done just a year or two ago, and it's by ACT, the standardized test. Did you take the ACT? Yeah, I think it's much more common in the West.
Starting point is 00:02:50 And may I say Midwest? I think it's like a Midwest thing. Like you don't take the SAT, you take the ACT. Right. Anyway, so I find this article, it's called, Great Inflation Continues to grow in the past decade. And what they say is that what a lot of people believe is that since the pandemic, grades have increased because we're getting like softer on young people. We're just so worried about their mental health. But also it's true, I think that many organizations, be it high school, college,
Starting point is 00:03:21 etc., during the pandemic, basically said, we're moving away from grades that'll be pass fail for a while. So it was this real shift. We don't know if you have a good wifi connection. So if you know, that's impairing your ability to learn. By the way, I don't think many districts did that for long, but right, I mean, everything was different during the pandemic.
Starting point is 00:03:39 But it's like when you went to work from home for all these businesses, there's kind of no going back. And I wonder if the same thing is plaguing academics, right? You can't totally go back. Well, what this report published by ACT says is that great inflation is not only a thing, it far precedes the pandemic. High school senior GPAs in national samples have risen between 2010 and 2021. It says the average high school GPA increased 0.19 grade points. I mean, it doesn't sound like a lot, but on a 4.0 scale, it is a lot. From 3.17 in 2010 to 3.36 in 2021 with the greatest grade inflation occurring between 2018 and
Starting point is 00:04:29 2021. And they say grade inflation is real, it is widespread, and it weakens the value of student transcripts as a single measure of what students know and are able to do. And I haven't seen any studies saying the opposite. So let's assume that high school grades are going up and up and up, and that they have been since well before the pandemic. That leaves open the question about college though.
Starting point is 00:04:54 And it sounds to me like you're seeing news articles that suggest that college grades are also a rising tide. Is that what you're seeing? Because I see a little bit more mixed evidence there. There's a really interesting thing that I read about this. You may be familiar with Stuart Roystasher. He's a retired Duke University professor, but he created a website called GreatInflation.com.
Starting point is 00:05:18 I'm not familiar with GreatInflation.com or what's his name, Roy? His name is Stuart Roystasher. Like Worstasher but with an R. Well, yes and spelled differently. And Stuart Roystasher, he wrote a piece called Great Inflation at American Colleges and Universities. And he goes over 50 years of the rise of the A grade. And the biggest shift he shows was from 1963 to 1973.
Starting point is 00:05:48 And it was during the Vietnam War. Before the Vietnam War, the average grade in the United States on college campuses was a C, but during the Vietnam War, it rose dramatically. And I wonder, I mean, it's very different than the pandemic. Wait, why? Well, he's got to have a theory. It's the same type of idea that during the Vietnam era, there is so much pressure and other things on mental health. And I think if you had better grades, you were less likely to be drafted. Ah, so maybe the professors were trying not to send the 18-year-old boys, like, off to
Starting point is 00:06:16 war. Yeah. Then what I'm seeing, the data that I'm seeing, for example, I've got a figure that shows the average undergraduate GPA from 1983 to 2013 based on data from a wide swath of universities from Alabama to Indiana to Minnesota to Harvard to BYU to Wisconsin and William & Mary but it's showing that the rise of GPAs at those four-year universities over that 1983 to 2013 time frame. At public universities, the GPA inflation is much lower than at private universities, but still both going up. Okay, that's what I mostly am seeing. Grades are going up in high school, they're going up in college, it's not just the pandemic. So let's assume it is a thing.
Starting point is 00:07:05 You know what's really interesting about this? Going back to Stuart Roystichur, he talks about this really interesting shift that happened, which I had not thought through. He said that we've moved from the era of students as learners to the era of students as consumers. And when you treat students as consumers. And when you treat students like consumers, then the customer is always right.
Starting point is 00:07:31 And so you're more likely to give them good grades. I just want to read this one thing from him. Professors faced a new and more personal exigency with respect to grading. To keep their leadership happy and help ensure their tenure and promotion, they had to keep focusing on keeping students happy. I'm sure you've seen this old meme where there's a kid in elementary school, it's not a meme, just a cartoon, but comes home with a grade and it shows the parents kind of getting angry at the child and it says like 1970.
Starting point is 00:08:00 And then it says 2020. And then the next image is of the parents yelling at the teacher. Yeah, I was going to guess that even though I hadn't seen that. There's another article that was in Perspectives on Psychological Science, one of my favorite journals. And it's called, Why Good Teaching Evaluations May Reward Bad Teaching on Great Inflation and Other Unintended Consequences of Student Evaluations. Basically, what this argument is, is that there's another customer who wants to be happy. And it's not the student, it's the professor. Because professors basically, and this is true for me too, like we get graded.
Starting point is 00:08:36 So we get teaching evaluations. Typically what happens is close to the very end of the semester, students fill in these multiple choice questions on how good they thought the class was, how good they thought the professor was, how difficult they thought the course was, etc., etc. Many universities, including mine, basically force the students, like you can't get your grades until you fill out all your course evaluations. Oh, okay. your course evaluations. So why this matters is that, for example, when you go up for tenure,
Starting point is 00:09:08 the course evaluations are part of your package. They're also public. So like my class, you know, I was recently confessing to you that my course evaluations didn't come out the way I thought they would for my MBA course. That's public. And that creates an incentive for professors to get good course evaluations. And then here's the rub, and it's kind of obvious, but it's a fact that professors who give out lenient grades, who give out a lot of A's and A minuses, well, they're making their students as customers happy. Guess what the happy customer students do? They give their professors high ratings.
Starting point is 00:09:47 And so there's a positive correlation between professors giving out high grades, professors getting good ratings. And that's another force, right? So maybe all the forces, you know, high grades keep the students happy, high grades lead to high ratings. That keeps the professors happy. There's been another argument that it keeps the university administration happy because if the grades are higher, fewer kids are dropping out. If fewer kids are dropping out, that means more kids are in paying tuition.
Starting point is 00:10:15 So I want to be the kind of professor who holds students to a high standard and who will fail them when they need to fail them and who will give them a C when they deserve a C. But there isn't a lot of incentive in the system. I think the kind of courage to be that really tough love professor or teacher, I think it's rare and I don't know, I guess the statistics say maybe it's getting rarer. I will say this. I mean, you have to fill out your course eval before you get your grade, usually. And one of the regrets that I have, I had a professor in undergrad who would just slaughter my papers.
Starting point is 00:10:53 I mean, he would redline them like crazy in a way that would make me better, but also in a way that I thought from a grade perspective was maybe unfair. And I remember that I wrote his evaluation and was like, he nitpicks every little thing. It's about detail, not learning. And then I get my grade and I got an A and I thought, oh no, no, no, no, no, he was great. He was helpful. Right? And I actually to this day feel bad that I responded much more negatively than I probably would have in a course eval if I thought that I was going to get an A. Now, part of that, I think to
Starting point is 00:11:30 me came down to this idea of fairness for the work and effort that I put in versus just, oh, I might get a bad grade. But yes, I would be lying if I said I wasn't incentivized maybe way too much by the grade and not enough by the learning because he gave a great gift, which is that he spent enough time on our papers to tell us where they needed to be improved and where we could get better. And I think a lot of other professors just kind of skimmed them or had their TAs. This professor actually went in, took the time, took the effort, and unfortunately was probably punished as a result. Yes, right.
Starting point is 00:12:07 So, you know, how do you, Mike Mon, think about this? I mean, you have to hire people. Do you care about their grades? Do you worry about grade inflation? I mean, isn't that hard if you have, you know, 10 applicants from Yale and they all have A's and A minuses with a GPA of 3.9. Right.
Starting point is 00:12:28 Because one of the only things that you could know about somebody is now like a noisier signal. We do care about their grades and that's where it starts to get tricky though. Because I think professors know that grades matter, universities know that grades matter when it comes to hiring. And so they're also incentivized to get their students jobs. So part of that becomes on the hiring manager to see, okay, what do we think about the grades from this school? But it is harder to use that as a distinguishing feature given that it appears the grades are going up across the board. I will say one thing that we have been doing
Starting point is 00:13:05 for a long time, at times we will ask, especially of undergrads, obviously not so much of grad students, not only GPA, but what was your ACT or SAT score as well? Oh, you do? Wow, that's interesting. It was to the point where when I was joining, I was finishing my second master's degree,
Starting point is 00:13:24 and they asked me what my ACT was. And I thought when I was joining, I was finishing my second master's degree and they asked me what my ACT was. And I thought that was something I took so long ago. When you were hired at Qualtrics? Yes. Really? That was what, 11 years, 12 years ago? But I think there's this idea that you can almost
Starting point is 00:13:39 balance them out by asking what was a standardized test. We've talked before there are issues with standardized tests as well, but at least that's maybe more transparent across the board than GPAs that can fluctuate. I want to say about my school, about Wharton, so I teach the kids in the, I shouldn't say kids, I teach the leaders in the MBA program and I teach undergraduate students and at the MBA level there's a forced curve. So there is this computer system where we have to input our grades at the end of the
Starting point is 00:14:10 semester. It quite literally will not let you finish the transaction of uploading your course grades unless the arithmetic average is 3.5. So you could put in half A's and half B's, or there could be like A's and A minuses, and B's and B pluses. There's a lot of different configurations, but it calculates what the mean is, and it won't let you press the button to submit it unless you have exactly a 3.0, or of course, less, right?
Starting point is 00:14:40 So you could have a lower average GPA. And I think the administration wouldn't have such a draconian policy unless they thought somebody was looking at these grades. And I do think that one of the functions of grades is a signal. It's a little flag that goes up for an employer or the next school that you go to should you be proceeding to get yet more degrees and I think you could argue that if Everybody is getting A's and A minuses and by the way, I'm not being all self-righteous
Starting point is 00:15:14 I looked at my own undergraduate grades this last semester So not not my MBA course where I had a forced curve But in the undergraduate class where dr. Duckworth was allowed to do whatever she wanted, and guess what Dr. Duckworth apparently did? 3.9 average. Yeah, mostly As and A minuses. Oh my gosh, I didn't even calculate it. I asked my TAs, I was like, so these grades that we've apparently already given to the students, the distribution is actually mostly As and A minuses, and then my TAs came back and they were like, yeah, but you know, the students. The distribution is actually mostly A's and A minuses. And then my TAs
Starting point is 00:15:46 came back and they were like, yeah, but you know, the students did great. And I was like, ugh, I'm so tortured by this. I hate it. But anyway, I just want to say like, I'm not preaching from some pulpit where I feel like I've got everything right. I'm tortured because on the one hand, I think they are an important signal, and if everybody's getting the same signal, it's no longer a signal. It's just noise. And on the other hand, they already work so hard to get into this selective institution,
Starting point is 00:16:13 something about a forced curve within that institution does rub me the wrong way, so I'm a mess. One thing that I thought was really interesting came from an article I read called To Help New Students Adapt, Some Colleges Are Eliminating Grades. One thing that I thought was really interesting came from an article I read called to help new students adapt Some colleges are eliminating grades the journalist John Marcus wrote this for the Hetchinger report at Brown University in Rhode Island Students have a choice among written evaluations that they only see results of satisfactory or no credit and
Starting point is 00:16:43 Letter grades of a B or C, but they can't see their D or F. That's not put on the transcript. MIT has what they call ramp upgrading, specifically for first year students. And so in the first semesters, they only get a pass without a letter grade. If they don't pass, then no grade is put in at all. And then in their second semester, they get letter grades,
Starting point is 00:17:06 but if you have a D or an F, that's also not put on the transcript. Really? At MIT? Whoa. And then after that, it sounds like year two, you're back in the kind of normal system, but they have this ramp up grading system for first year students. A lot of people don't know this,
Starting point is 00:17:24 but MIT has actually become the cool university. Like when I was in high school, it was not the cool university. It was a smart university, and very smart people went there, but you would never use the word cool at MIT. You're saying it was the nerd university. Yeah, right? But by the way, I love my own school. But MIT is so cool.
Starting point is 00:17:44 They made their courses free for people online. They're like, oh, by the way, everything we do, if you want to just learn, you could just have what we do. I mean, you won't get a degree. They put, I think, almost all their courses online. They have a really progressive and supportive and just cool and fun administration. Anyway, I just wanted to let the world know.
Starting point is 00:18:05 MIT is hip. So when MIT does something, you should listen or you should watch. So, Mike, this brings me to a question for our listeners. Both Mike and I would love to hear your stories about grades, maybe your thoughts on the pros and cons of grade inflation. You can record a voice memo in a quiet place with your mouth close to the phone and just email us at nsq at Freakonomics.com. Maybe we'll play your story on a future episode of the show. Also, if you like NSQ and want to support us,
Starting point is 00:18:42 the very best thing you can do is to tell a friend about it, or spread the word on social media, or leave a review in your favorite podcast app. Still to come on No Stupid Questions, what happened when Angela tried to get her students to appreciate learning for learning's sake? Please send in the writing assignment that was due on Wednesday. It's now Friday. I also reminded you on Thursday. We really don't want to fail you. Now, back to Mike and Angela's conversation about grade inflation. Now, back to Mike and Angela's conversation about grade inflation. I have a pass fail story for you.
Starting point is 00:19:29 Okay. So, I had this conversation with a dean at my school and now we're going back, I think like five years. And I told them I wanted to teach this undergraduate course called GRITLAB. And I said that I was going to put everything I had as a psychologist into the course, not only in terms of the content, like they're going to learn about growth mindset and deliberate practice and the flow state,
Starting point is 00:19:53 but also into the structure of the course. I'm going to use psychology to motivate the students to be engaged, to put full effort in, to be open-minded, and to do everything that every professor wants their students to do. So, you know, my mindset was like how much of college is trying to get a perfect GPA and how much of it is actual learning. I don't want to be an authoritarian professor who's forcing my students because I have this big stick called their grades, right, and just cajoling them into doing the reading and paying attention in class and making a full-throated effort
Starting point is 00:20:37 on the writing assignments and everything else. And I thought I would use intrinsic motivation that I would draw them in and that the grades would then become a non-nuisance. So this was all a wind up. The dean is like, why am I getting a sales pitch about an undergraduate course? Because you're passionate. Well, no, because I needed them to approve a very unusual feature of the course, which is I wanted it to be mandatory pass fail. And this dean didn't even understand what I was saying. They were like, what? Does not compute.
Starting point is 00:21:09 And I'm like, you cannot take it for a letter grade. It's not a choice. So then the dean had to check to see whether the computer system could actually handle this because it's not typical. And then the answer came back. They're like, well, technically, it's possible. So that's what I did I made my class mandatory pass fail. What do you think happened?
Starting point is 00:21:29 Well, my first reaction is that a course called grit lab I would have thought like students want to come in because they're taking it and want to show a lot of grit learn about grit Which means they're kind of these gritty people, or at least have the ambition to be gritty people. Yet, knowing what I know about human beings, my guess is that when it became pass-fail and we all respond to incentives, that the incentive to get a good grade was taken away. And as much as we want to say, you're in this for the learning, not for the grade, there's a lot going on in everybody's lives. My guess is that they did not put as much time, effort, energy, and passion into the
Starting point is 00:22:13 course as they otherwise would have with the no grade option. Well, Mike, Mom, I have always thought that you were quite the psychologist, and I wish you had been talking to me at the time that I was doing a song and dance for the dean, trying to get the computer system to allow me to create a course like this. And the reason why is that you're right. What happened is, instead of having an authoritarian state, I had a nanny state. So the poor TAs in the course, like the teaching assistants, oh my gosh, every week it's like they're sending email after, please send in the writing assignment that was due on Wednesday.
Starting point is 00:22:52 It's now Friday. I also reminded you on Thursday. Now you're behind by two writing assignments. Hello, you have three writing assignments that haven't been done. We really don't want to fail you. Was the fail part not strong enough? You know, I realized of late, I was interviewing this legendary
Starting point is 00:23:12 high school football coach. His name is Bob Lattiser, and he coached, I think, the winningest high school football team in history, the De La Salle Spartans in Concord, California. And he was telling me about his coaching philosophy. So I was interviewing him because he's what I study, a paragon of grit, somebody who encourages grit
Starting point is 00:23:34 in his athletes. And then he's telling me his philosophy of how you get 16, 17, 18-year-old boys to become men. Because he was like, this is not about football. This is about life. This is about character. This is about learning to be accountable to the person who's standing next to you, right?
Starting point is 00:23:53 And then he says, a lot of it is love, but it's tough love. Because what young people need is somebody who demands of them what they cannot yet do. And I'm thinking to myself, okay, I've got the love part. It's the tough that I'm not doing very well. So you're right, I should have said to these students, I'm not a nanny. You have to actually do the work.
Starting point is 00:24:17 If you don't do the work, pass fail means you fail the class. But I am no Bob Lattiser. I was like, okay, TAs, maybe you could the class. But I am no Bob Lattiser. I was like, okay TAs, maybe you could text them. I didn't fail anybody. I probably should have. Maybe you could argue that, you know, pass fail would have worked if there was more tough in my tough love. Well, the other thing you said that Bob said is that they're accountable to the person next to them. And in this class, it's just myself. And maybe if my actions impacted everybody else's pass fail around me, or if I was awful, then they all failed.
Starting point is 00:24:56 You know, this kind of innovative thinking, Mike, I mean, definitely Coach Ladd, as he's called. I think he would have loved that because one of the things he did in his coaching days He's now retired is that he had this thing called the commitment card So he 100% believed that one of the most important lessons in life and arguably the most important lesson was to understand your Interdependence with other people how they rely on you and you rely on them. That's why he loved football So he had this commitment card invention and it's a tradition that endures to this day. So a commitment card is the lowest tech possible device there is.
Starting point is 00:25:33 Three by five note. It's an index card. And on the commitment card at the top, you write your name and then you write three goals for the following week. It was football, so for his athletes and for the athletes who still play today on the De La Salle Spartans, it's a game goal, it's a practice goal, and it's a conditioning goal. And then at the end, this is the part I love, you ran into an I commit to, and then you name another player. I think they did this at the night before Friday night, you know, football, right, Friday nights, Friday night lights. So on the Thursday, they would have dinner at one of the players' homes. And then they have to basically stand up and read their goals aloud to the team.
Starting point is 00:26:17 And then look at somebody in the eye and hand them the card. And Bob says, you hand that other person a card, and you say, hold me accountable. And then that other player carries around your card for the whole week. Wow. Right? I mean, come on. I was like, if there were a Nobel Prize for football coaches, Bob Lattiser
Starting point is 00:26:42 should absolutely get two of them. Like, this is genius. So now you're in a partnership, right? Like you're with this accountability partner for the week. You're looking at them in the weight room. You're watching them in practice. You know you're being watched. And then the next week, you know what you do? You stand up with your commitment card, partner's card in your hand and you say, game goal, and then you report on it. Like, yes, no, thumbs up, thumbs down.
Starting point is 00:27:12 Conditioning goal, practice goal. And I was just interviewing one of his players, this amazing human being named Scott Hugo. And he's now a lawyer, but he's like an advocate for equitable housing in Oakland, California. And I was interviewing him and it was clear that this commitment card had an enduring effect on him as a person for his entire life. And I asked him if that were true. And he said, oh, I have a box of commitment cards in my apartment and I'll never throw them away. It taught me the lesson of responsibility. It taught me what it means to be a person.
Starting point is 00:27:52 So anyway, the point is, how could I have young people think about work the way these 16-year-old boys thought about their commitment cards and what they were going to do in the weight room that week It's like almost you can't even imagine two more opposite images Well, it's also I think partly the problem of scale, right? Bob can do this in his team and with his group but it's much harder across every academic institution and to come up with something that is standardized enough that again it is a signal to
Starting point is 00:28:25 employers, it is a signal to grad schools, and how does one do that? Just so you, Angela Duckworth, do not feel bad about your experience trying to innovate. Yeah, please. I want to go back to this article that John Marcus wrote for the Hetchinger Report where he also talked about Johns Hopkins, a report where he also talked about Johns Hopkins, the university, that reversed their policy of giving satisfactory or unsatisfactory grades to first semester freshmen. So they had sort of this same ramp up thing. Oh, they reversed it. And two of their deans in a letter announcing the end of the practice said this, covered grades, meaning satisfactory, unsatisfactory, merely delay development of steady skills and adaptation to college-level work. They were like, come on, this is life.
Starting point is 00:29:11 Nobody runs a company and says, oh, I don't care how you performed. Exactly, and oh, hey, you're a brand new hire. We don't really care for the first year, and we hope you ramp up on your own time and your own way. To your point of this accountability of commitment cards. When you join a company, you are joining a group of people and everyone has to be accountable to each other
Starting point is 00:29:34 and pull their own weight. And so just saying that other people have tried what you tried, other very smart, capable, talented people. Okay, so there was this article that I read years after I had sweet-talked the dean into letting me do whatever I wanted. And by the way, I also reversed my decision.
Starting point is 00:29:54 So I taught my class pass-fail. I ran a nanny state for four semesters, I think. Oh, wow, okay. And then I changed it to grading. And for me, it to grading. And for me, it wasn't that hard of a choice because I realized that if you're going to change this, it's very hard to be the only professor who has the pass fail course because then you know, what are your students going to do?
Starting point is 00:30:16 Like they've got everything going on. They absolutely feel stressed and you've got four classes that are graded and one that's pass fail. Like what are you going to do? Right? So I felt like teaching my class and expecting students to do all the reading and put a full-throated effort into the writing was kind of like asking people to eat a salad in the middle of a bakery. It's just psychologically dumb.
Starting point is 00:30:39 So I changed the class to be graded. I talked to my friend, Jamie Pennebaker, who's a professor at UT Austin, and he, for a long time, was like the legendary professor of Psych 1, and he's a world-class psychologist. So he also put all of his psychology into the structure of the course. And he told me that the number one most important thing was I gave a quiz every week. There's no midterm and there's no final. He was like, that's dumb because basically what you do when you have like one midterm and one final is you incentivize the students? to slack off for the six weeks before the midterm and the six weeks before the final and the cram right before and
Starting point is 00:31:20 That doesn't lead to learning. I have the clearest memory in college. In like a, I don't know, intro to biology course or something. Yeah. And I had no idea what was going on the whole semester. And I was cramming in my freshman dorm room right before the final. And I remember thinking, whoa, this is all really cool. And it makes so much sense. But I had not paid attention at all until I had to. Right. And so what you really want to do not paid attention at all until I had to. Right.
Starting point is 00:31:45 And so what you really want to do is you want to make have to more frequent. You want them to have to do the reading and have to pay attention a lot more frequently than twice a semester. So I put in these weekly quizzes and it was a freaking miracle. Like halfway through the semester, I was being asked by my students to teach more. They were like, yeah, we already saw that graph. I was like, yeah, I know, because it was in your reading. And in my head, I was like, but in my experience, nobody does the reading.
Starting point is 00:32:20 And they were like, now what do you have for us? I mean, it was the only time in my life as a professor where my students were asking me to be harder, you know, to go farther. So I have to say, I think my undergraduates learned more when it was a graded course than when it was pass fail. It was like palpable. And so this all happens to me.
Starting point is 00:32:41 I have my little journey from idealistic pass fail professor to slightly more sober graded professor with quizzes and so forth. And then I find this article called Making the Letter Grade, the Incentive Effects of Mandatory Pass-Fail Courses. And it's published by three economics professors at Wellesley. So in the fall of 2014, they say, Wellesley College began mandating pass fail grading for courses taken by first year, first semester students.
Starting point is 00:33:14 So similar to those other policies. Although instructors continued to record letter grades. So they had this great experiment. And then they run all these like fancy econometric analyses. And what they run all these like fancy econometric analyses. And what they find is that letter grades of first semester students declined by.13 grade points. And then they go on to try to unpack this and they're like, well, could it be because students are selecting different court, like maybe professors didn't teach as well. And
Starting point is 00:33:42 what they conclude is that the effect is consistent with students not trying as hard. In other words, my personal experience may not be unusual. And this isn't the salad in the bakery thing so much, right? Because all of their classes were pass fail, even without the competition of graded classes. Like maybe that's because they were brought up in a culture that had grades and then all of a sudden you take the grades away. I don't know, but I do think it gives one pause.
Starting point is 00:34:10 Right. We want people to learn for the love of learning, but people do respond to incentives and so do academic institutions and individual professors. professors, and like all things, that means that there's probably great inflation along the way as institutions want to make their students happy and professors want to have students like it there incentivized for great inflation as well. Right. And I think we should experiment and like we should try something that's the analogy to commitment cards. But I also want to say this, you never really know until you do it. I thought my experiment was great. But you know sometimes it doesn't actually work out the way You think it's going to work out if I could learn to be a little bit more like coach lad I it's a resolution I remember like hanging up the phone with Bob Lattiser, and I was like I am no Bob Lattiser
Starting point is 00:35:01 Like I think if I had to grade myself right now, I wouldn't give myself an A. I don't know what I'd give myself, but it would, I'm not a 4.0 professor. Well, in my book, you get a big A for effort. Aww. And now, here's a fact check of today's conversation. In the first half of the show, Mike and Angela say that it's much more common for college applicants to take the ACT than the SAT in the American West and Midwest. That's true of the Midwest and the Mountain West, but not the West Coast. The SAT is the more popular test in Washington, Oregon, and California.
Starting point is 00:35:40 Then, Angela says that she believes that retired coach Bob Lattiser had the winningest high school football team in history. Lattiser is the winningest high school football coach in California history, with 399 wins over the course of his 34-year run with the Dallas-South Spartans. However, Lattiser is not the winningest coach in U.S. history. John McKissick, who coached Somerville High School football in South Carolina for 62 years, retired in 2015 with 621 wins. Finally, Angela says that James Pennebaker, professor emeritus of psychology at University
Starting point is 00:36:22 of Texas at Austin, gave his introduction to psychology students a quiz every week. Pennebaker and his colleague, psychology professor Samuel Gosling, actually gave students a quiz at the beginning of every class, three times a week. In 2013, they published a paper on the success of this regimen in the journal PLAS ONE. That's it for the Fact Check. Before we wrap today's show, let's hear some thoughts about last week's episode on fear. Hi Angela and Mike. My name is Matt.
Starting point is 00:36:54 Listening to your latest episode about fear and my number one fear has always been a fear of heights. I'm okay if I'm six, eight, ten feet up or something, but more than that, I get really anxious, nervous, afraid. But a number of years ago, I wanted to see if I could get over that fear, and I agreed to participate in a fundraiser where you rappel down the side of a 14-story building. I did it. It took me nearly orders of magnitude longer than anybody else.
Starting point is 00:37:29 But doing that has reminded me that I can do things that I'm afraid of. Great show. Hi, Mike and Angela. This is Maeve from Ohio. I loved your episode on fear. I recently faced my fear of needles. It started when I was a kid. I was just really scared
Starting point is 00:37:46 to get a shot or even a finger prick at the doctor. I'd cry and hyperventilate and it was miserable for everyone, including the nurses and my mom who didn't know how to help me. I had accepted for myself that I'd always be scared of needles. Getting blood work done was my nightmare. So it was inhibiting my health choices, but it really got out of hand when I went to the dentist as a 23-year-old and decided to get a cavity filled without the numbing shot. I ended up reading a book that only had a chapter about forming new memories around fears. And if you can form a new memory with a fear in a safe way,
Starting point is 00:38:25 that it can help you just kind of break the ice. So I went to get a flu shot with my friend and realized without having had a needle poked in me for so long, I had really overestimated how much it hurt. So since then I've gotten blood work done and I'll get a flu shot. I was able to get my COVID vaccines, but now I'm actually
Starting point is 00:38:50 regularly donating blood. So getting exposed and getting used to it has been really helpful and it's given me courage to face more of my fears. That was, respectively, Matt Beckworth and Maeve Herbst. Thanks to them and to everyone who shared their stories with us. And remember, we'd love to hear your thoughts on grade inflation. Send a voice memo to nsq at Freakonomics.com and you might hear your voice on the show. Hi everyone, Angela here. I want to tell you about a special project Mike and I are working on. We're planning a series of episodes of No Stupid Questions about personality. In anticipation of the first episode, we have a really fun quiz we're excited to share. To check it out and to learn more about your personality, go to Freakonomics.com slash Big Five. Take the Big Five inventory and get an immediate
Starting point is 00:39:37 personality profile. Your results will remain completely anonymous. And if you have a question about personality, feel free to email us at nsq at Freakonomics.com. We may be able to answer your question during the series. Thanks and see you next week. Coming up next week on No Stupid Questions, when should you trust your gut? Sometimes I just need somebody to look me in the eye and say, hey, you're not crazy. Or you are crazy.
Starting point is 00:40:08 That's next week on No Stupid Questions. No Stupid Questions is part of the Freakonomics Radio Network, which also includes Freakonomics Radio, People I Mostly Admire, and The Economics of Everyday Things. All our shows are produced by Stitcher and Renbud Radio. The senior producer of the show is me, Rebecca Lee Douglas, and Leerak Baudich is our production associate. This episode was mixed by Greg Rippon with help from Jasmine Klinger. We had research assistance from Daniel Moritz-Rabson. Our theme song was composed by Luis Guerra. You can follow us on Twitter at NSQ underscore show and on Facebook at NSQ show.
Starting point is 00:40:48 If you have a question for a future episode, please email it to NSQ at Freakonomics.com. To learn more or to read episode transcripts, visit Freakonomics.com slash NSQ. Thanks for listening. I remember visiting Brown with the girls. And by the way, at the end of the tour, I wanted to go to Brown. I think they have a club, I think it's called like Bob's Club and like everybody who belongs to it just their first name is Bob or something. Anyway, Brown is quirky and adorable. The Freakonomics Radio Network, the hidden side of everything. Stitcher.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.