93. Annie Duke Thinks You Should Quit

PGE and California 211 Providers Network have teamed up to prepare you for a power outage.

There are free resources available for people who have medical or independent living needs.

Dial 211 or visit pge.com/slash pspsresources.

A rich life isn't a straight line to a destination on the horizon.

Sometimes it takes an unexpected turn.

With detours, new possibilities,

and even another passenger, two are three?

And with 100 years of navigating ups and downs, you can count on Edward Jones to help guide you through it all because life is a winding path made rich by the people you walk it with.

Let's find your rich together.

Edward Jones, member SIPC.

My guest today, Annie Duke, is a psychologist, turned poker player, turned best-selling author.

Her focus in all of these endeavors, how to make better decisions.

I've had this realization that I never had stopped doing cognitive science because the thing that I was obsessed with in graduate school, which was learning under conditions of uncertainty and uncertain systems, was really what I was doing in poker.

Welcome to People I Mostly Admire with Steve Levitt.

In her latest book entitled Quit, The Power of Knowing When to Walk Away, Annie tackles one of my favorite subjects, quitting.

All sorts of systematic biases have been laid bare by the field of behavioral economics, but in my opinion, not quitting soon enough is the most costly mistake people are making in their everyday lives.

But I haven't had much success in convincing people that's the case.

Hopefully, Annie Duke is more persuasive than I am.

So, Annie, a couple of times on this podcast, I've offered my guests one of the highest compliments I can give.

I've called them a quitter.

How would you feel if I called you a quitter?

Well, knowing you, I would feel complimented.

Because you've just written a new book, and it's called Quit, The Power of Knowing When to Walk Away.

And I hope a lot of people are going to read that book, and they're going to come to realize that it is a compliment to be called a quitter precisely because we live in a world where so many forces push us to persist far too long at failing endeavors.

Yes, exactly.

What are the aphorisms?

Quitters never win, winners never quit.

If at first you don't succeed, try, try again.

Sure.

You know, everything is just quitters or losers.

I don't think that people quite appreciate how valuable the gift is that we have that is this ability to quit.

Because when we start anything, We're making that decision to start it under conditions of uncertainty.

And there's two sources, right?

One is just plain old luck.

So you could choose something that's gonna work out for you 80% of the time, but that means 20% of the time it's not gonna work out for you.

So that's one problem when we start things.

How it turns out is probabilistic.

And the other thing is that for most decisions we make, we know very little.

And I think we all have that feeling probably every day of, I wish I knew then what I'd know now.

So here we are as decision makers in this awful position of having to make a decision where making these educated guesses, but guesses nonetheless about how things are going to turn out.

So the good news for us is that when we do find out this new information that, hey, things aren't really going our way, or I found out this new information that would have made me make a different choice in the first place, we can quit what we're doing.

and go do something else.

So it's the thing that makes really decision making under uncertainty bearable.

But I don't think we appreciate that gift.

Yeah, so I agree completely.

To summarize the basic argument in your book in one sense, it would be that people stick with bad things almost always for too long.

And we'd be better off if we quit things sooner.

And if I understand it, the goal of your book is to get people to actually change their behavior.

But one thing we know is that behavior change is hard, right?

It's very hard.

There are so many cognitive and motivational forces that are working against us that generally we're quitting things too late.

And that's causing us to stop our progress.

When the world tells you that it's time to switch to something else, if you don't do that, you're going to be sticking to something that isn't allowing you to gain ground toward your goals.

But if you quit when the time is right, that's going to speed you up because that's going to allow you to switch to something, another opportunity, and really defray those opportunity costs.

One of the things that I'm trying to do in in the book is create motivation for people to actually try to get better at this, but just knowing about it doesn't really help.

You have to actually put tools in place that will allow you to be a better quitter.

And the overall theme of the tools is think in advance.

Don't trust yourself to be good at making decisions in the moment.

We have to start to be good advanced thinkers about when we should and shouldn't quit.

So I think actually you and I believe the same thing, but we have different ways of interacting with the world.

That could be.

I think it's completely obvious you should quit.

And I stop there and I figure, well, everyone else should just know that too.

And what you're actually encountering is the fact that you and I and maybe like seven other people on the planet think that quitting is a good idea.

And you're trying to meet them halfway and pull them along gently to hold their hand and take them with you to make them true believers.

I don't have the patience for that, but I'm glad that you do.

I think you're actually right.

What I'm really trying to achieve in the book is to translate the science for people.

And it's part here, I'm going to give you these tools that are going to help you be better at it, but also I'm going to let you know that the problem exists because I'm not sure that people know that they have this problem.

I don't think that most people do think they have a problem with quitting too late.

I think most people completely mistakenly think they have the opposite problem.

They think they quit too much just because they've been socialized so brutally and completely to believe all those things you said, like how quitters never win and winners never quit.

So I think there's a lot of therapy and counseling you have to do if you really want to get people to believe in quitting.

Somebody wrote me who knows about this work that I've done.

And she said, thank you so much.

for giving me permission because I just quit my job where my boss was toxic and this had been going on for a long time

and i had been thinking about quitting but i was unwilling to do it because i thought it would be a failure on my part i thought that in order to show character that i needed to stay in this situation but now that i've seen what you're saying i quit today and First of all, I'm so happy that that's the result for this woman.

But also, doesn't that say how negatively we view it?

How much we think that quitting is synonymous with a lack of character and sticking to things is synonymous with character itself.

So I want to talk about grit versus quitting.

Grit, of course, is a very popular book by psychologist Angela Duckworth, who also co-hosts the podcast, No Stupid Questions.

And her book is about the value of perseverance.

And naively, it seems like grit and quitting might be polar opposites.

But I actually think when people say that, they're totally confused.

So let me give you my take on it, and then I want to get your reaction.

Let's say you've got a long-term goal.

You want to write a new book or win a gold medal in the Olympics or quit smoking, get a PhD, finish a triathlon, whatever dream excites you.

In pursuit of that dream, there will likely be many tasks along the way that are painful or boring or exceedingly difficult.

And grit to me is the ability to persevere through the tough patches in pursuit of a worthwhile goal.

Okay, but quitting, on the other hand, it's something totally different.

It's about assessing whether our goal is actually worthwhile.

It's about recognizing early that things are unlikely to turn out well, even if you are gritty in pursuit of that goal.

It's the awareness that time spent pursuing the gold medal, you'll never win, or the PhD that will lead you to a job you don't really want, that that time could be better spent pursuing another dream, applying your grit to something that

actually has a higher expected payoff.

So at least to me, you can be the grittiest person on the planet and be a serial quitter.

What do you think of that argument?

People have asked me this question, like, are you more quitty or gritty?

And I said, I'm both.

Obviously, I'm gritty.

I've done a whole bunch of stuff.

For one thing, I wrote a whole book that takes grit.

But I'm a total quitter for just the reasons that you said.

I think I feel a little defensive for Angela Duckworth.

Everybody interprets her as saying, just stick to things, that that is how you build character.

And she would agree that that's totally absurd.

Sometimes you do decide that the goal that you're pursuing is worth it, but that the

particular road you're on in trying to achieve that goal is not the right road.

You're not using the right strategy.

You're not using the right tactics.

And I would say the book writing is actually a really good example of this.

I have had book ideas where I kind of started working on it and I was trying to write the proposal.

And then I decided, you know what, this isn't the right book to write.

And so I've tossed that.

But also, when I'm thinking about even the book quit or thinking in bets, which did get published, I did tons and tons of quitting along the way.

There were whole sections that I wrote that I ended up throwing out.

There were whole narratives that I wrote that never appeared in the book because I quit them.

So I think about that not so much as like walking off the court, but as changing direction, as deciding that the particular defense that we're using isn't working.

So we're not going to leave the court, we're not going to quit the game, but we're going to change what we're doing on the court.

And I think that that's a really important form of quitting as well that we overlook.

I like what you said about classifying yourself as both gritty and a quitter, because that's what people should strive for.

The people who are both gritty and quitters, they shine because they work hard, but they work on the right problems.

And the very saddest cases I see are extremely gritty people who haven't learned how to quit.

And it's so common in higher level academics because most people who enter PhD programs, they have no idea what they're getting into.

I mean, I know I didn't.

And it turns out that liking a subject in college and being good at it, that just isn't a very good predictor of being good at doing academic research or more importantly, enjoying doing academic research, doing what academics do.

And I see so many students sticking with PhD programs when they should have quit years earlier.

And so many young people who get their PhDs, then they pursue academic careers, even though they know at some level, it's the wrong choice.

They just feel locked in.

And that's actually a fate you narrowly escaped, right?

Well, I did five years worth of PhD work at the University of Pennsylvania.

And at the end, I got sick.

And I ended up in the hospital for a couple of weeks with a stomach illness that was pretty chronic at that point.

And I really actually needed to just take time off in order to take care of myself.

And it happened to be right when I was going out for all my job talks.

So I had to cancel all of my job talks.

And it was during that time that I found poker out of necessity because I needed to make money.

So what ended up being something that I wanted to do in the meantime to make money turned into an 18-year-long career that was actually quite successful.

Whenever you're pursuing something, that means that there's a whole bunch of things that you can't pursue.

And all of those other opportunities that you're foregoing have gains and losses associated with them.

The problem is that when we're pursuing something like a PhD,

we are so focused on the path that we're on that we actually completely neglect the opportunity costs.

What are the things that we could be doing instead that would make us really happy or allow us to gain ground toward what those broader goals are that we have in our life, where I assume that if you're trying to pursue a PhD, it's not so much about the PhD, but something about fulfillment and happiness that the PhD has become a proxy for.

So when we're forced to quit, we now have to go explore all those other opportunities that we've been neglecting.

in service of pursuing the goal that we've been trying to achieve.

And that's certainly what happened to me.

And then I found something amazing because of it.

Should it take an act of forced quitting to get us to explore the other options that we have, the other opportunities that we might have available in our lives?

Or should we be trying to incorporate this type of exploration without the world foisting that necessity upon us?

During COVID, Phil Tetlock, who wrote Super Forecasting,

reached out to me and asked me to do some research on counterfactual forecasting with him.

And so we did four pretty large-scale studies.

And then at the end of it, he said, you know, you could just write this up and turn it into a PhD.

So I am now currently enrolled as a graduate student at the University of Pennsylvania.

And I should be defending my dissertation in the spring.

But I think that's also a really important lesson about quitting is that we think that quitting means closing a door permanently.

But usually the door is still unlocked.

You know, and if you decide that you want to go back and do it, you can usually open that door back up and head right back in.

We had a student at the University of Chicago who had taken his qualifying exams in 1960 and he had gone and had a wonderful career and about 50 years later he decided he wanted to come back and actually complete his PhD.

And there was a lot of confusion around what the requirements were and whether he was still grandfather Dan and could do it.

And ultimately, they decided that if there were three faculty members who would be willing to be on his committee, then he would be allowed to pursue his PhD.

It turned out there was one faculty member, D.

Gale Johnson, who had actually been on the faculty 50 years earlier and

who remembered the guy and wanted to do it.

And then Gary Becker and I also said that we'd be on this.

And it was really fun to watch this 70-something year old man who had become a big player in the strawberry industry, write a really great thesis 50 years later on strawberries and come back and defend it.

compared to our usual students who grumble all the time.

Yeah.

This was a guy who there's nowhere else on the planet he would rather be than writing up this dissertation.

I have to re-qualify, but that's okay.

It's interesting that you end up writing a book about quitting when it seems to me quitting didn't really come very naturally to you.

Having spent some time around Danny Kahneman, the Nobel laureate behavioral economist, he's terrible at making decisions.

And I once asked him, I said, Danny, how can you spend your life studying decision making and still be so terrible at it?

And he said, well, I'm good at studying decision making because I'm so bad at making decisions.

It gives me intuition.

Do you think your own limitations at quitting, your forced quitting, do you think that helps you communicate about quitting better than somebody who naturally was a quitter?

I think maybe I have more empathy for it because, you know, it did take that act of forced quitting to get me to quit graduate school.

I grew up with a father who prided himself on never missing a day of work, no matter how sick he was.

And this is what was instilled in me.

He would play tennis matches where his whole body would start to cramp up.

And he would finish the matches.

He would go to the hospital, get electrolytes and come back for the finals the next day.

I myself am a tennis player.

And I have to confess I have played district championships with a broken toe through a lot of pain.

It's a little bit how I'm built and it's a little bit how I was raised.

And when I left graduate school and became a poker player, even though I was so successful, I always felt some sense of shame for having quit, like a pretty strong sense of shame.

So you suffered with two decades of guilt about making a decision to quit.

That was obviously a really good decision.

And I think that is what is so awful about what our society has done with quitting.

Even someone who's thoughtful like you are and who thinks about quitting is forced to carry this baggage of shame.

That's the real problem.

The problem isn't just that people quit too late.

It's that people suffer when they quit.

That's what I loved about your book is it is exactly permission not to beat yourself up for the next 20 years if you decide to quit.

That's part of why I wrote it, because I wanted people to stop getting that message that it's not okay to quit, that I think was very deeply instilled in me.

We'll be right back with more of my conversation with Annie Duke.

People I Mostly Admire is sponsored by LinkedIn.

As a small business owner, your business is always on your mind.

So when you're hiring, you need a partner who's just as dedicated as you are.

That hiring partner is LinkedIn Jobs.

When you clock out, LinkedIn clocks in.

They make it easy to post your job for free, share it with your network, and get qualified candidates that you can manage all in one place.

And LinkedIn's new feature can help you write job descriptions and then quickly get your job in front of the right people with deep candidate insights.

You can post your job for free or choose to promote it.

Promoted jobs attract three times more qualified applicants.

At the end of the day, the most important thing to your small business is the quality of candidates.

And with LinkedIn, you can feel confident that you're getting the best.

Post your job for free at linkedin.com/slash admire.

That's linkedin.com/slash admire to post your job for free.

Terms and conditions apply.

Raise a glass of Sierra Nevada, and you'll taste more than just a beer.

You'll taste a trail-blazing spirit.

You'll taste pure ingredients, sustainable brewing, and a commitment to community.

And you'll taste a world of flavor-from the legendary pale ale to the citrusy and smooth, hazy little thing, and beyond.

It's flavor that takes its time, so you can make the most of yours.

See for yourself refined beer is sold.

Sierra Nevada Brewing Company tastes what matters.

Please drink responsibly.

People I Mostly Admire is sponsored by Mint Mobile.

From new shoes to new supplies, the back-to-school season comes with a lot of expenses.

Your wireless bill shouldn't be one of them.

Ditch overpriced wireless and switch to Mint Mobile where you can get the coverage and speed you're used to, but for way less money.

For a limited time, Mint Mobile is offering three months of unlimited premium wireless service for $15 a month.

Because this school year, your budget deserves a break.

Get this new customer offer and your three-month unlimited wireless plan for just 15 bucks a month at mintmobile.com/slash admire.

That's mintmobile.com/slash admire.

Upfront payment of $45 required, equivalent to $15 a month.

Limited time new customer offer for first three months only.

Speeds may slow above 35 gigabytes on unlimited plan.

Taxes and fees extra.

See Mint Mobile for details.

So, my son was playing soccer, and he wasn't very good at it.

In fact, he was terrible.

He was about nine, and on the way to one of his soccer matches, we got into a conversation.

I said,

How good would you say your team is in the league?

Like, how does your team rank among all the teams in the league?

And he said, accurately, well, I'm on the worst team in the league.

And I said, How would you rank yourself in terms of skill among all the players on your team?

And he said, well, I'm the worst.

So I said to him, if you're the worst player on the worst team in the league, what do you think that says about you?

And he said, I think it says I'm really bad.

And I said, don't you think it says you should quit?

And he said, yeah, I probably should quit.

And that was the last soccer game we ever went to.

Most parents would probably not use that strategy, but I thought it was right.

And interestingly, he later, the same kid who was so bad at soccer, went on to be one of the top 10 fencers in his age group in the USA and quit.

Quit at the top, said, I don't like doing it.

And it was hard to watch because it was actually really fun for me to go to his fencing tournaments and fun to have a world-class athlete as a son.

But when he said he wanted to quit, what could I say except for fantastic?

He must have wanted to quit so badly to walk away from this thing that was giving him so much identity and so much positive feedback.

He must have been so miserable.

And I knew immediately that he must be making the right decision.

That's so amazing.

If your son had said to you, I know I'm the worst player on the worst team, but I love it.

Right.

Then I think that that's okay because I think that these things are a matter of values, right?

Like, what are the things that you value or not?

I think we need to recognize that there's no objective way to determine as an observer, is this something they should continue to pursue or not?

Except, I mean, there's extreme cases like you're in the middle of a snowstorm on top of a mountain, turn around.

But in these cases, it's more nuanced than that.

And it has to do with what someone's own values are.

If my child had said to me, I'm the worst player literally in the league, but man, I totally love it.

I'd be like, okay.

But if your child said, I know I'm the worst player in the league, but I think if I work hard, I'm eventually going to make the Olympic team at soccer.

And that's why I'm doing it.

That's where I think as a parent, you got to figure out.

Maybe you let them pursue the dream, but dreams that have no chance of coming true are probably not the best dreams to pursue.

One of the best ways to become better at quitting is to think in advance.

There's some pretty deep scientific work, particularly by a wonderful scientist named Barry Stah, that says when we get signals from the world that the path we're on is not working out, that we ought to quit what we're doing, we don't actually pay attention.

As you described with the PhD student who sort of keeps going even though they're unhappy, we know that intuition is just plain wrong.

In fact, when we get those negative signals, we'll escalate our commitment to the losing cause.

In other words, we'll double down and triple down on the path or the goal that we're trying to pursue for a variety of reasons.

One of which would be we don't want to feel like we wasted our time up until this moment.

So if we know that we're not going to pay attention to the signals, one of the things we can do is as much as we possibly can, determine those signals in advance.

Okay, I'm going to start this thing.

Let me imagine that things go quite poorly.

What are the signals that I'm going to be seeing that would tell me that I ought to walk away, that things aren't going well?

And we write down a list of those signals and we call those kill criteria.

Doing that advanced work will actually get you to be much more likely to pay attention to them and quit earlier than you otherwise would have, which is really good for you.

Because if things aren't going well, you want to quit as quickly as possible so that you can go do something that would be better.

So like in the case of your child, they're playing soccer and they say, yes, I'm the worst in the league, but I'm going to make the Olympic team, which would be overly optimistic.

And over optimism is one of the things that stops us from quitting.

So we want to sort of help our child through that.

We can say, okay, I'm totally with you, bud.

You have a dream of becoming an Olympian.

Maybe that can actually happen for you.

What do you think would have to happen in the next year?

or the next six months or during this season that would tell you that you're you're getting way better at soccer and that eventually making the Olympics is actually like a realistic goal that you ought to keep pursuing.

And you can work that out with them.

Like, how many goals do you think you would have to score?

Or, you know, if they're a goalie, how many stops would you be making?

An example of this that's really simple would be like, if you're thinking about letting somebody go who's in your employee, which is something that we know that we do too late and firing somebody is quitting.

When you have that moment of thinking, maybe this person isn't working out, instead of assuming that you're going to be rational about making that decision to let the person go, sit down with them and say, all right, like, I think we can both agree that things aren't working out.

They'll say, I know I can turn it around.

And you'll say, I have no doubt that you can turn it around.

So let's look at what does turn it around mean.

Imagine it's six weeks from now and your performance is really improved.

What does that look like?

And you can write those benchmarks down.

And you can agree that if you don't hit those benchmarks or if you're still seeing some other signals that would be adverse or negative, that you're then going to have that conversation.

It's going to be reasonable for you to terminate the employee-employer relationship.

And it just turns out that we're better at actually following through on that than if we sort of leave it to our own devices to pay attention to those signals when we come across them.

It's my strong impression that a lot of what trips people up is that don't keep track of time very well.

Yes.

The key to me about these kill criteria is that they're thresholds with a time stamp attached to them.

If I haven't grown revenues to a million dollars in three years, then I'm not on track to be a billion dollar company.

That three years is really, really important because once you get into the thick of it, You always feel like, ah, I've got a million dollars and revenues right around the corner.

If I can just do this, I can just do that.

But the problem is you can just do this and just do that forever and never get resolution.

And so that I think is a really powerful idea that you have to tie your goals to a time frame to make them more realistic.

Yeah, it's what I refer to as states and dates.

So the best kill criteria contain a state and a date.

If I am not in this state by this date, I must quit.

If I am in this state by this date, then I can continue.

It's just essentially just a deadline because the deadline could also be if I haven't achieved these particular benchmarks after having spent a certain amount of money.

So that would then basically put a limit on the time as well.

So just as you say, you're trying to limit the amount of time that you're in a losing endeavor for exactly the reason that we lose track of time.

Otherwise, it's always right around the corner.

And I think this brings up a problem with quitting, which is this interesting asymmetry.

Like once we start something, we kind of want to know how it turns out.

And this is where we get into this issue, which is that if you want to know how the thing you're doing turns out, the only way to do that is to keep doing it.

Richard Thaler, a Nobel laureate in economics, What he said to me is generally we won't quit until it's no longer a decision.

In other words, there's no hope.

You've butted against the certainty your startup is out of money and you can't raise another round.

You're in a job with a boss that is so toxic that you have used up all your vacation and sick days and you're still having trouble getting yourself into work.

And I thought that was so insightful to the point of what you just said.

The reason why kill criteria need to have a date.

You need a time stamp, a deadline, is because as long as there's hope, there's always some chance we can turn it around.

And that moment where we go from failing to having failed is so horrific for us as humans that we'll just keep going until we're certain that we had no other choice.

So let's talk about the academic evidence on quitting.

Quitting is a hard question to study.

What's the academic research on the subject that you find the most compelling?

There are so many, but I would love to talk about one by a certain person named Steve Levitt, if that's okay, because this is one of my favorites.

Sure.

That's my all-time favorite study I ever did.

Here's the thing.

If you quit on time, meaning at the objectively right moment, it will feel like you quit too early, usually.

Do you want to describe the the study?

Sure.

It was a super simple study.

I just built a webpage.

And on that webpage, all we did was we said to people who were having trouble making decisions that we would flip a virtual coin for them.

And so we would have them tell us what they were struggling with.

Maybe they couldn't decide whether to quit their job or to end a relationship or to get a tattoo or which college to go to.

And then

we would flip a coin.

And if the coin came up heads, they should make a change.

and if the coin came up tails they should stick with it and what was great about it is that a lot of people came something like 25,000 people came and believe it or not they actually followed the coin toss not always but something like two-thirds of the time people followed the coin toss and so what we were able to do was compare people who were thinking about quitting their job and got heads relative to people who were thinking about quitting their job and got tails.

And we could follow up in three months or six months later and ask them how life was.

Was their life better?

And we also tried to get them to give us the name of a friend who might give us an even more truthful response about how life was treating their friend.

And overwhelmingly, what we saw is that the people who got heads, who were prompted therefore to make more changes, reported having higher happiness six months later, saying they would make the same decision again given the chance.

I found it to be overwhelming evidence that people who thought they were indifferent between making a change or not, it turned out those people actually did much better when they made a change when they didn't.

This is such great work showing that when we quit on time, it will feel like we're quitting too early for the reason that by the time we experience the choice between quitting and sticking as a close call, it's not actually close at all.

So by definition, that means that we're really really getting to that decision too late.

I mean, who's gonna flip a coin to make a big life decision except someone who thinks it's a 50-50 choice?

They have to, by definition, believe that they're as likely to be happy staying in their job as quitting their job.

They're as likely to be happy staying in their relationship as quitting their relationship.

So they have to be experiencing this decision as a close call.

But what you found was that no, it wasn't actually close at all.

On average, the people who quit were happier.

Now, Now, if it were as they experienced it, an actual close call, then the quitters and stickers would end up equally happy six months later.

So, what that shows us is that we're just getting to this decision too late, partly because of a lot of the cognitive biases that make it very hard for us to walk away from things.

And that's what I think is so beautiful about that work that you did, is that it shows so clearly that our calibration is just way off on this.

You're listening to People I Mostly Admire with Steve Levitt and his conversation with Annie Duke.

After this short break, they'll return to talk about why Annie quit poker.

Firestone Complete Auto Care's epic savings event is the sign you need to stop putting off your car's maintenance.

And you can save up to $100 on tires and services while you're at it.

Don't wait.

Call Firestone Complete Auto Care for an appointment.

So you've got your streaming subscription sorted, but every now and then, live TV FOMO hits hard.

Good news!

With Passes by Sling, get instant access to live TV when you want it.

Big football game tonight?

Grab a day pass.

Baseball series?

Try a week pass.

Show or movie marathon?

You guessed it.

Weekend Pass.

Introducing passes.

Get the live TV you love for the day, week, or weekend starting at $4.99.

Sling lets you do that.

Offer applies to Orange Day Pass, restrictions apply.

Honey, do not make plans Saturday, September 13th, okay?

Why, what's happening?

The Walmart Wellness Event.

Flu shots, health screenings, free samples from those brands you like.

All that at Walmart.

We can just walk right in.

No appointment needed.

Who knew we could cover our health and wellness needs at Walmart?

Check the calendar Saturday, September 13th.

Walmart Wellness Event.

You knew.

I knew.

Check in on your health at the same place you already shop.

Visit Walmart Saturday, September 13th for our semi-annual wellness event.

Flu shots subject to availability and applicable state law.

Age restrictions apply.

Free samples while supplies last.

Well, I can't bring Annie Duke on this show and not talk about poker.

She was a true poker celebrity and she earned more than $4 million in live tournaments over her career.

She retired from poker a decade ago, but she still remains the fourth highest earning female poker player of all time.

All right, so let's talk poker.

You spent roughly 20 years playing poker professionally, and you had great success in big tournaments.

Now, the oddest thing about you as a poker player is that you're a woman.

And back when you were competing, only three or four percent of the competitors in these big tournaments were women.

That's actually still true.

Is that true?

The absolute number of women are greater, but not the proportion.

So do you think it helped you or hurt you to be a woman at the poker table?

Separate from what was happening at the table, it was easier to get an endorsement because I was unusual.

But in terms of the actual poker play, I think it was quite helpful, partly because I was unusual and also reasons having to do with just like stereotyping and somewhat with misogyny.

So the men you were playing with.

Not all.

So many of the men you were playing against, what did they think that you were going to do that you could then turn on its head and do the opposite?

There were two main ways that it expressed itself.

In one case, you would be playing with somebody who seemed perfectly nice, but they didn't give you credit for being able to think more than a level deep.

What that meant was that they sort of created a one-to-one mapping between your action and your cards.

So if you raised, they assume you had to be strong because they didn't really give you credit for the creativity it would require to bluff in that situation.

If you check, they assume you were weak.

And that's great, right?

Oh, it's amazing.

What a gift because it deserves some game.

And if they make such blatant mistakes, you just exploit them.

So, in that particular case, if you're playing with someone like that, you can bluff them a lot.

Right.

Because they're giving you credit for a hand that's stronger than it is.

And they don't think that you have the masculinity, I guess, to bluff, like the courage, whatever.

There was another type of person who also really disrespected you, but in a particular way that had to do with a threat to their masculinity.

So the idea that a woman might outplay them or outthink them would be horrifying.

This would be sort of the category of person who thinks, what are you doing at a poker table?

This is my space.

You don't belong here.

You should be barefoot and pregnant in a kitchen somewhere.

And they wanted to assert themselves over you.

So that expressed itself as like hyper aggression.

So their goal was like, I'm going to bluff you and then I'm going to show you my cards.

That was kind of what they were trying to achieve so that they could dominate you in that way.

So also that's wonderful.

I'm actually surprised to hear you say that you'd like it.

when people are super aggressive because I would think that that's a tough thing to deal with at the table.

Well, I think that where most people go wrong is when someone's really aggressive, they try to be aggressive back.

But that's not actually the right strategy.

You can think about it as a pricing problem.

If I'm playing in a game, when I think about the hand that I'm going to play, I have some sort of expected return on the hand because there's only so much that you're going to bet.

So if I'm playing in a game with people who are pretty tight, where the pots are pretty small, I'm not going to get as much return on any hand that I play because they're keeping the pot small.

So that means that the price for whatever I I bet is going to be smaller.

But if I'm playing with somebody who's being very aggressive toward me, that means that they're going to bet more than somebody else would in their circumstances, which then is going to increase my ROI because they're sort of artificially increasing the size of the pot.

So I did play some poker and I decided that I should participate in two World Series of poker events.

And the first one was a complete disaster.

I literally did not win a single pot.

Oh my gosh, that's horrible.

I sat there at the table for two hours and I either folded or lost every hand.

Undeterred, though, I decided to enter another event the next day.

My luck is a lot better than it was in that first tournament.

I keep on getting into big hands with this guy who's sitting just to the right of me.

And I'm beating him over and over.

And people at the table are shaking their heads and they're muttering because I obviously have no idea what I'm doing.

I don't don't know how to stack my chips and I forget to ante and everything.

And this guy is swearing at me repeatedly.

He's insulting me.

And finally he barks at me, don't you know who I am?

And I look at him and I say, honestly, I have no idea who you are.

And he says, I'm David the Dragon fam.

And that was supposed to impress me, but I still didn't know who he was.

Now, it turns out he was a two-time card player magazine poker player of the year, and he's won over $10 million in live tournaments.

But look, I didn't know who the guy was.

And here's how my story relates to what you were saying, Annie.

Oh, it totally relates.

It was obvious from his comment and the reactions of the people around the table that I was somehow supposed to play differently because this was David Pham.

I was supposed to defer to him maybe or believe he had better cards than everyone else.

Anyway, it made me wonder whether just being a big name might give you an advantage in the tournaments, making people fear you.

But I also think that that works the opposite of the biases that I think many poker players had about women.

And so I wonder whether overall, maybe it was harder to be a professional woman poker player because you weren't getting all the benefits that the other male professional poker players would get in terms of fear or respect.

I mean, I think that's true.

Look, when someone's playing really aggressively at you, you sort of become what's called a nuts peddler.

The nuts, it would be the best hand, but when you're talking about a nuts peddler, you're talking about someone who's playing very, very good hands, which it sounds like you were.

Like you were just getting really good cards and then David was trying to assert himself over you and you were sitting there with the best hand waiting for him to do that.

So you actually are displaying exactly the strategy that I was talking about, which is when someone's being very aggressive towards you, you actually tighten your play up.

You can afford to wait longer because the size of the pot you're going to win is going to be so much greater for your waiting.

The other reason that you're supposed to wait is that when you're playing someone who's trying to assert themselves over you, it's also much harder for you to bluff them.

We can think about this relationship between the strength of your hand and your ability to bluff.

The weaker the hand that you play, the more likely that the only way that you will have eventually out of that hand is to bluff somebody right to win with the worst hand the stronger the hand you have the less likely you're ever going to have to bluff in a game where bluffing is very easy because it's very easy to push the people around and make them fold good hands you can play many more hands you can play hands that are much weaker because you have really two ways to win the hand one is you could have the best hand the other is you can make the other people fold and do you think that in general that was an advantage to the well-known players that people somehow attribute to them better hands than they really have because they're famous?

I think in general, that is true.

You will sometimes come across somebody who just really wants to have a story.

You know, like people wanted to have stories about knocking Phil Helmuth out of a tournament.

And I think that that's a lot of the advantage that Phil Helmuth has because people want the story.

They want to knock him out.

And then he'll have the best hand.

And they knock themselves out in going for the story.

And I think that from the day that I sat down at a poker table, before I was ever well known, I came across both of these types of people.

The ones that didn't give me credit, I could bluff a lot against because they didn't think that I was capable of bluffing.

The ones that just were kind of mad that I was there and didn't want to lose to a woman.

Well, those people I couldn't really bluff because they were going to call me because they wouldn't want to be outplayed by me.

Right.

So, therefore, I had to be much more careful about the types of hands that I was playing against those people.

Now, I think that as I got more famous, people started giving me credit.

So, everybody started shifting into that category of, I just want to have a story.

I want to knock her out.

And so, I had to actually tighten my playup

because it just became harder and harder for me to bluff people.

Now, you were obviously extremely successful at poker, but I'm curious whether it was hard for you to just be a poker player.

I mean, there's nothing at all wrong with being a poker player, but it's not necessarily viewed by society as a high status job.

And you were on this high status track before you stepped off.

Were you haunted by that?

When I first started playing, I was just so deeply interested in the game and trying to figure out how do you solve?

for playing in this environment where you can't see other people's cards.

There's a lot of luck involved.

It's very, very hard to close feedback loops.

When we think about biases like the sunk cost bias, for example, you would hear players say, well, I couldn't fold because I had too much money in the pot, like because of the sunk cost fallacy.

And I could feel those forces exerting themselves on me.

I could feel like self-serving bias exerting itself on me, which is just like, if you lose, it's because of bad luck.

And if you win, it's because you're great.

Of course.

Yeah.

I could certainly see that in other players.

And trying to solve that problem really captivated me for a few years where everything else went out of my head.

But, you know, when I think about that regret, that shame that I felt about quitting academics, it's a lot of because of what you said,

you know, which is a lot of people had put time into me.

They had trained me to do something that was supposed to be better for the world than what I was doing in poker.

Which is interesting because you were providing so much you should enjoy to so many people.

People love to watch you play poker on TV.

It really was socially probably far more rewarding than what you might have done as an unhappy academic.

The chances of doing anything useful are probably really, really low.

So it's interesting that society has such a pull in that regard.

It's a little bit different now.

You know, I think that poker players are cool in a lot of ways now.

But when I started playing poker, it wasn't on television.

It wasn't on the internet.

People would talk to me about it and ask questions about it.

It would generally end with something like, have you considered gamblers anonymous?

Interestingly, though, I don't think that that had anything to do with my

starting to really come back to cognitive science, which happened in 2002.

I was very pregnant with my fourth child and I got asked to come to speak to a group of options traders about how poker might inform their decision making and that environment.

And it was this real aha moment for me where I started thinking explicitly about the way that those two disciplines informed each other.

And I had this realization that I never had stopped doing cognitive science because the thing that I was obsessed with in graduate school, which was learning under conditions of uncertainty and uncertain systems, was really what I was doing in poker.

It was just a different way to explore the topic that was really fun and really interesting and really hard.

And when I got asked to give that first talk in 2002, I could feel something light up in me.

And I knew that was something that I couldn't let go of, that conversation

between those disciplines.

And I still haven't.

Looking back, knowing what you know now about quitting, did you have quit poker sooner?

Oh, for sure.

No question about it.

There were a lot of things that were going on in poker that were kind of miserable.

And I think the reason why it took me so long to walk away is the reason why a lot of people have trouble walking away from things.

It was part of my identity.

I was a poker player.

And in the most public way, I was a poker player.

Even though I was spending most of my time doing speaking and consulting, my public face, the way that people knew me and the way that I identified myself was as a poker player.

And if there's one thing that I learned from writing this book, the hardest thing to walk away from is who you are.

That's the most difficult thing we ever face.

Quitting is hard.

It's hard for me.

It's hard for Andy Duke.

It's probably hard for you too.

And given the data I've seen, about half of the people who are listening right now should be quitting something.

And by that, I mean there's something, a job, a relationship, a habit, a limiting belief.

that you're on your way to ending.

That in your heart, you know you need to quit.

That you will eventually quit, but maybe not until years from now.

The time you waste putting off quitting, you'll never get that back.

We've all been socialized to think quitting is wrong.

The data say the exact opposite.

So maybe today will be the day you decide to quit.

And if so, I'd love to hear from you because there's nothing I admire more than a quitter.

And now, a question from a listener.

Hi, Steve.

So our listener, Will, wrote to us.

He's an academic in Australia where there's an increasing interest in using academic research to launch spin-off companies.

Will is in favor of this, and he wants to know what you think of this trend.

Well, you know, Morgan, I'm often quite definitive in my answers to questions, but this is one where even I am going to be wishy-washy because I think it's just a hard question.

Now, let's just be clear what behavior we're talking about.

Academics do their research and they come up with some kind of insight or invention, and then they're able to go and launch companies in which they can benefit potentially dramatically financially from the insights that they've gained by doing research in an academic sphere.

And that's the issue under debate.

Should academic who's doing research while employed for a university should be allowed to have direct and potentially enormous financial gain based on the insights that they come up with.

So just as an example from academics we've had on this show, chemist Carolyn Bertozzi has actually launched, I think, 10 spin-off companies based on research she or her students have done.

And Jennifer Doudna, the creator of CRISPR, has also launched a company based on that research.

Those two both have won Nobel Prizes for their research, and I think they've been pretty successful with their company.

So what are the downsides of academics doing this?

The first one is that if you're spending your time trying to commercialize an idea, you're distracted from the basic tasks that the university pays you to do, teach your classes or come up with other inventions that would be good in the public domain.

The second con is that These incentives could distort people away from the projects that have the greatest social benefit and towards the projects that have the greatest personal benefit.

In other words, those in which the opportunity for profit are the highest.

And the third con, which is quite extreme and hopefully not very common, is that we know that people respond very strongly to strong incentives.

And so you could imagine real academic malefeasance, fabricating data, intentionally misinterpreting results that would be more likely to happen if you have a billion-dollar company on the line than if you're just trying to get your next paper published in an academic journal.

How often do you think it's true, though, that a company that was started from academic research actually goes on to be a very profitable thing?

I think Carolyn Bertozzi even said that while the hope is to make money off of these companies, her drive was really more to bridge the gap that often occurs between academia and the real world, where unless she starts a company, her research never really sees the light of day and never lands with the people who could actually benefit from it.

In some ways, I think if all of these academic spin-offs, all these commercialized ideas never actually make anybody any money, then that's worse than them making money, right?

Because it sounds like the academics are spending a lot of time trying to promote their ideas, but their ideas aren't actually very good.

That being said, it often takes a lot of imagination and vision to see how a basic research finding after tweaks and twists and changes and improvements is something that people are willing to pay a lot of money for because it does a lot of good.

And I think it's often the creator, the academic himself or herself, who is likely to have that vision, to be able to see what's really important about what they're doing.

So we talk about R D, there's basic research and then there's more applied development.

That gap is big and it's often the case that if the researcher doesn't have the enthusiasm to bridge that gap, that it will never be commercialized.

In terms of you being a little undecided in how you feel about this, what are the benefits?

Just so we are spelling out both sides of the argument.

Sure.

So the obvious benefit is that it's motivating.

If you can financially benefit, then it gives you stronger incentives to do good research.

At a more subtle level, you could imagine that knowing that you can get rich as an academic might lead really good people who otherwise wouldn't be drawn to academics into academics.

A second potential benefit is that it distorts the incentives of academics to work on projects that are more commercializable.

Wait a minute.

That sounds awfully like one of the cons you listed just a minute ago.

It is exactly what I said for one of the cons,

because it's just not clear whether distorting the incentives of the researchers is a good thing or a bad thing.

Many pet academic projects are of interest only to the academic.

There's no way in the world that it could ever lead to any good in society.

Whether this kind of distortion is a pro or a con depends on whether you think academics left to their own devices are going to work on the most important social problems or whether they're going to piddle away their time working on pet projects that nobody cares about.

And the third benefit that comes to mind, which is a little more subtle, which is if you're a university employee and you develop ideas, the university owns that intellectual property.

So it's not that these researchers are getting all the benefit themselves.

They're sharing that benefit with the university.

Most universities are of the mind that this is good research, research that leads to a lot of money coming into university coffers.

That's the kind of research they like, they support.

So am I right in thinking that it's pretty rare for an economist to be able to create a spin-off company from their research?

My 25-year career, I've never had an idea that anybody would ever want to pay for.

So there hasn't been anything I've ever had to try to commercialize.

Wait a minute.

A lot of people paid money to read Free Economics.

Now, I get that that's not a company, but does the university benefit from having a professor publish a popular book?

Well, they do not benefit financially.

If you go out and write a popular book like Freakonomics, that is heavily based on the research I did while I was employed at the University of Chicago, they don't try to take any of the royalties.

And believe it or not, I was actually on the intellectual property committee at the University of Chicago for a year, and I'd never thought about that.

And the more I I sat in and listened on these disputes, which were happening in the hard sciences, where professors were complaining because they felt like they owned the intellectual property, but the university claimed they owned it, the clearer it became to me that it was quite odd that the university had never come knocking on my door and asked for any of my royalties.

In that year I was on the committee.

I was very tight-lipped about that particular issue and didn't want to even get people thinking about what I think really would have been quite fair.

But our royalties have gone way down now, so I'm ready to have that topic be discussed.

Will, thank you so much for writing.

If you have a question for us, our email is pima at freakonomics.com.

That's p-im-m-a at freakonomics.com.

It's an acronym for a show.

We read every email that's sent, and we look forward to reading yours.

In two weeks, we'll be back with a brand new episode featuring my good friend, economist John List, who I suspect will come to be viewed as the most important economist of my generation.

I applied to 150 schools when I went on the original job market in 1996.

One of the 150 gave me an interview.

People I Mostly Admire is part of the Freakonomics Radio network, which which also includes Freakonomics Radio, No Stupid Questions, and Freakonomics MD.

All our shows are produced by Stitcher and Renbud Radio.

Morgan Levy is our producer, and Jasmine Klinger is our engineer.

Our staff also includes Neil Carruth, Gabriel Roth, Greg Ripon, Rebecca Lee Douglas, Julie Canfor, Zach Lipinski, Ryan Kelly, Catherine Moncure, Eleanor Osborne, Jeremy Johnston, Darik Lennard, Emma Terrell, Lyric Bautich, Alina Coleman, Elsa Hernandez, and Stephen Dubner.

Our theme music was composed by Luis Gara.

To listen ad-free, subscribe to Stitcher Premium.

We can be reached at Pima at freeconomics.com.

That's P-I-M-A at freeconomics.com.

Thanks for listening.

Steve, I'm tone deaf.

Like truly, if you heard me sing, it would be painful to you.

The Freakonomics Radio Network, the hidden side of everything.

Stitcher.

What is awe and then some?

It's

and then it's

It's all sorts of awesome.

It's awe and then some.

Visit lake Tahoe.com.

Honey, do not make plans Saturday, September 13th, okay?

Why, what's happening?

The Walmart Wellness Event.

Flu shots, health screenings, free samples from those brands you like.

All that at Walmart.

We can just walk right in.

No appointment needed.

Who knew we could cover our health and wellness needs at Walmart?

Check the calendar Saturday, September 13th.

Walmart Wellness Event.

You knew.

I knew.

Check in on your health at the same place you already shopped.

Visit Walmart Saturday, September 13th for our semi-annual wellness event.

Flu shots subject to availability and applicable state law age restrictions apply free samples while supplies last did you know tide has been upgraded to provide an even better clean and cold water tide is specifically designed to fight any stain you throw at it even in cold butter yep chocolate ice cream sure thing barbecue sauce tide's got you covered you don't need to use warm water additionally Tide pods let you confidently fight tough stains with new coldzyme technology.

Just remember, if it's gotta be clean, it's gotta be tied.