Is AI Making Us Stupid?

37m
AI tools like ChatGPT have taken the world by storm, with tons of people saying they use them regularly. This is especially true for students, many of whom say they use AI to get their schoolwork done. And this is freaking some of us out — we're hearing that jumping on the AI train could be a terrible idea, partly because of claims that these tools could be bad for our brains. So — are we outsourcing too much of our thinking to the bots?? Will our brains turn to mush? Or can we use AI to boost our brainpower? To find out, we talk to Dr. Shiri Melumad, expert in the psychology of technology, and Dr. Aaron French, expert in information systems.

Find our transcript here: https://bit.ly/ScienceVsAIStupid

In this episode, we cover:

(00:00) Is AI ruining or boosting our brains?

(02:45) How often are LLMs like ChatGPT wrong?

(05:01) Do LLMs mess with our ability to learn?

(19:26) Does using AI make us more productive?

(24:33) Another example of a technology that freaked a bunch of people out

(27:40) Can using AI help us learn?

This episode was produced by Meryl Horn with help from Ekedi Fausther-Keeys, Michelle Dang, and Rose Rimler. We’re edited by Blythe Terrell. Our executive producer is Wendy Zukerman. Fact checking by Erica Akiko Howard. Mix and sound design by Bobby Lord. Music written by Emma Munger, So Wylie, Peter Leonard, Bumi Hidaka and Bobby Lord. Thanks to all the researchers we spoke with including Daniela Fernandes, Dr. Marcin Romanczyk, Professor Michael Henderson, Dr. Tim Zindulka, and Professor Vitomir Kovanovicent. Special thanks also to Sebastian Peleato, Chris Suter, Elise, Dylan, Jack Weinstein and Hunter.

Science Vs is a Spotify Studios Original. Listen for free on Spotify or wherever you get your podcasts. Follow us and tap the bell for episode notifications.

Learn more about your ad choices. Visit podcastchoices.com/adchoices

Press play and read along

Runtime: 37m

Transcript

Hi, I'm Meryl Horn filling in for Wendy Zickerman. You're listening to Science Versus.

This is the show that pits facts against frying our brains with AI.

Today on the show, is AI destroying our ability to think?

A lot of people are saying, yeah, it is. And they say that we've got the science to prove it.
It's been medically verified that ChatGPT makes people stupider.

ChatGPT users could not even remember what they wrote. They basically stopped thinking entirely.
Every single time we give it a prompt, our own brain cells are burning.

And if this is true, we might be in for a brain cell bonfire because a lot of us are using AI.

One recent survey found that 62% of adults in the US say they interact with it at least several times a week. And AI really seems to be booming for students.

A bunch of surveys suggest that around 80% of high schoolers and college students say they're using it for schoolwork. And nobody's really worried about this.

Obviously, I'm kidding. People are panicking.

We have no idea how our students will ever learn anything or whether universities have any future. One professor graded papers and discovered every single one was AI generated.

The whole system is cooked. Cheating is the new major.
Game over. It's just f ⁇ ing game over.
But there is a flip side here because some people say that AI is going to be good for us.

That it can help us save time by breezing through busy work, get information for us, and accelerate scientific progress. It can do away with a lot of the really annoying, sort of tedious tasks.

It's helped me boost my productivity by like 300%.

AI is driving a transformation across all fields of science. Buckle up, tech enthusiasts.
The future with AI is bright and it's happening now.

Wait a minute. Buckle up tech enthusiasts? That last one was AI.
How did it get in there? But seriously, who is right here? Could AI help us be more productive and lead to a boom in science?

Or is using AI the equivalent of shoving your brain into the microwave? So do we stop using AI so our hippocampus doesn't turn into a hot pocket?

Buckle up science enthusiasts because when it comes to AI, a lot of people are saying chat GPT makes people stupider. But then there's science.

And full disclosure, some AI companies do advertise on science vs.

Science vs. AI is coming up after the break.

This episode is brought to you by Ford Blue Cruise. So some of the most unexpected, unforgettable moments happen in the car.

A life-changing decision, a quiet, I'm proud of you, and the kind of conversation that can only happen when you're both looking straight ahead.

And Ford Blue Cruise is about making space for those moments. Because with hands-free highway driving, you can be more present in the vehicle and more connected to the moments that truly matter.

Like this trip I took recently with some really close friends.

We were all ready to go, we had our songs, we had our snacks, we had our suitcases, but it also turned out that each of us had some things we were working through.

Maybe it was a health thing, a relationship thing, a work thing, and we all ended up bringing up like what was going on with us kind of one by one.

You know, the other people in the car would ask questions, they would offer advice where it made sense. And we ended up spending hours like this on the road.

It was almost like a group therapy session. Very impromptu.
And by the time we got to our destination, we realized that we hadn't listened to a single song on the playlist we'd made.

We'd all been too busy just talking.

Hands free on the highway, fully present in the moment. That's Blue Cruise, Consumer Reports' top-rated active driving assistance system.
Visit Ford.com slash Blue Cruise to learn more.

Available driver assist feature does not replace safe driving or driver's need to control the vehicle. Terms apply.
Consumer Reports does not endorse products or services.

To read the full report and for additional details, visit www.ford.com slash Blue Cruise.

This episode is brought to you by Ford Blue Cruise. It's not just where you're going, it's how you feel when you get there.

With hands-free highway driving, Ford Blue Cruise helps you recharge and reset behind the wheel so you can be more present in your vehicle and more connected to the moments that truly matter.

One moment that I always love is when I'm driving with a friend and a song comes on the playlist that we both love, just like an absolute jam, a favorite.

And without even thinking about it, we'll stop what we're doing, stop talking, mid-conversation, maybe even mid-sentence. Put the windows down and sing basically at the top of our lungs.

And then when the song is done, you know, usually one of two things will happen.

Either we'll play it again, rinse and repeat, do the same thing all over again, or we'll continue the conversation, pick up exactly where we left off, even if it was mid-thought, maybe even mid-sentence.

And both of those options are pretty good.

Arrive energized, ready for your hands-on life with Blue Cruise. Consumer Reports' top-rated active driving assistance system.

Visit ford.com/slash Blue Cruise to learn more. Available driver assist feature does not replace safe driving or driver's need to control the vehicle.
Terms apply.

Consumer Reports does not endorse products or services. To read the full report and for additional details, visit www.ford.com/slash bluecruise.

Welcome back. I'm Meryl Horne, and today we're going to look at whether using AI, stuff like ChatGPT, is bad for our brains.
I have senior producer Rose Rimmler here. Hi, Rose.
Hi, Meryl.

So you recently mentioned to me that you have been using ChatGPT more and more these days.

I guess that's true. My under oath.

I'm curious, like, do you feel like it's changing how your brain is working?

I do sometimes catch myself about to ask ChatGPT something

that I could do,

and I'm just too lazy. Let's, do you want to see what you've used chat GPT for recently?

I asked how many Roma tomatoes to equal 500 milliliters of pureed tomatoes?

How to clean my velvet armchair I spilled milk on it. I asked it to tell me if a couple of bottles of wine I had on Thanksgiving were dry or sweet, I think.
Dry or juicy.

Would you say it's like your go-to now for like just looking up info online? Yeah, it is kind of becoming my go-to. It's, it is.

For me, also, and I've been like curious about what kind of problems this might lead to. So, let's just address one thing first.

We, we do need to acknowledge that one big problem with this sort of AI is that it can get stuff wrong.

I actually did try to find some numbers on this. Like, how often is it wrong? And when ChatGPT first came out, it looked pretty bad.

Like a lot of the research was finding that it was only right, like roughly half the time.

I remember that from the early ChatGPT exploratory stuff. Yeah, it made up a lot of, a lot of stuff.

And now there are a couple of reviews which compared like ChatGPT 3.5 to ChatGPT 4, and they do find that it's gotten better.

But it's still not 100% accurate. So bottom line, it's like, it's just hard to tell whether it's telling you BS or not.
Yeah, that's true.

And so yeah, I do feel like that's one way it could be making us stupid is just by like feeding us incorrect information. Yes, just like the government.
Yeah.

But now on top of that, there's this other fear that it's like bad for our brains to be using stuff like Chat GPT or other LLMs, large language models.

Like if we let these things do a bunch of the thinking for us, then we'll lose our ability to think on our own or even be creative. So let's dive into all of that.
Okay.

And I want to start with this one study. It was done by Shiri Melumad.
She's an associate professor of marketing at the University of Pennsylvania. And Sheri looks at how tech is changing us.

When did you first get the idea to start looking into AI? Yeah, I mean, as a person who studies technology, it was difficult not to study AI, right? It's pretty prevalent at this point.

So yeah, Sheri just published a huge study on AI. Altogether, it looked at more than 10,000 adults.
And the goal was to see what happens when we use LLMs like ChatGPT to try to learn something new.

Like, how does it compare to an old school Google search? So here's what she did. First, she got some people to do a fun little research assignment.

I told them to imagine that a friend came to them asking for advice on the topic. So for example, how to plant a vegetable garden.

Other times they had to research something else, like like how to lead a healthier lifestyle.

And so they did some research on this thing, and half of them had to use ChatGPT for this, where the other half had to do a normal Google search, like no AI summaries, just links.

And their next job was to write up a little blurb based on the stuff that they had just read, as if they're writing up advice for that imaginary friend who needs their help.

And this is what Shiri was really interested in because she wanted to see if the advice was any different when people used Google versus ChatGPT. Okay.
And it was.

So when they used ChatGPT, the advice they came up with was sparser. It was more generic and it referred to fewer facts after participants learned from an LLM versus web search.
Mm-hmm.

That's interesting. Yeah.
So let me play you some examples so you can hear for yourself, like what it sounds like when Shiri says the advice was more generic and referred to fewer facts. Okay.

So this first one was written by someone who used Chat GPT to research how to lead a healthier lifestyle. Basically, you want to eat better foods and limit sugar and processed foods.

Get at least 30 minutes of exercise a day. Stay hydrated and also check with your doctor as well.
What do you think? Wow. It's like, it's like a lyric poem.

Yeah, you're impressed. I'm so inspired to live a healthier lifestyle.
And then she played me another one, which for me helped see what she meant by like the genericness of it.

So let me play you was one more from this ChatGPT.

Having a balanced diet, exercising regularly, staying hydrated by drinking water, getting enough sleep, and avoiding stress are ways to live a healthier lifestyle. To get more details, ask ChatGPT.

Yeah.

And this wasn't just copy and pasted. This was a human.
Remember, they did the research

and then they actually wrote, just ask GPT.

So yeah, now let me play you an example from someone who used the old school Google search for their research. So there's no AI summary.

There's just a bunch of links to click on and they could look at as many websites as they wanted. And again, the prompt is how to lead a healthier lifestyle.

So here's Sherry with one of the responses. Start with focusing on the outer, then inner of your body.

It's recommended to be active a minimum of 30 minutes most days of the week by engaging in healthy movements such as walking, riding a bike, yoga, sports, or even dancing.

From there, the inner workings. Make sure to stay hydrated with at least eight glasses of water a day, avoiding sugary drinks, and focusing on consuming a well-balanced diet.

Add a variety of foods to your diet from vegetables, fruit, seeds, and whole grains while avoiding foods high in sodium and also avoiding foods high in saturated fats.

Make sure to get plenty of sleep each night, at least eight hours or so. Always wear sunscreen before sun exposure to limit the chance of skin cancer.

That's more engaging for sure. Yeah.
Basically the same advice, but it does sound like a human wrote it. Yeah, even though I know humans wrote.

the other examples too, but it doesn't sound like they did. Exactly.
Yeah.

It sounds more human, even though like it had information that is wrong in it, like the eight glasses of water a day thing, is it actually a real, like, that's not based on science.

If you remember our hydration episode, like there's nothing magical about having eight glasses of water a day.

Yeah, that's true. But even with that, I still, it's just like more charming, like even with the flaws.
And when I took a look at the other examples that Shiri sent me, a lot of them were like that.

Here's Shiri. It's unique to the writer, right? It really doesn't come off as generic as the chat GPT pieces.

Yeah. And it sounds like they're kind of having fun with it.
Like they're, I bet they're so excited when they thought of that inner versus outer even.

That doesn't really make any sense, but I guess they're having fun. Yet it's brilliant at the same time.
Yeah.

Yeah. It does, it does read at least like the writers sort of put more of themselves in into the advice.

And in Cherry's experiments, she also asked the people who wrote the advice how they felt about it. And the group that used ChatGPT felt like they learned less compared to the people who used Google.

And then she also showed the advice to a different group of strangers and people basically liked the advice from the Google group better.

They said they were more likely to take the advice and said that it was more helpful, more informative. Okay.

Shiri, by the way, she also did the same thing with that Google's AI overview and the results were basically the same.

In both cases, the advice kind of sucks when people use large language models, whether it's ChatGPT or Google's AI overview.

Wow. The difference between how much people felt felt like they learned, it wasn't huge, but it was statistically significant.
And Sherry found it again and again with different groups of people.

So it does seem to be real.

Okay.

And if you think about like why this might be happening, why people aren't learning about the topic as deeply, it does sort of make sense because when you use something like ChatGPT for research, you are probably skipping over a bunch of steps.

And it turns out those steps are actually pretty important when you're trying to to learn something new.

It's the process of going through the links yourself, reading them, you know, digesting them yourself, interpreting them that leads you to at least feel like you're learning more.

But also we still find these differences in the content of the advice that they write, which suggests it's not just like the sense of learning, it's actually differences in learning.

So that's the important part is like doing the work of actually getting information from these different sources and then synthesizing it in your brain. Exactly.

because essentially these syntheses that LLMs provide are transforming learning from a more active to a more passive process. And that's what we're losing.

And we reached out to these companies, Google and OpenAI, which makes chat GPT, to get their take on this.

OpenAI didn't get back to us, but Google told us that the AI overview is supposed to just be a jumping off point because you do still get those other links.

But moving away from the study, there is other research that backs all this up and sort of gets at what might be going on in the brain. So this study kind of went viral.

They looked at people's brains when they were using ChatGPT. So it's called Your Brain on Chat GPT.
I don't know if you remember this one. Yeah, I do think I saw that headline.
Yeah.

Yeah, it's just a preprint. So like, and it's pretty small.
So take it with a grain of salt. But it was interesting.
So they got around 50 people and then used EEG to measure people's brain waves.

Those are like the little electrodes on your scalp. Yeah, exactly.
Then

some people used ChatGPT to write an essay and other people used Google or just their own brains.

And they found that when people were using ChatGPT, brain connectivity was the weakest, which is sort of a measure for how much different brain regions are talking to each other. Wow.

They could actually measure that. Yeah.
And so it just seems like maybe people are just less engaged when they're using ChatGPT. Yeah, that it makes sense to me that you need to

do some of the like trying and failing and then succeeding to make these connections work in order to really remember and process and add your own thoughts to what you just read or learned about.

Well, it's funny you should bring up memory because there are also studies, a couple of preprints that have found that that can also be worse when we use stuff like ChatGPT.

So

yeah, if people use ChatGPT to write something, they'll remember less of like what was in that work when they use AI.

Yeah, I mean, I think sometimes that's okay because I might be using it because I don't really care that much to learn it myself or, you know, or like whatever.

I don't really need to like commit this to memory for all time. You might not care about how to tell the difference between a juicy wine and a dry wine for like your life in general.

And if I forget the answer, I'll just ask Chad to be the girl or look back at my

previous question. Yeah.

Yeah. Okay.
So, but what she's saying is that it has, it messes with our learning process. And that is scary to think about it when we know how many students are using it.
Exactly.

Yes, which they are, right? Yeah. Which is like a lot of what I hear about.
And I think it was in the beginning, like, oh my God, the students are using ChatGPT. They're not going to learn anything.

And that's bad because like that is what you're supposed to be doing at that age. It's just like learning, learning, learning, learning, learning.
Yeah. Exactly.

And a big idea is that this learning forms the basis for critical thinking, you know, doing research, putting together your thoughts in a meaningful way.

And it does look like maybe these these LLMs are getting in the way of that. Like there was a big survey of Australian university students that asked them what they use AI for.

And most of them said that they were using it to do stuff like answer questions for them or create text that I can use.

So like that doesn't seem great.

Create text I can use, cheat.

They're admitting to it.

And so Sherry is also worried about this, about how AI will affect the next generation, since most adults, like we didn't grow up with this stuff.

We had to figure out how to do our own research and write essays on our own.

At least you and I have that foundation, but I'm really worried that younger generations won't be able to establish those foundations

because it's so tempting to outsource all of that work to LLMs and AI in general. And do you think that we have cold, hard data that says that students are getting worse at that yet?

It's hard because you need longitudinal data and these things were only introduced fairly recently.

But I do think that we currently already have data that is at least pointing directionally at what the effects are going to be.

I mean, people were cheating back in my day too. Yeah.

But now they can do it even better. Yeah.
And just one more science tidbit. If you want to get a little bit more freaked out about all of this, Rose.
Yeah, let's just

face it. Finish it off.
So there's this fear that AI will lead to something called de-skilling,

make us forget how to do things that we once knew how to do.

The thought I had when you said de-skilling was there's a term for when

if your skin ever gets peeled back off something, it's called de-gloving of your hand.

Sorry, I'm so sorry. This is the equivalent for your brain because

that like, yeah, we'll just lose these abilities thanks to AI. And I did find a study that looked into this.

So it was on a group of doctors doing colonoscopies, and they started using AI to like find little spots on the inside of the colon that could become cancer.

But then for the study, the researchers had them stop using the AI.

And it turned out that the doctors were then worse at finding the little spots on their own compared to before they ever started using the AI. Uh-oh.
Yeah, right? Not great. Right.

Like, what if they can't access it? Or if something goes wrong with the AI and worst case, doctors might start missing these little spots and those can eventually turn into cancer.

Which would totally, that would be the worst case scenario. Yeah.
Mm-hmm. Interesting.

I mean, it does all make sense because it's like you get better at what you focus on and you forget what you don't, when you don't focus on.

And you're supposed, that's supposed to happen because your brain can't

retain everything. It's sufficient.
Yeah. Otherwise, you'd have these like gigantic,

you know, these gigantic heads you'd have to have expandable skulls so of course of course that would happen yeah and now i do though think when when i'm doing something with ai i'm like do i care about losing this skill because sometimes i don't really mind but other times i do so it's helpful to think about that yeah i guess it's like if it's something i really want to improve or get better at or retain don't outsource so much of it to ai yeah so that's sort of the science that i found that supports some of the fears around what ai is doing to us uh but But next, let's look at the counter argument here.

Okay.

The claim that we have a lot to gain from using AI, that it can kind of take care of the easy stuff so our brains can do the hard stuff and ultimately use AI to do more and better stuff than we ever could have done without it.

So that's after the break. All right.

This episode is brought to you by McAfee. During the holidays, everyone's online more than ever, booking trips, checking itineraries, and grabbing deals, often on public Wi-Fi.

Luckily, McAfee's scam detector automatically spots and alerts you to travel-related scams in texts, emails, or booking sites. So you can book flights, hotels, and excursions without worry.

Visit McAfee.com slash online protection today to get award-winning online protection for just $39.99 your first year. Cancel anytime terms apply.

This episode is brought to you by Ford Blue Cruise. There's something to be said about long drives, the playlists, the games, the snacks, the goofy stuff we do for our entertainment.

Ford Blue Cruise makes these moments even better. With hands-free highway driving, it takes one thing off your plate so you can fully enjoy the drive and the company and every mile of the journey.

It makes me think of this trip I took with my best friend years and years ago. We were in the car for 17 hours each way across a lot of desert.

And we decided to keep a notebook, kind of a log for the entire drive.

Every silly inside joke, every vanity license plate that made us laugh, Every single weird place we stopped along the highway, like the haunted wax museum with a a lot of weird and creepy artifacts.

Everything, it all went into the notebook. And it ended up being such a cool thing because that notebook became this memento, this souvenir of that very, very long, very, very fun road trip.

And I still have it.

Make more memories with Blue Cruise, Consumer Reports' top-rated active driving assistance system. Visit for.com slash Blue Cruise to learn more.

Available driver assist feature does not replace safe driving or driver's need to control the vehicle. Terms apply.
Consumer Reports does not endorse products or services.

To read the full report and for additional details, visit www.ford.com slash Blue Cruise.

This episode is brought to you by eBay. Before all the algorithm fed blah and the endless sea of dupes, shopping used to feel more fun.
Find that feeling again on eBay.

It's not mindless scrolling, it's a fashion pursuit. And when you score that rare Adidas collab or the Dior saddlebag you've been manifesting, it's a rush.

eBay has millions of pre-loved finds from hundreds of brands backed by authenticity guarantee. eBay, things people love.

So good, so good, so good.

Give big, save big with Rack Friday deals at Nordstrom Rack. For a limited time, take an extra 40% off Red Tag Clearance for a total savings up to 75% off.

Save on gifts for everyone on your list from brands like Vince, Kohan, Sam Edelman, and more. All sales final and restrictions apply.

The best stuff goes fast, so bring your gift list and your wish list to your nearest Nordstrom rack today.

Welcome back. Today we're finding out whether AI is making us stupid or smart.
Rose Rimmler is here with me. Hello, Meryl Horn.
Oh, no.

I have been replaced by AI.

Already. No, I'm still human and I'm ready.
Oh, here

why AI is good. So, yeah, let's, we've talked a lot about the scary science, but I also wanted to understand the pro-AI arguments.
So, I called up Aaron French.

He's an assistant professor of information systems at Kennesaw State University in Georgia. He's also on the advisory board of an AI company.

And he was basically like, the effects of AI are going to depend on how you use it. For some people, it's absolutely going to make them, I guess,

I don't want to say dumber, but they're not going to learn or improve because of that. Other people, they're going to be able to do more with AI than they were able to do without it.

So you could either use it as like a crutch or like an enhancer. Is that the idea? Yeah.

So one obvious way that it could enhance our work is that AI could take over the mindless rote tasks for us. What are the repetitive tasks that consume a lot of time that I don't need to be doing?

And can I use AI to handle those tasks that allow me to spend my time in a more valuable way? Just the busy work. Yes.

So, yeah, the idea is that once AI does the busy work, the human brains can swoop in for the harder, more complicated parts of the task, you know, critical thinking and analysis.

And so there is science that does sort of back up this idea because it does look like AI can save people time, for one. Like there are studies finding that this is true for all sorts of careers.

So dieticians, computer programmers, people who run clinical trials. The effects were pretty big in some cases.
Sometimes it took people 30% less time to do something thanks to AI.

Sometimes it was 80% less time, depending on the thing they were doing in the study.

And an obvious caveat here is that you do need to, like for this to work, the AI has to do a good job at the thing for it to really replace. But we're hearing that in some cases, it is helping.

Teachers in particular have said that they can save a lot of time with AI. One survey found that some teachers who are using it were saving an average of six hours a week.

What are teachers using it for? Putting together materials for class, sometimes grading.

Basically, it's the type of stuff that teachers say is just hard to get done during their normal hours. And Erin's like, yeah, if you can get AI to speed some of this stuff up, it could really help.

As a professor, if I can use AI to accurately grade, that would be great because instead of spending five, 10 hours a week grading assignments, if AI can do it and provide proper feedback, I can spend that time working with the students, giving them more engagement.

Teachers do always talk about how much time they have to spend grading, right?

And so, like, Aaron spends this saved time engaging more with his students.

But this does raise a question, which is like, are most people actually going to spend the extra time doing stuff like that?

Like doing their jobs even better or engaging with the world in a meaningful way? Or are we just going to use it for like mindless scrolling or watching Love Island? So I like.

Well, that's your prerogative. You can do whatever you want to do with your extra time.
So judgy. Well, but it's like,

for the point purposes of this episode and whether or not AI is going to like lead to this like, you know, new and improved humanity, It might not do so well on that front if we're just scrolling all the time.

Like pick up the slack at some like rote part of your job and then going home and inventing a new kind of flying machine like Leonardo da Vinci or whatever. You're just like, it's lying on the couch.

Yeah.

Looking at Instagram. It feels very likely, right? And I went looking for a paper on this, like, how are people actually spending the time they saved with AI?

And the only thing I could find was this one early study, not peer-reviewed.

In it, they got 83 managers. So these are people like vice presidents and C-level executives.
And first it asked them, do you save time because of AI? And the vast majority said yes.

It was almost three hours a week on average. And they did say that they often used the time to do stuff like continue working on my tasks or take on additional projects.

But a lot of the time was also wasted. And they admitted that? Yeah.
So within this group of managers, 36% of them said they wasted at least half of the time that they saved.

Okay. Wow.
And they asked a random group of adults about this too and got similar results. Hmm.
Which feels pretty on point. Yeah.

As long as our bosses don't find out that we have all this extra time, we can just use it for watching Love Island. So let's just keep it quiet.
Stop filling out these surveys, honestly, people.

What are you doing?

But there is one other thing a different way that ai might actually make us smarter okay uh the idea is that ai will open up new doors and let us do things that we would have never been able to do without it and the scientists who think that this is possible often bring up an analogy the calculator

which does have some interesting parallels to AI because on the one hand, you can imagine that maybe people will get worse at math

because it's doing the work for you. But on the other hand, maybe we'll be able to do more things like harder math because of it.

And when calculators were first introduced to classrooms back in the 70s, it generated a similar controversy that AI is now. Like some people staged protests.

Some math teachers were worried that young kids would get hooked on calculators to do basic math problems. To write boobless.
What? Yeah.

Yeah. Over and over and over again.

I I forgot about that.

And they even had a name for these students who are calculator dependent, calcuholics.

Oh, my God. Yeah.

So the specific fear was

calcuholics would be so dependent on their calculators, they could no longer add and subtract and divide. By it with paper and pencil or in their heads.
Exactly.

Yeah, that we would lose those skills because you just type everything in and we would never learn anything.

So we've, so that's cool because we've actually had plenty of time to test if that has happened. Yeah.
So we have science on this.

And when, so I looked to see like, okay, what did happen? Yeah. And it seems like the answer is everything was basically fine.
Like there is a meta-analysis of over 50 studies on this. Whoa.
Yeah.

Which looked at what happened when kids started using calculators in the classroom. And it found that, first of all, kids' basic math skills didn't really get worse.

Like if they got to use the calculators for learning, but then they took them away for a test, they didn't do any worse on that like pen and paper test.

And if they got to use the calculators for both learning and testing, they showed improvements. So their problem solving got better.

The graphing calculator led to improvements in visualizing things and understanding graphical concepts.

And some studies found that kids' attitudes towards math was better when they got to use the calculator. Maybe because they got got to write boob bliss.

Or because, you know, these were kids who have some interest in mathematical stuff, but not arithmetic, which is basic, which is just like two plus two. And that's the tedious part.

And so they could outsource that part and dig into like imaginary numbers and trigonometry and stuff that gets more interesting. Yeah, exactly.

And so yeah, overall, the review said that the science supports using calculators in elementary and high school classrooms because our basic math skills didn't seem to get worse.

And now we can do harder math since we can use it as a tool.

Is there anything we can say though about AI specifically in the classroom? Because it's pretty new and it's different, you know, from a calculator.

Well, like we said in the first half, like some academics are worried that if we use AI too much, you know, it'll kind of inhibit learning.

But then there's also a ton of papers which show that it might be helpful in the classroom and in particular ways.

So like there is tons of studies that just try having like chat GPT give students feedback for like, you know, writing something.

And they'll find that like, look, it can help them polish their writing. And there are some researchers that are making like customizing chatbots to help students with specific learning disabilities.

and think that there's a lot of potential there. And then there are some studies that have students use ChatGPT

kind of for good, like like as a tutor. So rather than just having it give them all the answers, they'll just have it help them learn how to do like a particular kind of math problem.

And then like, it's okay at that. Like it can do as good of a job as using a textbook to learn math.
So like there is potential here. And Google told us that they're working on tools like this too.

I mean, sure, but also all those examples are the stuff that teachers are supposed to do,

you know, like human teachers. That's kind of the point.
So I guess theoretically, but often they're spread so thin.

You know, I think the idea is that this can help them address all their students' needs when like they're often just, you know, don't have enough time to do that. Yeah, fair enough.

So yeah, maybe I think the the dream is that this will be like a helpful tool in the toolbox. Yeah.
And maybe, you know, yeah, well, we're just spitting out here over nothing.

And then there are people at like the top levels of academia who are using it to solve all sorts of problems. So not just, not just talking about LLMs, but AI more broadly, like machine learning.

So, for example, in biochemistry, AI is really good at predicting protein shapes based on like amino acid sequences.

In physics, it's been used to help find black holes and analyze data from particle collision experiments in real time.

And according to a group of 1600 scientists, more than half of them said that AI tools will become very important or essential for their fields over the next decade.

It makes sense to me that there are going to be use cases where you're not going to have a physicist

piece through

200 million images of the far reaches of the universe looking for black holes. They're just like, that's not even humanly possible.

And it's certainly not possible in the span of like getting a PhD or something. So it makes sense to have the computer do it.

And there's lots of things we outsource to computers or machines that we just generally feel is a net good.

So yeah, I'm convinced that there is,

I'm convinced that there is a role for AI to be positive in personal development and like human development. Yeah.
Yeah, I agree.

For me though, as I think about all of this research, the main thing that I've been finding myself worrying about is that homogenization effect.

The fact that what we create is more generic when we use AI to do it. Like that really boring

saying healthy advice. That really stuck in my brain.

And so now I'm like trying to avoid using it for anything too creative because there's so much now about how AI can be used for creativity in all these different ways.

And I'm always now like, ooh, I don't know if I want it trying to do the things that I care about sounding like me.

But I do, I still use it just for like looking up stuff that I don't really care about that much.

Like, and all of the academics that I talked to for this episode, including the ones that found negative effects from it, still use AI.

Like Shiri, our scientist from the beginning, she's like, you know, if you just want to look up something quickly and you don't really care about getting a super deep understanding of it, use an LLM.

Yeah. Right.
It'll make your life a lot easier.

But to the extent that you actually care about learning more deeply about something, you should really try to avoid starting off your research with an LLM because it's too tempting to stop with the syntheses that you're provided.

I even see it in myself. I've studied this stuff.
And when I start with ChatGPT to learn about something,

I find it really hard to motivate to keep learning more.

So, Meryl, let me ask you:

are you worried? I mean, you have little kids too. Are you worried about

this generation coming up? Are they going to be

stupider, less skilled than, I don't know, us or previous generation because of using AI, especially using it in school instead of doing their homework.

I don't know. I'm not that worried yet.
Like, it's a couple of decades ago. People were freaking out about the internet making us stupid, you know, Googling stuff too much.

But I think we're still okay.

And, you know, even beyond that, humans have existed in so many different contexts throughout history when we were never learning how to like write essays in school about pride and prejudice.

That's true. Like, were we really all totally stupid when we were cavemen? I don't think so.
I think we were probably okay.

For whatever that context required of us. Yeah.

Yeah. And now will there be a new context because AI will, I guess, change the world in some way and everything will just be different.
Right. Yeah.
All right. Thanks, Rose.
Thanks, Meryl.

That's science versus. This episode had 59 citations in it.
Check out our transcript if you want to see all that science.

And one quick note, we've heard from some of you wondering why you have heard a little less from Wendy the past few months.

She has taken a bit of time to be with family, but you'll be hearing more from her again in the new year.

And the show will take a few weeks off for the holiday, but we will be back in your ears in January. And we have some amazing episodes in store for you in the new year.

We'll tell you the secret to happiness, according to science. We'll dig into relationships and tell you whether yours is toxic.

And we're going to give you the science on one of our most requested topics, running. Should we really be doing it? Plus the weird science of something called sad nipple syndrome.

2026, it's going to be great.

This episode was produced by me, Meryl Horn, with help from Akedi Foster Keys, Michelle Dang, and Rose Rimmler. We're edited by Blythe Terrell.
Our executive producer is Wendy Zuckerman.

Fact-checking by Erica Akiko-Howard. Mixed and sound design by Bobby Lord.
Music written by Emma Munger, So Wiley, Peter Leonard, Bumi Hidaka, and Bobby Lord.

Thanks to all the researchers we spoke with, including Daniela Fernandez, Dr. Martin Romanchik, Professor Michael Henderson, Dr.
Tim Sindulka, and Professor Vitomir Kovanovich.

Special thanks also to Sebastian Pelleato, Chris Souter, Elisendillon, Jack Weinstein, and Hunter. Science Versus is a Spotify Studios original.

Listen for free on Spotify or wherever you get your podcasts. And if you do listen on Spotify, follow us and tap the bell for episode notifications.
Talk to you next year.

Ja sell a Big Mac, McNuggets, or un sausage, egg, and cheese, McFriddles, bidetuntojocamoon meal, and a hora. Oof, nava comodarte un gustaso por tam poco.
Los extra value meals están de regreso.

Gana por la mañana con el extra value meals, sausage, mc muffin with egg, hash browns, y un cafe cariente pequeño por solo 6 dolaris. Ba ba ba ba.
Preces y participación pueden varías.

Lo peses de la promosión pueden sermenores que los de las comidas. Save over $200 when you book weekly stays with Verbo.
This winter, if you need to work, why not work from a chalet?

If you haven't seen your college besties since, well, college, you need a week to fully catch up in a snowy cabin.

And if you have to stay in a remote place with your in-laws, in-laws, you should save over $200 a week. That's the least we can do.

So, you might as well start digging out the Lounge Johns, because saving over $200 on a week-long snowcation rental is in the cards. Book now at Verbo.com.