Landlords Demand Your Workplace Logins to Scrape Paystubs
YouTube version: https://youtu.be/KtvSBb6rtHE
Landlords Demand Tenants’ Workplace Logins to Scrape Their Paystubs
18 Lawyers Caught Using AI Explain Why They Did It
How Ruby Went Off the Rails
Subscribe at 404media.co for bonus content.
Learn more about your ad choices. Visit megaphone.fm/adchoices
Listen and follow along
Transcript
Hello, and welcome to the 404 Media podcast, where we bring you unparalleled access in the worlds, both online and IRL.
404 Media is a journalist-founded company and needs your support.
To subscribe, go to 404media.co.
As well as bonus content every single week, subscribers also get access to additional episodes where we respond to their best comments.
Gain access to that content at 404media.co.
I'm your host, Joseph, and with me are 404 Media co-founders Sam Cole.
Hello.
Emmanuel Mayberg.
Hello.
And Jason Kebler.
You sound clearer to me.
You sound like you're coming in at high death.
It's maybe because I'm standing up.
I converted.
I have one of those converters where I can move the desk up if I want.
Maybe now.
Your windpipes are different.
They're unconstricted.
Exactly.
Lungs, diaphragm, windpipe.
I mean, I feel a lot better standing up.
I spend so much time in front of this computer talking to all sorts of strange, unusual, fascinating people, but I'm usually cramped up in my chair for it.
So, yeah, I think it's much better to be standing up now.
Don't you have a standing desk, Jason?
I do.
Should I stand?
Are we standing?
Yeah, go for it.
Well, Sam's going to ask me.
I'm going to convert.
I will not be standing.
I'll be lying down.
Sure.
Well, Sam is going to ask me the questions for for this while Jason, for those that are watching on YouTube, can see his camera slowly moving up.
Hiring is almost always such a grind.
You post a role, then you wait and wait, hoping the right candidate shows up.
Meanwhile, you're probably getting inundated with irrelevant resumes, reaching out to people who don't reply, or worse, finding great talent, but they're not even looking for a job right now.
Well, the future of hiring looks much brighter because ZipRecruiter's latest tools and features help speed up finding the right people for your roles.
So you save valuable time.
And now you can try ZipRecruiter for free at ziprecruiter.com/slash 404media.
With ZipRecruiter's new advances, you can connect with qualified candidates in just minutes.
If someone catches your eye, you can unlock their contact info instantly.
Plus, with over 320,000 new resumes added every month, your chances of finding the right fit fast just went way up.
Use ZipRecruiter and save time hiring.
Four out of five employers who post on ZipRecruiter get a quality candidate within the first day.
And if you go to ziprecruiter.com/slash 404media right now, you can try it for free.
Again, that's ziprecruiter.com/slash 404 media.
ZipRecruiter, the smartest way to hire.
Sam, do you want to take the headline of this?
Yep.
So the story headline is: landlords demand tenants' workplace logins to scrape their pay stubs.
A lot happening in that headline, and a lot of things to instantly get upset about in that headline, but we'll unpack it.
I mean, I guess I'm curious if anybody else has ever had like a wild landlord experience.
Like, if there's anything
insane that landlords have had you do to get an apartment, I mean, I feel like New York City landlords, it's like the most degrading experience.
It's also the most expensive is what I was going to say.
That the poorest I've been was actually not when I was making the least money I've made, but when I was moving to an apartment in New York, and it's like first security,
security deposit.
I think it was also last,
and then also the fee for the broker.
And it's like the broker
is like the fucking biggest scam out there, which I know they've tried to legislate away several times, but still exists as far as you know.
Every time you think it's going to go away, and then they're like, psych, we're actually keeping it.
But yeah, that was like all our money.
Me and my wife said it was all our money.
And I remember, I don't know if Jason remembers, but there was like a month in the vice office where I was eating rice and beans.
And that was because I literally had no money because I was moving.
And then also, I was going to say, like, first apartment I got, the most humiliating thing is I had to have my parents co-sign because I was a child.
And they're like, didn't trust me to pay the rent.
I love how you're like, yes, the landlords or the brokers or whatever took all my money.
So I had to eat rice and beans.
And I'm like, that's just literally what I eat.
Every single time.
Just your favorite food.
food yeah i've i proudly have never had to pay a broker fee like i always managed to somehow find one without but i feel like if you're trying not to do a broker's fee in new york city then you're very limited on like which places you can get um
my story is like i i haven't had any that crazy but the
Like the situation in New York City with apartments is always that you go and you look at the apartment and there's like
the genre of apartment that's street easy disappointment, where it's like look, the pictures look nice, but they're all like taken from like 0.5 zoom, and so they look a lot bigger than they actually are.
And then it's like, you know, in a weird basement with like weird lighting or something, or it's just like obviously going to be infested by rodents or something like that.
Um, but the situation in New York is like when you find a good apartment, you basically have to like commit to one living there, and then also, as Emmanuel said, giving like a ton of money kind of instantly.
Like, I remember the longest that I've ever delegated or deliberated on an apartment was like 20 minutes in New York.
Like, that's as long as you're allowed to think about it.
Otherwise, it's gone.
And so, when we moved into an apartment in LA,
like, I have a good rent-controlled place here now.
And when I was looking at this apartment, there was like
15 other people looking at it.
Um, and they were asking the broker, like the person who was showing it things like, Oh, like, are you gonna keep these cabinets?
Or like,
does the refrigerator like, can you replace the refrigerator?
And I was like, There's no way, like, you just throw money at them immediately.
And, like, we came with our application ready, like, checks ready because I had like learned from New York City.
So, just like immediately, there's no thinking.
It's just like, we live here now.
Like, we're moving in right now.
Like, here's all of our stuff.
They don't even have to give you a fridge in LA, which is wild to me, or a a stove or any of that shit.
It's very, very crazy coming from New York, where I think usually if you see a fridge in an apartment, that's your fridge if you're viewing the apartment.
I've definitely turned down apartments because of broker fees before because they didn't do anything.
They didn't even unlock the apartment.
They were like, here's a lockbox,
$900, please.
So this story
came to you, Joe, through a tip, which is how many of our best stories arise.
Um, what was the tip?
Yeah, so I mean, everything you just said, all of those, it totally sucks.
But now,
landlords are being like even more invasive, it seems.
Whereas before, maybe you just have to prove something about your income or show them, hey, I do have a full-time job, or even, you know, several part-time jobs.
I can pay the rent and you have to prove that.
I got this tip that somebody
in Georgia, they were a potential renter, a potential tenant, and they tried to rent an apartment.
And it was one of the most invasive things I believe they've seen and that I've definitely heard about, which is that they were basically forced to hand over the login credentials, not for their own bank account, which you might do,
you connect it with Plaid or whatever it's called, and you can verify your income that way.
They were told to you have to hand over the login credentials for your employer's sort of workday instance.
And Workday is this horrible tool that we're all very, very familiar with,
having worked at Vice.
We don't have Workday for Rifle Media.
We don't have Concord, we don't have any of these big corporate tools, but they had to hand over those logging details.
And these various companies and tools that we'll talk about in a minute, they just would scrape their pay stubs en masse, even though to get the apartment, they were told, oh, you just need to show, I think it was two months or something, four pay stubs if you're being paid every two weeks or whatever it is, right?
The tip was these tools are scraping way, way more information than is actually required to get the apartment.
The person doesn't really know what happens with that data.
And they sent me a bunch of screenshots to prove it as well.
Yeah, the amount of like software as a service involved in getting an apartment is also increasing and egregious.
So, this, the, the software we're talking about here is called Approved Shield.
Um, what does Aprove Shield actually do?
Yeah, so Aproove Shield is the first part, and they're basically like a tenant screening service.
And I'm looking at their website now.
And of course, it's marketed to landlords.
And the idea is that you outsource verification of your potential tenants to us.
And we'll use various pieces of technology or whatever to do that.
And Approved Shield says it can, again, just reading the website now, dramatically reduce eviction rates,
transform tenant profiles within a year, which I presume means you change the sort of people renting your apartment.
You don't change the profile of the person exactly.
You reduce bad debt and delinquency, all of these sorts of promises.
I almost see it kind of like
these anti-fraud companies, almost like a KYC company as well, know your customer, but it's really for landlords who are trying to figure out who is this person who's trying to rent in my building or at my apartment.
Do they have enough money?
And, you know, frankly, do I want them to be renting from me?
And I'm definitely going to look into these companies more.
That there's a bunch more.
Approved shield is not unique whatsoever, but that's just the one that this tipster happened to be told: hey, if you want to rent this apartment in Georgia,
you have to go through these steps.
Yeah, so what happened when they actually did go through the approved shield process?
Yeah, so they go through it, and this little widget is how they described it.
It starts to use
another tool called Argyle.
And we'll talk about them in a minute, but Argyle, A-R-G-Y-L-E,
the tipster said they watched Argyle hijack their workday session.
Again, they had to provide the login details for their employer's workday.
It stayed hidden from view, and then it downloaded every pay stub plus all of their W-4s back to 2024.
they know this because in their email they kept getting these notifications from workday saying hey your pay stub from xyz date uh is ready to be printed and you know when you export data out of workday you have to maybe wait a little bit or something like that same with google takeout you get a little email notification telling you it's ready and i saw this screenshot and there's like 14
at least 14 notifications there.
Obviously, that is way, way more than the four pay stubs necessary to actually rent this apartment.
And then, you know, they or their employer went through workday
audit logs as well.
And they found that it was from two IP addresses that are not theirs, obviously, and also from a MAC address.
And a MAC address is just, you know, a unique identifier for a device on a network.
You can cycle MAC addresses.
Sometimes iPhones do that as far as I know.
But basically, the takeaway was he'd given these login details to Approved Shield because his landlord said he had to.
Then this other company he's never heard of mass downloads all of his data in a pretty sketchy way.
This is something you would usually associate with some sort of mass web scraper or something.
But it went in and it downloaded all of this data.
So then they contacted me.
Very crazy.
I would be freaking out if Workday was just like like downloading pay stubs through the years without my permission.
Well, it looks like you've been having what is going on.
Yeah, exactly.
Right.
Yeah, I would be, I would be panicking.
Do we know of any other companies that are like doing something along the same lines?
I'm scared to even ask
that or no to the answer to that because I'm sure the answer is yes.
Yeah, there's a few more.
There's one called Pay Score, which someone else actually contacted me about.
And I need to follow up with them and look into what they showed me.
There's Nova Credit, which judging by the name and my cursory look of the website and I'll look more into them, they're not just about tenant approval and their leadership actually includes a co-founder of Argyle as well.
So there's a connection there.
And then another one called Snapped with a T, not an E D, also uses Argyle.
So clearly, you have all of these different tenant screening companies selling their services to landlords or buildings or whatever.
Then Argyle, which is the actual company in the tool doing this pretty unusual, sketchy scraping, is working with a bunch of them.
Or, you know, at least two of them, it seems, if not more.
Yeah.
If you're in IT or security, you know the struggle.
Tons of devices, identities, and applications to monitor, and employees who use technology in different ways.
Sometimes it can feel like the attack surface is just so big.
But I love how OnePassword makes it easy to cut through the noise and keep accounts and identities secure.
Over half of IT pros say SaaS apps are their biggest challenge.
And with SaaS sprawl and shadow IT, I can see why.
That's where Trellica by OnePassword comes in.
It discovers and secures access to all your apps, managed or not.
Treleka inventories every app your team team uses, then use pre-populated app profiles to assess risks, manage access, optimize spend, and enforce security best practices.
You can handle shadow IT, securely onboard and off-board employees, and meet compliance goals, all in one place.
I've used OnePassword to manage all of my own accounts for years, and it couldn't be any easier.
I simply couldn't recommend their products any more than I am.
They've totally simplified my digital life in a way that makes me feel secure.
OnePassword is trusted by millions of users and over 150,000 businesses, from IBM to Slack.
It's ISO 27001 certified, regularly audited, and even has the industry's largest bug bounty.
Take the first step to better security for your team by securing credentials and protecting every application, even unmanaged shadow IT.
Learn more at onepassword.com/slash 404.
That's onepassword.com/slash 404, all lowercase.
Fall is planting season.
Did you know a lot of plants actually do better when planted this time of year?
That's why I love fastgrowingtrees.com.
It doesn't matter if you're in the sunny south or where the air is getting chilly.
Their plant experts can help you find the perfect fit for your space.
Personally, I was blown away when I ordered from fast-growing trees.
I'm someone who spends all my time at nurseries googling whether a plant is likely to survive in my backyard.
Fast-growing trees, on the other hand, has all that information right on their website, helping me figure out what types of plants and trees would survive at my house.
No messy car rides or wasted weekends at nurseries, just a few clicks online and my trees showed up in my door in days, happy, healthy, and thriving.
I picked up an Arbaquina olive tree, a dragon fruit plant, and a bird of paradise.
I'm thrilled with how they arrived and they seem thrilled to be in my backyard.
Fast Growing Trees has over 6,000 plants for any space.
Fruit trees, flowering trees, shrubs, even indoor plants.
Every single one goes through a 14-point quality checklist and comes with their Alive and Thrive guarantee, so you know they'll last.
This fall, they have the best deals for your yard, up to half off on selected plants and other deals.
And listeners to our show get 15% off their first purchase when using the code 404Media at checkout.
That's 15% off at fastgrowingtrees.com using the code 404media at checkout.
Now's the perfect time to plant.
Use 404 Media to save today.
Offer is valid for a limited time.
Terms and conditions may apply.
Check out the link below or in the show notes and support the show.
Joseph, is Argyle different than Plaid?
It's so weird that they are both clothing-related companies that seemingly do very similar things.
Yeah, that's a fair point.
I think that Argyle would say, hey, we're no different from Plaid.
And Plaid, for those who don't know, is basically, you know, an API and a tool for linking up lots of different payment systems at once.
So let's say, I don't know, you use an accounting firm and they need to look at all of your different accounts.
I think you can do it like that.
I've used it to link up various different accounts before as well.
So Argyle, I think, would say, hey, we're no different to them.
What does make them a little bit different, and I'll just answer this question now since Jason brought it up, Argyle has done some pretty unusual stuff or is connected to some pretty unusual stuff.
So I actually covered Argyle several years ago, back when we were all at Motherboard, the tech section of Vice.
And for that, there were all of these very weird phishing pages going around where they would send emails to people or there'd just be web pages and they would say, hey, are you an employee of JP Morgan?
Give us your workday login details and we'll give you 100 bucks because we're trying to democratize financial data.
I think there was also stuff around gig workers as well.
And it was an organization called Workers Unite, very progressive,
labor-focused, lefty.
branding.
A bunch of security researchers that I spoke to at the time found this very odd.
And I then went in as well and analyzed some of the web traffic.
And you could see that there were connections between Workers Unite's website and argyle.com, if I'm remembering correctly.
And I said, well, what the hell is this financial company, which was a startup?
Why are they connected to this?
They never responded.
When I started to write about it and security researchers found out about it, the site suddenly went offline.
So was Argyle running it and harvesting data?
Was it one of their clients?
I don't know, but they were really strongly connected to that sort of thing.
If anyone knows Plaid doing something like that, let me know.
Or if you know about another Argyle sort of operation connected to that doing similar, let me know.
But that was really unusual.
They were straight up phishing pages, and I hadn't seen Plaid or any of the other companies do that.
And that's why I was interested in this in the first place.
It's insane.
I wonder if a lot of this is also
these things are effective because people are just just so used to having to like connect your accounts to do with like literally anything online.
It's like earlier today, I was like trying to connect to like a an app that compares Uber and Lyft prices.
And it wanted me to connect my Uber login and my Lyft login.
I was like, why the do you need that?
That's information that is publicly available if you don't have a login, but like they benefit from getting your your data that way.
So I wonder if people are just like used to,
I don't know, their privacy being invaded basically constantly.
I mean, ideally, these apps are not
doing things without users' consent when they connect that way, but
there are like privacy gateways that are involved.
But I don't know.
That's why something like this is successful, I would think, or part of why.
Yeah.
I mean, once you give over those login details, you don't necessarily, I mean, you don't.
You don't know what Argyle or Approve Shield is going to do with them.
Are they going to log in once and just scrape all the data one time?
They're already scraping more data than is necessary by the landlord.
Handing over those creds could create all sorts of problems for you.
Crazy.
So are there like, I mean, this sounds, it sounds illegal to me, but like, and it sounds like it could also be something that could get people into legal trouble
in both directions.
What are the kind of the legal implications around
something like this?
Yeah, when I covered Argyle way back with those phishing pages, we included a couple of paragraphs that this sure looks like it could violate US hacking law, which is the Computer Fraud and Abuse Act, the CFAA, and very broadly, generally speaking, you can't share logging credentials that you do not have authorization to share, basically.
So let's say it's your own Facebook profile, and maybe you give your login creds to your partner or something because you want to be locked out of your Facebook profile.
It seems pretty unlikely that anyone would prosecute that.
Of course, there's two things.
Is it a crime and is it a crime that anyone's going to prosecute?
I don't really think people super care about that.
Now,
if you are an employer, and we'll just use Vice as the example, when we were back at Vice
and we were logging into workday that contains all of this information not just about us but about the company as well right there's org charts in there all this corporate information if any one of us took those credentials and then basically gave them to another company i mean
at the minimum you're going to get yelled at maybe you're going to get fired because that's a like a serious security concern and also potentially there's a legal issue there as well and of course i mean since Argyle exists, I'll give them the slight benefit of the doubt, and that they have probably got lawyers who said this is okay, but you know, they've never responded to my request for comment, so I don't know.
And I would love to hear their argument on this if they're able to provide it.
But if I'm Argyle and I'm using those login details to go into a workday that Vice or whoever the employer has has not given me authorization to do, maybe Argyle is committing a crime there as well.
So, yeah, there's this legal stuff,
but really, I'm kind of worried about the workers, that you give over your details, your security team is like, what the fuck is this?
And what is this system logging into our workday?
Yeah, that could cause real, real issues for it.
And to be clear, I haven't heard that happening, but the response to this article has been,
well, people are pissed because it's got landlords in there, it's got hacking in there, it's got weird startup doing phishing pages as well or being connected to phishing pages as well.
It's nuts all around.
Yeah, it's got a little something horrifying for everybody, which is a classic 404 media blog.
Yeah, anything else on Argyle?
I guess if you're Argyle, please hit up Joseph.
If you have gotten in trouble because of Argyle, please hit up Joseph.
But yeah, anything else to add on this?
Or
should we move to the next horrifying story from 404 Media?
Yeah,
nothing to add.
Plenty more horrors to come after the break when we're going to talk about how lawyers, well, rather, lawyers are now admitting it and saying why they've been using AI after they've been caught.
We'll be right back after
this.
As the weather cools, I've been swapping in pieces that actually get the job done.
Warm, durable, and built to last.
And Quince delivers every time with wardrobe staples I can rely on.
Quince has the kind of fall staples you'll actually want to wear on repeat, like 100% Mongolian cashmere from just $60, classic fit denim, and real leather and wool outerwear that looks sharp and holds up.
I've also got my eye on their suede trucker jacket, which is perfect for layering and looks really casual but put together.
And here's the thing: by partnering directly with ethical factories and artisans, Quince cuts out the middleman.
That means premium quality at half the cost of similar brands.
I've been wearing this 100% European linen long-sleeve button-down most of the summer.
And now that it's fall, I can easily layer it with some of the high-quality heavyweight t-shirts I've gotten from Quince.
We've also picked up a Quince throw blanket that's great for getting cozy on the couch.
Layer up this fall with pieces that feel as good as they look.
Go to quince.com/slash 404media for free shipping on your order and 365 day returns.
Now available in Canada too.
That's quince.com slash 404media.
Free shipping and 365 day returns.
Quince.com slash 404media.
So many of today's biggest tech trends wouldn't even be possible without the digital infrastructure running behind the scenes.
We see the fancy new tools and software, but we don't see the edge compute and cloud systems that actually run them.
That's exactly what the new podcast Interconnected from Equinix is all about.
If you care about this stuff, check out Interconnected, a video and podcast series where the hosts sit down with industry experts and visionary thinkers to unpack the megatrends shaping the future.
They don't just cover the flashy tech, they show you the infrastructure that makes it all work.
The first episode dives into the AI renaissance in medicine, breakthroughs like rapid diagnostics, personalized treatments, optimized clinical research, and faster drug discovery, all powered by interconnected data systems.
My personal favorite so far is their episode on the digital infrastructure that will help secure our food systems for people all over the globe.
Today's farms are high-tech, utilizing advanced mapping, precision agriculture, and new sensors that help farmers produce the crops that feed the world.
Discover the digital infrastructure powering today's biggest tech trends with Interconnected.
Follow Interconnected on YouTube, Apple, Spotify, or wherever you get your podcasts.
All right,
and we are back.
I'll take the questions this time.
Jason, this is one you wrote, I believe, with Jules as well.
And the headline is: 18 lawyers caught using AI explain why they did it.
You and Sam as well have been all over lawyers, judges in some cases as well, using AI in lots of different ways.
It seems to be, maybe crisis is too strong, but like it keeps coming up in the legal profession.
So hold off the reasons from these 18 lawyers first of all, but just like, what are lawyers actually using AI for?
Is it writing briefs?
What are they actually using it for, first of all?
Yeah, so I think we've talked about this at some point on the podcast.
Sam has definitely written about this a few times, but back in like 2018, I wrote wrote an article about how AI was going to revolutionize the legal profession, which is just to say that was eight years ago,
like seven, eight years ago.
And for a very long time, it's like everyone in law keeps sort of saying like
LLMs are going to fundamentally change the job.
And the job, of course, like most of the job of a lawyer is researching.
and writing.
You know, very little lawyering is actually like going to to trial and arguing in front of a judge.
It's a lot of writing briefs, it's a lot of researching arguments, things like that.
If you're watching on YouTube, my camera keeps overheating.
I just sold out
that.
Yeah.
It's very hot out here.
So sorry about that, but I will be back on.
There I am.
So, I mean, there's an entire industry or part of the industry that's paralegals, that's legal assistants, that are interns, people whose entire job is to research precedent and other cases and things like that.
And AI sort of promises to do all of that for you.
And like the entire currency of law firms is like billable hours.
So it's like, how long are you spending on any given thing?
And so, like, nominally, if you can replace a lot of this work with AI, you can like
maybe charge the same.
I mean, I've talked to a lot of lawyers.
And so it's like really a big ethical question.
It's like, are you charging people the same amount of money, even if you're using AI?
But then you also have like clients who are saying, why are you charging me so much money for all this research time?
Like just use AI to find the case that you're citing, things like that.
So it's a mix.
Like lawyers are using it to do their research, but then they're also using it to write the briefs.
And that is like the actual legal arguments that end up getting filed in court.
And so
what has happened is judges judges keep finding
lawyers who have written briefs where they cite cases that don't exist, where they're basically just like hallucinating precedent, hallucinating laws, like citing laws that don't exist, things like that.
I don't know if I mentioned this ever, but I actually like had a landlord beef with my own apartment, but I needed to like file something.
And so for the first, really, this is the first time I ever tried to use ChatGPT.
but I asked it to write me like a legal brief to like fight with the landlord.
And
I got something back that looked like a legal letter.
And I then cited, like I checked the citations that it, it said, and almost none of them were real.
And when they were real,
they were referring to, they were referring to real laws, but they were not like,
um,
interpreting that law correctly.
Like they were referring to real laws, but then they were saying that it said something like totally incorrect.
So anyways, a lot of lawyers have been doing this over the last few years.
And there's a database now of lawyers who've been caught doing this.
And it's over 400
worldwide.
It's not just the U.S.
problem, but the vast majority of them have been in the U.S.
And you,
presumably, you're in this database as well, considering you just admitted that you used.
I never filed that.
I never used any of that.
Oh, okay.
okay.
Yeah, you proofread it, and you were like, wow, this is complete garbage.
I'm not even going to get it.
And I threw in the trash, yeah.
Right.
Okay.
So
there's this database which you referenced.
I believe it's linked to in the story as well.
Why was this useful?
Because it contains all these cases where lawyers have been caught.
And if that, and then what did you do after that?
Yeah, so the researcher is named Damien Charlatan.
He's in Europe.
I forget exactly where, but I spoke to him before doing this story.
And he has been documenting all of the cases where a judge has basically been like, hey, you used AI.
You should not have used AI.
You cited a case that didn't exist.
And he has a really awesome database that sort of like explains what happened in each of these cases.
But what Damien does is he summarizes like
what the AI use was.
And he pulls like one document from each of those court cases.
But what he doesn't do, and I understand why,
is he doesn't pull the documents where the lawyers are forced to apologize and explain why they used AI.
Because
basically, in each case, the judge is like, you filed a nonsense brief that, you know, hallucinated AI.
Like,
why did you do that?
You have to correct it.
You have to apologize.
You have to sort of like say why you shouldn't be sanctioned, which means either, you know, you could be disbarred in some cases.
I don't think lawyers have been disbarred yet, but some have been suspended, some have had fines, things like that.
And so I went in and Jules, we sort of split them up and we
tried to find the document where the lawyers apologized and explained like why they used AI.
And I thought that that was really eye-opening because there has been quite a lot of reporting about the fact that lawyers are using AI, but not a lot about like the underlying impulses as to why they're doing it.
Yeah.
And their reasons for doing it, which we'll go into next, are different from what they're using it for.
You know what I mean?
Like, what they're using it for, as you said, is writing briefs or doing research or apparently lighting their careers on fire when the AI fabricates case law or whatever.
So
what are some of these reasons?
Because I was kind of surprised at how varied a lot.
It's not as simple as, I don't know, I didn't feel like doing it.
Like, there's a lot of actual different reasons going on here.
Yeah, I mean, I guess to summarize, it's like the reasons are almost uniformly very bad.
Like, the vibe is like, the dog ate my homework almost like entirely.
Like, they all, not all, but the vast majority of them try to come up with some really extenuating circumstances for why they used AI.
Some of them said that they weren't, they didn't know that AI could hallucinate.
Like they were unclear that this was even possible.
Like a lot of them sort of explained themselves to be not technical or like they've never, like they thought that ChatGPT was doing something different than it actually was.
A lot of them use LexisNexis products or Westlaw products, which are, they are legal products.
And so they're marketed to lawyers.
And nominally, they're supposed to be like pretty good at not hallucinating, but in some cases they do.
And then a lot of sorry, just on that.
So the LexisNexis product, the legal product, that might have chat GPT or some sort of AI integrated in it as well.
Is that what they're saying?
So LexisNexis, well, it's not Nexus.
It's like Lexis.
is a gigantic database company that has a bunch of different products for researchers, including some for lawyers.
And
they have several different legal products and some of them are legal research tool products and they have begun incorporating AI into those products.
Westlaw similarly is a huge database that I believe is made by Thompson Reuters, like just massive, massive company.
And
these are like really, really expensive pieces of software.
And over the last few years, they have begun integrating AI and LLMs into their products.
And so,
you know, I can't speak specifically to these two products because I haven't used them, although I've talked to lawyers who use them.
But they've started integrating like, hey, use our products to do your research.
I think they may have started
saying like, use these to help write your briefs, although Maybe we haven't gotten that far with Lexis and Westlaw.
But there's definitely like a lot of software companies that are like heavily marketing their products to lawyers and saying like, we use a bespoke AI that won't hallucinate or we use a bespoke AI that will like help you write the perfect brief like really quickly.
So in some cases you have lawyers who are using ChatGPT.
In some cases you have them using Microsoft Copilot.
There was one who used Grok,
RIP to that guy.
Yeah.
You got to fire your lawyer if they're using Grok.
If they're using Grok, Grok, yeah, it's not a good situation.
That person was fined a lot of money, the one that used Grok.
One person was.
Was it like the hot anime girl Grok, or was it like
cross-playing as a lawyer?
Yeah.
There was one that was also using Grammarly,
which
is like a grammar, you know,
tool that has started including AI stuff in it, I guess.
And it's like, I don't know, if your lawyer is like using Grammarly to write their briefs, Prob should get a better lawyer.
Yeah.
But, anyways,
the excuses that they make are all over the place.
Like, one person said that they were suffering from vertigo.
That was my favorite one.
Well, head colds and malware as well.
Yes.
So he apologized for his failure to identify the errors in his affirmation, but partly blames, quote, a serious health challenge since the beginning of this year, which has proven very persistent, which most of the time leaves me internally cold and unable to maintain a steady body temperature, which caused me to be dizzy and experience bouts of vertigo and confusion.
The lawyer then goes on to say that he was, quote, affected by malware and unauthorized remote access.
And so he blames both Vertigo and the fact that he was hacked.
I was with them up until the malware bit.
Like, we're not going to mock anybody's legitimate medical condition.
I have no idea whether it's real or not.
I mean, I'm not mocking their medical condition, but having a medical condition doesn't mean you have to use AI, you have to use AI.
I feel like overall, you're being very generous to the general tone of these.
I read this, I edited this piece before we published, and I was really laughing, like, actually laughing at the reasons.
There's like only two categories of excuses, and it's like
one of them is
apologies, Your Honor.
I'm a moron.
You know what I mean?
It's just like, I don't understand AI or I'm stupid.
And I just like, I'm really, really sorry I fucked up.
Like, that's literally like
apologizing.
And then the other one is not better.
It's just people throwing their paralegals and assistants under the bus.
Like, literally just saying, it's like, my assistant did it.
What a moron.
And that's entirely unfair.
And it's like still your responsibility.
And like, don't you need to read the briefs before you file them?
Don't you need to read like the court documents you're presenting to a judge?
The only like
the only thing I'll give them, and I think the thing it says about generative AI more generally is some people are like, hey, man, it's like, this was advertised as a thing that I can use.
So I trusted that I can use it.
And it turns out I can't.
And it's like, that's definitely not good enough.
And you still have to read the stuff that you generate and make sure it's accurate.
But I think it does say something about how generative AI is advertised and used.
And we report about how bad it is all the time.
But this is like a great reminder that some people are just taking that advertising.
for its word and using it and not even thinking that something could go wrong because like why would open ai this gigantic company run by these geniuses make tools that don't work and make up case law?
It's like a lot of people don't know that.
And to be fair, like I'm going to do more articles on this.
I was trying to like put it all in one article, but it was impossible.
But one of the lawyers that was caught was forced to go to like an AI class with the Texas state bar.
And I was able to get a copy of the class that they had to go to.
And that class is just like five AI companies being like, use our AI.
Like it's, it is, they are getting heavily marketed too.
And even since I published this, you know, this morning as we're recording this, lawyers have been forwarding me the like marketing emails that they're getting from not just like AI companies, but from like legal organization, like continuing education organizations within the law profession being like, you want to be more efficient?
Like use AI.
Another thing is like five different people blame internet outages or like IT problems.
And they're like, we are checking with IT at the office to see how this could have possibly happened.
So, yeah, I mean, it really is like
wasn't my fault, Your Honor, like pass the buck situation in
my computer.
Yeah.
And then the other really notable one was someone who claimed that they created, that they filed it as a quote legal experiment.
Oh, right.
I'm testing you.
Yeah, exactly.
Exactly.
So yeah,
it was a fun piece to do.
It took forever.
This took so long to do.
Like it took us months to put this together, like off and on.
And not because it was difficult, but because our court system is so fucked up that like
finding the correct document to pull in any given case took a lot of things, a lot of time.
And then a lot of them were at like state court.
And so it's not just navigating PACER, which is like the expensive, shitty U.S.
federal court system records that is bad, but I at least know how to use.
It's like figuring out like Michigan's system.
It's like basically every little quote in here was like the 15th click on the worst website that you've ever used.
And so that's why it took like a long time to put together.
But it was very eye-opening for me, I think, because in a lot of cases, like straight up, these lawyers are just like,
I don't know what I'm doing.
Like, I'm a giant dumbass.
That's why I did this.
Well, you answered what was going to be my last question, which is like, do any take responsibility?
And as Emmanuel said, there's a lot of throwing under the bus, but it sounds like some of them just throw their hands up and be like, yeah, whatever.
I just want to.
Ask, well, what has the reception been like?
You said more lawyers and they'll send you this marketing material.
Are you getting like even more emails from lawyers who either their coworkers have done this or maybe they've done it themselves or like what's the reaction being
yeah i mean people have said it's interesting i think unfortunately i was hoping that more lawyers would reach out with like
a lot of the lawyers are like i want to talk to you on the phone which is good and helpful except it's hard when like 30 different people they're like we should talk but i won't tell you what about classic lawyer classic lawyer they're like let's get on the phone but like i can't tell you any details about what it what it is They're gonna bill you after exactly and so I mean there there will be more to come but like when I wrote about teachers using AI a lot of them like followed up with very well-written very
honest and open like communications about AI in schools whereas like a lot of these lawyers like I want to talk to you, but like let's let's do a briefing first.
And so we'll see.
We'll see how this goes.
But yeah, if you're a lawyer, if you like are a paralegal, paralegal, if you work in big law, like if you are being pushed AI or have used AI or have been asked to use AI, I would love to hear from you.
My signal is jason.404.
Email is jason at 404media.co.
Yeah, I definitely would be curious if there are more people who say, well, I used it, not from the advertising, but because we're being told by our law, like leadership, our law firm or something, like that we're seeing in other companies or something like like that.
Really, really fascinating piece.
People should go read really the full thing and go through and see some of the responses.
We'll leave that there.
If you're listening to the free version of the podcast, I'll now play us out.
But if you are a paying 404 media subscriber, we're going to talk about all of the drama surrounding the Rubri programming ecosystem and why it's actually, you know, really, really important for the internet, the web, and everything on it, essentially.
You can subscribe and gain access to that content at 404media.co.
As a reminder, 404 Media is journalist-founded and supported by subscribers.
If you do wish to subscribe to 404 Media and directly support our work, please go to 404media.co.
You'll get unlimited access to our articles and an ad-free version of this podcast.
You'll also get to listen to the subscribers-only section where we talk about a bonus story each week.
This podcast is made in partnership with Kaleidoscope.
Another way to support us is by leaving a five-star rating and review for the podcast.
Here is one of those.
Some of the best in the game.
This pod is the purest nourishment for this hungry brain.
It's that simple.
That is all.
And then there's two brain emojis and the word, feed me.
That's from Rabble Rousing RSA.
Zede, thank you so much.
We'll see you again next week.
This episode is brought to you by LifeLock.
It's Cybersecurity Awareness Month, and LifeLock has tips to protect your identity.
Use strong passwords, set up multi-factor authentication, report phishing, and update the software on your devices.
And for comprehensive identity protection, let LifeLock alert you to suspicious uses of your personal information.
Lifelock also fixes identity theft, guaranteed or your money back.
Stay smart, safe, and protected with a 30-day free trial at lifelock.com slash podcast.
Terms apply.