AI Agents Explained: Build a Digital Workforce That Works 24/7

Speaker 1 It's this transformational moment that I think every company is like, wow, how do I enable this and how can I use this for my customers?

Speaker 2 Just months after announcing Agent Force, Salesforce is unveiling its next generation AI platform called Agent Force 2.0.

Speaker 1 Tell us how big companies are using Agent Force. I know already it's being employed.
I've never been more excited about anything in my entire career.

Speaker 3 Salesforce dove into Agentic AI quite early on and developed Agent Force, which I know you were lucky enough to be customer zero.

Speaker 1 We were treating it like an old school chatbot. Don't do this, if that, do this, right? Instead, it was like, no, no, you're smart.

Speaker 1 We went back into Agent Force and we coached it just like you would coach a human employee and that solved that problem.

Speaker 1 What we forgot to do with Agent Force is we trained it on the hard skills, but we didn't focus on the soft skills. And we talk about this as the head and the heart.

Speaker 1 We now have a digital workforce that will augment our human workforce.

Speaker 4 You're like the original case study and companies can just copy paste your your strategy.

Speaker 1 Every company in the world has this problem of they show their silos to their customers. Suddenly you now have this agentic layer that goes across all of them.

Speaker 4 The things that look contrarian and crazy today will be commonplace in the future and so this will probably be very common, I would assume, in the next year or two.

Speaker 1 You're going to see a lot of companies going live with AgentForce over the next couple of months. A lot.

Speaker 3 Hello, everyone, and welcome to Experts of Experience. I'm your host, Lauren Wood.
And today we have another host as well, Stephanie Postels.

Speaker 1 Thank you. Thank you.

Speaker 4 I'm excited to be here. So excited for this conversation today and especially excited to post this content and put it on Marketing Trends.
So thanks for letting me be here.

Speaker 3 And just so everyone knows, Marketing Trends is another mission show that Stephanie leads. So definitely head over there to listen to that as well.

Speaker 3 But we're doing a joint episode today because we have a very special guest, Bernard Slowy, who is the Senior Vice President of Digital Customer Success at Salesforce.

Speaker 3 And today we talked about how they were customer zero for their new Agent Force product, which was really fascinating. Steph, what did you take away from the conversation?

Speaker 4 Yeah, I mean, now I feel like I'm going to be looking at everything in my life, wondering, how can I put Agent Force in it? What can I automate here?

Speaker 4 I mean, it was very inspiring, especially thinking about like how I can use these functionalities within my own company, which I think I had a story that maybe this could only be for enterprises.

Speaker 4 So, yeah, also impressed that they got this up for Salesforce in four weeks. I

Speaker 4 have not heard of that happening so quickly. So, that was amazing.
Yeah, what about you? What was the most exciting parts for you?

Speaker 3 I mean, I think the fascinating thing for me about AgentForce, and I've been nerding out on this big time, because agentic AI is the next wave of AI.

Speaker 3 We've been in the generative world using LLMs, Chat GPT, all this stuff.

Speaker 3 And now we have actual AI employees that are joining our team who can own entire processes, who can make decisions on their own.

Speaker 3 And that requires us to think very differently about how we are using AI and training AI and actually coaching AI to do what we need it to do. And Salesforce has really been a pioneer in this space.

Speaker 3 And they've been very early. And I think that Agent Force is really the best example in the market of an agentic AI that is enabling customer experience to really be what it should be.

Speaker 3 And so it was really cool to hear Bernard talk about their experience of being their first customer and the learnings that they had in actually utilizing it and how they were helping other companies now do the same.

Speaker 3 So I thought it was fascinating. I'm really excited about this episode.

Speaker 4 Yep. The authenticity was real.
He definitely talked about some stories that we won't share now.

Speaker 4 Got to get into the episode, but very fun just hearing some of the little mess ups and the feedback they got and LinkedIn posts that got a little crazy and comments.

Speaker 4 And so if you want to hear about that, you want to see how to dive into the world of Agentic Agents and see how it can transform your life, this episode was lit.

Speaker 3 Yeah, let's get into it. Bernard, welcome to the show.
It's so great to have you.

Speaker 1 I am very excited to be here. Thank you so much for having me.

Speaker 3 So we want to kick it off by taking a trip down memory lane and talk a little bit about your history and what you've seen over the past, wow, decade plus in the tech space.

Speaker 3 And I know you started your career in customer service as a project manager at AOL. Is that correct?

Speaker 1 I actually started as a tech support agent for AOL and worked my way up to project manager. Support agent.
Yeah, yeah. I was a tech support agent part-time when I was in college.

Speaker 1 That was where I started.

Speaker 3 Amazing. And so you've seen a lot of change.
Can you tell us a little bit about what you've seen since then until now?

Speaker 1 Yeah, you made me feel old, by the way, when you said that, which kind of of made me laugh but it has it has been a while

Speaker 1 it has been a while yeah god it's incredible change actually when i think back on it because i started as i was in college and i i needed a way to fund my college activities i worked for aol in the evenings and on weekends and i used to be a support agent helping people set up aol on their computers and even if i think back to that like they had CDs to install.

Speaker 1 So now it's like even just thinking of a CD and trying to put it in.

Speaker 1 And it just like at the time time that was that was normal right that's how everyone did anyone like the cloud didn't exist back then everything was mainframes it was local and so yeah it was it was an interesting job because I would have people I couldn't see them so now we're all used to video calls that feels really normal to us like it was literally just me talking to someone and them trying to describe their problem to me and me trying to describe steps for them to do and so even if i think back to that and where we are now just on this call right or i think about my son and use he uses you know face time to call home to my grandparents in Ireland.

Speaker 1 Like, it's just amazing the change in technology that we've seen in that timeframe, both in our personal lives and also in enterprise commercial.

Speaker 3 And our ability to support customers as well.

Speaker 3 Like, if you think about being on the phone, walking them through a physical action of putting a CD into a computer to download, now it is just a whole other level of automation and ease

Speaker 3 as well. And so, I'd I'd love to hear, you know, AI agents is the big conversation.

Speaker 3 We're going to talk about AI agents a lot today because of Agent Force and all the incredible work that Salesforce has been doing.

Speaker 3 What makes you excited about AI agents, especially as we look at it in the context of where we've been, even in the past 10 years?

Speaker 1 Yeah, I think we have like these moments in time with technology, like every 20 years or something, there's just something that transforms it.

Speaker 1 Like if you think about the service industry, it started face to face.

Speaker 1 you had to walk into a physical store or whatever it was and so you were limited in the hours of operation of that store right then we had tele service right all of a sudden you could phone someone right and that was a big transformation in technology right seems kind of weird to think about that now but it was it meant people could be available longer hours it wasn't just the opening hours of the store and then we had the internet right and then so then it all became very much self-service like every single company in the world has a portal that you can go to and try and find out something about their product.

Speaker 1 Everybody starts in Google. Everyone searches.
They go to YouTube. They try and figure it out themselves probably before they even come to you or come to your company.

Speaker 1 And so now we have this moment in time, which like anyone who used ChatGPT, that first moment you used it, you kind of went, wow.

Speaker 1 You know, it's these moments and times where it just transforms technology. And so now you have this way, these agents that are going to enable you to have 24-7 availability.

Speaker 1 You know, it's always there. It's always available.

Speaker 1 It's trained on all of your content, you don't have to like predefine these specific scenarios, it has access to everything that you want it to have access to, and it's incredibly accurate.

Speaker 1 And the other thing that's amazing is like today, a lot of our interactions are text-based, but voice is coming at us fast, you know, so you're going to be able to deal with these AI agents.

Speaker 1 And it's not like a robocall, it's actually, you know, natural human language. It feels very, very natural.
So you think about that in the service injury space.

Speaker 1 It's like, I'm going to be talking to an agent that's going to be helping me solve my problem or it's helped guide me on onboarding whatever that might be so it's just it's this transformational moment that i think every company is like wow how do i enable this and how can i use this for my customers i think it solves so many of the problems that we've been seeing in the customer experience space for example when we call i mean this is still to come but when we call a company and we have to then choose the button or choose choose who we want to talk to and go through all of of this.

Speaker 3 It's so laborous. And now we are just easing so much of that friction through AI.

Speaker 3 And I'd love to just take a quick step back to make sure everyone understands what we're talking about when we talk about AI agents because this is still new. Can you define it for us?

Speaker 1 Yeah, I think like people still trip up a little bit on like chatbots and agents and kind of what's the difference. And I think we've all had an experience with a chat bot on a company's website.

Speaker 1 And generally it tends to be a bad experience. Chatbots historically, like you had to define the logic that was in the chatbot.
What I mean by that is you would write a dialogue.

Speaker 1 You would literally say, if this, then that, if this, then that, if this, then that. And if you asked that specific question that that chatbot was trained on, it did an okay job.

Speaker 1 It had no emotion, no intelligence. It just helped with that thing.

Speaker 1 But if you went off script, if you asked it something that it wasn't trained on, it was a terrible, it is a terrible experience, right?

Speaker 1 So now with these AI agents, something like ChatGPT is trained on the internet, right? So it's incredible the access it has.

Speaker 1 But what we do at Salesforce is we give you the capability to train Agent Force on your content corpus.

Speaker 1 So instead of me having to suddenly like write all of these dialogues, I can literally give this large learning model access to whatever content I want to give it access to.

Speaker 1 And so now it can answer any question straight out of the gay related to that content. But where it gets much more powerful is that's called unstructured content.

Speaker 1 At Salesforce, we also have a lot of structured content. So a lot of information about our customers that's stored in something called our C360, right?

Speaker 1 So you start to use that structured content and you can now personalize the experience. I know who Lauren is.
I know the product she bought. I know she just recently became a trailhead ranger.

Speaker 1 And so you can really personalize this into the agent experience while it's giving answers. That's just something you could never, ever do before.
You know, it's pretty incredible.

Speaker 4 When it comes to AI agents, I hear the pieces around adding in the custom data and you've got your own LLMs that you can work with. But to me, how I understand them is they're more goal-oriented.

Speaker 4 Like they have somewhere like a problem they can solve and they can head that way without building out chat bots and adding in information.

Speaker 4 Like it's really built off, like you said, if this, then that, only the scenarios that you built out. But is it correct to understand that AI agents is more just like goal-oriented?

Speaker 1 So today, like with our implementation of Agent Force, it's Q ⁇ A conversational. You ask it a question and it comes back with an answer.
And that's kind of how most of us have experienced Chat GPT.

Speaker 1 But where we're moving to is the agent can actually do action on your behalf. And that's super powerful.
So if you think about the example where you ask it, how do I reset a password? Right.

Speaker 1 Generally, it will come back where you do steps A, B, C, and D. But imagine when we can actually do that on your behalf, right? So there's information we can get just to verify you are who you are.

Speaker 1 And then we reset the password for you. That's just a very simple example.
Like in banking worlds, it's like issuing a refund on your behalf. A retailer could be as well.

Speaker 1 So they can actually do action as well as just conversational Q ⁇ A. And that, that's that's a game changer.

Speaker 3 It's like having an employee. It's an AI employee.
And I think that that's the big shift that I'm seeing when we talk about agents is it's no longer just a tool.

Speaker 3 It's actually capable of so much more and making decisions on its own, which is also wild to think about. Yeah.

Speaker 1 Yeah. We think about it a lot as like it's a digital employee.

Speaker 1 Just the way that we have human employees, we now have a digital workforce that we need to empower.

Speaker 1 and that will augment our human workforce right it allows us like a good example as well is these these models have language capabilities in them right so suddenly we can go to all of these other languages that we might not be in today because we just wouldn't have the budget to invest in headcount to do support in these languages now you have it in English and you can use these large learning models to do real-time translation so you know Lauren could be in Japan as an example that's gone back and forth with our agent that agent was trained in English but it's able to translate and go back and forth with you and you know no difference, you know, so, so that's pretty incredible as well is these real, these language translation models just open up so many avenues for companies.

Speaker 3 Yeah, it's wild. I actually, a quick example of that is Airbnb.

Speaker 3 I'm an Airbnb host and I've had guests from other countries come and stay at my place and I talk to them in English and sometimes I get an email in another language, but in the chat, it shows up as English.

Speaker 3 And so I've been like, what is this? And then I went in to look at it and I was like, oh, that's what they're doing is real-time translation between the guest and the host.

Speaker 3 And it's like, wow, that opens up so many more possibilities.

Speaker 3 So when we think about agentic AI and bringing this into businesses, what is the opportunity at stake for companies to start using agents as soon as possible?

Speaker 1 It's interesting that I meet with companies a lot to talk about what we're doing.

Speaker 1 And like everyone's really interested and everyone wants to get started but in a lot of cases companies are afraid to get started and a lot of cases they want to do internal implementations before external when i when i say internal what i mean by that is like maybe you have an agent beside your support rep that's helping your support rep which which is a great use case right but they're nervous to go external because they're worried about things like hallucinations or is it going to say something that like oh no my company is going to be associated with this and so so that's one of the things i've really been helping companies and customers with is like I showcase what we did to say, hey, look, there's, there's, there's rules, there's guardrails you can put in place so that it only answers certain things.

Speaker 1 And so I definitely, I see people want to get into it, especially companies, but I do see an apprehension and nervousness on like, what happens if it goes wrong?

Speaker 1 And for us for that is like we have in Salesforce, it was a design principle for us was that agent force is backed by humans.

Speaker 1 And so it's, if it can't solve, you easily go into the conversation with a human. It's actually pretty slick.
It like Agent Force leaves the conversation.

Speaker 1 Lauren, the support engineer, joins the conversation. She can see the history of the conversation with Agent Force.
She gets an AI summary of it.

Speaker 1 So she can quickly start with, okay, I'm going to continue on from here. And so I think that's an important design principle to help companies is it should always be backed by humans.

Speaker 1 Otherwise, you're going to dead end. You're going to dead end people and frustrate them.

Speaker 4 What kind of company is this for? I'm thinking at least as like a small business owner. Is this something that a small business owner can use?

Speaker 4 Or is it right now really for enterprise companies who do have a lot of data and a lot of things that they're trying to automate?

Speaker 1 I think it's the full spectrum, Stephanie, which is kind of what's amazing. Like if you're a small business company today, like you probably can't have like a support phone number, right?

Speaker 1 And like, you know, because you're not going to invest in that headcount. You have other things you need to be worrying about, right? And so suddenly you have the ability to have support, right?

Speaker 1 You could have a digital agent on your website that's maybe answering some of your top questions from your FAQs.

Speaker 1 And if it can't answer, maybe it submits like an email a case where one of your humans can come back afterwards. But I think it goes all the way from like small SMB to massive enterprise.

Speaker 1 Now, obviously, the use cases are different than how enterprises are going to think about it.

Speaker 1 But I actually think it helps give SMBs a leg up because suddenly now you have this digital workforce that you can leverage to help you go faster.

Speaker 4 It seems like companies will be built off of this model, like of agent force and having a bunch of agents. It's like a whole different way of building a company.

Speaker 4 But even when thinking about these different marketing leaders that I talk to and the teams that they have, like they're thinking about team structures different.

Speaker 4 And I think actually startups might have a really great advantage of like, I have no employees currently, but I can have some digital ones.

Speaker 4 And now all of a sudden I have five or 10 departments that are all, you know, these digital employees.

Speaker 1 Yeah, yeah, totally. It's crazy.

Speaker 1 Like it's, you know, it's often sometimes that you, you know, you have that advantage when you're new is that you can build around this technology that's there versus having legacy holds you back a little bit.

Speaker 3 I see this a lot in my consulting work because I work with a lot of startups who are in that position where we kind of have a blank slate or it's not too hard for us to take a step back and redesign how we're approaching AI, especially AI and CX.

Speaker 3 And then I also work with organizations that are much larger who it's, it's challenging.

Speaker 3 Like we have to really change our fundamental structure in order to now work with this AI and bring it into our existing system. It's just more complex and it takes more time and intention.

Speaker 3 Although I will say, I think the intention is important no matter where you're implementing AI and really how you're doing it and what you want it to be doing.

Speaker 3 But there's definitely an opportunity for earlier stage companies to

Speaker 3 start off with AI as a foundational principle.

Speaker 1 Totally agree.

Speaker 3 So I'd love to talk a little bit or a lot actually about Salesforce's agentic AI journey because Salesforce dove into agentic AI quite early on and developed Agent Force, which I know you were lucky enough to be customer zero of.

Speaker 3 And I want to get into that story and understand, one, what was it like really bringing in an agent workforce into your team?

Speaker 3 And then we're going to get into the lessons and the learnings and all that good stuff. But first, tell us, just what was it like starting to use this?

Speaker 1 Yeah, it's kind of crazy to think about.

Speaker 1 Like we have our big sales conference, Dreamforce, around september every year and we had dreamforce last year which we pivoted to agent force as a company and like agent force just kind of happened like this pro like you know as i said this technology exploded we were very lucky that we were working on an incredible product that could leverage that so our whole dreamforce conference was pivoted to agent force and i was kind of standing there i was in that conference and i was like wow if anyone should be an amazing use case of this it's what me and my team do because we're responsible for our health portal at salesforce which is where customers go and it gets like 60 million visits a year.

Speaker 1 It's like the second biggest portal at Salesforce. And it has a lot of content.
It actually has 740,000 pieces of content. And it does a good job.

Speaker 1 People find what they need, but we always heard two common pieces of frustration. It's too much content.
I can't find what I'm looking for when I need it quickly.

Speaker 1 And so that was the opportunity with AgentForce, right? Is you can now have this conversational experience, ask it a question, get the answer you want, and go back and forth. So I challenged my team.

Speaker 1 I came back from Dreamforce and I said, let's get this up and running in October. So, that was four weeks.
It took us. And that shows how easy this product is.

Speaker 1 Because if you think about Salesforce, right, it's a massive B2B enterprise, hundreds of products. You know, it's complicated.
And we launched on October the 11th.

Speaker 1 So it was just over, I think we were four and a half weeks that we got it up and running and we launched it on our health portal, which was pretty incredible.

Speaker 1 I've been in, you know, I worked for Microsoft for 15 years. I worked for GitHub.
I've been in lots of technology companies.

Speaker 1 And to get something like this launched so quickly just showed the flexibility in the product.

Speaker 4 Did you tell anyone that you were doing this? Or did you like run it on the down low where you're like, I'm just going to see what I can make?

Speaker 1 And surprise me. No,

Speaker 1 surprise. We're live.
Here you go, Mr. Benny off.
You're a great example for you now.

Speaker 1 No, we did tell people we were doing it. I felt like we were the perfect use case.
I think service is a great use case, right? Like, cause

Speaker 1 there's a clear ROI, right? It's like, hey, if we can have customers solve with this agent, then, you know, more of them are getting the solution, what they need, et cetera.

Speaker 1 So you're seeing a lot of companies as they look at these agents, service is kind of the number one use case.

Speaker 1 And it's not to say there's like marketing's use cases, sales, there's hundreds of other ones, but I think companies are kind of honing in on like, okay, service is something where I could really see this thing having an impact.

Speaker 1 And so that's why I felt we should be, you know, my leader, Jim Roth, who I know you had on the show before, he always challenges us on to be customer zero, you know, use our own products, be a showcase for our own products so that I can go talk to customers and say, here's how we're using it.

Speaker 1 Here's the mistakes we made. Here's the impact we're seeing from it.
And so we really wanted to be the customer zero of AgentForce. That was our goal.

Speaker 3 Which I think is generally if you can be your first customer, you always should be, just as a principal when it comes to customer experience, because that allows you to really learn deeply what your customer is going to experience.

Speaker 1 Totally. Totally.

Speaker 3 So like launching in four weeks is insane, especially if you think about how new this technology is and how complex the Salesforce system and help center is as well.

Speaker 3 Can you give us a bit of an insight into like what you launched? I'm assuming it wasn't like the whole thing. I'm assuming you kind of took off a piece and said, okay, we're going to launch this.

Speaker 1 Yeah, it's interesting. So like if I reflect back to that, like I was so nervous.

Speaker 1 And like I was so nervous, like I had major anxiety because this was like, it's going to be available for people to use.

Speaker 1 And you know, once people have access to something, they're going to tell you what they think about it. And so we went live.
We started small, actually.

Speaker 1 We went live to what we, a cohort of authenticated customers. What I mean by that was a small percentage of customers who are logged into our help portal could see the experience.

Speaker 1 So they kind of saw like an ask Agent Force kind of on our documents. So we felt comfortable doing that because we wanted to see, well, how does it perform? How many people click on it?

Speaker 1 Like all your classic, it's like, it's like a funnel, right?

Speaker 1 You're seeing who lands on your portal out of that number, who engages with agent force how much did agent force resolve how many went true to the human so you had all of these metrics that we're measuring and and so we started pretty small but then we actually as we started to have reviews internally in salesforce we realized we were actually going too slow and that we just needed to get out there and open it up so that we could start to get feedback and learn but i'm going to screw up this this quote but read hoffman who started linkedin he has this great quote on like you should never be happy with the first product you release but you should release it it

Speaker 1 and and so that was the mindset i was like it's not going to be perfect it's going to be things that people aren't going to like but because it's out there and because it's live we're going to quickly iterate and improve on them things versus if we keep it back here forever we're probably going to be too slow and so that was our mindset was like it's good enough it's not perfect and it will never be perfect by the way we're going to have to constantly keep iterating it's good enough let's get it out there so then we exposed it to everybody so anyone who goes to help.salesforce.com you'll now see this beautiful full-screen experience of Agent Force.

Speaker 1 You can access it. Anyone can access it.
Whether you're logged in or not, you can go ask it a question and it will help you on a question related to Salesforce.

Speaker 4 So I'm thinking about a lot of these big companies who probably listening to this show, marketing trends.

Speaker 5 Great CX starts with a great story, and Agent Force helps you tell it consistently across every channel.

Speaker 5 AgentForce allows you to build AI agents that empower teams and customers to provide top-notch customer service 24-7, all seamlessly integrated with Salesforce.

Speaker 5 Discover the future of CX Today and visit salesforce.com slash agentforce.

Speaker 4 I'm wondering how, like, did you have people pushing back on you being like, do not launch this. Here's why is the terrible idea?

Speaker 4 Like where they're seeing the risk being like so large that they were like, Bernard, this is the terrible idea.

Speaker 4 Because I'm sure in other companies, this would be happening and like how to push back against that risk adverse mentality.

Speaker 1 It's interesting because the hardest part actually came was Mark Benioff tweeted about about it and posted on LinkedIn that we were live.

Speaker 1 And he got a lot of comments under his LinkedIn and his Twitter post. And I was literally like going in reading every comment.

Speaker 1 Every day I'd get up and have my morning coffee and I'd open it to see what new comments were.

Speaker 3 I can't imagine the anxiety you were feeling in that moment.

Speaker 1 Some of them were brutal. Some of them I honestly, I didn't feel great about my Salesforce career that first day because we had a lot, like we have a very engaged community at Salesforce.

Speaker 1 Like we have our Trailblazers, our MVP program. Like we are incredibly lucky, the engagement we have from our community.
But with that, they'll tell you what they think. And I like that, right?

Speaker 1 But there was times they were asking it questions and the answer coming back wasn't a great answer, right?

Speaker 1 And, you know, there was, I'll give you one example, which is like someone had put a screenshot on their need.

Speaker 1 They asked a question about integration with a competitor product. And we kind of said something about the product and then had a ref.

Speaker 1 link to that company's website, which is not a great situation, right? I was like, okay, I'm definitely gone. This is the end of my career.

Speaker 1 And I'll just, this is like one of the learning moments of agents, by the way, is like, what we did then is you go into, we have something called agent builder, which is where your prompts live.

Speaker 1 So these are like, you teach agent force. There's something called the global instructions, which is like a topic where you teach agent force the world it lives in.

Speaker 1 So you tell it you're part of Salesforce, you know, code, right? It's all in natural language. And you tell it, I want you to speak in this voice and tone.

Speaker 1 These are the things I don't want you to speak about. So you can set guardrails.
Like maybe you don't want it to ask questions on your CEO as an example.

Speaker 1 So you put all of this inside the global instructions.

Speaker 1 So when we saw that happen, we were like, oh, crap, jumped into our global instructions and said, do not talk about our competitors and listed every competitor. It was problem solved.
Great.

Speaker 1 The very next day, you know, not mine, the very next day, we saw a case where someone asked, how do I integrate this competitor's product with Salesforce? We have great content on that.

Speaker 1 But what happened? Agent Force didn't answer, right? Because we'd given it this strict guardrails of what not to do. So So this was the learning moment first.

Speaker 1 We went back into agent force and we coached it just like you would coach a human employee. We told it, we deleted that guardrail and we said, listen, you're a Salesforce employee.

Speaker 1 You're a customer service agent. Put the best interest of Salesforce in everything you do.
That was what we wrote. And so we taught it, we taught it to think.

Speaker 1 We were treating it like an old school chatbot. Don't do this.
If that, do this, right? Instead, it was like, no, no, you're smart. We just need you to think this way.
And that solved that problem.

Speaker 1 And so that was a huge learning for me and my team. It's like this prompt design, this prompt engineering, it's a discipline now that's in the industry.

Speaker 1 And it's like, it's, it's really, you really need to think through it on what you write and how you write it.

Speaker 4 This is like such a new space we're in where people are still just trying to like figure out prompt engineering for chat GPT.

Speaker 4 And they're like, oh, maybe instead of just like, give me the answer to this, it's like, I should say, pretend you're this and think about it this way, like the more context.

Speaker 4 And so it's, yeah, no surprise that, of course, you're like, oh, yeah, maybe we should do that here too.

Speaker 1 But it's such a fast-paced world right now to keep up with are there any other funny moments like that that would came up or just like things that happened while you were rolling this out that probably are relatable to other people who would be going through this process i think maybe coming back to lauren's question which i didn't do a good job of answering on of like risk averse versus pushing like we definitely had like people internally like i i used to like we obviously Slack, Salesforce, it's a massive product for us.

Speaker 1 And so we all live in Slack. I would get Slacks every single day from people in the company giving me examples of where it didn't do a good job.

Speaker 1 A lot of the times they were people that were very knowledgeable in Salesforce products asking it a very detailed question. And a lot of the times the problem wasn't AgentForce.

Speaker 1 The problem is the content in the back end that it's trained on. If you don't have good content, right, if you like, it's only as good as the knowledge it has access to.

Speaker 1 And so like, and people will go and they try it with ChatGPT and they go, well, ChatGPT gives me this answer. I say, yeah, but ChatGPT has access to the whole internet.

Speaker 1 So it can pull an answer from Reddit. It can pull an answer from some blog somewhere.
And the risk of that is hallucinations, right?

Speaker 1 That's what scares companies on these agents is like, so ours is one of the, what I mentioned this earlier on, but agent force you limited to your own content set.

Speaker 1 So with that, sometimes if it didn't have the right content, it didn't do a good answer. So we had to work on updating our content.

Speaker 1 I think it actually exposed to us areas where we didn't realize we didn't have great content.

Speaker 3 I mean, that's such an important factor, which I actually think a lot of people who are approaching or rolling out AI, building it into their systems, we all need to do it.

Speaker 3 And people are taking different approaches. But the thing I keep hearing time and time again is that your data is critical.
The information that you're feeding to the AI is critical.

Speaker 3 And it's a very large and complex.

Speaker 3 thing to think about because we have it's almost like we have like a all of our stuff is like strewn everywhere and all of a sudden we have to organize it in a way where someone can come in and actually like intake it and use it.

Speaker 3 And I'm curious to know your thoughts on that piece. And like, how did you go about organizing your data so quickly to then allow Agent Force to use it?

Speaker 3 Or had you already had a totally clean house and none of that had to happen?

Speaker 1 No, no, I don't think anyone has a clean house.

Speaker 1 We have an advantage at Salesforce that we have this other product called Data Cloud. And with Data Cloud, like people always ask me where we started with Agent Force.

Speaker 1 And what I tell people is like, it's like when you have a new employee start, what do you do? You give them access to data, right? You give them content.

Speaker 1 You train them so that they can start to be upskilled and be able to do their job. And so data cloud allowed us to take all of these different data sources, right?

Speaker 1 These knowledge articles, these products, and actually hydrate them all into data cloud. And then that gave Agent Force this foundation.
It's able to access all of this data in data cloud.

Speaker 1 That's the unstructured data. And as I mentioned earlier on, we're now going to give it access to structured data as well.

Speaker 1 So I think I had a bit of an unfair advantage where I had access to data cloud because I work in Salesforce. But when I talk to customers, I'm like, this needs to be part of the solution.

Speaker 1 Like you can use it without data cloud, but if you can have a repository that can contain all of this data and can bring it all in, it can normalize it, it can standardize it, then you have a huge advantage as you go live in these agents.

Speaker 3 I mean, it's really the strength of your agent. at the end of the day.
Like as you were saying, it's not going out into the internet to find answers.

Speaker 3 It's using the information that you provided to it. And that's the beauty of it.
And also, it means we need to do that extra legwork to make sure that the agent has what it needs.

Speaker 1 We learned this crime the hard way. So we're a couple of months in now and our agent force implementation still feels a little bit robotic.
Like it responds to you, it gives the right answer.

Speaker 1 And so what we learned is what else do you do when a new employee starts in a service world, right? Yes, you train them on the hard skills, right?

Speaker 1 Like, do they have the information to answer these problems, but you also train them on the soft skills, right? The way that you deliver a difficult message, right?

Speaker 1 If you're a support engineer, like we spend a lot of times on that soft skill training.

Speaker 1 And so what we forgot to do with Agent Force is we trained it on the hard skills, but we didn't focus on the soft skills. And we talk about this as the head and the heart.

Speaker 1 We were very much focused on the head, the brain element of it, and not enough on the heart.

Speaker 1 So now we're doing a lot of work where we're actually taking the training that we train our support engineers on and we're using that around some of the prompts for agent force so just think about it as we're giving agent force access to that training so it has much more of the soft skills on how it delivers its message it's kind of crazy when you think about that but that has been a big learning for us

Speaker 3 the thing that i'm like what kind of mind blown by is you're taking a training that you give to humans about soft skills and you're able to train an ai agent on the same content.

Speaker 1 You're just teaching it in certain ways. Like, like we always have this good example, like like if someone comes to us, let's say, with a severity one issue, right?

Speaker 1 Like, let's just say Salesforce is down. Doesn't happen very often, but some companies can have things we're down.

Speaker 1 The last thing you want is the agent going back and forth with you on potential ways to solve that problem. You want it to go, oh my goodness, you're having a seb one.
I'm so sorry to hear that.

Speaker 1 We're going to get you through to one of our support engineers and they're going to, you know what I mean?

Speaker 1 Like that's an example where agent force needs to get out of the way quickly, but it needs to have a lot of empathy in that situation, right? And so, that's the example of what we mean.

Speaker 1 You don't want it to be like kind of robotic and try and answer that problem. It's like, no, no, get out of the way, be very empathetic.

Speaker 1 And that's how you would teach a human employee to also react in that situation.

Speaker 4 One thing we haven't talked about yet is like the success that you saw once you implemented Agent Force.

Speaker 4 I mean, one, I'd love it if you like, if you had a before and after, because I'm trying to visualize like what it was like before when customers would go on there and ask a question, what it's like now to like really understand what it looks like and then what happened after how many cases are getting solved with agent fours like tell me a bit of the stats so

Speaker 1 this visual that you can see this was our help portal in i guess september last year right and so it looks like pretty much every single company in the world has some portal like this right you can come to it you could search on it you could access our content it has videos places to learn etc and you can go in and create a case from it so that's kind of what it looked like back then.

Speaker 1 And so, as I said to you earlier, unfortunately, the problem with this is people struggled to find what they were looking for, right?

Speaker 1 Especially if you were having a problem, you need an answer quickly. You know, we hear that in all of our research with customers.

Speaker 1 It's like, hey, if I'm having an issue, you need to be able to answer me quickly, right? And so let me now show you what this looks like now. So this is help.salesforce.com now.

Speaker 1 And so what you can see is it's a completely different experience. It's a full screen experience of Agent Force.
So you can go in and ask it any question.

Speaker 1 As I mentioned earlier, it doesn't matter whether you're logged in or not, you can engage with Agent Force. And what we've done as well is you asked me, like, how do we determine the success, right?

Speaker 1 We believe transparency is key for trust. So what we've done is down the bottom, you can see down here, we actually have a live ticker to show how many Agent Force conversations.

Speaker 1 So since launch, you know, we've had 450,000 conversations with Agent Force. So since October the 11th, it's a pretty huge number.

Speaker 1 And then you you can see we also try and show our human tickets as well because we want to try and show people. But what I want to show you is just something a little bit cool here.

Speaker 1 Now, when I go, you can click on this here's how.

Speaker 1 And what that will do, it's going to show you all of our metrics and how we measure success. So this is our customer zero page.

Speaker 1 And you'll actually see there's a video there that some of me and my team are in to talk about our implementation.

Speaker 1 But what we show you is you can actually look at all of our data and you can go back to any date since we launched. And what you asked earlier on is like, how do we measure success? Right.

Speaker 1 And so what we look at is, think about this as a funnel, right? Someone has a conversation with Agent Force, right? It comes back with an answer and you go away. And we consider that resolved, right?

Speaker 1 So you asked it a question, it came back with an answer and you go away. You don't, when I say go away, you don't go on to create a case with a human.

Speaker 1 And so you can see our resolve metric is like mid to high 80s, right? But we also get asked questions, but is that really resolved? Like, how can you determine that was resolved?

Speaker 1 Like, maybe the question, I just went away.

Speaker 1 And so, what we've implemented now is we have something called customer confirmed resolution, which is in the flow of the conversation, we ask the question at the end of the conversation, hey, did this resolve your issue?

Speaker 1 Yes or no? And on that customer confirmed resolution, right now we're about 76%.

Speaker 1 So that's a really good data point for us that like all of these conversations that you're having at the highest level, it's probably about 80 something.

Speaker 1 And then customers are telling us it's about 76 when they answer that question. The other two metrics I just wanted to show you so I can help explain it is we also look at this thing.

Speaker 1 This is the agent force conversation handoff. So you can see that 4%.

Speaker 1 So that is that week, 4% of customers who engage with Agent Force got handed off to a human support engineer. So that was that kind of flow that I was telling you about.

Speaker 1 Like it's really critical to us that it's an easy flow. The other metric, which is interesting for us, is we have this thing called abandon.

Speaker 1 And let me explain what abandon is, is you can kind of see the ask agent force in the bottom right-hand right-hand corner.

Speaker 1 So a certain percentage of customers click ask agent force, they open it up and they don't ask it a question. And we're really interested on this and why is that happening?

Speaker 1 And we think some of this is to do with kind of UX UI where people are like, oh, that's one of them old school chatbots. I don't want to engage with that.
Right. And so they don't ask it a question.

Speaker 1 And so that's something that we're working on is how do we kind of pull more people into the experience?

Speaker 1 But that is kind of the metrics that we measure today. And what's pretty cool on this site, by the way, is we have lots of blogs on how we did it.

Speaker 1 You can, there's Jim Roat up there, you all know very well. And so we're very transparent.
Here's all of our information. Here's how we launched it.
Go look at it and see what you think yourself.

Speaker 4 Yeah, that's, this is awesome. I love the ticker numbers on the homepage.
I just feel like it's kind of gamified.

Speaker 4 I'm like, I just want to sit here and watch it go up and see how many humans are involved. And yeah, that's fun.

Speaker 3 And can we also talk about the sales, the sales strategy here? I mean, you're literally showing like we are using this and here's the results that we are getting in real time.

Speaker 3 I think it's something like this point about transparency is so critical it's always been critical but when we talk about ai it is ever more important because customers whether they're b2b or b2c will trust you more if you are transparent with when you are using ai versus when you are not and we see that in the data and i just want to I just think it's a really great, really great website.

Speaker 3 You did a great job.

Speaker 1 Dude, I've got to admit, the ticker was not my idea, but I love it. And at first, I was like, a ticker?

Speaker 1 Why would, because like, it's going to hit like half a million soon, you know, and you're like, wow, like, that's a pretty incredible number.

Speaker 1 And then, yeah, to your point on transparency, Lauren, like, if we're not using our own products and we're not showing them, like, why would a customer buy it?

Speaker 1 You know, so it's this like, this trust piece of, okay, Salesforce is using it. Here's all the metrics we measure.
And like, we debate the metrics as well.

Speaker 1 Like, people are like, well, is that really a resolution rate? And like, yeah, you're right. We need to do better there.

Speaker 1 And so we introduced that customer confirmed resolution, which is people actually telling us, yes, you solve my issue, you know? And so we're just like any support leader in the world.

Speaker 1 I have the same pressures they do to kind of show ROI and all of that sort of thing. And so we're transparent.
Here it is. Here you can see it.

Speaker 4 I love that you guys are like the, you're like the original case study and companies can just come in and like copy paste your strategy.

Speaker 4 And by you doing all this legwork, I mean, I think about back when I worked at Google, we were always trying to figure out metrics of like, which ones mattered. And we used to get excited about ones.

Speaker 4 And then people would come in and be like, actually, you don't want that metric to to be high. That's bad.

Speaker 3 That means you're having a problem.

Speaker 4 And like, there was always so much debate.

Speaker 4 And so the fact that you guys did this first and you already have like a whole entire, like, basically, you can copy this entire strategy and just do it with another company.

Speaker 4 But I'd love to hear who else has done this? Like, who else has copied this?

Speaker 1 I love what you said there, Stephanie, because one of the other things that we like had these long debates on is that.

Speaker 1 handoff to human internally we call that escalation rate which is a real support mindset metric and you say that to people externally and like they're like what's escalation is that a bad thing and so at that whole page you saw our marketing team built that page so we partnered heavily with our marketing team on like how can we tell this story easily to customers so they can go use it and kudos to our marketing team hand off the customer is way better than our human is way better than escalation rate but the the thing i want to tell you about like we had a long debate because that escalation rate was down at like one percent and sometimes it was two percent and now we're at four percent and people are like oh my god what's going on and it's actually at four because it was too hard to get from agent force into a support engineer with too much friction in the process.

Speaker 1 And so we wanted, we've simplified that process. You can literally come and go talk to a human, talk to an agent, whatever that might be, and it will create your case and send you through.

Speaker 1 And so we think that escalation rate will probably get a little bit higher.

Speaker 1 And we're okay about that because that means it's a good experience for our customers, which is the most important thing we're doing. But it's interesting because people can get driven by metrics.

Speaker 1 You know, it's like, oh, no, it's at 4%. It's like, yeah, but that's a good thing.

Speaker 1 And so, so that's just like, as you talk about that, Google and that like debate and metrics, we do that a lot internally as well.

Speaker 3 I think that this piece is something that so many companies struggle with, especially from as a CX leader.

Speaker 3 I would always say, let's make the experience best for the customer, but it's not always the most cost-efficient way because it's better if we don't have a human.

Speaker 3 talk to them, if we just make the customer figure it out themselves, or if we just have the AI do it, it's a cheaper option, but it's not the best experience.

Speaker 3 And we all know as consumers that when you want to speak to a human and you can't speak to a human, there is probably nothing more frustrating. So,

Speaker 1 I share this story with my team all the time. Like, when I was kind of earlier in my career at Microsoft in Dublin and Ireland, we had this project that was literally called Automate and Eliminate.

Speaker 1 And if ever there was a name on a project that tells you you're doing the wrong thing, automate and eliminate was that.

Speaker 1 And, like, I remember I won like a gold star or some monthly award at microsoft for driving up this number of automate and eliminate and what did we do we just made it really hard to get to the human we put lots more clicks in the flow and so we saw people drop off and we were high-friending each other so it's my example of like whatever leadership defines is like these are the metrics these are sure you can do things to do that but it can have terrible terrible impacts i think it'd be fun to hear maybe some lessons that you've gotten from either Microsoft or any previous companies that have influenced what you're doing with AgentForce and how you're thinking about, you know, like we were talking about with metrics or building out a team or really anything you're working on.

Speaker 4 I'd love to hear a bit about that.

Speaker 1 Even if I think about my role, I'm the SVP for digital success. And someone called me recently in a webinar in Unicorn, which I didn't know how to think about that.

Speaker 1 But like, what it is, is that not many companies have a leader and a team that are 100% focused on the digital experience when you think about service, right?

Speaker 1 A lot of the times, like I got passionate in this in my career because like, I used to lead Windows support for Microsoft, there's massive support footprint, thousands of support engineers.

Speaker 1 But I always say, like, no one gets up in the morning and says, I want to contact support, right? They're all going to go online.

Speaker 1 And so, like, I started to really kind of hone in on digital and spend a lot of time there. And then, kudos to Jim Roth.
He created a function and I joined to come lead it.

Speaker 1 And my team wake up every single day, wake up in the morning, thinking about how can we improve the digital self-service experience for our customers. That's our day job.

Speaker 1 It's not an art, like I find in many companies, they have people that run functions. And then like, it's like, oh, and also you should think about digital.

Speaker 1 You know, and so, so that's the big thing for me is you have to have people that are invested in it.

Speaker 1 You know, I have a team of over a hundred people now that are working on like agent force is one thing we work on.

Speaker 1 We have other things, but they're all waking up in the morning thinking, how do we improve the digital experience for our customers? Whether that's, you know,

Speaker 1 that's not just support motions. We also think about success motions, right? You've bought our product.
How do we help you onboard?

Speaker 1 How do we make sure that you're getting, you're getting the value from that product so you renew, right? Like that's critical.

Speaker 1 Like support's kind of that moment something goes wrong and I need help, but we also need a great digital journey to help you on. And that's what my team 100% focuses on.

Speaker 1 And that's been a big learning in my career is like, you need people that that's their day job. That's all they worry about.

Speaker 4 So I'm naive. Is this not normal to have this kind of role?

Speaker 1 Like is this role not? Oh, okay. I'm like, that sounds like perfectly like, yes, it makes sense.
We should have it. Yeah.
Yeah. No, it's funny.

Speaker 1 Like, there's, there's a, there's a LinkedIn community now for digital success. And there's like digital success webinars and like that didn't exist a while ago, you know?

Speaker 1 And so, so I get asked to attend these things and talk a little bit about my role and Salesforce.

Speaker 1 That's where the unicorn thing came up because I think I'm the only SVP that's on digital success, which made me, made me laugh.

Speaker 1 But no, it's not, it's not something that, unfortunately, for a lot of companies, it's on top of someone's current job.

Speaker 4 yeah i just heard a quote in my interview the other day where someone's like the things that look contrarian and crazy today will be commonplace in the future and so this will probably be very common i would assume in the next like year

Speaker 5 consistency builds trust and that's what i love about tools like agent force with agent force ai agents can help you deliver consistently excellent service to your customers 24 7.

Speaker 5 Fully integrated with Salesforce, Agent Force is redefining CX. Salesforce has the experts, resources, and technology to help you start your Agent Force transformation today.

Speaker 5 In fact, Salesforce's support experience is now powered by AgentForce. See the future in action at help.salesforce.com.

Speaker 1 Yeah, I love that.

Speaker 3 The way that we can utilize AI in customer success is still yet to be seen in many use cases. And Salesforce is really, I mean, Salesforce has pioneered customer success period.

Speaker 3 So it makes sense that you are

Speaker 3 getting to lead that function. The new wave of what customer success really means.

Speaker 3 I'd love to hear some examples of other clients that you've been working with other than Salesforce yourself to really utilize AgentForce and how that's been taking place.

Speaker 1 Yeah, it's actually interesting. That site I showed you, if you scroll down to the bottom of that site, you'll also see other customers that are using it as well.
So I feel like.

Speaker 1 a majority of my job now is going talking to customers about what we do.

Speaker 1 So that wasn't my job a couple of years ago, but we have some great examples like Open Table is a big company that's using AI agents now.

Speaker 1 And so we share with them what they're doing and they kind of share.

Speaker 1 I also want to learn from these other companies, by the way.

Speaker 1 Like, how are you implementing them? What are you doing? What learnings can I take from you? So Open Table is a huge one. Vivit.

Speaker 1 I actually have to my house their security alarm system, camera system. If you go to their website, you're going to engage with an agent.

Speaker 1 Remarkable, which probably behind me somewhere. Literally cool.

Speaker 3 I have one that I'm using right now.

Speaker 1 They're the people who are

Speaker 1 incredible. And the best, amazing.
You go to their website to engage with support and you'll engage with Agent Force. And so they're just kind of three top-of-mind examples.

Speaker 1 Like there's huge companies that we're working with right now.

Speaker 1 I can't kind of get into the names of some of them that are getting ready to do implementations.

Speaker 1 And so that's where me and my team come in a lot because we share what we did, our lessons learned, and our mistakes, and so that they can get ready to go live.

Speaker 1 So you're going to see a lot of companies going live with Agent Force over the next couple of months a lot are there any key questions that you keep getting asked especially among these like larger companies coming in are there themes where people are like asking similar questions yeah well one of them you all touched on earlier which is a kind of around the data hygiene right like we actually there's this new new terminology my team were talking about recently which was a new one for me called data collisions um which is like you have data that you know content is a good example where maybe you have a couple of articles on something that's similar and maybe you're using like an acronym name or something and the agent can't pick the right piece of content it's a collision of that content and so so that comes back to this kind of data hygiene piece that you asked about earlier it is really important that you have the right data you're you know we've spent a lot of time actually culling older articles, right?

Speaker 1 Stuff that's not relevant anymore so that the agent's not trained on it. So that's definitely a very, very common one.
The other one I would say is the experience from agent to human.

Speaker 1 We talk talk about that a lot. Like, cause in our experience, it's like you have a choice.
You can have the human join the chat.

Speaker 1 And so, you know, they come in, it's a seamless experience, or maybe you don't have the time at that moment.

Speaker 1 So you can create a case to like have someone come back to you at a time that works for you. And so we spend a lot of time designing that experience.

Speaker 1 And so a lot of customers are like, how did you do that? Show me how it works. And so that's another one that we spend a lot of time on as well.

Speaker 4 Do you have to go through like expectations with them? I know when we talked previously, you were kind of talking about how a lot of people come in and they just expect AI to work right away.

Speaker 4 This better be perfect. I better fix all my problems.
And you had a good analogy around like, would you treat your employee that way in week one? Be like, what did you do? Why did you mess that up?

Speaker 4 You got that thing wrong.

Speaker 1 There's, I can't remember the name of the bias, but as humans, we have a bias for machines that machines should always be correct. And the example, the great example is like self-driving cars, right?

Speaker 1 Like we're afraid to let them onto motorways because there's like 0.000, whatever percent chance is that it'll have an accident. Humans have accidents all the time, right?

Speaker 1 So, self-driving cars are actually a safer option than a human, right? But we don't want that to happen until it's near perfect, right? And so, it's similar with some of these agents.

Speaker 1 It's like people expect the answer to be perfect all the time, and it might not be, and it might not be for multiple reasons. Like, we talked about content.

Speaker 1 If the agent doesn't have access to the right content, if that content's wrong, then your agent's going to be wrong, you know.

Speaker 1 And so, so there's so many reasons, like, there's so many reasons behind it.

Speaker 1 Like, I gave you the example earlier on of like, if you don't, like, the prompts aren't positioned the right way, then it might respond in a different way than you want it to.

Speaker 1 And so, there is that expectation setting, and that's why I think that experience agent to human is critical because you need to make it easy that someone can go, oh, actually, you know what?

Speaker 1 I just want to go true to the human.

Speaker 3 How have you gone about creating the guardrails beyond just the here's the content to pull from?

Speaker 3 But especially as we think about the more like empathetic skill set of the agents, how do you like set values in place with the agent? And how have you made those decisions around what to train it on?

Speaker 1 It's interesting, actually. We spend a lot of time as a team just thinking about like, what do we not want it to answer questions on?

Speaker 1 And so one example is we have a simple guardrail that you should only answer questions on Salesforce products, which I think every company would do, right? Like it's funny.

Speaker 1 I look at our conversations every day.

Speaker 1 I go in and read some of the ones and I can see like we have a sediment analysis that runs on our conversations that tells me whether they're positive, neutral or negative.

Speaker 1 And I can go look at the negative ones and see what it was. And so like some of the negative ones, people ask like, how do I cook pasta?

Speaker 1 And so like Agent Force didn't respond. And I'm like, wow.
Like, and I think it's because like,

Speaker 1 people think chat GPT and so they want to go ask it anything.

Speaker 1 And like, no, we've confined it into the world world of please don't answer anything just answer questions related to Salesforce you know so that was one it seems obvious but like that's a that's a design choice if you want you could give like these things access to the internet and say hey go go answer all of these things other things it was funny like we were sitting down going God we don't want it to try answer questions on Mark Benioff Like we don't want people to be asking it questions about our CEO and it comes back and says, you know, like, cause, cause that's not ours.

Speaker 1 It's a support persona. It's a support site.
That's not what it should be for. So we set guardrails.

Speaker 1 If someone asks about one of our leadership team, it will point them to our investor relations page. You know, so it's really interesting.

Speaker 1 Like it's an exercise you need to do with your team on where do I want it to answer? And then probably more importantly, where do you not want it to answer?

Speaker 3 And I think that that's, you know, it's one of those steps that has to be talked about before implementing. So many companies want to just dive right in.

Speaker 1 But

Speaker 3 this is one of those things. It's like, make sure your data is clean and then also be aligned on where you want this agent to play and where the boundary is.
Where's the fence to the playground?

Speaker 1 Totally. And the other thing I'd say, Lauren, is like companies kind of treat it like a traditional software release, right?

Speaker 1 Like, hey, we're going to go do all this work and we're going to bang, release this thing. And like, it's not a one and done.
It's a constant refinement. It's a constant looking at the performance.

Speaker 1 Why was it doing things this way? Like, did we not have content for that? Do we need to adjust our prompts? Because like we said earlier, it's an employee, right? And it's grown.

Speaker 1 It's getting better all the time. Like ours is far from perfect right now.
It'll get better and better and better over time. So you got to be thinking like that.

Speaker 1 It's not an old school traditional software release. It's, it's a digital employee and you got to be constantly refining it.

Speaker 4 I feel like this is a perfect segue, knowing the timing that we have left into more of that, like the closing the loop between sales, marketing, CX.

Speaker 4 Because right now it feels like we're entering into a different world when it comes to businesses. And it used to just be, you know, you've got your awareness top of funnel.

Speaker 4 Your customer comes in, you sell to them, hopefully retain them. Customer support is sometimes, you know, either in the middle of that or at the end, depending.

Speaker 4 Now it feels like everything's kind of merging together and like more conversations have to be happening between these teams.

Speaker 4 Like you just mentioned, Bernard, like when people have an issue, you might want to come back and like change the model. Okay, this happened over here when someone was coming into the flow.

Speaker 4 Like this now needs to be adjusted.

Speaker 1 How do you see the world going forward with this like cross-functional collaboration space that we're in every company in the world has this problem of they show their silos to their customers you know you have marketing that's all about lead gen and like how are we driving the pipe etc and okay now you have sales we're going to create that and we have a customer now you kind of have your post sales function support success and they tend to be siloed And suddenly you now have this agentic layer that goes across all of them.

Speaker 1 Right. And so like an example of that is like, like, I see with companies that they struggle to pass the relevant information between the different departments.

Speaker 1 Like, I'll give you a very simple example. Sometimes a success team doesn't have the relevant information of why the customer bought the product.
What do I mean by that?

Speaker 1 Sales sold it for a certain reason, right? They sat in a room and said, Hey, you buy this product and it's going to give you this feature. It's going to give you this ROI.

Speaker 1 They sell and they're gone. I mean, I'm not, this is not Salesforce, by the way.
I'm just saying, this is what a lot of companies tend to think about it, right?

Speaker 3 I've seen it many times.

Speaker 1 Yeah, yeah, right. And then suddenly it's like

Speaker 1 customers are, okay, like

Speaker 1 so. Your success team needs that information, right? So that they can now figure out how do I do a tailor onboard for Lauren to make sure that she gets that value of why we sold it, right?

Speaker 1 Or why we marketed it originally, right? And so now you have this agentic layer across them all that's able to see all of this data. It's able to see what did marketing do, why did we sell it?

Speaker 1 What was the business outcomes the customer said they wanted?

Speaker 1 And now I can tailor, like we get really excited with agents is that today our agents really about the support persona, but we're going to light up these other personas like a success manager, right?

Speaker 1 It would help you with your onboarding, right? It would even today our agents text.

Speaker 1 we're getting ready to launch voice right which is pretty incredible our agent would ring you and say hey you know i see you you just signed up for salesforce i see you bought it for these reasons i'm here to help you onboard let's schedule an onboarding session you know know, like that's something today that not every customer might get because maybe they're a smaller customer or something like that.

Speaker 1 So suddenly these agents give you this ability, this digital workforce to do all of that at huge scale.

Speaker 4 It seems like, too, this is a.

Speaker 4 an amazing time for like CX leaders and marketing leaders all to also be at the product leader table to be able to influence products that are being developed because they have a lot more intel and everyone's going to know more about the customer and more about what sold them and why they're excited about that than ever.

Speaker 4 And so it seems like it's just, there's going to be a lot of collaboration opportunities that bring marketers and CX and other leaders to a table that maybe they were not really at previously.

Speaker 1 Totally. And one of the conversations we've been having, Stephanie, is like the, I think the danger with some companies is you could go create agents for all of them divisions.

Speaker 1 You could have a sales agent, a marketing agent, a support agent. And for us, we want to make sure in our customers' experience, it's agent force, right? So it's one agent, but it might be behind it.

Speaker 1 You have an army of agents that are skilled in certain things.

Speaker 1 You could have a renewals agent a success agent a sales agent a support agent but depending on what you ask it it brings the relevant agent into the conversation so for the customer i'm just talking to agent force in my world like companies will call it different things i'm just talking to that company's agent i don't realize there's all these different agents behind it so you suddenly Because what companies do today is like they show their organizational seams, right?

Speaker 1 I always like my example with this is portals, right? Companies will have a support portal. They'll have a, you know, sales portal.
I mean, they've all in Salesforce, we did it.

Speaker 1 And we're working to try and bring all of them together. The danger is you do that with agents as well.

Speaker 1 You build all of these separate agents versus leveraging the capability that it can work across it all.

Speaker 3 So then we have to train our agents to be cross-functional.

Speaker 4 That's a wonder. How? Like, how, Lauren, do you train these agents and people to think differently about building this structure?

Speaker 4 When you're like, okay, don't learn, don't think about anything I've ever learned before. Now think different.

Speaker 1 Do different, like, how do you,

Speaker 1 you can still have, so you still have like your, your subject matter expertise and your company should still build your sales agent, you know, and your support team should still, but what you have with Agent Force is we have this

Speaker 1 agent-to-agent transfer. And so, what it should do is based on the question Stephanie asks it.
So, let's say like you ask it, like maybe you have a licensing question or a pre-sales type question.

Speaker 1 In that scenario, Agent Force is able to recognize that question is related to this domain. I'm going to bring in this agent to answer that question.

Speaker 1 It's more about the technology recognizing what the customer's intent is and then bringing the relevant agent into that conversation.

Speaker 4 Okay, that, yeah, that feels a little easier. So instead of me being like, oh, I have a, this feels like it's a customer support question.
I don't need to know that as the customer.

Speaker 4 I just need to go and be like, help, SOS, this is what I need, blah, blah, blah. Like I'll just voice it into the system.

Speaker 4 And then behind the scenes, they'll know like, oh, actually, that's a finance thing. She's having healing problems.

Speaker 1 Coming back to if we're using structured data and let's say you are a customer, right? And you're logged on.

Speaker 1 We're then able to start to use some of this information as well to know what we should come back with, right? Like maybe we can see, okay, Stephanie's day two with our product, right?

Speaker 1 She's, she's onboarding, right? We need to use our onboarding age.

Speaker 1 Like so there's ways we can use our structured data as well, like to help us and understand where you are in your journey and what you're trying to do.

Speaker 3 I just wanted to bring it back to a real life example here that this is solved, this is a real life problem that this is solving.

Speaker 3 When we call up a number and we wait on hold and then we get through and we end up being on the wrong number and then they're like, oh, let's transfer you to this other place and you can wait on hold over there again,

Speaker 3 which is the most frustrating thing in the world.

Speaker 3 And this is the beauty of agentic AI is that we, the consumer or the customer no longer needs to deal with that because the AI knows what it is that we're asking for and can directly put us in touch with the right agent where we don't have to wait on hold because

Speaker 1 they are totally. And it knows you know who you are.

Speaker 1 That's the most important. It knows who you are.
And it's tailored that experience based on who you are.

Speaker 4 I'm very excited by this. I was just on a chat line with Adobe trying to cancel my like crazy enterprise account that I accidentally signed up for two years ago.

Speaker 4 And it, I still don't even know if it's canceled. And I was on with like four different chat bots and they kept being like, but actually, do you want to buy this thing? I'm like, no.

Speaker 4 And then I'd come back to it and it'd be like, oh, that never got canceled four times. And I think it's still a problem.
And they didn't know enough information about me.

Speaker 4 And they kept asking me stuff. I'm like, I don't know.
I think you should know this. I think I'm your customer.
You should know this about me.

Speaker 1 They probably do, but they just don't want you to cancel.

Speaker 4 They just don't have Agent Force yet.

Speaker 1 It's a problem.

Speaker 3 So I wanted to talk a little bit about the impact on the humans in the loop here.

Speaker 3 And how this is, I mean, obviously AI is having a huge impact on business.

Speaker 3 And with new employees, these AI employees it's going to impact the existing employees and the thing i keep coming back to is what are the skills we need to be learning to really

Speaker 1 work with ai now that we have these these new types of friends that we're working with day in and day out it's interesting so One of the things, I'll come to your question in a minute, but just I think one of the other things is this like fear of what's it going to do for my job, et cetera.

Speaker 1 And so one of the things we've been really trying to do is like with our support engineers is making sure they're part of our Agent Force launch.

Speaker 1 So we use our support engineers to look at the performance of Agent Force to help go, actually, what would you have done in that scenario?

Speaker 1 Because they have more expertise in our products than anyone else in the company, maybe outside our engineering team.

Speaker 1 So since day one, we've included our support engineers so that they feel really part of it.

Speaker 1 And, you know, hopefully it takes away some of the volume that's probably easier for them and they're left with the more complex scenarios.

Speaker 1 We're always going to need like incredible support engineers. So that's the first thing I'd say.
On your question, it's been interesting. I was having this conversation with my team the other day.

Speaker 1 We just hired a prompt designer/slash engineer. And, you know, that role, I don't know how far back you'd go, but it didn't exist.
There was no such thing, right?

Speaker 1 Like, you know, and so, and I was even laughing because I was super curious on what type of applicants we would get.

Speaker 1 I was like, God, does really have a, you know, when people put like 20 years experience or something, and there's no possibility of 20 years experience.

Speaker 1 So I was like, I wonder like who's going to apply for this? We actually got a rock star. I can't wait for her to start.
But like, to your point, there's these new roles starting now.

Speaker 1 We have a director of our LLM operations. You'd have told me two years ago, I'd have a director of LLM operations.
I'd be like, what are you talking about? Is this English you're speaking?

Speaker 1 And so I do think it's up to people to be start training on some of these, like depending on what your interest is, like, you know, UX designers, there's now this prompt design, which is a new flavor of UX design, you know, and then there's understanding these models and more about them.

Speaker 1 So I think it's, it's really exciting. And I said it to my team.
It's like, wow, look at us. We're blazing a trail.
We're creating these new opportunities.

Speaker 1 There's opportunities for existing people on my team or getting more deeper into it. It might create new roles for them.

Speaker 1 So it's kind of cool, to be honest with you, on some of these roles that are opening up.

Speaker 3 Yeah. I mean, with any technological innovation, new roles have been created.
And of course, right now, a lot of people are afraid. Oh, is AI going to take my job?

Speaker 3 And as you know, your job to be today, probably in some cases. But there's going to be whole new jobs, whole new careers, whole new departments maybe that are even created.

Speaker 3 I know I've been talking to a lot of people about the new role of the AI manager, the agent manager. Like a human needs to now manage this team of agents and train them and guide them and coach them.

Speaker 1 Yeah. And

Speaker 1 I think your point is I feel in a lot of situations, they augment the human. You know, I was just on a call earlier today.
I have a team, a video production team.

Speaker 1 So we have a Salesforce support YouTube channel.

Speaker 1 It's an amazing news, like the second fastest growing YouTube channel in Salesforce. And we have a lot of things happening in Salesforce, which shows you like how much it's grown.

Speaker 1 But they were talking to me now about how they're using AI for their video scripts, you know, and something that would have normally taken, you know, hours and days is now taking minutes.

Speaker 1 You know, so it's not that it's replacing their role, it's allowing us to go faster and to implement more videos at a more, you know, quicker timeframe.

Speaker 1 And so that's great because it means we're getting more out there for customers to self-serve on. So I think you'll see more examples like that, where it's like, it's augmenting my job.

Speaker 1 It's allowing me to be more efficient at my job.

Speaker 3 And then it frees up time for more valuable activities as well.

Speaker 3 I mean, I think about especially in the realm of customer success, if we can spend more time listening to and thinking about our customer instead of doing operational, you know, even scheduling meetings and things like that, that just like eats up our time, we're much better off thinking about our customer, spending time with our customer, listening to our customer, and then bringing that insight back into the organization.

Speaker 3 Cause those human to human interactions, that is what AI will definitely never be able to replace, right?

Speaker 3 So let's lean into that.

Speaker 4 So one of my favorite questions that I ask of all my marketing trends guests who are all normally CMOs of the Fortune 500, Fortune 1000 is what's something that you believe that very few agree with you on?

Speaker 1 I love this question, by the way. I'm going to steal this question and I'm going to use it with people when I'm interviewing them because then I think you'll see how their brain thinks.

Speaker 1 They had to think about this a lot, by the way. So kudos to you.
You had me kind of like, oh my God, what will I say to this one? The thing I landed on is like, I don't think data is everything.

Speaker 1 And I think a lot of leaders in marketing, support, whatever it is, they just live in data. Now, I live in data.

Speaker 1 I look at data all the time, but sometimes I think the best decision goes against what data tells you.

Speaker 1 And so, like, I always push my team is just because our data is telling us something, like, is that really what's happening? It doesn't often tell you the why,

Speaker 1 the why someone chose to do something, the why they made that decision, the why they went that way. And so, I challenge people.
Of course, you should have data.

Speaker 1 Data is foundational to everything you do. I live in scorecards and metrics, but I really challenge people.

Speaker 1 Sometimes it's about going with your good instinct, you know, and saying, hey, no, I think this is the right idea. I've been doing this for a long time.

Speaker 1 I'm going to go against the data and I'm going to try to do something myself.

Speaker 4 Have you done this recently? I'd love to hear a story if there is something that comes up around this.

Speaker 1 I don't know if I have a perfect example, but even coming back to Agent Force, like, you know, data probably should have said, don't release Agent Force to the whole world at once, right?

Speaker 1 Like, it's doing an okay performance or resolution rate is X or whatever. You know, you look at the data and you're like, let's just continue to go slow.
Let's just iterate.

Speaker 1 And over time, we'll get it better and better and better. And then we'll go large.
And if I'd have made that decision, I don't think we would be where we are now.

Speaker 1 Because because we went big, even when the data told us it wasn't doing an amazing job, it was doing a good job, it meant that suddenly it was exposed to more people and there was more pressure on me and my team to make it better faster.

Speaker 1 And so that's like, that's an in like where it was like it forced us to go faster by going against the data and releasing it to everybody.

Speaker 3 I think about this often. I'm so glad that you share this take or this opinion, Bernard, because going back again to what AI will not be able to replace, it's our intuition.

Speaker 3 And it is so important that we hold on to that intuition. And if anything, strengthen it now that we have AI doing a lot of the logical thinking for us, where we can say, is this right?

Speaker 3 Just because the data says it doesn't mean that we need to do it that way. It is insight.
It is information.

Speaker 3 We can take that, but we still need to use use our human critical thinking skills to decide, is this the right way to go?

Speaker 1 Totally. And your intuition is built up over years of decisions, bad decisions, you know, things that went wrong, you know, and so like AI doesn't have that.

Speaker 1 You know, and so sometimes your human instinct is the best way to go. And it's the best way to go.
Yeah.

Speaker 4 AI probably a lot of times has all the risks that have ever happened in however many years it's been tracking data.

Speaker 4 And I think what's amazing about humans is being like, I'm going to do it it anyways and that's actually where most of the breakthroughs have happened the biggest companies the most life-changing things is like yes it's showing me this might be a terrible idea to do based off these things and i'm gonna send a rocket to space anyways and it happens yeah exactly right no it's a great no you're crazy right why would you do that people are gonna die yeah you know yeah yeah

Speaker 3 have you changed how you lead your team at all Now that AI is such a big part of your day-to-day?

Speaker 1 I think it's a lot of my focus right now. And I actually kind of worry a little bit that I spend so much time here.
Like my team has lots of other elements.

Speaker 1 Like I talked about like our YouTube channel. I manage all of our email campaigns for onboarding.
And there's just like a ton of things to my team.

Speaker 1 And I worry actually a little bit that I'm so much of my time as an agent force that people that aren't working on it in my team feel like they're not working on the big shiny thing.

Speaker 1 And so it's about prioritizing my time and making sure I'm still spending time in other areas so that they can see that it's still because it's not all agent force you know we've lots of other things we do that's super important I think that the AI hype cycle definitely has a lot of people's attention at the moment but it's really important to remember that it's not everything it's the shiny thing

Speaker 1 it's the shiny new thing but there's yeah still a lot else although I do tell my team I think everything that we do today will change like even like if we go in that example of like you know we send emails to customers you know and like hey you know you bought sales force you should do these things like and it feels so 1980s now you know and and like you can imagine a world like i said earlier a proactive agent right that's looking at signals and saying oh stephanie hasn't turned on this feature yet you know and it either reaches out in text or voice or like you know what i mean and so like it all becomes automated so like i do think everything we do today will change i think some things will change completely other things will augment other things will be a little bit different you know and so but i think everything will change it's it's kind of similar to that quote where it's like, if you have a hammer, everything you see is a nail.

Speaker 4 And that's kind of what I see with everything right now. I'm like, I do think AI will be in many of these things and they will be completely different.

Speaker 4 And so I'm kind of like seeing everything as a nail of like everything can be disrupted. And it's amazing.

Speaker 4 And what a great future we get to live in with like all the things we don't have to do anymore when this comes to game.

Speaker 1 Yeah. Like, how much do we use Chat GPT now

Speaker 1 in your daily life?

Speaker 3 You know, I mean, on that point, I actually have a question for both of you, which is, what is your favorite personal use case of AI?

Speaker 1 Yeah, no, I have a good one because someone actually shared it with me.

Speaker 1 We're going on spring break vacation in a few weeks. And someone shared to me about like actually putting into chat GPT where you're going on vacation, who you're going with.

Speaker 1 I have an eight-year-old son. These are the things I like, et cetera, et cetera, et cetera.
Here's how long I'm going to be here. Here's the food we like to eat.

Speaker 1 And it gave me a tailored inventory of what I should do on my holiday. And like, I was like, wow, like some of this is really cool.
I'm not saying we're going to do everything on it.

Speaker 1 I want to relax at some point as well, but like, what a cool use case, you know, of like being able to get that inventory of what to do. Yeah.

Speaker 4 Oh, that one's way more fun because I'm like, I think about the stuff that I'm in now and I'm still, it's still so work related, but I love having it just like. poke holes in anything I'm doing.

Speaker 4 So if I'm, for example, coming up with, you know, some questions for an interview with Bernard and uploading the whole document and being like, pretend you're like a top podcast host and tell me which questions are going to result in a lame answer and which ones are going to go nowhere and which ones are more thought-provoking and contrarian.

Speaker 4 And like, and I keep making it poke and then I get a new one. And I'm like, now look at this one and tear it apart and pretend you're a CMO.
Like, what won't resonate with you?

Speaker 4 What parts don't you care about? Like, basically, be really aggressive with everything I'm giving you. And it just, I feel like, gives me

Speaker 4 such good output by saying, pretend to be this like. cutthroat killer in the podcast industry.
I'm like, ah, okay, this is great.

Speaker 1 I'll give you a good one, Stephanie, because I know you have kids that someone shared with me recently.

Speaker 1 Is they were at home and it was a rainy day in Seattle, and they asked ChatGPT and it gave them games to play in the house with their children that they had never played before.

Speaker 1 Oh, I love that.

Speaker 4 Especially if I could say, like, here's the things that I have. I've got this random tree you can climb.
I have a, you know, yeah, oh, that's a good one. I love that.

Speaker 4 I'm stealing that for all four of my kids.

Speaker 1 There you go.

Speaker 1 Parenting 101 from Berlin here. There you go.
I'm taking it. It's hot tips.

Speaker 1 Yeah.

Speaker 3 Well, Bernard, we have one question that we ask all of our guests on this show to close it out. And that question is, what is one piece of advice that every customer experience leader should hear?

Speaker 1 Oh, that's an easy one for me because I talk about this a lot is

Speaker 1 I don't think the word customer obsession. I find people say them words and they don't really mean it.
Like it's like, it sounds good.

Speaker 1 It's a nice thing to write on a wall, but like you got to be spending time, even in the digital space, right? Like AgentForce, a good example.

Speaker 1 Like I read every day some transcripts from Agent Force, the ones that were bad, right? I'm meeting with customers.

Speaker 1 I'm meeting with our MVPs who give very critical feedback on like, what should we be doing different? How do we make it better?

Speaker 1 And so like, I think to be truly customer obsessed, you have to be looking at your calendar and going, how many hours a week am I actually talking to customers or reading something that was interaction with them.

Speaker 1 That's what it means. And I just think if you're in the world of CX, that is critical to anything you do.

Speaker 3 And it goes back to the data point you made. It's not just the data.

Speaker 3 We have to actually have those conversations, really be there with our customer, listening to them, understanding what's the need behind their need, and digging deeper with our questions.

Speaker 3 So I could not agree more. Thank you so much.

Speaker 4 This was awesome. Thank you all for letting me jump in and be in this conversation.
Super fun and excited to run it on marketing trends as well. Thanks, Bernard.

Speaker 1 Yeah, great to meet you both.