The AI Skills You Should Be Building Now

If you listen to IdeaCast for conversations and strategy, you'll want to check out Founder's Mentality, the CEO sessions. In-depth conversations with top executives about the judgment calls that define their careers. Follow wherever you get your podcasts. Turn breakthrough ideas into real results at the virtual HBR Innovation Summit on November 12th with top CEOs and master classes on AI and growth. HBR executive subscribers attend free with exclusive programming November 13th. Learn more at hbr.org slash innovation summit.

Welcome to the HBR IdeaCast from Harvard Business Review. I'm Alison Beard. Generative AI has been heralded as a breakthrough technology for workers in a wide variety of industries, and many companies are encouraging employees to experiment with, if not wholeheartedly embrace it. But beyond playing around with ChatGPT, Claude, Adobe's AI tools or Microsoft's Copilot, what can you do to understand and get comfortable with these tools? How do you make them work for you? How do you master them?

Whether you're really excited about gen AI or worried it will make your job obsolete, it's time to learn what our guests today call fusion skills, ways of working with large language models that will help you get the most out of them and set you up for success in this new world of work. H. James Wilson is the global managing director of technology research and thought leadership at Accenture, and Paul R. Daugherty is Accenture's chief technology and innovation officer.

Together, they wrote the HBR book, Human Plus Machine, Reimagining Work in the Age of AI, which is now available in a new and expanded edition, as well as the HBR article, Embracing Gen AI at Work. Paul, Jim, thanks so much for joining me.

Yeah, Alison, uh, looking forward to the discussion. Great to be here, Alison.

This might seem obvious, but why does gen AI, as opposed to the AI that's been around for years, promise to be so revolutionary for all kinds of workplaces?

What's new about generative AI now is that it has the ability to create new things. Previously, you could do diagnostics with AI, you could do predictions, and it's been applied in business, you know, for many years and people have been using it every day. If you use your mobile phone, if you use maps, if you use e-commerce sites, you're using AI, you know, every day in what you do. What's different is that ability to create and approximate more human-like capability.

It's the first technology that we've had that really has that uh ability to do things and, uh, you know, simulate the way we as humans do them. And that's why, you know, I think of it as, you know, we've been talking about AI or artificial intelligence. With generative AI, you really you can reverse it and flip the script almost and talk about IA, which is intelligence augmentation and how we as humans, you know, can use the the technology to advance our own capabilities.

I know that a lot of workers maybe focus on the worry that they'll lose their jobs to AI, but I think experts like you often say the real worry is losing your job to someone who knows how to use AI well, and particularly gen AI, better than everyone else. So are you seeing evidence of that already?

Absolutely, you know, I I think it's important to not look at AI as a zero-sum game, as human versus machine, right? When workers use it effectively, they see that it's really about collaboration, collaboration with, you know, an intelligent new colleague in a lot of ways. It's about the advertising writer using AI to augment her research, her brainstorming and so on. It's really about amplifying that writer's work in two or three of her jobs, maybe ten or fifteen tasks.

It's not about wholesale replacement. You know, we did a a large survey a bit earlier this year, and we found that 95 of workers see potential value in working with these systems. And moreover, about that same number, 94 of professionals tell us that they're ready to learn new skills to work with these gen AI systems. I think it is really important to consider that the pace of technology innovation, of technology, uh, improvements is really picking up, right?

So workers are gonna need to develop advanced AI collaboration skills continuously across their careers, right? It's not something that can be done annually or every couple years or every couple months. There really needs to be a fusion of human and machine, both in work processes, but at the same time, I think there's an increasing need for a fusion of working and learning at the same time. And that's part of the reason why we we call these fusion skills.

Okay, let's dig into these fusion skills. As an overview, which are the most important when it comes to working with gen AI?

Well, there's three that we've really singled out that we think are particularly important for, you know, for all of us to focus on. The first is intelligent interrogation, and th- this is how you use different techniques in terms of how you work, you know, with these generative AI models to get better results out of them. So it's how you interact, how you work with the models. The second fusion skill that's important is judgment integration, and this is, um, you know, integrating the judgment that we as humans have, along with the results that come out of the models to make sure that the right results are presented with the right context and in the right way, and that you draw the

right conclusions. And then the third one is a really interesting one. We call it reciprocal apprenticing. How do you, you know, combine the human and the AI capabilities so that you're improving the capabilities of the models in the way that you're working with it and also, you know, learning more yourself? So it's the concept of helping the AI do a little bit better and learning yourself as you do it.

Okay, so let's start with intelligent interrogation, thinking with AI. What do you mean by that?

You know, one of the really interesting features of generative AI is that natural language is the new programming language in a sense. You don't need to be a a data scientist or a software engineer to get these systems to run really complex tasks. So this is really opening up all sorts of new ways that AI can be brought into, you know, your knowledge work routines, your creative work routines, like, you know, market analysis or brainstorming. You know, there's this business theory going back to the mid 1960s.

I think Michael Polanyi first coined this phrase that we know more than we can tell. And Polanyi called this the tacit dimension of organizational knowledge since our professional thought processes and imaginings about how to, say, run a marketing campaign couldn't be efficiently coded into computers. So you really couldn't amplify many of the cognitive tasks of knowledge work of that marketer's job, for example. But that's really changing. That tacit dimension, those hidden mental activities that we perform in our day-to-day work can be jotted down, you know, into Claude or, uh, Gemini's chat window.

So that tacit dimension can be made explicit in a sense with large language model interactions. And moreover, we're discovering now that there are really more robust prompting tools and techniques for thinking and creating and reasoning with machines. And we call this first skill intelligent interrogation, because it's really the skill of thinking with AI in a way that produces measurably better reasoning outcomes.

Okay, so what are some ways to get better at this skill of intelligent interrogation?

What you're really trying to do is bring out what's in the back of your head, this tacit dimension that is, by, you know, writing your thoughts and your queries into the prompt window in a practical and incisive way. And the thing is, without the skill, you're kinda winging it, right? And we see we see a lot of this going on these days in our research. So your prompt is somewhat, you know, improvisational or ad hoc and probably isn't gonna be all that effective.

But we're starting to see both in practice and also in the empirical research that human gen AI interaction can really be improved with some of the techniques like chain of thought prompts, for instance. That is, you know, when you break down your reasoning uh into steps, and when prompting gen AI, you need to break down the process it should follow into the constituent parts and then strive to optimize each step. It's important to prompt the machine to know that you're thinking step by step with the machine, and literally you write, let's think step by step into the prompt or something along those lines.

That was cool to me that you could just say something as simple as that, like, do this in a step-by-step fashion, and the AI would come back at you with, um, answer that was sort of more clearly thought through or more transparently thought through. And there does seem to be this common theme in intelligent interrogation of breaking down your work. I think my hesitation with that is it feels like more work for me, but ultimately, the productivity gains are astronomical, right?

Exactly, yeah. I think there are two sides to this. That, you know, one is there are certain, you know, work activities that you can break down, right? Like a supply chain manager who's looking to understand the right inventory levels, would ask the model to consider steps like, you know, demand forecasting and lead times for components or storage costs or even, you know, potential supply chain disruptions. And then for each step, she could ask the model to consider the impact of each of those steps on the final inventory decision.

So that's a really structured way of thinking and, you know, uh, and thinking in advance, cause I think there has to be some of that before you go into a prompt. But the thing is, you can also apply uh this approach for more open-ended and exploratory types of work activities, like, you know, strategic planning and, uh, skillful chain-of-thought prompting can really help you become a much better forecaster of, say, you know, future trends or, uh, potential economic shocks that might come to your core market and that sort of thing.

And so by working with AI in a disciplined, skillful way, you know, like a recent business graduate, can kind of leap up the experience curve to co-create really sophisticated market scenarios with the AI. So that new MBA can kind of punch above her weight to develop almost a CSO level vision of future market trends. So it's both really structured work, but also that open-ended type of work as well that we see the benefit. One of the areas where we see it being applied a lot really foundational is in the area that's getting a lot of uh focus right now, which is software development coding itself.

It is a very stepwise process. If you're writing software, you're gathering data, you're analyzing it a certain way, you're writing code to do certain things, and you're testing the code. And this kind of process of intelligent interrogation is very, you know, is very consistent with the way that process works and is allowing software developers using models tool tuned in this way to get much greater results. And ano- another interesting, you know, kind of twist on the case story is what we're doing in our own company and Accenture with a tool that we have called Amethyst, which is, uh, our own knowledge agent that any employee can interact with.

Amethyst will actually prompt me every morning with, uh, you know, did you know this? Did you know that? Here's some things to think about. And that prompts or, you know, suggests for me things to do and things to ask Amethyst to help me with, uh, you know, to get better information. We're finding that by using Amethyst, uh, our employees are spending 98 less time searching for information than they were previously because they're learning, you know, how to get the information better in in using the tool in the appropriate way.

Uh, so, for example, we're in a season where we're doing a lot of, uh, performance reviews and feedback for our employees. So there's certain things that suggesting to me, have you have you done this yet? Have you thought about this yet? You know, things like that, that, uh, that are, you know, really helpful. And part of this is is developing a culture of teaching people to be comfortable and interact in the right way with it, you know, with the generative AI technology.

So that does seem like a good transition to reciprocal apprenticing. You know, I do think that most people can see the value add in some of the more basic tasks that you described. But the real idea, as you're talking about it, is s sort of for the AI to get better and better at helping you, for you to get better at teaching the AI how to help you. And it becomes this virtuous loop of clearer communication, increasing productivity.

So what recommendations do you have for improving on this front of apprenticing?

You know, a lot of the tacit parts of our work, a lot of that tacit dimension is about context, right? So your company wants to grow its product line in, say, Southeast Asia, but there's also this other context in the back of your head that your company also wants to streamline its product portfolio in Northern Europe. So your company is going to be very culturally and strategically and operationally different than its industry peers. And with generative AI, you can now bring that really critical context back, you know, from in your head into the chat window in everyday language.

And that just wasn't feasible for most non-technical workers in the earlier eras of AI and analytics.

So what's a good real-world business example of how someone is using reciprocal apprenticing to create that virtuous loop?

One is, uh, is something that we've implemented, uh, at our company for one of our clients, which is a large consumer goods company, and this is an application to help their sales professionals be more effective. So it's a generative AI model that has a lot of capabilities in it. It understands the im- let's let's say you're selling chocolate-based products to distributors, uh, you know, food products.

So as a sales professional, you want to know what's in stock, what's the inventory look like, needing access to your supply chain. You want to know what's in demand from your customers, who have you sold to recently, because you're planning out your day and who you're going to call, who you're going to try to try to sell to. So the model's got all this information in it. And, you know, the sales agent, by interacting with the model, is giving a sense of, you know, how these decisions are developed and how the sales process works.

On the other side, you know, the sales agent can ask for help and say, Hey, I I'm trying to sell to this customer and they've been a difficult buyer. Do you have any insights or advice from other best practices that might help me? And you could actually do sales simulation and training sessions before he actually calls the customer. So it's this very, you know, very much, again, this is this interaction and, uh, interplay that's helping the sales agents be much more effective in the work they do, increasing, you know, estimated to increase the sales significantly in the organization, the productivity of all the salespeople in the process of doing so.

Okay, so let's get to judgment integration. This, you know, given concerns about AI seems to be maybe the most critical, um, the whole human in the loop idea. But what does it look like in practice? You know, is it setting up good parameters to start, recognizing when it's time to interrupt and correct work? Where are those touch points where human judgment comes in and works effectively?

So we're moving from earlier machine learning systems that were effective at kind of diagnostic and predictive tasks into this new generative AI era. So machines aren't just predicting with high accuracy, they're also creating content and offering personalized suggestions through natural language and so on. So in this new era, there's a skill premium, in a sense, on the ability to judge the novelty, the usefulness, and the trustworthiness of of generative AI outputs and responses. And this goes beyond just fact-checking for machine hallucinations.

Obviously, that's a must-have and a baseline requirement, but really creating value in this gen AI era also requires bringing your expert human judgment in areas like law, uh, or product design or science, into the way that you collaborate with a LLM. So, you know, just to give a a quick example, if you think about sectors like, you know, biotech or pharmaceuticals, there's all sorts of judgment calls for those industry professionals to make that involve trust and, um, you know, patient experiment population privacy in those data sets and safety and the reliability of the information that's going to be shared with with patients and with doctors.

And the integration of judgment into those AI interactions, in this case, has to happen widely across the enterprise. One company that we've talked to in our research is aiming to launch 15 new products over the next five years. And so they're really aiming to, you know, turn the whole company into a product innovation lab from marketing to sales to service and so on. But they've really invested in giving their non-technical experts the the right training to make effective judgment calls and also the time to learn through experimenting with these tools in their roles.

So, really, the path to strategic innovation has to run widely across the enterprise, not just in the R D team or the IT department.

Or the individual using the AI. Assuming that those ethical codes or parameters that the company is using regarding consumer privacy or, um, avoiding bias in algorithmic decisions or the information that's being given, you know, are there things individuals can do to make sure that, as they're collaborating with AI, that the AI is giving them good outputs?

Well, in the article, we talk about some basic principles and technologies that if your organization doesn't have it, they probably should look into getting it, such as, uh, RAG, which is retrieval augmented generation. And that's kind of bringing a, a, uh, a a database of facts into that loop as well so that the outputs, uh, are verified through that database. Another thing is, you know, just being careful that if you're using an open source model or a model off the web, freely available, to not use any, you know, proprietary data or private information, that sort of thing.

You know, I think a really key thing here, too, is deciding the point where you need to put the judgment in. And this is really what we're seeing, uh, you know, companies look at as they as they apply generative AI. And it really requires stepping back and rethinking the current business practices and processes you have and looking at where gen AI should play a role and where the individuals need to step in with a judgment integration.

One example is in insurance, where we're seeing a lot of companies look at, uh, generative AI and large language models for the things like underwriting, which are hugely document-based, language-based processes. Think, you know, lots of information, contracts, policies, et cetera, that needs to be analyzed to underwrite an insurance policy. A great job for, you know, generative AI, but in terms of the policy and pricing and risk decisions, you want that ju- you know, the the judgment of of individuals to be, you know, to be applied on that.

But the benefits you can get are pretty amazing. You know, historically, at a lot of companies, only the underwriters have only had time to read about 10% of the inputs coming in because they just didn't have time to get through it all. Now, with generative AI, you can process 100% of it to still, you know, the key facts for the underwriters that they can make better decisions and they could ultimately then make the right judgment.

Cause in this case, gen AI alone wouldn't be able to do it. That's a, you know, kind of one example. We're seeing similar examples in customer care, customer service applications, where, yes, the generative AI can, you know, understand the customer's intent, what they might be calling about in a customer service, uh, situation. But you need the the customer rep to really understand, you know, the nature of, um, you know, the types of solutions that they might have to the customer's problem and really make that decision on how to best satisfy the customer's need.

And what advice do you have for leaders who are trying to get their people to embrace AI? It seems like from your research, most people are interested and want to, but surely a few are resistant to change or just not sure how to go about it. So what should managers do?

Yeah, I think it's a kind of a requires a different era or different type of leader, uh, going forward. I think to be successful with generative AI, this really is about changing business and reinventing the way you do things, but it requires bringing the whole company along with it. And we're seeing a lot of at the leading companies, we're seeing leaders really dive in and embrace it at the CEO level, at the board level, at the C-suite level, not just the, you know, the technology executives.

I think that's important. Uh, the second leadership quality that's important is being, you know, kind of a learning with humility and, you know, continuing to learn the new techniques, the new new ways that you apply the technology. And finally, there's a there's kind of a culture and learning element of it where, you know, the more you can help people, all the people in the organization, understand and embrace the technology, the more you'll be successful in applying it to, you know, to transform the business.

And so democratizing the access to this technology, you know, applying and building the the learning platforms at scale, you know, that that Jim and I have been talking about are gonna be really important for the the leading successful organizations as we go further into the generative AI era. I think, you know, leaders need a vision of the future workforce, and many don't have that yet. A really important insight that we see in our research and work is as workers develop these skills, they're gonna be able to do more sophisticated and innovation-focused and economically valuable work.

And gen AI really enables skilled people a way to move up the knowledge work ladder in a sense. And, you know, one company that we we looked at in our research, it's telecom company, had been scaling generative AI while also upscaling its people. And they've been identifying new career pathways for the people as they've been doing that. Uh, and they've also been redesigning and expanding roles inside the company. So those frontline customer service agents who acquire these fusion skills are really moving into potentially more lucrative roles like technical support and digital marketing and so on.

So we're really seeing early evidence that companies that get this dynamic right of redesigning and improving career opportunity around skillful human-machine interaction have a real opportunity to leapfrog in their industry and to really help enable industry reinvention.

This space is evolving so rapidly, though. You know, how much time should we as individuals and should organizations spend sort of experimenting with what's new and what can change versus doing our jobs and keeping the companies running?

Well, I think from a company perspective, I think this is the job for companies is understanding, uh, I think this is, you know, the biggest transformation that we've seen to date in terms of tech, you know, in terms of, uh, exponential technology allowing companies to really transform what they do and redefine leadership. For companies, it's it's incumbent on them to really understand how this will allow them to drive their business differently, both at a strategic and operational level, and, you know, make the appropriate investments, form the right partnerships, uh, you know, to do so and prepare the organization, uh, accordingly.

For individuals, I I think again, it's it's about, um, it is it is always changing, and I think that can be daunting, uh, because you hear every week about new models, new advances, you know, you know, new startups that are coming. But I I wouldn't let that, uh, s, you know, dissuade anyone from really using what's there now and developing the right skills. Cause a as you, you know, if you've developed skills and became familiar with the early versions of ChatGPT, you're you're able to, you know, use more powerful versions of the models as they come about.

And that'll help you then learn Claude and and other models that are out there. So I think it's this continuous learning environment we're in that we've been talking about for years, but is even more important than ever. And with generative AI, the good news is we have some, uh, technologies that can help us with that learning and, uh, informational process, uh, more so than ever.

Thank you all so much for being with me today.

Thanks, Allison.

That's H. James Wilson and Paul R. Daugherty, both of Accenture. Together, they wrote the HBR book, Human Plus Machine, Reimagining Work in the Age of AI, now available in a new and expanded edition, as well as the HBR article, Embracing Gen AI at Work. And we have more episodes and more podcasts to help you manage your team, your organization, and your career. Find them at hbr.org slash podcasts or search HBR on Apple Podcasts, Spotify, or wherever you listen.

Thanks to our team, senior producer Mary Dew, associate producer Hannah Bates, audio product manager Ian Fox, and senior production specialist Rob Eckhardt. And thanks to you for listening to the HBR IdeaCast. We'll be back with a new episode on Tuesday. I'm Alison Beard. If you listen to IdeaCast for conversations and strategy, you'll want to check out Founder's Mentality, the CEO sessions. In-depth conversations with top executives about the judgment calls that define their careers. Follow wherever you get your podcasts.