# Micro Utility With Gen AI: Shopify's Miqdad Jaffer

- **Show:** Me, Myself, and AI
- **Published:** 21 Nov 2023
- **Source:** https://sloanreview.mit.edu/audio/micro-utility-with-gen-ai-shopifys-miqdad-jaffer
- **Transcript:** https://podcasts.opennash.com/shows/me-myself-and-ai/micro-utility-with-gen-ai-shopifys-miqdad-jaffer-274085/
- **Provider:** OpenNash Podcasts (machine-generated)

## In brief

Shopify's Miqdad Jaffer argues that generative AI works best in business when it does small, practical jobs inside tools people already use, and when the user keeps the final say. Shopify started with product descriptions and built a suite called Shopify Magic around one rule: AI suggests, the merchant decides.

The tension is between speed and control. Shopify moved fast on a new, error-prone technology, and it calmed fears of hallucination and bland, uniform output by designing for failure. Merchants can regenerate, choose from options and edit freely, so the AI gets them started but never defines their brand.

## Key insights

1. **Keeping the human in control defused AI fears** Jaffer says Shopify's main rule is that the AI never writes without user intervention, so merchants always see a message before it goes out. That removed most of the worry about hallucination (AI stating false things) because the merchant approves everything.
2. **Start with one painful, high-volume task** Shopify began with product descriptions because merchants struggled with them daily and billions exist on the platform. The first version needed only keywords and a tone of voice, and users then asked for the feature everywhere.
3. **Small tools used by millions can matter more** Ransbotham calls Shopify's approach 'micro utility': saving users the trip between a chatbot and their store tools. Small gains repeated across many users can beat one large system with few users.
4. **Plan for AI failure instead of avoiding it** Because outputs vary from run to run, Shopify assumes the first result often won't satisfy. It builds in easy regeneration and multiple options, such as three email subject lines, so a miss costs the user almost nothing.
5. **Guard against bland output by giving merchants edit power** Asked whether everyone would end up with the same generic descriptions, Jaffer says the tools are a starting point, not the finish line. One merchant built a 3,000-product outlet store in three days instead of three months, then tuned the style with custom instructions.

## Questions this episode answers

### What is Shopify Magic?

It is Shopify's suite of generative AI tools built into the workflows merchants already use. It writes product descriptions, blog posts, pages and email text, and drafts customer service replies, per Miqdad Jaffer.

### How does Shopify stop the AI from saying something false or off-brand?

The AI never publishes anything on its own, so the merchant reviews the text first. Jaffer adds that the merchant knows their own product best, so they judge whether it is accurate.

### Will everyone's product descriptions end up sounding the same?

Sam Ransbotham raised this risk, which Jaffer calls a 'local maxima', meaning everyone settling on the same plain output. His answer is that the AI only gets merchants started, and they can add instructions and edit to stand out.

### What does 'micro utility' mean here?

Ransbotham uses it for small, practical AI features, such as writing a description inside the store tool so users skip copying text from a chatbot. The value comes from many small gains multiplied across millions of users.

### Why did Shopify feel comfortable adopting generative AI so early?

Jaffer says entrepreneurs are unusually willing to take risks, and many merchants were already using ChatGPT on their own. Shopify also made AI normal inside the company, so staff understood issues like hallucination.

## Facts

- **Miqdad Jaffer** [0:01:23]: "You may have gone to the checkout and seen that purple shop pay button."
- **Miqdad Jaffer** [0:04:24]: "We did things along the lines of fraud detection, where a transaction comes in and it's not as easy to tell whether this is fraudulent or non fraudulent."
- **Miqdad Jaffer** [0:04:51]: "we've created a suite of products called Shopify Magic. And the idea behind this was how do we embed this directly into the workflows"
- **Miqdad Jaffer** [0:06:16]: "one of the more recent ones, even before generative AI, was product classification. So the idea of being able to determine the category of a product using its text and as well as its image"
- **Miqdad Jaffer** [0:07:05]: "we saw them struggling with product descriptions daily. There's billions of them across Shopify"
- **Miqdad Jaffer** [0:08:24]: "All a merchant has to do is they enter a couple keywords, they pick a tone of voice, and they press generate."
- **Miqdad Jaffer** [0:09:13]: "We introduced the ability to support eight languages, and we saw people writing translations with it"
- **Miqdad Jaffer** [0:09:13]: "there were merchants that didn't speak English and wanted to sell to an English audience and saw product descriptions as a way to bridge that gap."
- **Miqdad Jaffer** [0:10:11]: "building Sidekick, which is the first of its kind AI enabled assistant, purpose built for commerce."
- **Miqdad Jaffer** [0:12:12]: "we've built our own kind of internal ChatGPT instance equivalent. We have it for our internal wikis for search and discovery."
- **Miqdad Jaffer** [0:14:39]: "we already had merchants that were using ChatGPT or whatever was out there to be able to prompt it"
- **Miqdad Jaffer** [0:15:35]: "the AI will never write without user intervention, and so the merchant will always be able to see what the message is that's gonna go out there."
- **Miqdad Jaffer** [0:19:00]: "you upload a product image and then you pick what background needs to be switched out on."
- **Miqdad Jaffer** [0:23:31]: "he wanted to set up an outlet store for some of the overstock inventory that they had, and they had 3,000 SKUs that they wanted to put together"
- **Miqdad Jaffer** [0:23:31]: "I would have hired a team. We would have taken three months to get this thing spun up"
- **Miqdad Jaffer** [0:25:17]: "We actually see that it takes multiple generations before the user is happy with what they have in front of them."
- **Miqdad Jaffer** [0:25:47]: "subject lines, you get three options to choose from, you can change it"
- **Miqdad Jaffer** [0:27:04]: "I took an initial role as a engineer and was introduced to product management in what was then meter data management."
- **Miqdad Jaffer** [0:21:14]: "I can almost guarantee that 99% of Shopify knows what that means and how that happens"
- **Miqdad Jaffer** [0:29:05]: "it's the same as when Photoshop came out. Designers got much better and much more creative, and I think this will raise the bar for everyone"

## Transcript

**[0:00:02] Shervin Khodabandeh:** How can generative AI tools help grow businesses while keeping users in control? Find out on today's episode.

**[0:00:10] Miqdad Jaffer:** I'm Miqdad Jaffer from Shopify, and you're listening to me, myself and AI.

**[0:00:15] Sam Ransbotham:** Welcome to Me, myself and AI, a podcast on artificial intelligence and business. Each episode, we introduce you to someone innovating with AI. I'm Sam Ransbotham, professor of analytics at Boston College. I'm also the AI and business strategy guest editor at MIT Sloan Management Review.

**[0:00:33] Shervin Khodabandeh:** And I'm Shervin Khodabandeh, senior partner with BCG and one of the leaders of our AI business. Together, MITSMR and BCG have been researching and publishing on AI since 2017, interviewing hundreds of practitioners and surveying thousands of companies on what it takes to build and to deploy and scale AI capabilities and really transform the way organizations operate.

**[0:00:59] Sam Ransbotham:** Hi everyone. Today, Shervin, I'm pleased to be joined by Miqdad Jaffer, director of product at Shopify. Miqdad, thanks for taking the time to talk with us. Let's get started.

**[0:01:08] Miqdad Jaffer:** Thanks for having me. Happy to be here and excited to talk a little bit about AI.

**[0:01:13] Sam Ransbotham:** Great. We all use Shopify, but we may not know it. Can you give us a brief overview of Shopify and tell us what a director of product actually does?

**[0:01:23] Miqdad Jaffer:** Sure. So Shopify is a platform for entrepreneurs to be able to set up their storefronts online. You may have seen Shopify whenever you're going to purchase an item from a retailer. You may have gone to the checkout and seen that purple shop pay button. And for many of us, that's probably where you've been exposed to Shopify. It's a way for an entrepreneur to be able to set up their storefront on the internet, and for a way as you as a buyer to be able to transact in the fastest, simplest way possible to be able to make sure that the item arrives at your door.

**[0:01:57] Miqdad Jaffer:** In other cases, you may have seen Shopify on a platform like Shop dot ai, where you might have searched for a specific event that you're putting together, a specific product that you're looking for, and tried to filter it all down across the many merchants on Shopify. A merchant would go into Shopify and log in. There is a product section on the left, as an example. They would go into the product section, they would click add a new product, and then within add a new product, there is space for a title, a description and some other fields.

**[0:02:30] Miqdad Jaffer:** In terms of my role, my responsibilities are how do I think about AI and how can it fit into that realm of entrepreneurship? And what can we do to accelerate our merchants success and progress as they build up their storefronts, sell their products, and grow as entrepreneurs?

**[0:02:47] Sam Ransbotham:** So how does that involve artificial intelligence? I heard a lot of e-commerce, I hear a lot of connecting, but how does that involve artificial intelligence?

**[0:02:54] Miqdad Jaffer:** Yeah, it's a great question. I think that, uh, when people are looking to start as an entrepreneur, there's a lot to it. So there are considerations of what's the right product, what's the right price, what's the right placement, what's the right promotion. How do I set up everything with my storefront? How do I maintain what good looks like as I grow and as I advance? What we've seen is that AI is an opportunity to make entrepreneurship accessible for everyone.

**[0:03:20] Miqdad Jaffer:** With every business owner, we want to utilize AI to create more efficiency from managing administrative tasks to supporting business operations. Administrative tasks can be as simple as, like, creating a new product description, figuring out what the right subject line for an email could be. And then the business operation side of it could be just about everything from understanding the business, figuring out the analytics of it. What questions should I ask? What's the strategy that I should employ?

**[0:03:46] Miqdad Jaffer:** And we view AI as a powerful assistant that can weave itself in and out of that process.

**[0:03:53] Shervin Khodabandeh:** What you're saying is Shopify is letting the entrepreneurs focus on the actual product You know, brand and all of that kind of stuff, but then have Shopify be a platform for how they take that to market, how they want their brand to appear, and a lot of the backend operations. Obviously, AI could be quite prevalent across all of those. Was AI embedded from day one as it launched?

**[0:04:24] Miqdad Jaffer:** We've had AI in its most traditional sense embedded since early days. We did things along the lines of fraud detection, where a transaction comes in and it's not as easy to tell whether this is fraudulent or non fraudulent. We've done basic classification models to be able to determine whether something is fraudulent and then provide a score back to the merchant in a reasonable fashion. And that's been in there from the start. Then generative AI comes along and there's opportunities to be able to do a lot more.

**[0:04:51] Miqdad Jaffer:** And what we've seen is we've created a suite of products called Shopify Magic. And the idea behind this was how do we embed this directly into the workflows that our merchants are having to go through? And how do we make that easier to start, run and grow your business? We did things like auto write, where we can create a description for a product, create a blog, create a new page, help with the subject line of an email, create the body of an email, and look at even ways for on the customer service side, to be able to provide responses for a merchant as they interact with their customer.

**[0:05:24] Miqdad Jaffer:** So those are some of the early stages, but we're trying to accelerate it even more these days.

**[0:05:29] Shervin Khodabandeh:** A lot of companies on the aren't thinking about generative on the AI, and it seems like you know, you've been doing it for quite on the some time. Can on the you comment a bit topic, but on when you started but thinking about it, prepping I think for it? And I that's would assume, to some really important. extent, redirecting We can't just or upskilling or ignore the the reskilling some of your fact that technical folks to be able that to actually take these things that to market.

**[0:05:50] Shervin Khodabandeh:** that

**[0:05:51] Miqdad Jaffer:** I'll give you a little bit of the genesis of how we kind of started with the first thing and accelerated it even more. We have some general themes that come up every year in terms of things that we should be looking at. And one of the ones that's usually pretty prevalent on there is staying on the cutting edge of technology is critical. What we wanna do is try to bring as much of the latest technology into the hands of our merchants so they have every advantage possible.

**[0:06:16] Miqdad Jaffer:** And we've always tried to do things with AI, and one of the more recent ones, even before generative AI, was product classification. So the idea of being able to determine the category of a product using its text and as well as its image to be able to figure out where this belongs. It helps in channels, it helps you basically market to a wider audience and get a reasonable taxonomy set. When ChatGPT came out, the question was, what can we do with this technology to put it in front of merchants?

**[0:06:45] Miqdad Jaffer:** And this was one where we wanted to lean in for a couple reasons. One, it's important to get this in the hands of merchants as fast as possible, staying with the cutting edge of technology side. And the other part of it was we actually saw that there was utility for the first time, and that utility was important to get out there and to see whether our merchants would use it and what we could learn from it.

**[0:07:05] Miqdad Jaffer:** So we started with a simple path of what's the thing that merchants are struggling with, and we saw them struggling with product descriptions daily. There's billions of them across Shopify, and we saw that as like a wide space to work in. And we had all of the conditions around what would make a good product description. And then we felt, okay, let's get this in and see how people use it and see whether this is something that's palatable.

**[0:07:33] Miqdad Jaffer:** So we quickly spun up a team and we relied upon a couple different principles. Shopify generally builds off of a set of principles and then allows the team to go fast. Some of the principles we worked off of was this has to be easy, this has to be integrated into their workflow, and the merchant need to be able to have final say as to what goes out there to represent their business. It's a simple start. We said, Okay, let's figure out what the rules of a good product description are.

**[0:08:00] Miqdad Jaffer:** How long should it be? What's the tone it should be used in? What are the type of words that'll be used and what makes it really good? We did the basic thing of prompting against that and then said, Okay, well, what additional context should the merchant provide and what should we look for to be able to help them? And so we said, Okay, well, they can probably list out a couple keywords about their product, and that fits into the realm of knowledge they know about, and the rest of it should be us.

**[0:08:24] Miqdad Jaffer:** Like, this should be as simple as, like, pressing a button. It should feel like magic. So apropos to that, we named it Shopify Magic, and we wanted to stick with that. All a merchant has to do is they enter a couple keywords, they pick a tone of voice, and they press generate. That was it. That was the first version. We tried to ship that real quick and and see what would happen. And the feedback we got was, This is amazing, can you do this everywhere?

**[0:08:49] Miqdad Jaffer:** So I was like, Okay, so there's there's some positivity here. So what can we do next? And so we added a special instructions field. And initially, in our trials, we were doing things like add a quote from a famous celebrity that would be relate to my product, just as like a meme for how to try it. And then we saw merchants using it in different ways. So we saw them using it for language, and this was an interesting one.

**[0:09:13] Miqdad Jaffer:** We introduced the ability to support eight languages, and we saw people writing translations with it, and that was expected, but it was interesting to see. And I think one of the most interesting ones we saw was there were merchants that didn't speak English and wanted to sell to an English audience and saw product descriptions as a way to bridge that gap. Unexpected, but at the same time, it's one of those things where you put the product in the hands of the user and then the user decides what they're gonna use it for.

**[0:09:44] Miqdad Jaffer:** And it was remarkable to see that, like, we opened up entrepreneurship for even a small window more of people than were there previously. And that's what kinda got the ball rolling on the AI at first. After that, it was every team wanted a piece, every team wanted to do something, and we accelerated it in every way we could. We've tried to, like, systematize things from a UX perspective. Whenever a merchant sees something, they know that this is what that's gonna do.

**[0:10:11] Miqdad Jaffer:** And we've also tried to look into building Sidekick, which is the first of its kind AI enabled assistant, purpose built for commerce. And so that's kind of been the journey that we've gone into. We have dedicated teams that are working on specific features, and then we have the entire company that is looking at opportunities of where AI can accelerate commerce.

**[0:10:32] Sam Ransbotham:** So when Shervin at first heard about what you were doing, I think what kinda got us excited was how pervasive this is. The effect of something like Shopify integrating artificial intelligence into its tool is huge. And I think we were talking earlier, you know, talked about introducing this product in February. This is very early on in the generative days. A lot of people are investigating generative, but this was an exciting story where you're using these tools in production very quickly.

**[0:11:05] Sam Ransbotham:** I'm sure that was a little bit painful. Maybe you could speak a little bit about any of the pain or difficulty you had, maybe other people could learn from that, but also just how pervasive it is. Both of those are interesting ways that people can learn from what you've done.

**[0:11:19] Miqdad Jaffer:** Yeah, early days came with its challenges, but I think that that's kind of the fun of it. It was interesting because this was the latest technology, there was so much utility to it, and we just wanted to get that in the hands of our users. Along the way, we had to figure out things like, how do you do evaluation? Like, what is this prompting stuff? How do you systematize this and make this make sense? What's all this RAG stuff about, like RAG being retrieval augmented generation?

**[0:11:43] Miqdad Jaffer:** How do I bring in more data into this context of a prompt, and how do I make this make sense? And the crazy part was every week, a month or a year's worth of other technology time passes, and all of a sudden there's a new thing to try and a new thing to explore, and we didn't wanna miss that either. Every time something new came out, we tried, we explored. And I think that the culture at Shopify is one of exploration and of one of crafters and builders.

**[0:12:12] Miqdad Jaffer:** And what we tried to do is put this in the hands of people that could build and to try things. And we also did things internally to encourage the use of AI, and we've built our own kind of internal ChatGPT instance equivalent. We have it for our internal wikis for search and discovery. And what we've tried to do is just make this into the fabric of the company. It's normal, it's expected, and then all of the risks and challenges that come with it, hallucinatory included, are things that people are familiar with.

**[0:12:44] Miqdad Jaffer:** And once we got them familiar with it, then we figured out ways to work around it and to embrace it in some cases, too.

**[0:12:51] Shervin Khodabandeh:** Yeah, I think that's a very important point you're making, cause as I reflect back on my own experience and, like, BCG's experience in this field. We're working with many companies, and many of them have the same mindset and ambition as you've described and are putting solutions in production and are embracing it. And then there are some that are, I would say, quite reserved about this. And some of that is based on, I would say, some Unfounded fears.

**[0:13:21] Shervin Khodabandeh:** I mean, the reality of it is this is new technology and it comes with a lot of risk, and maybe a little bit more risk than traditional AI because of how pervasive it can become. But I think the mentality of waiting for all of the risks to be figured out by other people then puts you at somewhat of a huge disadvantage. Because the only way, as you described, I mean, I love how you said it. The only way to actually get ahead of these things is to start experimenting with it and getting comfortable with it.

**[0:13:51] Shervin Khodabandeh:** I'm sure at the board level, there were some risks and some concerns. And maybe just comment on what many people thought back then versus what the reality was. And put it in perspective for some of our listeners so that they understand that these risks can be mitigated versus, you know, you just stay away forever.

**[0:14:11] Miqdad Jaffer:** Yeah, one of the first things I'll say is that I wanna describe who an entrepreneur is to even put this into context. Every entrepreneur I have ever come across has the highest risk tolerance of anyone I have ever met. They are willing to drop everything in their life to start a business, and sometimes they don't know anything except that they wanna start a business. And these people are inherently risk tolerant, so our user group is very different than others.

**[0:14:39] Miqdad Jaffer:** And obviously, you're gonna get a spectrum of of tolerances across that user base, but by nature, this is a group that is, like, willing to dive in, take risks and try things. And then one of the things that we observed was that they were already using it. So we already had merchants that were using ChatGPT or whatever was out there to be able to prompt it, figure out alternatives, and use it directly into their software. We did a brief round of research where we asked a number of merchants, is this something that you know about?

**[0:15:09] Miqdad Jaffer:** How have you used it? What are you doing with it? And many of them were like, Yeah, well, I mean, I just ask it everything, and so I'm just getting to figure it out. And we already saw that happening. So for us, it was all right. Well, we already have this risk tolerance merchant base, and the biggest concerns that we have are typically on two vectors. Vector one is a fear of losing control. So asking questions along the lines of what's it gonna say?

**[0:15:35] Miqdad Jaffer:** What do I do if it hallucinates? Is this gonna be right for me? Is it gonna speak to my buyer? So all of those initial questions, and that fear of losing control was easily mitigated. So we said, Okay, well, here's a quick fear. How do we mitigate this fear? And we mitigate a fear of losing control by putting the control back in the hands of the user. So carte blanche principle was the AI will never write without user intervention, and so the merchant will always be able to see what the message is that's gonna go out there.

**[0:16:02] Miqdad Jaffer:** So all of the hallucination risk, all of the what's it gonna do? Risk is gone because now it puts control right back in the hands of the user. The second risk is around whether it's factually accurate or not, and that's typically one that a lot of people come across. The way that we've tried to manage that is the person that knows the most is the person selling the product. The thing that they know the most about is their product, and that's what they're trying to talk about, and they're trying to talk about their brand.

**[0:16:29] Miqdad Jaffer:** And so that one didn't feel as risky for us either, because it was gonna be up to the merchant to decide how they were gonna be represented in a factual way.

**[0:16:38] Shervin Khodabandeh:** You talk about this in such matter-of-fact way, but when you think about the actual key word here is the user, which is actually when you think about Sam. Like, a lot of our work around human and AI versus just human alone or AI alone. Thanks for talking about that. That's very key.

**[0:16:57] Sam Ransbotham:** One of the things I really like, too, you keep using the word utility. A lot of the examples that Shervin and I talk about, we'll ask people for an example, and they'll bring out some AI heavy application that they've implemented that crosses lots of parts of their organization and it's a big deal. And those are great, but the utility you're talking about seems like micro utility. And so what I mean by that is that, as you mentioned, people may have already been going out to some large language model and generating some text and then pasting it into Shopify.

**[0:17:30] Sam Ransbotham:** Your incremental utility here was saving them some back and forth between those two tools, but also then incrementally making it work better within your tools and within your context. And I think that's exciting when you think about how all those tiny pieces multiply by the billions. And that's a different story than what Shervin I see sometimes, which is we have a big system which has a big utility, and there may be not so many users of it.

**[0:17:59] Sam Ransbotham:** I want to come back to something that you mentioned earlier, and maybe I just picked up on your tone of it, but you were talking about fraud detection and these somewhat traditional uses of artificial intelligence. I mean that that feels like an oxymoron now. But you say, oh yeah, we're using it for fraud. We're using it for back end business optimization and and these sorts of things. Oh yeah, yeah, yeah, we do all that stuff, but here's the really cool stuff.

**[0:18:23] Sam Ransbotham:** That seems really exciting that you're able to stay forward. What's next?

**[0:18:27] Miqdad Jaffer:** It's a great question. I think the the hope for us is that we want AI to lower the barrier of entry for entrepreneurship, period. And I think the idea for us is, let's look at everything that's on the space. So we did something relatively recently about image generation, and we saw this as, okay, well, we can lean in here too. There's different modes of operating that we can play with. So we released a Hugging Face pipeline, and the idea behind this was, let's put this out into the market, let's see how people are gonna use it, and let's do it in a way that's gonna be innocuous.

**[0:19:00] Miqdad Jaffer:** The idea behind it is you upload a product image and then you pick what background needs to be switched out on. And some of this there's some fun stuff behind the scenes of, like, uplift upscaling the image of figuring out the right mask for it, making sure that the reflections and shadows are gonna be good, and then generating all sorts of backgrounds that make sense in the vein of commerce. And what we see from this is the ability to explore in a different way.

**[0:19:28] Miqdad Jaffer:** What we've tried to do with AI, and to your point about the risk tolerance of our user base, it's not meant to be something that is just disruptive to their existing workflows. Many of them, especially established ones, have existing workflows where they do everything in their specific way, and that's what works for them. All we're doing is for anyone that needs that extra push or needs that extra piece, there's a button to click, a way to invoke this, and it is their choice to make on that.

**[0:19:58] Miqdad Jaffer:** And Shervin, I like some of the stuff that you were talking about in terms of putting the user in place. And our adage has always been that this is meant to be something that augments and isn't a replacement. So this is always gonna be something that helps a user be the best version of themselves. And with image generation, we see the opportunity for them to holistically change their storefront if they want to. If they have a Thanksgiving sale coming up and they wanna be able to change all the backgrounds to be fall themed, it's a quick, easy move for them to do.

**[0:20:32] Miqdad Jaffer:** Their product stays at the forefront, their branding stays at the forefront, but they can merchandise just for the specific event. If it's if Thanksgiving, if it's Christmas, if it's New Year's, whatever it might be, something that would require additional photo shoots might be a lot easier to achieve now than they were previously.

**[0:20:50] Shervin Khodabandeh:** Exactly, just just remember, like, how complex and unnecessarily sort of process oriented something like this would have been, you know, a few years back, where you have just agreeing on the background and the photo shoot and the look and feel and the impact on brand. And like, all of that, and now you're putting it all in the hands of the merchant.

**[0:21:14] Miqdad Jaffer:** For us, it was really important that many people across Shopify were using this, asking the right questions, pushing the boundaries, and understanding some of the nomenclature around it. When I say hallucination, I can almost guarantee that 99% of Shopify knows what that means and how that happens and what that works. And that makes the conversation much different every time you go towards product development, because it's not bringing it up and relitigating it every single time.

**[0:21:40] Miqdad Jaffer:** It's people trying the solution around the normal problems that come up with this technology.

**[0:21:46] Sam Ransbotham:** If I squint, I kind of see something developing over this market of artificial intelligence. You alluded to it with the ease of transfer learning. You're able to take these existing models and augment them slightly, and I see that as an improvement over the last decade. From, oh yeah, sure, you can download these tools and build them yourselves to, hey, no, you can take what we've done and what we've trained our GPUs and burned up our GPUs on, and incrementally burn up a little GPU on your own, but then move forward.

**[0:22:16] Sam Ransbotham:** I think that's a dynamic that's happening in this market here. But let me go darker here and talk about another dynamic. Is there a, let's say, a race towards mediocrity? And I think that's a little charged way of saying it. But if all of your users in Shopify are using the same tools to generate the same sort of product descriptions, isn't that going to lead to a sort of vanilla feeling of all product descriptions? How do we push back and get beyond that?

**[0:22:43] Sam Ransbotham:** It's great that we get everybody to mediocre. Well, how do we get people distinctive? Where do we build off of that? How do we make that beyond mediocre?

**[0:22:54] Miqdad Jaffer:** Yeah, the the problem you're talking about is a local maxima, effectively, right? So everyone moves towards this standard, simplistic, homogenous, boring thing. And what we've looked at is that all of the tools that we provide will get you started. The idea is not to be this is the finish line. The finish line is the merchant. The finish line is their product. The finish line is their brand, and being able to represent accordingly. For many cases, this is about, like, getting you something which is better than nothing and getting you started in thinking.

**[0:23:31] Miqdad Jaffer:** We had one merchant that really described it well for me. He wanted to set up an outlet store for some of the overstock inventory that they had, and they had 3,000 SKUs that they wanted to put together, 3,000 different products that they wanted to put on this initial outlet store. And what he said to me was, Yeah, typically, what I would have done is I would have hired a team. We would have taken three months to get this thing spun up and we would have tried to put it together.

**[0:24:00] Miqdad Jaffer:** And he said, I spent the weekend by myself and I just used your generation feature, it got me started. I made a couple changes, and in three days I had an outlet store stood up and ready to go for all my products. And I made the changes necessary. I don't like the style that you had, so I gave it some specific instructions and it got to what I wanted. And I think the idea is, like, flexibility within the framework.

**[0:24:24] Miqdad Jaffer:** So provide a framework, let them get started, but give them all the flexibility in the world to do what is appropriate for their business and for them to be able to differentiate to their audience. And I think the key is every audience is different, and nobody understands that better than the merchant themselves. The idea is capability and augmentation, not replacement. And you're right, there could be a point of local maxima for people, but we wanna leave every escape hatch possible so that they can get out of that.

**[0:24:52] Sam Ransbotham:** One thing I want to stick back to, and you alluded to it, was the deterministic versus stochastic nature of this. That seems really difficult to work with in a production standpoint, that you're using tools that have stochastic outputs, but you'd like to have a defined, tested, refined process. And those two things seem antithetical to me in in many ways. How do you deal with that?

**[0:25:17] Miqdad Jaffer:** Part of it is there needs to be a risk tolerance built in, so there needs to be almost an expectation that the system will fail and that the user needs to have a way to be able to work through that failure. So product description's a great one. We actually see that it takes multiple generations before the user is happy with what they have in front of them. So, with that in mind, you have to allow for that second, third, fourth, fifth generation to take place with no effort whatsoever.

**[0:25:47] Miqdad Jaffer:** And so that's an error case that we know is going to happen, so we plan for it. So this is regenerate button right there, presents multiple options. In other cases, we will try to present as many options as we possibly can to make it easier. So subject lines, you get three options to choose from, you can change it, do whatever you wanna do. Then the other part of this is that we understand that technology is gonna change and the way that people use it is gonna change and the expertise level is gonna change.

**[0:26:16] Miqdad Jaffer:** So there are people that are going to try and break the system, and there are people that are going to try and work around the system. It's important that we plan for that scenario too. So it's every risk and every failure case has to be considered up front. And then you almost do it in a fun way. And with the one that's typical is prompt hacking, where people are trying to figure out what the prompt was that was used for this.

**[0:26:38] Miqdad Jaffer:** In most of those cases, you do the best you can, but you expect that the prompt will get out there. So you write the prompt in a way that, like, when it gets out there, it's like, Hey, you found me, that's great. Do you wanna apply for a job or something? Like, there's lots of different ways to, like, think about this.

**[0:26:52] Sam Ransbotham:** Your human in the loop solves a lot of this, too.

**[0:26:54] Miqdad Jaffer:** Correct?

**[0:26:54] Sam Ransbotham:** Your whole design philosophy really addresses, I I think, a lot of the backstops, a lot of the stochastic nature, too. Can you give us a bit of your background? How did you get to your role?

**[0:27:04] Miqdad Jaffer:** Yeah, I started out as an engineer. I think since I was, like, twelve years old, I was programming and trying to figure out how to make the computer do what I wanted it to do. And I took an initial role as a engineer and was introduced to product management in what was then meter data management. So it was like big data for utilities that just come out. I got to work in that space and then I moved into document classification, then ad tech, and then retail data platform management.

**[0:27:37] Miqdad Jaffer:** And I've always been adjacent to data. And at Shopify, my journey had been build our infrastructure and data platforms, work on our machine learning platforms, and figure out what needs to be built there. And I always had, like, one toe in the machine learning AI pool at all times. Then I had teams that were focused on the analytics side of it and what merchants were gonna experience and how they were gonna understand their business. And the mandate was always, like, how do I optimize my business with data?

**[0:28:04] Miqdad Jaffer:** And we looked at opportunities with ML, we looked at opportunities with AI, and then when generative AI came out, it was just the next step along the way. So it's by luck, by accident, by design, who knows? But I've always been in data for the last, like, fifteen, twenty years, and this was the next step.

**[0:28:24] Shervin Khodabandeh:** okay, time for five questions, but not do you know what that is?

**[0:28:29] Miqdad Jaffer:** I do not. Okay, you're I mean, I know what good, five questions are,

**[0:28:31] Shervin Khodabandeh:** good. So we're gonna ask you five questions, rapid fire style. Just tell us the first thing that comes to your mind. What do you see as the biggest opportunity for AI right now?

**[0:28:42] Miqdad Jaffer:** I think the biggest opportunity is solving cold start for many people. What I mean when I say cold start is looking at a blank screen and not knowing what to do, whether it's how to navigate a system, write a thing, or whatever it might be, just that unknown moment. I think that's where AI steps in and does the biggest.

**[0:29:01] Shervin Khodabandeh:** I love that. What is the biggest misconception about AI?

**[0:29:05] Miqdad Jaffer:** That it will take over. I think that there's a long way to go. It's an augmentation, not a replacement, and I think it's the same as when Photoshop came out. Designers got much better and much more creative, and I think this will raise the bar for everyone in terms of what they can do.

**[0:29:22] Shervin Khodabandeh:** Is there such a thing as too much AI? When is there too much?

**[0:29:26] Miqdad Jaffer:** I think it's too much when the user is out of the loop. I think the user needs to have a stronghold in how they use AI and how they interact with it. I think this is not about replacing, and I think this is a matter of augmenting and helping the user be better.

**[0:29:42] Shervin Khodabandeh:** What was the first career you wanted?

**[0:29:45] Miqdad Jaffer:** I wanted to be a doctor, but I'm faint at the sight of blood, so that didn't work out so well.

**[0:29:50] Shervin Khodabandeh:** What is the one thing you wish AI could do that it cannot do right now?

**[0:29:55] Miqdad Jaffer:** I wish we could incorporate all of the modes of a user wanting to interact, whether it be a combination of voice, facial expressions, just to be able to get that semantic meaning behind the scenes that words can't do by themselves. Wonderful.

**[0:30:14] Sam Ransbotham:** We really appreciate the idea that what you're doing is using generative AI right now, just barely after it got started. I think a lot of people are wringing their hands and wondering how to use these technologies, and what you've shown is a great example of how people can get real utility from this tool right now. Thanks for taking the time to join us today.

**[0:30:34] Miqdad Jaffer:** Thank you so much for having me both.

**[0:30:38] Shervin Khodabandeh:** Thanks for listening. On our next episode, Sam and I speak with Ellen Nielsen, chief data officer at Chevron. Please join us.

**[0:30:51] Speaker 4:** Thanks for listening to me, myself and AI. We believe, like you, that the conversation about AI implementation doesn't start and stop with this podcast. That's why we've created a group on LinkedIn specifically for listeners like you. It's called AI for Leaders, and if you join us, you can chat with show creators and hosts, ask your own questions, share your insights, and gain access to valuable resources about AI implementation from MITSMR and BCG. You can access it by visiting MITSMR dot com forward slash AI for leaders.

**[0:31:22] Speaker 4:** We'll put that link in the show notes, and we hope to see you there.