In brief
People resist AI less because the technology is weak and more because of how it feels to them. Julian De Freitas of Harvard Business School argues there are five barriers: AI seems opaque, emotionless, rigid, autonomous, and not human. Each barrier has a practical fix, such as explaining decisions, keeping humans in control, or not mentioning AI at all.
The tension is that the fixes that win adoption can also create risk. Making AI more human-like or more flexible can lead people to use it in unintended ways. De Freitas's AI companion app study shows this: some users shared serious mental health problems, and a quarter of audited responses were judged risky by a clinician. He urges managers to think about the whole customer lifetime.
Facts
Stated by the speakers. Each quote matches the transcript, which shows what was said, not that it is true.
A 2023 Gartner survey found that 4 out of 5 corporate strategists said AI would be critical to their success, but only 1 in 5 used AI in their day-to-day work.
“According to a Gartner survey, for instance, 4 out of 5 corporate strategists say AI will be critical to their success in the near future, but only 1 out of 5 said they actually use AI in their day-to-day work.”
0:00:32 · Curt Nickisch · AI adoption · 2023
Julian De Freitas says some of the latest AI models use billions or trillions of interacting parameters, which makes it impossible even for their makers to fully understand how they work.
“Some of the latest models are operating using billions or even trillions of interacting parameters, making it impossible even for the makers of the technology to understand exactly how it works.”
0:04:39 · Julian De Freitas · Model complexity
Harvard Business School colleague Sunil Gupta wrote a case about Miroglio Fashion, an Italian women's apparel company.
“one example which a colleague, Sunil Gupta, wrote a case about is miroglio fashion, which is a Italian woman's apparel company.”
0:05:14 · Julian De Freitas · Case study
Miroglio Fashion previously had local store managers forecast inventory, and found that an AI model could make forecasts more accurate and raise revenues.
“Previously, this was something that the local store manager was responsible for, but they realized that they could get more accurate at doing this, and this would translate into higher revenues”
0:05:56 · Julian De Freitas · Inventory forecasting
Miroglio Fashion first rolled out a simpler, easier-to-explain forecasting model to a subset of stores, where managers used it and those stores performed better than stores without it.
“they initially at least rolled out the simpler model to a subset of their stores. And the store managers did use these. The stores that had this model performed better than the ones that didn't.”
0:07:11 · Julian De Freitas · Phased rollout
After a period with the simpler model, Miroglio Fashion upgraded to the more capable but harder-to-understand forecasting model.
“And after doing this for some time, eventually, they felt ready to upgrade to the more capable model, which they did eventually do.”
0:07:11 · Julian De Freitas · Model upgrade
De Freitas cites Amazon's Alexa making a 'hm' sound as an example of a cue that makes technology seem like it has a mind and body.
“when Amazon's Alexa goes, Hm, you know, it it's as if it's really pausing and and thinking”
0:09:07 · Julian De Freitas · Anthropomorphism
De Freitas says experiments show people prefer human dating advice over AI dating advice, but this flips for financial advice.
“Much of the experiments will show that people prefer receiving dating advice from a human than from some kind of AI system, and that gets flipped when you think about something like financial advice.”
0:09:54 · Julian De Freitas · Advice preferences
De Freitas says OkCupid often promotes its AI algorithms as finding the perfect match, which plays to AI's perceived strengths.
“So a company like OkCupid, for instance, uh, often talks about how its AI algorithms are doing this to find the perfect match for you.”
0:10:45 · Julian De Freitas · Dating apps
Nest lets users choose between a learning algorithm and a manual mode for its thermostat.
“Nest, the the thermostat company, lets you use sort of a learning algorithm, or you can just switch to manual mode.”
0:13:30 · Curt Nickisch · User control
Kurt Nikisch says iRobot programmed its Roomba vacuum to move in predictable paths rather than possibly better unpredictable ones, to give users a sense of control.
“iRobot actually programmed it to move in predictable paths rather than unpredictable ones that might have been better, but just to to give more of a sense that it was under control”
0:13:30 · Curt Nickisch · Product design
De Freitas says lab experiments show that calling a system 'machine learning' rather than an 'algorithm' reduces people's belief that it is inflexible.
“a lot of the lab experiments will show that even if you label the system differently, calling it, for example, machine learning as opposed to algorithm, this changes people's belief that AI is very inflexible.”
0:15:32 · Julian De Freitas · Labeling effects
Netflix uses cues such as 'for you' and 'recommended because you saw X' to show its recommendation system is learning.
“In some companies like Netflix, you see them address this by including little cues such as, you know, for you, or, you know, recommended because you saw X”
0:15:32 · Julian De Freitas · Recommendations
Boroson Cat is a Turkey-based subsidiary of Caterpillar.
“Boroson Cat, which is a subsidiary of Caterpillar, the sort of large vehicle manufacturer. Boroson Cat is is in Turkey”
0:16:12 · Julian De Freitas · Company background
Boroson Cat embedded sensors in its machines to collect data on parts over time in order to predict failures.
“They very smartly embedded sensors in all of the machines so that they could collect data on, you know, various features of the parts as they were used over time.”
0:17:16 · Julian De Freitas · Predictive maintenance
De Freitas says Boroson Cat's system predicted machine failures with roughly 97% accuracy.
“I think they were able to predict with something like 97% accuracy whether the machine was about to have a failure.”
0:17:16 · Julian De Freitas · Prediction accuracy
Boroson Cat folded its failure-prediction capability into its maintenance contract rather than selling it as a standalone service.
“What the company eventually did was it just folded this ability into the maintenance contract.”
0:18:00 · Julian De Freitas · Bundling
By predicting failures early, Boroson Cat could salvage and refurbish parts and sell them, creating additional revenue.
“they were able to salvage many of the parts and refurbish them and sell them to create additional, uh, revenue streams.”
0:18:35 · Julian De Freitas · Revenue streams
De Freitas says people use AI if they believe it truly outperforms humans, but prefer humans when performance is equal.
“people will use AI systems if they believe that they truly outperform humans trying to do the same job. But when the performance is equated between the AI system and the human, people continue to prefer to interact with the human.”
0:19:43 · Julian De Freitas · Human preference
De Freitas suggests that methods social scientists use to ease intergroup relations, where repeated contact makes people see others in a more nuanced way, might also ease discomfort with robots.
“when you have these interactions with those that you view as other, you slowly change how you psychologically represent them from something that's much more categorical and stereotypical to something that's much more nuanced”
0:21:07 · Julian De Freitas · Intergroup contact
In a study of AI companion apps, De Freitas and colleagues found about 5% of users were using them to express serious mental health problems.
“But what we found was that about 5% of users were also using the system to express pretty serious mental health problems that they had”
0:25:14 · Julian De Freitas · AI companions
In an audit of AI companion apps, about 25% of responses to crisis-type messages were judged risky by a clinician.
“when we audited the performance of these apps by sending such messages to them and classifying how they responded, that about 25% of the responses weren't just unhelpful, but they were also deemed as risky by a clinician.”
0:25:14 · Julian De Freitas · AI safety
De Freitas argues that interventions that raise AI adoption in the short term can create long-term risks for consumers, firms, and society.
“the same interventions that could increase adoption of AI in the short term can create risks for consumers, firms, and society in the long term.”
0:23:41 · Julian De Freitas · AI ethics