Questions
How is fairness in generative AI different from fairness in credit models?
Saleh says credit models output numbers that can be checked against whether people repaid, while generative AI outputs ideas with no clear right answer. So you must de-bias reasoning and language, and people disagree on what a fair idea is.
What does it mean that generative AI is non-deterministic?
Saleh explains it means you may get two different answers if you ask the same question twice. So testing has to look at the range of possible outputs rather than a single result.
Does FairPlay still matter if the federal government cares less about fair lending?
Saleh says yes. Fairness concerns shift rather than vanish, such as debanking and rural access, and states like New York and Colorado are pushing disparate impact rules. He also says old laws have long limitation periods.
What is an AI agent, and why does it need special testing in banking?
Saleh describes agents as systems that act autonomously, reason and interact with users, rather than just scoring risk. In work like KYC (know your customer) and AML (anti-money-laundering) checks, they must be consistent, explainable and aligned with regulators.
Why do traditional banks struggle to trust AI tools?
Saleh says banks lacked good tools to evaluate AI rigorously, and their compliance teams are mostly lawyers rather than technical staff. FairPlay built interfaces that non-technical risk, compliance and legal teams can use.
Facts
Stated by the speakers. Each quote matches the transcript, which shows what was said, not that it is true.
FairPlay was founded with the mission of helping financial institutions build fairer and more accurate machine learning-based credit models.
“When Kareem founded Fairplay, the mission was straightforward, helped financial institutions build fairer, more accurate machine learning-based credit models.”
0:00:52 · Peter Renton · FairPlay mission
Kareem Saleh says generative AI systems are non-deterministic, meaning the same question asked twice can produce different answers.
“generative AI systems are non-deterministic. And that is just a fancy way of saying if you ask them the same question twice, you may get two different answers.”
0:04:32 · Kareem Saleh · Generative AI
Kareem Saleh argues that the definition of a fair idea changes over time, which complicates measuring fairness in generative AI.
“What was a fair idea 50 years ago may not be considered a fair idea today.”
0:04:32 · Kareem Saleh · AI fairness
Kareem Saleh says FairPlay is seeing strong adoption of its agent testing tools in high-stakes workflows such as KYC, BSA, AML and collections.
“We're also seeing really strong adoption on the agent side, especially in high stakes workflows like KYC, BSA, AML, and collections.”
0:06:47 · Kareem Saleh · Agentic AI
Kareem Saleh says using FairPlay may add a day to model development but saves 60 to 90 days in compliance and validation.
“Yes, we might add a day to the development process, but we save 60 to 90 days in compliance and validation.”
0:08:40 · Kareem Saleh · Compliance savings
FairPlay's newest platform layer is agentic testing and monitoring, after its optimization tools and model validation layers.
“And then the third is agentic testing and monitoring. And this is the newest layer and increasingly critical”
0:08:40 · Kareem Saleh · FairPlay platform
Kareem Saleh says AI systems used by financial institutions often depend on foundation models they do not control, which can change without warning.
“They often rely on underlying foundation models that the financial institutions themselves don't control and which can be changed without warning.”
0:09:47 · Kareem Saleh · AI drift
Kareem Saleh says FairPlay finds that about 25 to 33 percent of the highest-scoring applicants lenders decline would have performed as well as the riskiest applicants they approve.
“something like 25 to 33 % of the highest scoring folks that most lenders decline would have performed as well as the riskiest folks they approve.”
0:10:57 · Kareem Saleh · Lending analysis
Kareem Saleh says relying heavily on consistency of employment in credit models disadvantages women who leave the workforce to care for family.
“consistency of employment is going to have a disparity driving effect for women who take time out of the workforce to care for a loved one or raise a family.”
0:11:42 · Kareem Saleh · Credit bias
Kareem Saleh says FairPlay's customers include several top 20 banks and two of the three major mobile network operators.
“That includes several top 20 banks. It includes two of the three major mobile network operators.”
0:13:56 · Kareem Saleh · FairPlay customers
Kareem Saleh names Plaid, Chime, Upgrade, Octane, Figure, Borrow, Happy Money and Splash Financial among FairPlay's fintech partners.
“whether it's Plaid, Chime, Upgrade, Octane, Figure, Borrow, Happy Money, Splash Financial.”
0:13:56 · Kareem Saleh · FairPlay customers
Kareem Saleh says compliance and risk teams at most banks and insurers are largely non-technical, mostly made up of lawyers.
“But if you look at most banks and insurance companies, their compliance and risk teams are largely non-technical.”
0:16:50 · Kareem Saleh · Bank compliance
Kareem Saleh says new bank charters granted by the OCC are bringing AI-native competitors that pressure legacy banks to adopt AI.
“with all of these new bank charters being granted by the OCC, Like competitors are coming fast and they're coming armed with AI native infrastructure.”
0:18:22 · Kareem Saleh · Bank charters
Kareem Saleh says the current administration emphasizes fairness issues such as debanking, viewpoint discrimination and rural access.
“And you see this in the increased focus on issues like debanking and concerns about viewpoint discrimination and access for rural communities and rural Americans.”
0:19:29 · Kareem Saleh · Fairness policy · 2026
Kareem Saleh says New York, New Jersey, Colorado, Maryland and Massachusetts are advancing frameworks focused on disparate impact and rigorous AI testing.
“New York, New Jersey, Colorado, Maryland, Massachusetts, they're all advancing frameworks that focus on disparate impact and require more rigorous AI testing and validation.”
0:20:12 · Kareem Saleh · State AI regulation · 2026
Peter Renton notes that Kareem Saleh has testified before Congress about AI and algorithmic bias.
“You actually testified before Congress about AI and algorithmic bias.”
0:21:24 · Peter Renton · Congressional testimony
Kareem Saleh compares AI to nuclear power, saying it creates large value when properly harnessed but carries significant risk without safeguards.
“I liken AI to nuclear power, right? When properly harnessed, it creates enormous value.”
0:22:40 · Kareem Saleh · AI policy
Peter Renton says FairPlay launched its Agentic Assurance platform last year in partnership with Avar AI.
“I saw that you launched last year, the Agentic Assurance platform partnering with Avar AI, which I know well from our AI native conference days,”
0:23:54 · Peter Renton · Agentic Assurance · 2025
Kareem Saleh says non-discrimination laws remain in force and carry statutes of limitations of five, sometimes six years.
“many of these laws, especially around non-discrimination, are still on the books, and they have long statutes of limitations, five, sometimes six years.”
0:00:08 · Kareem Saleh · Regulatory look-back
Kareem Saleh says cash flow underwriting signals such as monthly spending on hair or clothes could introduce unintended disparities.
“Can certain signals like how much you spend on hair or how much you spend on clothes every month, introduce unintended disparities.”
0:28:10 · Kareem Saleh · Cash flow underwriting
Kareem Saleh, who lives in Los Angeles, says climate risk is making insurance more expensive or unavailable and will eventually affect property values and credit risk.
“We have seen firsthand how disruptive climate risk can be. We're seeing insurance become more expensive or unavailable altogether.”
0:28:48 · Kareem Saleh · Climate risk
Peter Renton says OCC head Jonathan Gould spoke at the AI Native Banking and Fintech Conference in Salt Lake City in September.
“And this is what the head of the OCC, Jonathan Gould, said at the AI Native Banking and Fintech Conference in Salt Lake City last September.”
0:31:25 · Peter Renton · OCC remarks · 2025