Person
Kareem Saleh
Kareem Saleh is the CEO of FairPlay, and this page collects what he said on the Fintech One-On-One podcast about AI, fair lending and compliance in financial services. He discussed how banks and lenders use AI, how to test it, and how rules and regulators are changing.
Saleh said generative AI systems are non-deterministic, so the same question can produce different answers. He said FairPlay finds that about 25 to 33 percent of the top-scoring applicants lenders decline would have performed as well as the riskiest applicants they approve. He also said using FairPlay may add a day to model development but saves 60 to 90 days in compliance and validation.
1 episodes · 18 quoted claims
Kareem Saleh says generative AI systems are non-deterministic, meaning the same question asked twice can produce different answers.
“generative AI systems are non-deterministic. And that is just a fancy way of saying if you ask them the same question twice, you may get two different answers.”
Fintech One-On-One · 0:04:32
Kareem Saleh argues that the definition of a fair idea changes over time, which complicates measuring fairness in generative AI.
“What was a fair idea 50 years ago may not be considered a fair idea today.”
Fintech One-On-One · 0:04:32
Kareem Saleh says FairPlay is seeing strong adoption of its agent testing tools in high-stakes workflows such as KYC, BSA, AML and collections.
“We're also seeing really strong adoption on the agent side, especially in high stakes workflows like KYC, BSA, AML, and collections.”
Fintech One-On-One · 0:06:47
Kareem Saleh says using FairPlay may add a day to model development but saves 60 to 90 days in compliance and validation.
“Yes, we might add a day to the development process, but we save 60 to 90 days in compliance and validation.”
Fintech One-On-One · 0:08:40
FairPlay's newest platform layer is agentic testing and monitoring, after its optimization tools and model validation layers.
“And then the third is agentic testing and monitoring. And this is the newest layer and increasingly critical”
Fintech One-On-One · 0:08:40
Kareem Saleh says AI systems used by financial institutions often depend on foundation models they do not control, which can change without warning.
“They often rely on underlying foundation models that the financial institutions themselves don't control and which can be changed without warning.”
Fintech One-On-One · 0:09:47
Kareem Saleh says FairPlay finds that about 25 to 33 percent of the highest-scoring applicants lenders decline would have performed as well as the riskiest applicants they approve.
“something like 25 to 33 % of the highest scoring folks that most lenders decline would have performed as well as the riskiest folks they approve.”
Fintech One-On-One · 0:10:57
Kareem Saleh says relying heavily on consistency of employment in credit models disadvantages women who leave the workforce to care for family.
“consistency of employment is going to have a disparity driving effect for women who take time out of the workforce to care for a loved one or raise a family.”
Fintech One-On-One · 0:11:42
Kareem Saleh says FairPlay's customers include several top 20 banks and two of the three major mobile network operators.
“That includes several top 20 banks. It includes two of the three major mobile network operators.”
Fintech One-On-One · 0:13:56
Kareem Saleh names Plaid, Chime, Upgrade, Octane, Figure, Borrow, Happy Money and Splash Financial among FairPlay's fintech partners.
“whether it's Plaid, Chime, Upgrade, Octane, Figure, Borrow, Happy Money, Splash Financial.”
Fintech One-On-One · 0:13:56
Kareem Saleh says compliance and risk teams at most banks and insurers are largely non-technical, mostly made up of lawyers.
“But if you look at most banks and insurance companies, their compliance and risk teams are largely non-technical.”
Fintech One-On-One · 0:16:50
Kareem Saleh says new bank charters granted by the OCC are bringing AI-native competitors that pressure legacy banks to adopt AI.
“with all of these new bank charters being granted by the OCC, Like competitors are coming fast and they're coming armed with AI native infrastructure.”
Fintech One-On-One · 0:18:22
Kareem Saleh says the current administration emphasizes fairness issues such as debanking, viewpoint discrimination and rural access.
“And you see this in the increased focus on issues like debanking and concerns about viewpoint discrimination and access for rural communities and rural Americans.”
Fintech One-On-One · 0:19:29
Kareem Saleh says New York, New Jersey, Colorado, Maryland and Massachusetts are advancing frameworks focused on disparate impact and rigorous AI testing.
“New York, New Jersey, Colorado, Maryland, Massachusetts, they're all advancing frameworks that focus on disparate impact and require more rigorous AI testing and validation.”
Fintech One-On-One · 0:20:12
Kareem Saleh compares AI to nuclear power, saying it creates large value when properly harnessed but carries significant risk without safeguards.
“I liken AI to nuclear power, right? When properly harnessed, it creates enormous value.”
Fintech One-On-One · 0:22:40
Kareem Saleh says non-discrimination laws remain in force and carry statutes of limitations of five, sometimes six years.
“many of these laws, especially around non-discrimination, are still on the books, and they have long statutes of limitations, five, sometimes six years.”
Fintech One-On-One · 0:00:08
Kareem Saleh says cash flow underwriting signals such as monthly spending on hair or clothes could introduce unintended disparities.
“Can certain signals like how much you spend on hair or how much you spend on clothes every month, introduce unintended disparities.”
Fintech One-On-One · 0:28:10
Kareem Saleh, who lives in Los Angeles, says climate risk is making insurance more expensive or unavailable and will eventually affect property values and credit risk.
“We have seen firsthand how disruptive climate risk can be. We're seeing insurance become more expensive or unavailable altogether.”
Fintech One-On-One · 0:28:48