Sathish Muthukrishnan says Ally was started right after the 2008 financial crisis and is the largest direct-to-consumer digital bank in the US.
“Ally was started right after the worst financial crisis the country has ever seen in 2008. We are the largest direct-to-consumer digital bank in the US.”
Banking Transformed with Jim Marous · 0:02:01
Sathish Muthukrishnan says that about five years before the interview Ally still ran on mainframes, used hardware-based networking and had six different apps.
“it would be hard to believe that five years ago, we were still running on mainframes. We still had network that was plug and play, hardware enabled. We had six different apps.”
Banking Transformed with Jim Marous · 0:03:13
Sathish Muthukrishnan says about 75 percent of Ally's applications run in the cloud.
“Having all our applications on cloud, now we have about 75 % of our applications running on cloud.”
Banking Transformed with Jim Marous · 0:08:37
Sathish Muthukrishnan says about 95 percent of Ally's enterprise data is in a single cloud-enabled data warehouse.
“Having all our data in a single data warehouse that is cloud enabled, I have about 95 % of the enterprise data in the cloud.”
Banking Transformed with Jim Marous · 0:09:09
During the peak of COVID, Ally offered auto loan customers a six-month payment deferral.
“So anybody that had an auto loan, we offered them to defer their payments for six months.”
Banking Transformed with Jim Marous · 0:10:52
Sathish Muthukrishnan says customers who accepted Ally's COVID auto loan deferral kept making their payments anyway.
“the consumers that took the deferral never deferred their payments.”
Banking Transformed with Jim Marous · 0:11:34
Sathish Muthukrishnan says Ally originates about $45 billion in auto loans a year and works with about 21,000 US car dealerships.
“We do about $45 billion a year, have about 21 ,000 U.S. car dealerships that we have a relationship with.”
Banking Transformed with Jim Marous · 0:14:48
Sathish Muthukrishnan says 90 percent of Ally's Invest customers come from its bank deposit customers.
“And 90 % of our invest customers come from our bank deposit customers.”
Banking Transformed with Jim Marous · 0:15:55
Ally's one-click Invest account opening required three pages because of FINRA regulations, according to Sathish Muthukrishnan.
“We said one click, but for FINRA regulations, we had to go through three pages.”
Banking Transformed with Jim Marous · 0:15:55
Sathish Muthukrishnan says Ally created its own technology operating model, nicknamed Adam, that embeds compliance staff in requirement writing.
“we created our own technology operating model. We called it Allies Technology Operating Model.”
Banking Transformed with Jim Marous · 0:17:34
Ally has an internal technology lab that tests new technology with a business outcome and a stakeholder from outside technology.
“we also have what we call an allied technology lab.”
Banking Transformed with Jim Marous · 0:22:52
Sathish Muthukrishnan says an Ally board member asked him about ChatGPT on the morning of a board presentation, before he had heard of it.
“One of the board members literally that morning is like, did you hear about chat GPT?”
Banking Transformed with Jim Marous · 0:22:23
Sathish Muthukrishnan says Ally's leadership team spent three days in Seattle meeting Amazon and Microsoft after Microsoft's investment in OpenAI.
“we need to go sit in Seattle. So my entire leadership team and I, in November 2020, not the ideal time to visit Seattle when it's really cold.”
Banking Transformed with Jim Marous · 0:23:55
Ally AI removes personally identifiable information, logs transactions and restores the information afterwards when connecting to an external large language model.
“It would remove PII. It would keep track of all of the transactions going in and out. The ability to rehydrate PII so it'll have the context for Ally consumers that are using it.”
Banking Transformed with Jim Marous · 0:25:07
Sathish Muthukrishnan says Ally built its Ally AI platform in two months.
“Very simple. We built it in two months.”
Banking Transformed with Jim Marous · 0:25:07
By early 2023 Ally had a use case running on Ally AI using GPT-3.5 on its own private VPN on Microsoft Azure.
“by beginning of 2023, we had a use case that was working on Ally AI using 3.5 GPT running on our own private VPN on Azure.”
Banking Transformed with Jim Marous · 0:25:41
Sathish Muthukrishnan says Ally uses different large language models for content creation, code generation and risk assessment.
“Our content creation LLM is different from what I use for code generation. and that is different for what I use for risk assessment.”
Banking Transformed with Jim Marous · 0:27:26
Sathish Muthukrishnan says a company with fewer than 20 people can quickly reach $100 million in annual recurring revenue.
“a company with less than 20 people can quickly build something and can very quickly have a $100 million ARR”
Banking Transformed with Jim Marous · 0:29:19
Sathish Muthukrishnan says Ally customers with savings buckets save twice as much as they normally do.
“people save twice as much as they normally do when they have a savings bucket”
Banking Transformed with Jim Marous · 0:33:17
Ally uses generative AI to create five-to-six-line summaries of its financial education articles on its Conversationally platform, which increased engagement.
“we simply took that entire article and we created a five to six line bullet of this is what the article is talking about. And it was done by generative AI.”
Banking Transformed with Jim Marous · 0:36:04
Ally has a product called Plans that shows customers how to pay down debt across multiple accounts.
“We have rolled out a product that is called Plans that essentially tells you how you can pay down your debt across your multiple accounts”
Banking Transformed with Jim Marous · 0:35:24
Sathish Muthukrishnan paraphrased a blog by the founder of Anthropic as saying a world of geniuses in a data center can be accessed through an API.
“you now have access to a world of geniuses in a data center that you can enable through an API.”
Banking Transformed with Jim Marous · 0:38:22
Sathish Muthukrishnan began his career at Singapore Airlines in Singapore before moving to the United States to work for United Airlines.
“I grew up in India and started my first job with Singapore Airlines in Singapore and got to a point where I got offered a job to move to U.S. with United Airlines.”
Banking Transformed with Jim Marous · 0:02:04
Sathish Muthukrishnan worked at American Express before becoming Honeywell's first chief digital officer.
“Then had the opportunity to move into a completely different vertical industrial working for Honeywell as their first chief digital officer.”
Banking Transformed with Jim Marous · 0:02:36
Sathish Muthukrishnan describes Ally as a digital-native organization, the largest direct-to-consumer digital bank in the U.S. and the largest auto loan originator in the U.S.
“a fully native, digital native organization, the largest direct-to-consumer digital bank in the U.S., and also the largest loan originator for autos here in the U.S.”
Banking Transformed with Jim Marous · 0:03:11
Sathish Muthukrishnan says Ally was the first bank to offer rewriting or deferring loans entirely digitally during COVID.
“We were the first bank to introduce rewriting or deferring the loans 100 % digitally.”
Banking Transformed with Jim Marous · 0:04:49
Ally runs its own private instance of OpenAI models on Microsoft Azure that no one else can access.
“We have our own private instance of OpenAI on Azure, which itself is terrific because we know that nobody else has access to that instance.”
Banking Transformed with Jim Marous · 0:20:28
Ally.ai removes personally identifiable information from requests before they leave Ally's firewalls.
“Ally.ai allows us to strip out anything personally identifiable to our consumers or attributable to our consumers before we even send that request outside the Ally firewalls.”
Banking Transformed with Jim Marous · 0:23:49
Ally's team built a module that removes and restores personally identifiable information and contributed it to the open-source LangChain project.
“we have built a module that will strip out the PII and rehydrate the PII using LangChain that my team has contributed to the source code of LangChain”
Banking Transformed with Jim Marous · 0:24:31
Sathish Muthukrishnan says Ally customer care associates reported that automated call summaries were more than 85 percent accurate.
“It's more than 85 % accurate. It's saving me precious minutes or seconds.”
Banking Transformed with Jim Marous · 0:31:52
Sathish Muthukrishnan says Ally had over 205 generative AI use cases in progress at the time of recording, mostly proposed by customer care associates.
“We have over 205 use cases, and this is from this morning, heart of the press, use cases that my team is working on across different businesses”
Banking Transformed with Jim Marous · 0:31:52
Sathish Muthukrishnan believes Ally was among the first corporate customers, possibly the first, to use a private instance of Microsoft's OpenAI service.
“I believe we were one of the first, if not the first corporate customer to use the private instance of Microsoft OpenAI.”
Banking Transformed with Jim Marous · 0:29:25
Sathish Muthukrishnan describes LangChain as the largest open-source framework for maintaining context in generative AI conversations, which he says almost all companies use.
“Generative AI is not able to do that effectively. And the largest open source that allows you to do it is called LangChain, which almost all companies use it.”
Banking Transformed with Jim Marous · 0:24:31
Ally recently launched 'One Ally,' which brings all its products into a single digital experience.
“we recently launched what we call One Ally, where we are bringing all of the experiences across all of the products into a single digital experience.”
Banking Transformed with Jim Marous · 0:50:07
Sathish Muthukrishnan says Ally calls its effort to help communities understand generative AI 'AI equity,' tied to the company's 'do it right' mantra.
“And we call this AI equity. How can we stick to our mantra, which is do it right?”
Banking Transformed with Jim Marous · 0:46:06