OpenNashPodcasts

Person

Malcolm deMayo

Malcolm deMayo is an NVIDIA executive who spoke on the Banking Transformed podcast with Jim Marous about how AI is reshaping financial services. The episode covered NVIDIA's computing technology, bank and fintech examples, staff training and the company's own use of AI.

Malcolm deMayo said NVIDIA speeds up some large banks' simulation workloads from 20 hours to four hours. He also said Klarna's generative AI cut average resolution time from 11 minutes to two minutes, and that S&P Global hired Accenture to help train 35,000 employees in AI.

1 episodes · 19 quoted claims

NVIDIA says it began working with financial services firms about 16 to 17 years before this episode and that its accelerated compute platform took about 30 years to build.

“We began working with financial services firms 16, 17 years ago. What we do at NVIDIA is we build an accelerated compute platform, and it's taken 30 years to build.”

Banking Transformed with Jim Marous · 0:02:40

Malcolm deMayo says NVIDIA accelerates some large banks' simulation workloads from 20 hours to four hours.

“In some of the largest banks, these workloads take 20 hours to run and we accelerate them down to four.”

Banking Transformed with Jim Marous · 0:03:15

Goldman Sachs has said that its developers accept about 40% of the code generated by generative AI.

“Goldman Sachs talks very much about how they're using generative AI for code generation. And that 40 % of the code being generated is being accepted by their developers.”

Banking Transformed with Jim Marous · 0:05:25

Klarna used OpenAI's technology to handle two-thirds of its customer calls in a single month.

“Klarna over in Sweden using OpenAI's technology, API, to be able to handle two-thirds of their calls in a single month using generative AI”

Banking Transformed with Jim Marous · 0:06:02

Malcolm deMayo says Klarna's generative AI reduced average resolution time from 11 minutes to two minutes.

“reducing the average time to earn resolution from 11 minutes to two minutes.”

Banking Transformed with Jim Marous · 0:06:02

Malcolm deMayo says S&P Global hired Accenture to help train 35,000 of its employees in AI.

“S&P Global announced they hired Accenture to help them train 35,000 of their employees.”

Banking Transformed with Jim Marous · 0:13:48

Malcolm deMayo says over 1,700 companies build AI solutions on NVIDIA's platform, which is sold through partners rather than directly.

“So over 1700 companies are building AI solutions using our platform. So we, we, we actually don't sell our platform directly.”

Banking Transformed with Jim Marous · 0:16:49

Malcolm deMayo says NVIDIA built an AI factory, a shared AI hub, with Bank of New York and other institutions.

“an AI factory is something that we've built with Bank of New York and a number of other institutions where they have created an AI hub.”

Banking Transformed with Jim Marous · 0:23:32

NVIDIA worked with Capital One on modernizing models that decide which messages to show customers on its homepage, discussed in a GTC talk the prior year.

“We worked with, and we did a GTC talk last year, Capital One.”

Banking Transformed with Jim Marous · 0:28:18

Malcolm deMayo says the Titan supercomputer, built in 2012, used about 17,000 GPUs, drew close to 10 megawatts and delivered 20 petaflops.

“In 2012, we built Titan, a supercomputer that took up a tennis court, 17 ,000 GPUs, consumed close to 10 megawatts of power and generated 20 petaflops”

Banking Transformed with Jim Marous · 0:32:09

Malcolm deMayo says NVIDIA's Blackwell delivers 20 petaflops of AI performance while consuming about three quarters of a kilowatt.

“Blackwell fits in the palm of your hand, consumes three quarters of a kilowatt of energy”

Banking Transformed with Jim Marous · 0:32:41

NVIDIA built ChipNeMo, an AI that works with its chip designers to speed up design experimentation.

“Chip Nemo is a chip design AI that works collaboratively with our chip designers.”

Banking Transformed with Jim Marous · 0:33:13

NVIDIA's NIM packages open-source models such as Llama and Mistral into containers with its inference engines, which deMayo says gives up to a 5x inference boost.

“takes open source models like Llama or Mistral or Cohere or any of them. We NIM them.”

Banking Transformed with Jim Marous · 0:35:26

Malcolm deMayo says NVIDIA expected to spend about $8.5 billion on research and development in the year of the episode.

“we're going to spend probably $8.5 billion this year in R &D.”

Banking Transformed with Jim Marous · 0:36:49

Malcolm deMayo says NVIDIA's revenue grew from $29 billion to $60 billion while headcount rose less than 5%.

“In 2022, our revenues were $29 billion. The next year it was $60 billion. We added less than 5 % headcount.”

Banking Transformed with Jim Marous · 0:39:51

Malcolm deMayo says a chief operating officer told NVIDIA that employees pulling and reading contracts cost their company 4 billion euros annually.

“he told us it's 4 billion euro expense annually.”

Banking Transformed with Jim Marous · 0:39:21

Malcolm deMayo says one leading generative AI use case in banking is understanding and documenting legacy COBOL code bases.

“Probably one of the most exciting use cases right now in financial services is understanding the COBOL code base that exists in a lot of these large organizations”

Banking Transformed with Jim Marous · 0:19:59