Ten to fifteen years ago
Dhrubojyoti Das Deb says systems ten to fifteen years ago produced far less logging, traceability, observability and telemetry than today's systems.
“if you go back ten or fifteen years, we had systems running with very less logging, very less traceability, very less observability, very less telemetry.”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:02:29
Undated
Das Deb says applications generate data in silos that is not passed to the next application, so problems cascade down the chain.
“when they generate the data that is in silo, that data is not getting fed to the next application, and that happens, and that can get cascaded down.”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:03:32
Undated
Das Deb says connected applications often run on different technology stacks, such as Java, Python and C, as well as AWS and AI components.
“One is running on Java, one is running on Python, one is running on C, and then we have A W S coming in, then we have A I coming in.”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:05:21
Undated
Das Deb says continuous integration and deployment (CI/CD) makes applications change quickly, so their state a week apart may differ.
“with C I C D coming into picture, like continuous integration and deployment, applications are changing very fast.”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:05:21
Undated
Das Deb says knowledge held by subject matter experts is often lost when they leave, especially for legacy applications.
“this is particularly true for legacy applications. That knowledge may or may not be there because when people leave”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:06:33
Undated
Das Deb says his teams try to limit analysts to between one and three tools during an incident.
“We normally try to keep it to a bare minimum of one and three.”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:07:30
Undated
Das Deb says he has worked in the financial business for more than twenty years.
“I'm in the financial business, you know, for the last two decades, like twenty plus years.”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:09:13
Undated
Das Deb argues that a company investing in cloud, modernization and AI will grow faster than one that does not invest in new technology.
“company A, which is in investing in technology, they're investing in cloud, they're investing in modernization, they're investing in A I”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:08:38
Undated
Das Deb estimates that 99% of operational data is noise, such as debug and informational messages rather than actual errors.
“99% of the data is noise, which are kind of debug messages, which are inform messages, but those are not the actual errors.”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:11:01
Undated
Das Deb says AI alert grouping should be given historical data on prior incidents, as well as deployment information, to work well.
“feed them into A I, and you give A I the proper tools, like, you know, historical data of the prior incidents that were there”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:12:12
Undated
Das Deb gives an example in which AI reviews 5,000 messages and groups them into two incidents.
“it can go through those five, 5,000 messages and tell it like, oh, okay, um, all of them are kind of variation of two incidents.”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:12:12
Undated
Das Deb says a root cause analysis (RCA) draws on logs, traceability, metrics, deployment history and code, and that AI can help assemble this information.
“when we do an R C A, what we do is we look at the logs, we look at the traceability, we look at the different me metrics from different places”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:13:14
Undated
Das Deb says AI-driven automation and self-healing are a future step and cannot be trusted to do everything from the first day.
“You cannot trust A I to solve everything for you right on the first day. And so you will have to take baby steps one at a time.”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:14:00
Undated
Das Deb says AI should act as an assistant or co-pilot while a human remains accountable for the decisions.
“A I, we can think of it as a assistant or a co-pilot, and the main person driving the plane at that point of time will still have to be the human.”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:15:37
Undated
Das Deb recommends listing operational frictions and prioritizing them by risk or ease before automating the easy ones first.
“you start prioritizing them by risks or you may prioritize by which one are easy to pick up and then automate those pieces”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:17:46
Undated
Das Deb estimates that fully automating a complex application end to end will probably take years.
“it will probably take years for a complex application to get automated end to end and take decisions amongst itself.”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:18:17
Undated
Das Deb says the product or business side, not just the development team, should first own the risk of automation because it sells to customers.
“the first risk that has to be owned is not from the development team, but it's more of, you know, the product or the business”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:18:45
Undated
Das Deb says repeated incidents are a sign of failure that leaders should look for when finding where operations hurt.
“whether the same incident is getting repeated over and over again, because that's also indicative of a failure.”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:20:16
Undated
Das Deb says AI works best on structured data, including timestamps and the names of the application and sub-module that produced it.
“A I works effectively and best when the data is structured.”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:21:35
Undated
Das Deb says AI governance is distinct from data governance and starts where data governance ends, assuming it is already in place.
“A I governance is entirely different from data governance where data governance stop A I governance starts from there”
Dhrubojyoti Das Deb · Reducing Alert Noise with AI in Enterprise IT - with Dhrubojyoti Das Deb of JPMorganChase, 0:22:22