Person
2 episodes · 10 quoted claims
Anthony Scriffignano says regression testing, which proves previously working functions still work after a change, was a core software tenet about ten years ago.
“One of the tenets of, let's say, ten years ago, uh, the little thing called regression testing.”
Anthony Scriffignano proposes using AI agents inside the enterprise environment to watch for risks such as personal data leaving the organization.
“Nope, I'm gonna have controls in that environment, including AI agents, by the way, that watch what's going on”
Anthony Scriffignano says organizations can count AI tokens to see how much data is going in and out and identify heavy users.
“The good news is we can count tokens, we can look at things to see who the sort of mega users are.”
Anthony Scriffignano gives the example that counting rows in a CRM list overcounts customers because a customer can have more than one row.
“they're gonna grossly overcount because there's more than 1 row per customer, right?”
Anthony Scriffignano says major model providers announce when a model is changing but not what has changed, which is a cue to rerun tests.
“the major models at least do tell you when they're changing. They don't tell you what they're changing, but they tell you that you're they're changing.”
Anthony Scriffignano uses 'misadventure' for cases where an AI system speaks for an organization in unintended ways, which is a dimension to test alongside misuse.
“Another one is misadventure. You can't say hallucination anymore because everybody just gets triggered.”
Anthony Scriffignano says a recent major global outage was caused by releasing an empty file, which he uses to show how simple unforeseen failures can be.
“One of the most recent major oopses that hit a big part of the world happened by releasing an empty file”
Anthony Scriffignano says AI increasingly consumes content produced by other AI, which multiplies errors and makes mistakes more chaotic as well as faster.
“a lot of the content that AI is consuming was produced by other AI. So there's a multiplicative effect of this problem.”
Anthony Scriffignano says regulation generally requires human oversight more strictly as the use of an AI system becomes more critical.
“the more critical the use, the more mandatory it is that you have a human in the loop.”
Anthony Scriffignano notes that automatic code generators existed as early as 1980.
“there were automatic code generators in 1980. There's nothing new about that.”