Dr. Sheila Bond says she has practiced medicine for 22 years, caring for patients at Mass General or Brigham.
“I've been in medicine for 22 years now. So taking care of patients either at Mass General or Brigham for that time period.”
Person
Dr. Sheila Bond is the head of clinical AI at Wolters Kluwer Health, and this page collects what she said on Becker's Healthcare Podcast about how to build trust in clinical AI through governance and validation. She says she has practiced medicine for 22 years and worked in clinical decision support for about 14.
She told the podcast that trust starts with a governed system overseen by people who know how it is designed. She also said validation data and monitoring after release matter, and that generative AI must be tied to a trustworthy source. Each fact below gives her exact quote and a link to the moment.
1 episodes · 24 quoted claims
Dr. Sheila Bond says she has practiced medicine for 22 years, caring for patients at Mass General or Brigham.
“I've been in medicine for 22 years now. So taking care of patients either at Mass General or Brigham for that time period.”
Dr. Sheila Bond says she has worked in clinical decision support for about 14 years, at the intersection of content and technology.
“for the past 14 years or so, alongside of that, I've been in clinical decision support, usually at the intersection of content and technology.”
Dr. Sheila Bond describes her role as head of clinical AI at Wolters Kluwer Health as creating the vision for how information is delivered, through technology or written content.
“As the head of clinical AI, my role is really to help them create the vision of what's next for how we deliver information, whether that's through technology or through the words that we write on the page.”
Dr. Sheila Bond says the first tenet of trust in clinical AI at Wolters Kluwer is having a governed system overseen by people who know how it is designed.
“The fundamental tenets of trust for us are one, having a governed system.”
Dr. Sheila Bond says generative AI is good at assembling convincing text, so outputs must be tied to a trustworthy source.
“Genitive AI is very good at assembling words in the right order and having them sound great, but making sure that they are actually tied to a source that is trustworthy itself is important.”
Dr. Sheila Bond says validation data showing whether a system performs as expected is core to trust.
“And then the validation and the data that we produce is also, I think, really core to trust, right? Does the system perform as expected? How do we know? How do we measure that?”
Dr. Sheila Bond says many AI measurements come from the technical world, whereas in healthcare the end user is a clinician and the information acts on a patient.
“And a lot of the measurements that you see out there are really coming from the technical world. But for us in healthcare, the end user is in healthcare.”
Dr. Sheila Bond says Wolters Kluwer's clinical and clinical AI teams set the standard for what good looks like, within a cross-disciplinary governance model including product and technology teams.
“I think our clinical and our clinical AI team set the standard for what good is.”
Dr. Sheila Bond contrasts technology's fast release cycles with risk management, in which teams work until risk is eliminated or mitigated rather than to a deadline.
“technology is known for fast release cycles. But once you get into the elements of understanding and managing risk, it's a different framework, meaning you work until that risk is gone or otherwise mitigated or settled in some other way.”
Dr. Sheila Bond says post-deployment monitoring is an important part of validation and accountability, beyond testing before release.
“It's not only what you do before you design your system and how you measure it when it's at the gate, but that post-monitoring surveillance is very important.”
Dr. Sheila Bond says her team has expert reviewers examine samples of real-world AI output.
“we're always really sure that we've got expert eyes on the sampling of what is out there in the industry, just because of how precious it is.”
Dr. Sheila Bond says even perfectly written medical references can be misunderstood, which makes real-world measurement hard.
“you can write something to perfection in that state, but still someone might not understand it well enough.”
Dr. Sheila Bond says educating users in AI literacy is an industry responsibility and is becoming part of medical school education.
“to educate our users on what AI literacy is and how to use these tools, both individually. And then, you know, that's now part of medical school education as well, coming more and more AI literate.”
Dr. Sheila Bond says that in Europe, Asia and the United States, people are converging on a shared language about clinical AI.
“I've been all over the world talking about clinical AI and whether it's, you know, in Europe or Asia or the United States. I think everyone is starting to speak the same language”
Dr. Sheila Bond says questions from clinical and IT leaders have moved past novelty toward integration, scaling and getting it right.
“I think the questions are more pointed and precise now. I think we're sort of beyond the wow factor and we're beyond the usability factor and sort of the fun factor and the novelty factor of this.”
Dr. Sheila Bond says she recently visited Asia, including Singapore and China, where discussions focused on what to measure as clinical AI scales.
“as I said, I was just in Asia and Singapore and China, and we were all coming to the same point about what of all of this should be measured as we're starting to grow and to scale.”
Dr. Sheila Bond says evidence-based medicine has for decades provided a system for appraising medical literature, which she wants AI to build on.
“for years, we have, decades really, in the field of evidence-based medicine, made sure that we have a system for analyzing and appraising the medical literature”
Dr. Sheila Bond says a key goal is measuring whether an AI system makes an unsupported leap in a patient-care recommendation or stays disciplined.
“the ability to quantify and measure whether your system is taking a leap and making a recommendation for patient care or you being disciplined.”
Dr. Sheila Bond says the field is in a foundation-building stage and that getting the foundation right is mission critical.
“right now we're foundation building again. And making sure that we get this foundation right is just mission critical for us”
Dr. Sheila Bond says foundational clinical information will underpin electronic health records, ambient systems and other tools.
“it really will be the foundation for the healthcare information that we use in EHRs, in ambient systems, and for many, many, many things to grow.”
Dr. Sheila Bond argues generative AI's greatest power in healthcare is transforming information so people understand it better, not just summarizing or retrieving it.
“When you think about the power of gender to me, it's not really to summarize and retrieve things. It really is to transform things so that people can understand them better.”
Dr. Sheila Bond recalls that earlier in her career a single doctor might follow a patient across outpatient, inpatient and emergency settings.
“you used to take care of your patient in the outpatient setting, in the inpatient setting. Sometimes you would meet them in the emergency department and walk them up to their room.”
Dr. Sheila Bond argues that adding more information to old healthcare workflows would be harmful, because those workflows were designed for the past.
“the worst thing we could do for healthcare in many ways is to stuff more information into that old workflow, right? That workflow was designed for the past.”
Dr. Sheila Bond says medical information is locked in writing that takes years of training to understand, and AI could unlock it for others.
“when you think about medical information, it's sort of locked in writing. And that's a really elite form of communication that takes a lot of years, right? To understand”