2018
CaseText began working with large language models around the time of the BERT paper, in 2017 or 2018, to improve search.
“we started working with, you know, large language models, basically since the BERT paper in was that 2017, 2018,”
Topic
CaseText
18 facts from 1 episode, in date order. These are what speakers said on the shows, each linked to the moment it was said. They aren't independently verified.
2022
Heller says the surge of attention around ChatGPT beginning in November 2022 helped drive CaseText's growth by making law firm leaders eager to learn about AI.
“to the extent there was like a hype moment around ChatGPT starting in November 2022, that really like played into, I'd say, our our growth.”
2023
CaseText received early access to GPT-4 from OpenAI before its public release.
“we got really early access to GPT four”
2023
Heller says CaseText had roughly 10,000 customers when it entered 2023.
“We were growing fine as a company, you know, we had a good product, maybe even 10,000 customers at that point.”
2023
Heller says CaseText ran an unpublished bar exam on GPT-4, and it did better than at least 70 to 90 percent of human test takers.
“So we knew it wasn't part of the training data and it like, did better than at least like 70 to 90 of of human test takers”
2023
Jake Heller personally built the first demo of CoCounsel and showed it to all of CaseText's employees.
“Like I personally built the 1st demo of CoCounsel, and we demoed it in front of the whole company.”
Undated
CaseText operated for about ten years before it was acquired.
“we were in business for ten years before our acquisition.”
Undated
Thomson Reuters acquired CaseText for $650 million in cash, a deal that Heller says closed less than a year before the interview.
“an acquisition by Thomson Reuters for 650 million in cash, which took place, you know, a little less than a year ago.”
Undated
CaseText's original vision was to crowdsource legal information from attorneys and build a search interface on top of it.
“The original vision was really around crowdsourcing and enabling, uh, attorneys to help build a really good source of information and build a great kind of search UI on top of that.”
Undated
CaseText's crowdsourcing plan failed because attorneys did not want to contribute their time and information.
“long story short, attorneys didn't wanna contribute their time and information.”
Undated
Before GPT-4, CaseText's research product covered over a billion pages of legal material, including cases, rules, regulations and statutes, updated daily.
“over a billion pages of legal information updating daily. Uh, cases, rules, regulations and statutes.”
Undated
Heller says semantic search suited legal research because judges describe the same ideas in varied language, so keyword search used by competitors missed important opinions.
“keyword based searching, which is what most of our competitors offered at the time, would miss really critical, uh uh, legal, you know, legal opinions and precedents.”
Undated
Heller says CaseText grew about 50 to 70 percent a year in the years before the GPT-4 launch.
“we've been growing at call like 50 to 70 year over year for the years before then.”
Undated
CaseText shut down all of its offices during the Covid pandemic.
“we shut down all of our offices during Covid.”
Undated
Heller says CaseText had the model output a relevance score before its reasoning, which they found improved performance.
“you can have it output the number 1st and then provide its reasoning.”
Undated
Heller says CaseText could cut the model's output off after the first token, a score, so the result could be tested objectively.
“But you cut it off after the 1st token produced, so that's very objectively testable.”
Undated
Heller says about 20 customer support and success staff, mostly former attorneys, regularly graded CoCounsel's test results by hand.
“a lot of our customer support and success people, maybe 20 or so professionals, constantly checking these tests”
Undated
CaseText used a copy of GPT-4 that had not been fine-tuned for most of its tasks.
“we've been using a, uh, not fine tuned copy of, uh, GPT four for the vast majority of the tasks that we do.”
Episodes