Topic
7 facts from 3 episodes, in date order. These are what speakers said on the shows, each linked to the moment it was said. They aren't independently verified.
Undated
In early testing, Harvey's founders had GPT-3.5 and GPT-4 answer questions taken from Reddit's r/legaladvice community.
“we went on r slash legal advice, which is like a Reddit subcommunity where people ask legal questions. And we just downloaded a bunch of those and had 3.5 and four answer these questions.”
Undated
Ben Moore says Discovered Labs research found ChatGPT's retrieval engine allocated almost a third of its retrieval slots to Reddit.
“it had allocated like an inse, I think, almost a 3rd of its basically retrieval slots for Reddit.”
Undated
Ben Moore says most retrieved Reddit threads were rejected at citation time but still helped ground the model's answer.
“Most of those were actually rejected at citation time, so they basically are kind of used to ground the model.”
Undated
Ben Moore says Discovered Labs found traces of Reddit content in model weights, particularly for ChatGPT and also Gemini.
“there is traces of basically Reddit showing up in the weights, particularly from ChatGpt.”
Undated
Liam Dunne says Reddit offers an edge because many B2B companies do not know how to use it well.
“One of the advantages of Reddit is, um, a lot of B2B companies don't really know how to do it well. And so just like because of that, you, you can gain an edge.”
Undated
Liam Dunne says Discovered Labs saw no correlation between Reddit upvotes and citations, and the strongest correlation was with the content matching the query.
“we haven't seen that correlate with, um, increased citations. What we have seen highest correlation with is the actual um content itself, right?”
Undated
Stefan Zima said he believed, from statistics he had seen, that a large share of AI training data comes from Reddit.
“I think a majority of AI training data comes sometimes from Reddit.”
Episodes