2022
Chris Van Pelt says ChatGPT's release changed the AI landscape because of its interface and RLHF tuning, not because the underlying models were new.
“It's like the interface and the RLHF tuning to to make it like a real joy to to interact with.”
Chris Van Pelt · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:42:24
2023
Chris Van Pelt said about 70 percent of a recent Y Combinator class was working on generative AI, often treating models as just another API.
“a lot of entrepreneurs. Like 70 of the YC class is doing some gen AI thing, uh, they're coming and using these things, seeing it just as another API they can hit and use.”
Chris Van Pelt · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:42:24
2023
Chris Van Pelt said ChatGPT turned a designer's English description of a loading icon animation into CSS3 transforms.
“I could just ask ChatGpt and it perfectly translated that English into CSS3 transforms.”
Chris Van Pelt · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:50:05
Undated
Chris Van Pelt founded Figure Eight before co-founding Weights & Biases and had worked in machine learning for over 15 years.
“Before Weights and Biases, Chris founded Figure Eight, and Chris has been doing machine learning for over 15 years.”
Lavanya Shukla · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:00:01
Undated
Chris Van Pelt studied art and computer science in college and links his interest in tools to his art background.
“I studied art and computer science in in college, and like, as an artist, tools are like, fundamental, right?”
Chris Van Pelt · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:03:56
Undated
A T group is a session where about ten startup leaders gather over two days in a facilitated discussion.
“ten random startup leaders are gonna go on a little field trip, uh, Thursday and Friday this week.”
Chris Van Pelt · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:08:43
Undated
Chris Van Pelt says the Ruby programming language is what got him into programming.
“haven't done, I haven't done like Ruby in a long time. But I love, uh, Japan and Japanese culture, and Ruby's what got me into this.”
Chris Van Pelt · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:17:46
Undated
Chris Van Pelt says Semantic UI is no longer updated and the Weights & Biases team is replacing it with a new UI framework.
“Semantic UI isn't really being updated anymore. Now. It's like all over the code base, so the team's like creating a new UI framework.”
Chris Van Pelt · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:19:15
Undated
At his previous company, Chris Van Pelt's team worked with the US Department of Defense and held a meeting at the Pentagon.
“At our previous company, we, uh, were working with the Department of Defense, so we had a meeting in the Pentagon.”
Chris Van Pelt · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:29:32
Undated
Chris Van Pelt advises that if an LLM is used to evaluate another LLM's output, the evaluating model should be a different one.
“you can use an LLM to measure an LLM. But I would, I would think you'd wanna use a different LLM than the one like outputting stuff.”
Chris Van Pelt · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:46:49
Undated
Chris Van Pelt cites Llama.cpp and Whisper.cpp as projects enabling language models to run locally, including in a browser via WebGL.
“With projects like, uh, Llama.cpp and Whisper.cpp, um, you can also, you can, like, run it in the browser using, uh, WebGL.”
Chris Van Pelt · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:46:07
Undated
Chris Van Pelt suggests enterprises can obtain a private GPT instance through an enterprise contract with Microsoft.
“Or you just get that enterprise contract with with Microsoft to have, like, a private, um uh, instance of of GPT.”
Chris Van Pelt · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:48:09
Undated
Chris Van Pelt says an LLM given access to a database schema can generate and run SQL to answer business questions asked in English.
“if you've set things up right and and given the LLM access to the schema and where all the data is, it can generate and then run, you know, SQL and actually give you, give you charts or or information about things.”
Chris Van Pelt · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:50:44
Undated
Chris Van Pelt said GPT-2 seemed cool but toy-like to him, and he did not initially see its practical uses.
“I thought it was cool, but I also thought, like, all right, well, what can you do with this?”
Chris Van Pelt · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:51:25
Undated
Chris Van Pelt compares language as an interface to the transformer architecture, which he says made it possible to parallelize bigger compute.
“much like the transformer architecture became a really powerful way to parallelize, uh, bigger and bigger compute.”
Chris Van Pelt · Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt, 0:51:25