In 2012 neural networks solved image recognition much better than any other method.
“in 2012, basically, you know, image recognition for the first time, you could solve with the neural net much better than anything else.”
Person
Greg Brockman
1 episodes · 19 quoted claims
By 2014 neural network approaches were producing great results in machine translation.
“And, you know, 2014, suddenly you're getting great results in machine translation.”
OpenAI's Dota 2 project began with 16 cores on a desktop and scaled to 32 cores, with Jakob and Shimon leading it from the machine learning side.
“We started out with 16 cores to train a little agent on Jakob and Shimon who are leading the project from an ML perspective on their desktop, and then they scaled to 32 cores”
At The International Dota tournament, OpenAI's bot went 3-0, 3-0 and then 2-1 against its first-day opponents.
“So we showed up at the international, this tournament blind. First day, we had three players that we played against. We went 3-0, 3-0, and then 2-1.”
A professional player beat the bot in one game by using a Dota item the bot had never trained against.
“it turned out that this pro that we're playing against, that he had used an item we'd never trained against.”
The OpenAI Dota bot had learned a baiting strategy that looked like a bug to its human tester.
“He'd realized that what had happened was it had learned a baiting strategy.”
OpenAI combined two Dota bots into one, which beat the world's number one player.
“So what if we just stitch the two bots we have together? And then that bot was just undefeatable. And we played against this number one player and won.”
In 2018 an OpenAI board member told Brockman that near-term AGI would imply massive economic value from AI already, which Brockman called a fair criticism then.
“In a world with the near-term AGI, you would expect massive economic value to be delivered by AI already.”
After GPT-3, someone at OpenAI proposed releasing an API and letting customers find the uses, rather than building a specific product.
“And so someone had the idea of saying, well, why don't we just make a API and let people figure it out?”
AI Dungeon, a text-based adventure game, was according to Brockman OpenAI's first paying API user.
“in fact, I believe they were our first paying user”
Brockman describes GPT-3 as an impressive demo machine whose outputs were too unreliable for real businesses until GPT-4 and better post-training.
“I think in many ways, GPT-3 was like the world's best demo machine.”
Sal Khan, founder of Khan Academy, reacted to a GPT-4 demo by saying it was the thing for personalized tutoring.
“And we showed him GPT-4. He's like, this is the thing.”
OpenAI's ChatGPT plugins, released about two years before the interview, were limited to three at a time because the models were not reliable enough.
“Then we limited it to like three plugins at a time.”
OpenAI describes five levels of AGI: chatbots, reasoners, agents, innovators and organizations, and Brockman says the field is somewhere in level three.
“starting from chatbots to reasoners to agents to innovators to organizations”
OpenAI is building large data centers in Abilene, Texas, together with Oracle.
“I recently posted some pictures of our visit to Abilene, Texas, where we're building these big data centers together with our partner, Oracle.”
Brockman describes reinforcement learning as a data production mechanism, in which the AI trains on data it generates itself.
“If you think about the RL paradigm, fundamentally that's a data production mechanism.”
Brockman says OpenAI's Codex coding tool is good at working in large code bases, and finds where functionality lives better than he can.
“So if you look at something like Codex, it's actually great at operating in a big code base.”
Brockman compares OpenAI's strategy to Disney's: build one core asset, here the base model, and turn it into many products.
“maybe an analogy is to a company like Disney where you make one core asset like Little Mermaid, right? And then you productize it in all these different ways, right?”
Brockman began taking classes at the University of North Dakota while still in high school.
“Well, so I did in high school start going to the University of North Dakota and took a bunch of classes there.”