Listen now | Had so much fun chatting with my good friends Trenton Bricken and Sholto Douglas on the podcast. No way to summarize it, except: This is the best context dump out there on how LLMs are trained, what capabilities they're likely to soon have, and what exactly is going on inside them.
“There's some work where they'll simulate little basic agents and see if the representations they learn map to the tools they can use and the inputs they should have. ”
Some typos from the first 2 hours: "So there's a direct path and an indirect path. and, and so the model can pick up whatever information it wants and then add that back in."
"But we have a lot more work to do on that. surprise to the Twitter guy,"
"And there's a verifier there too, right? There's the real world. You might generate a theory about the gods causing the storms, And then someone else finds cases where that isn't true."
I enjoyed it, nice looser conversation. I didn't understand everything, but hey, you learn by stretching into new territory, so I appreciate the advanced discussion! 💚 🥃
Any idea which paper this is?
“There's some work where they'll simulate little basic agents and see if the representations they learn map to the tools they can use and the inputs they should have. ”
Some typos from the first 2 hours: "So there's a direct path and an indirect path. and, and so the model can pick up whatever information it wants and then add that back in."
"But we have a lot more work to do on that. surprise to the Twitter guy,"
"And there's a verifier there too, right? There's the real world. You might generate a theory about the gods causing the storms, And then someone else finds cases where that isn't true."
I enjoyed it, nice looser conversation. I didn't understand everything, but hey, you learn by stretching into new territory, so I appreciate the advanced discussion! 💚 🥃
Hiring discussion was spot on.
Reminds me that my blog post learning RLHF in one week may still be the top Google result 🤣