Argmax

15: InstructGPT

Vahe Hagopian, Taka Hasegawa, Farrukh Rahman Season 1 Episode 15

In this episode we discuss the paper "Training language models to follow instructions with human feedback" by Ouyang et al (2022). We discuss the RLHF paradigm and how important RL is to tuning GPT.