#rlhf
-
Stanford CS229 I Machine Learning I Building Large Language Models (LLMs)
Yann Dubois (Stanford PhD student, co-author of Alpaca and AlpacaFarm) gives a 1h44m guest lecture in CS229 (Summer 2024, 2.8M views) on building a ChatGPT-style model. He splits the work into five parts (architecture, loss, data, evaluation, systems) and skips architecture on purpose: academia works on it, but "what matters in practice is mostly the three other topics".