Reasoning in LLMs
Description
This workshop will tackle popular and important topic of reasoning in LLMs. It will show theoretical aspects as well as practical exercise of training an LLM for a math reasoning task by utilizing popular post-training methods like Supervised Fine Tuning and Reinforcement Learning.
How is reasoning in LLMs achieved and to they reason at all? What are the limitations of the current models? Scaling laws, impact of model size on reasoning and some intuitions behind it. How to perform scientific research and controlled experiments with LLMs? RL with LLMs is all the rage now - what is that about? What are the current research directions and what the future brings?
We will use free online resources to make an LLM better at math reasoning.
Speaker
