Skip to main content
Workshop Duration: 2h 30min

Reasoning in LLMs

Marko Velić
Description

This workshop will tackle popular and important topic of reasoning in LLMs. It will show theoretical aspects as well as practical exercise of training an LLM for a math reasoning task by utilizing popular post-training methods like Supervised Fine Tuning and Reinforcement Learning.
How is reasoning in LLMs achieved and to they reason at all? What are the limitations of the current models? Scaling laws, impact of model size on reasoning and some intuitions behind it. How to perform scientific research and controlled experiments with LLMs? RL with LLMs is all the rage now - what is that about? What are the current research directions and what the future brings?
We will use free online resources to make an LLM better at math reasoning.

Speaker
Marko Velić

Marko Velić

Engineering Manager and Machine Learning Researcher @ Google
Marko is an Engineering Manager at Google. Previously he worked at Photomath, Meta (Facebook), Styria, LEGO (as consultant), University of Zagreb and has entrepreneurship experience.

To make this website run properly and to improve your experience, we use cookies. For more detailed information, please check our Cookie Policy.

  • Necessary cookies enable core functionality. The website cannot function properly without these cookies, and can only be disabled by changing your browser preferences.