RL07 · RL for Language Models and Real Systems
A free, illustrated L4 course of 8 modules in the Reinforcement Learning track. Modules include: RL from human feedback; Reward models and preference learning; Direct preference optimization.
RL07 L4 · Expert 8 modules · about 32 lessons Planned · Ring 4
Part of the Reinforcement Learning track. Ships in Ring 4 (Expert) of the roadmap.
Modules
- RL from human feedback
- Reward models and preference learning
- Direct preference optimization
- RL with verifiable rewards and group-relative methods
- RL for reasoning models
- Bandits and RL in recommender systems
- RL in operations, networks and robotics
- Evaluation, reward hacking and safety
Signature illustrations
The pictures a learner should still see in their head a year later:
The human-feedback pipeline, training flow on preference pairs, group-relative advantage, the gap between simulation and reality.
Status
This course is planned, not written yet. It ships with Ring 4 (Expert).
Every lesson will follow the same twelve-part blueprint with at least three purpose-made figures. Watch the repository to hear when modules ship, or help write and review it.