RLVR vs. the Agent Loop: Training-Time vs. Inference-Time
Distinguishes RLVR as training-time weight updates from inference-time agent verification loops.
Rl
Where RL Fits: Training vs. Inference in the LLM Pipeline
Explains that RL in LLMs is a training/alignment stage, not inference, with pipeline context.
Reinforcement Learning (ELI-Teen Explainer)
Teen-friendly explainer of reinforcement learning agents, rewards, exploration, delayed rewards, and applications.
PPO — Proximal Policy Optimization
Overview of PPO, the clipped policy-gradient RL algorithm used in RLHF for InstructGPT and original ChatGPT.
GRPO — Group Relative Policy Optimization
Critic-free RL algorithm that replaces PPO's value model with group-relative rewards for LLM fine-tuning.