PPO — Proximal Policy Optimization

Overview of PPO, the clipped policy-gradient RL algorithm used in RLHF for InstructGPT and original ChatGPT.

May 19, 2026 · 2 min