ThunderSync: Lossless Acceleration of Agentic Reinforcement Learning
ThunderSync streams gradient computation as soon as each trajectory’s inputs are fixed, training agentic models up to 1.9x faster than synchronous RL with identical GRPO and OPD updates and zero policy staleness.
