Rollout & scheduling#
Place engines, schedule generation, and move data and weights.
- Understand the RL system you are building
- Synchronous, partial, and distributed fully async rollout
- Persistent rollout with straw
- PD Disaggregation
- External Rollout Engines Roadmap
- Delta Weight Sync
- vLLM Config: Advanced Engine Deployment
- Speculative Decoding
- Collect target features for an external draft