max / everycycle

261 B · 8 lines History Blame Raw

1	#![allow(clippy::doc_markdown)]
2
3	//! EveryCycle per-box scheduler.
4	//!
5	//! Admits requests, places them in the continuous batch, allocates kv-cache
6	//! pages, coordinates speculative decoding with the draft runtime, and
7	//! handles preemption and cancellation.
8