A policy layer above transport for KV movement, workload-aware admissibility, and explainable routing in disaggregated inference.

Open-source Python control plane for LLM inference: launch, route, scale, and observe disaggregated serving on infrastructure you control.

Measuring the KV-transfer tax of disaggregated prefill/decode LLM serving (vLLM + NIXL, 4x A10G): on PCIe-only hardware, disagg loses to plain data-parallel replication — measured, committed, reproducible.