Fast model suspend/restore for vLLM sleep mode — snapshot weights to disk and swap models on one GPU in seconds, not minutes.
-
Updated
Aug 6, 2026 - Python
#
model-swapping
Here are 4 public repositories matching this topic...
SwapOS: frontier-class agentic AI pipelines on commodity hardware by swapping specialized small models (Context Capsule runtime)
-
Updated
Aug 7, 2026 - Python
llama-swap alternative in Rust — OpenAI-compatible GGUF runtime with VRAM-pressure eviction, context auto-fallback, and usage tracking.
rust model cuda switching openai-api llama-cpp local-llm llm-inference gguf model-swap llama-swap model-swapping
-
Updated
Aug 6, 2026 - Rust
Heuristic signals on whether an OpenAI-/Anthropic-compatible endpoint serves the model it claims — catch model-swapping, quantization & silent context truncation. Zero-dependency Python CLI. Signals, not proof.
python cli benchmark proxy tokenizer verification openai gpt claude honesty llm anthropic ai-gateway deepseek llm-gateway openai-compatible model-integrity api-relay model-swapping downgrade-detection
-
Updated
Jul 19, 2026 - Python
Improve this page
Add a description, image, and links to the model-swapping topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the model-swapping topic, visit your repo's landing page and select "manage topics."