Eve library

Phase 88 sovereign model serving

Other

Revision 1

On this page

This directory is the deployable reference stack for the Phase 88 serving control plane. The compose stack provides vLLM multi-LoRA, SGLang structured generation, TensorRT-LLM through Triton/Dynamo, llama.cpp edge parity, and LMCache. kubernetes.yaml adds zero-downtime rollout, queue autoscaling, cache-aware service metadata, Blackwell placement, and NVIDIA GPU Operator MIG profiles.

Run docker compose config with the required model variables to validate the local/RunPod topology. Production images must be mirrored into the Oshun registry and pinned by digest before promotion.