This directory is the deployable reference stack for the Phase 88 serving
control plane. The compose stack provides vLLM multi-LoRA, SGLang structured
generation, TensorRT-LLM through Triton/Dynamo, llama.cpp edge parity, and
LMCache. kubernetes.yaml adds zero-downtime rollout, queue autoscaling,
cache-aware service metadata, Blackwell placement, and NVIDIA GPU Operator MIG
profiles.
Run docker compose config with the required model variables to validate the
local/RunPod topology. Production images must be mirrored into the Oshun
registry and pinned by digest before promotion.