A Survey of Hybrid Inference Systems for Large Language Models
Proposed a four-level taxonomy of hybrid LLM inference, identified the Orchestration Gap across inference levels, and introduced CPS and ITTS metrics for evaluating speed–quality tradeoffs.