Prefill-Decode Disaggregated Architecture

An LLM inference serving architecture that separates the Prefill phase and the Decode phase onto distinct workers for independent processing. The separation aims to optimize each phase according to its distinct computational characteristics, thereby improving overall service quality and resource utilization.