Streaming Inference Checkpoint Resume

An operational optimization technique for LLM streaming inference that continuously records a prefix cursor during streaming output. When a request is preempted or interrupted, only the remaining portion is regenerated, avoiding redundant billing caused by re-generating already-output tokens.