[KongchangAI]
ConceptTTFT / Time to First Token

Time to First Token

An LLM inference performance metric defined as the time interval between sending an API request and receiving the first output token. It reflects model preprocessing and scheduling overhead, and is a key measure of response speed from a user experience perspective.

Source Articles