Unverified50% confidenceFactExact time
The end-to-end latency of streaming recognition is typically required to be kept within a few hundred milliseconds, and it must support rolling correction of partial results as context evolves.
1
Sources
50%
Confidence
Long-term
Relevance
11/3/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedOn-device inference optimization and streaming processing technology allow the latency of real-time ASR to be kept within 200–500 milliseconds.79% similarUnverifiedStreaming output can reduce the user-perceived time-to-first-token from several seconds down to the millisecond level.78% similarVerifiedThe inference latency of the front-end lightweight model typically needs to be kept within 200 milliseconds to match the human perceptual threshold for real-time interaction.78% similarUnverifiedIt is recommended to adjust the exception handling timeout of the large model node from the default 180 seconds to the platform maximum of 600 seconds, to avoid multimodal image input inference timeouts being incorrectly judged as failures.77% similarUnverifiedSome vendors have compressed perceived latency to within 500 milliseconds through streaming processing, but it remains difficult to consistently meet this target in complex query scenarios.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1133307API
curl https://kongchang.com/api/v1/knowledge/claims/1133307MCP
get_claim(id=1133307)