Unverified50% confidenceBenchmarkExact time
An identical request to the same model immediately following took only approximately 1.6 seconds, nearly 10 times less than the first request.
1
Sources
50%
Confidence
Long-term
Relevance
10/6/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn actual testing, a single classification by the Dify question classifier takes approximately 11 seconds, because execution speed depends on the large model's response.70% similarUnverified对于BERT-base模型推理会话初始化通常耗时数百毫秒，重复执行会使延迟增加1-2个数量级69% similarUnverifiedWith all three optimizations stacked, generation speed stabilizes at 9 to 10 tokens per second, but time-to-first-token for a 10,000-character long document still requires approximately 329 seconds.69% similarUnverifiedOfficial data shows that on an entry-level GPU, querying 10 questions together takes a total of 72 milliseconds, averaging approximately 7 milliseconds per question.68% similarUnverifiedA standard large language model typically takes several seconds to complete one inference, making it nearly unusable in real-time scenarios that require millisecond-level responses.66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/979845API
curl https://kongchang.com/api/v1/knowledge/claims/979845MCP
get_claim(id=979845)