[
KongchangAI
]
Feed
Entities
Podcasts
Deep Dives
Developers
About
Get CLI
中文
Concept
Cold Start / 冷启动
GPU冷启动
GPU任务从零开始加载模型、初始化CUDA上下文、分配显存到服务真正可用之间的等待过程,是云端AI推理与训练场景中影响响应延迟与资源利用率的关键瓶颈。
Source Articles
Reverse-Engineering CUDA-checkpoint: The Technical Principles and Practice of Cracking GPU Cold Starts
Jul 10