Product
LMDeploy
大模型推理部署框架，在国产模型适配上具有优势
Timeline (last 90 days)
Oct 31
LMDeploy, combined with quantization techniques, quantizes the KV Cache data type from float to int, compressing the occupied space at the cost of some precision.
Unverified50%
大模型推理部署框架，在国产模型适配上具有优势
LMDeploy, combined with quantization techniques, quantizes the KV Cache data type from float to int, compressing the occupied space at the cost of some precision.