Unverified60% confidenceFactExact time
Llama 3.3 70B经过4-bit量化后模型大小约为40GB,可在配备64GB内存的Mac Studio或单张48GB显存的专业GPU上运行
2
Sources
60%
Confidence
Long-term
Relevance
12/8/2024
First Seen
Sources
Llama 3.3 70B深度测评:13道题实测最强开源大模型
bilibiliAI-seeker12/8/2024
Related Entities
Related Claims
Unverified容量并非越大越好:64GB以下高速盘性价比低已淘汰,128GB是甜点容量;256GB以上更推荐移动固态。做Win/Mac启动盘32-64GB足够,装ISO镜像选128GB79% similarUnverifiedLlama-3(8B)的全量微调约需80GB以上显存,Llama-3(70B)则需要超过400GB79% similarUnverified27B稠密模型在24GB M4 Pro Mac mini上使用4-bit量化可以运行,速度约为11 tok/s78% similarUnverified内置128GB存储并支持TF卡扩展,同时提供3.5mm单端与4.4mm平衡输出77% similarUnverified测试在一台36GB内存的MacBook上进行,模型以128K上下文大小和Q8 KV缓存加载77% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/672API
curl https://kongchang.com/api/v1/knowledge/claims/672MCP
get_claim(id=672)