hf_transfer
A high-performance model download acceleration library developed by HuggingFace and written in Rust. It uses multi-threaded parallel downloading to significantly increase throughput when retrieving large model weight files from HuggingFace Hub.
Timeline (last 90 days)
hf_transfer is a high-performance download acceleration library written in Rust and officially provided by HuggingFace, which improves throughput through multi-threaded parallel downloading.
After setting the environment variable HF_HUB_ENABLE_HF_TRANSFER=1, the huggingface_hub library will automatically invoke the accelerated backend during downloads.
All Facts (2)
hf_transfer is a high-performance download acceleration library written in Rust and officially provided by HuggingFace, which improves throughput through multi-threaded parallel downloading.
50%UnverifiedAfter setting the environment variable HF_HUB_ENABLE_HF_TRANSFER=1, the huggingface_hub library will automatically invoke the accelerated backend during downloads.
50%