跳转到主要内容

使用Hugging Face Hub加速文件传输。

项目描述

HF Transfer

通过Hub加速文件传输。

免责声明

这个库是高级用户工具,在非常高的带宽网络中(Python无法充分利用带宽的地方),可以超越~500MB/s

这不是一个通用可用性工具。它故意缺少进度条,并且通常以原样提供。

只有在底层下载文件存在问题的情况下才请提交问题。

贡献

python3 -m venv ~/.venv/hf_transfer
source ~/.venv/hf_transfer/bin/activate
pip install maturin
maturin develop

huggingface_hub

如果您正在对huggingface_hub进行更改

git clone git@github.com:huggingface/huggingface_hub.git
# git clone https://github.com/huggingface/huggingface_hub.git

cd huggingface_hub
python3 -m pip install -e ".[quality]"

您可以使用以下测试脚本

import os

# os.environ["HF_ENDPOINT"] = "http://localhost:5564"
os.environ["HF_HUB_ENABLE_HF_TRANSFER"] = "1"

from huggingface_hub import HfApi, logging

logging.set_verbosity_debug()
hf = HfApi()
hf.upload_file(path_or_fileobj="/path/to/my/repo/some_file", path_in_repo="some_file", repo_id="my/repo", repo_type="model")

项目详情


下载文件

下载适用于您的平台的文件。如果您不确定选择哪个,请了解有关安装包的更多信息。

源代码分发

hf_transfer-0.1.8.tar.gz (23.6 kB 查看哈希值)

上传时间 源代码

构建分发版

hf_transfer-0.1.8-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB 查看哈希值)

上传时间 PyPy manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.8-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl (3.6 MB 查看哈希值)

上传时间 PyPy manylinux: glibc 2.17+ i686

hf_transfer-0.1.8-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB 查看哈希值)

上传时间 PyPy manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.8-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl (3.6 MB 查看哈希值)

上传时间 PyPy manylinux: glibc 2.17+ i686

hf_transfer-0.1.8-cp312-none-win_amd64.whl (1.2 MB 查看哈希值)

上传时间 CPython 3.12 Windows x86-64

hf_transfer-0.1.8-cp312-none-win32.whl (1.1 MB 查看哈希值)

上传时间 CPython 3.12 Windows x86

hf_transfer-0.1.8-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB 查看哈希值)

上传时间 CPython 3.12 manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.8-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (3.4 MB 查看哈希值)

上传于 CPython 3.12 manylinux: glibc 2.17+ ppc64le

hf_transfer-0.1.8-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl (3.6 MB 查看哈希)

上传于 CPython 3.12 manylinux: glibc 2.17+ i686

hf_transfer-0.1.8-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.1 MB 查看哈希)

上传于 CPython 3.12 manylinux: glibc 2.17+ ARMv7l

hf_transfer-0.1.8-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB 查看哈希)

上传于 CPython 3.12 manylinux: glibc 2.17+ ARM64

hf_transfer-0.1.8-cp312-cp312-macosx_11_0_arm64.whl (1.4 MB 查看哈希)

上传于 CPython 3.12 macOS 11.0+ ARM64

hf_transfer-0.1.8-cp312-cp312-macosx_10_12_x86_64.whl (1.4 MB 查看哈希)

上传于 CPython 3.12 macOS 10.12+ x86-64

hf_transfer-0.1.8-cp311-none-win_amd64.whl (1.2 MB 查看哈希)

上传于 CPython 3.11 Windows x86-64

hf_transfer-0.1.8-cp311-none-win32.whl (1.1 MB 查看哈希)

上传于 CPython 3.11 Windows x86

hf_transfer-0.1.8-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB 查看哈希)

上传于 CPython 3.11 manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.8-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (3.4 MB 查看哈希)

上传于 CPython 3.11 manylinux: glibc 2.17+ ppc64le

hf_transfer-0.1.8-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl (3.6 MB 查看哈希)

上传于 CPython 3.11 manylinux: glibc 2.17+ i686

hf_transfer-0.1.8-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.1 MB 查看哈希值)

上传时间 CPython 3.11 manylinux: glibc 2.17+ ARMv7l

hf_transfer-0.1.8-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB 查看哈希值)

上传时间 CPython 3.11 manylinux: glibc 2.17+ ARM64

hf_transfer-0.1.8-cp311-cp311-macosx_11_0_arm64.whl (1.4 MB 查看哈希值)

上传时间 CPython 3.11 macOS 11.0+ ARM64

hf_transfer-0.1.8-cp311-cp311-macosx_10_12_x86_64.whl (1.4 MB 查看哈希值)

上传时间 CPython 3.11 macOS 10.12+ x86-64

hf_transfer-0.1.8-cp310-none-win_amd64.whl (1.2 MB 查看哈希值)

上传时间 CPython 3.10 Windows x86-64

hf_transfer-0.1.8-cp310-none-win32.whl (1.1 MB 查看哈希值)

上传时间 CPython 3.10 Windows x86

hf_transfer-0.1.8-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB 查看哈希值)

上传时间 CPython 3.10 manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.8-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (3.4 MB 查看哈希值)

上传时间 CPython 3.10 manylinux: glibc 2.17+ ppc64le

hf_transfer-0.1.8-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl (3.6 MB 查看哈希值)

上传时间 CPython 3.10 manylinux: glibc 2.17+ i686

hf_transfer-0.1.8-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.1 MB 查看哈希值)

上传时间 CPython 3.10 manylinux: glibc 2.17+ ARMv7l

hf_transfer-0.1.8-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB 查看哈希值)

上传时间 CPython 3.10 manylinux: glibc 2.17+ ARM64

hf_transfer-0.1.8-cp310-cp310-macosx_11_0_arm64.whl (1.4 MB 查看哈希值)

上传时间 CPython 3.10 macOS 11.0+ ARM64

hf_transfer-0.1.8-cp310-cp310-macosx_10_12_x86_64.whl (1.4 MB 查看哈希值)

上传时间 CPython 3.10 macOS 10.12+ x86-64

hf_transfer-0.1.8-cp39-none-win_amd64.whl (1.2 MB 查看哈希值)

上传时间 CPython 3.9 Windows x86-64

hf_transfer-0.1.8-cp39-none-win32.whl (1.1 MB 查看哈希值)

上传时间 CPython 3.9 Windows x86

hf_transfer-0.1.8-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB 查看哈希值)

上传时间 CPython 3.9 manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.8-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (3.4 MB 查看哈希值)

上传时间 CPython 3.9 manylinux: glibc 2.17+ ppc64le

hf_transfer-0.1.8-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl (3.6 MB 查看哈希值)

上传时间 CPython 3.9 manylinux: glibc 2.17+ i686

hf_transfer-0.1.8-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.1 MB 查看哈希值)

上传时间 CPython 3.9 manylinux: glibc 2.17+ ARMv7l

hf_transfer-0.1.8-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB 查看哈希值)

上传时间 CPython 3.9 manylinux: glibc 2.17+ ARM64

hf_transfer-0.1.8-cp39-cp39-macosx_11_0_arm64.whl (1.4 MB 查看哈希值)

上传于 CPython 3.9 macOS 11.0+ ARM64

hf_transfer-0.1.8-cp39-cp39-macosx_10_12_x86_64.whl (1.4 MB 查看哈希值)

上传于 CPython 3.9 macOS 10.12+ x86-64

hf_transfer-0.1.8-cp38-none-win_amd64.whl (1.2 MB 查看哈希值)

上传于 CPython 3.8 Windows x86-64

hf_transfer-0.1.8-cp38-none-win32.whl (1.1 MB 查看哈希值)

上传于 CPython 3.8 Windows x86

hf_transfer-0.1.8-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB 查看哈希值)

上传于 CPython 3.8 manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.8-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (3.4 MB 查看哈希值)

上传于 CPython 3.8 manylinux: glibc 2.17+ ppc64le

hf_transfer-0.1.8-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl (3.6 MB 查看哈希值)

上传于 CPython 3.8 manylinux: glibc 2.17+ i686

hf_transfer-0.1.8-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.1 MB 查看哈希值)

上传于 CPython 3.8 manylinux: glibc 2.17+ ARMv7l

hf_transfer-0.1.8-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB 查看哈希值)

上传于 CPython 3.8 manylinux: glibc 2.17+ ARM64

hf_transfer-0.1.8-cp37-none-win_amd64.whl (1.2 MB 查看哈希值)

上传于 CPython 3.7 Windows x86-64

hf_transfer-0.1.8-cp37-none-win32.whl (1.1 MB 查看哈希值)

上传时间 CPython 3.7 Windows x86

hf_transfer-0.1.8-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB 查看哈希值)

上传时间 CPython 3.7m manylinux: glibc 2.17+ x86-64

hf_transfer-0.1.8-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (3.4 MB 查看哈希值)

上传时间 CPython 3.7m manylinux: glibc 2.17+ ppc64le

hf_transfer-0.1.8-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl (3.6 MB 查看哈希值)

上传时间 CPython 3.7m manylinux: glibc 2.17+ i686

hf_transfer-0.1.8-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (3.1 MB 查看哈希值)

上传时间 CPython 3.7m manylinux: glibc 2.17+ ARMv7l

hf_transfer-0.1.8-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB 查看哈希值)

上传时间 CPython 3.7m manylinux: glibc 2.17+ ARM64

由以下提供支持