Spaces:
Running
on
A10G
Running
on
A10G
Duplicate space fail
#494
by
birdhackor
- opened
Hi, I try to duplicate this space, but it always build fail.
Here is the logs. How can I do to fix this issue?
===== Build Queued at 2023-06-06 16:17:34 / Commit SHA: dbf2e63 =====
--> FROM docker.io/nvidia/cuda:11.3.1-cudnn8-devel-ubuntu18.04@sha256:69cd988555eabe116f76acc754b363eee75f37674c23adb2b523f5fa32543984
DONE 0.0s
--> RUN sed -i 's http://deb.debian.org http://cdn-aws.deb.debian.org g' /etc/apt/sources.list && sed -i 's http://archive.ubuntu.com http://us-east-1.ec2.archive.ubuntu.com g' /etc/apt/sources.list && sed -i '/security/d' /etc/apt/sources.list && apt-get update && apt-get install -y git make build-essential libssl-dev zlib1g-dev libbz2-dev libreadline-dev libsqlite3-dev wget curl llvm libncursesw5-dev xz-utils tk-dev libxml2-dev libxmlsec1-dev libffi-dev liblzma-dev git-lfs ffmpeg libsm6 libxext6 cmake libgl1-mesa-glx && rm -rf /var/lib/apt/lists/* && git lfs install
CACHED
--> RUN useradd -m -u 1000 user
CACHED
--> RUN pyenv install 3.10 && pyenv global 3.10 && pyenv rehash && pip install --no-cache-dir --upgrade pip==22.3.1 setuptools wheel && pip install --no-cache-dir datasets "huggingface-hub>=0.12.1" "protobuf<4" "click<8.1"
CACHED
--> WORKDIR /home/user/app
CACHED
--> RUN curl https://pyenv.run | bash
CACHED
--> RUN --mount=target=/root/packages.txt,source=packages.txt sed -i 's http://deb.debian.org http://cdn-aws.deb.debian.org g' /etc/apt/sources.list && sed -i 's http://archive.ubuntu.com http://us-east-1.ec2.archive.ubuntu.com g' /etc/apt/sources.list && sed -i '/security/d' /etc/apt/sources.list && apt-get update && xargs -r -a /root/packages.txt apt-get install -y && rm -rf /var/lib/apt/lists/*
CACHED
--> RUN --mount=target=pre-requirements.txt,source=pre-requirements.txt pip install --no-cache-dir -r pre-requirements.txt
DONE 61.4s
DONE 63.5s
DONE 63.5s
--> RUN --mount=target=requirements.txt,source=requirements.txt pip install --no-cache-dir -r requirements.txt
Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/cu117
Collecting torch
Downloading https://download.pytorch.org/whl/cu117/torch-2.0.1%2Bcu117-cp310-cp310-linux_x86_64.whl (1843.9 MB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 1.8/1.8 GB 424.0 MB/s eta 0:00:00
Collecting torchvision
Downloading https://download.pytorch.org/whl/cu117/torchvision-0.15.2%2Bcu117-cp310-cp310-linux_x86_64.whl (6.1 MB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 6.1/6.1 MB 333.8 MB/s eta 0:00:00
Collecting fairscale
Downloading fairscale-0.4.13.tar.gz (266 kB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 266.3/266.3 kB 55.4 MB/s eta 0:00:00
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Installing backend dependencies: started
Installing backend dependencies: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting ftfy
Downloading ftfy-6.1.1-py3-none-any.whl (53 kB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 53.1/53.1 kB 323.8 MB/s eta 0:00:00
Requirement already satisfied: huggingface-hub in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from -r requirements.txt (line 7)) (0.15.1)
Collecting Pillow
Downloading Pillow-9.5.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 3.3/3.3 MB 137.5 MB/s eta 0:00:00
Collecting timm
Downloading timm-0.9.2-py3-none-any.whl (2.2 MB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 2.2/2.2 MB 256.9 MB/s eta 0:00:00
Collecting transformers==4.15.0
Downloading transformers-4.15.0-py3-none-any.whl (3.4 MB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 3.4/3.4 MB 142.4 MB/s eta 0:00:00
Collecting open_clip_torch==2.14.0
Downloading open_clip_torch-2.14.0-py3-none-any.whl (1.5 MB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 1.5/1.5 MB 105.5 MB/s eta 0:00:00
Requirement already satisfied: requests in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from -r requirements.txt (line 12)) (2.31.0)
Collecting clip-interrogator==0.5.4
Downloading clip_interrogator-0.5.4-py3-none-any.whl (787 kB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 787.5/787.5 kB 417.9 MB/s eta 0:00:00
Requirement already satisfied: numpy>=1.17 in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from transformers==4.15.0->-r requirements.txt (line 10)) (1.24.3)
Collecting sacremoses
Downloading sacremoses-0.0.53.tar.gz (880 kB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 880.6/880.6 kB 365.0 MB/s eta 0:00:00
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: filelock in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from transformers==4.15.0->-r requirements.txt (line 10)) (3.12.0)
Requirement already satisfied: tqdm>=4.27 in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from transformers==4.15.0->-r requirements.txt (line 10)) (4.65.0)
Requirement already satisfied: packaging>=20.0 in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from transformers==4.15.0->-r requirements.txt (line 10)) (23.1)
Collecting tokenizers<0.11,>=0.10.1
Downloading tokenizers-0.10.3.tar.gz (212 kB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 212.7/212.7 kB 382.1 MB/s eta 0:00:00
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting regex!=2019.12.17
Downloading regex-2023.6.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (770 kB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 770.4/770.4 kB 434.4 MB/s eta 0:00:00
Requirement already satisfied: pyyaml>=5.1 in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from transformers==4.15.0->-r requirements.txt (line 10)) (6.0)
Requirement already satisfied: protobuf==3.20.* in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from open_clip_torch==2.14.0->-r requirements.txt (line 11)) (3.20.3)
Collecting sentencepiece
Downloading sentencepiece-0.1.99-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 1.3/1.3 MB 412.4 MB/s eta 0:00:00
Collecting safetensors
Downloading safetensors-0.3.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 1.3/1.3 MB 430.7 MB/s eta 0:00:00
Collecting blip-ci
Downloading blip-ci-0.0.3.tar.gz (43 kB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 43.0/43.0 kB 289.6 MB/s eta 0:00:00
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Installing backend dependencies: started
Installing backend dependencies: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting triton==2.0.0
Downloading https://download.pytorch.org/whl/triton-2.0.0-1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (63.3 MB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 63.3/63.3 MB 286.0 MB/s eta 0:00:00
Collecting jinja2
Downloading https://download.pytorch.org/whl/Jinja2-3.1.2-py3-none-any.whl (133 kB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 133.1/133.1 kB 353.1 MB/s eta 0:00:00
Collecting sympy
Downloading sympy-1.12-py3-none-any.whl (5.7 MB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 5.7/5.7 MB 238.5 MB/s eta 0:00:00
Requirement already satisfied: typing-extensions in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from torch->-r requirements.txt (line 2)) (4.6.3)
Collecting networkx
Downloading networkx-3.1-py3-none-any.whl (2.1 MB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 2.1/2.1 MB 429.9 MB/s eta 0:00:00
Collecting cmake
Downloading cmake-3.26.3-py2.py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (24.0 MB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 24.0/24.0 MB 251.6 MB/s eta 0:00:00
Collecting lit
Downloading lit-16.0.5.post0.tar.gz (138 kB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 138.1/138.1 kB 381.9 MB/s eta 0:00:00
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting wcwidth>=0.2.5
Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
Requirement already satisfied: fsspec in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from huggingface-hub->-r requirements.txt (line 7)) (2023.5.0)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (2.0.2)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (3.1.0)
Requirement already satisfied: certifi>=2017.4.17 in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (2023.5.7)
Requirement already satisfied: idna<4,>=2.5 in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (3.4)
Collecting fairscale
Downloading fairscale-0.4.4.tar.gz (235 kB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 235.4/235.4 kB 405.5 MB/s eta 0:00:00
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Installing backend dependencies: started
Installing backend dependencies: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting timm
Downloading timm-0.4.12-py3-none-any.whl (376 kB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 377.0/377.0 kB 424.4 MB/s eta 0:00:00
Collecting MarkupSafe>=2.0
Downloading MarkupSafe-2.1.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Requirement already satisfied: six in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from sacremoses->transformers==4.15.0->-r requirements.txt (line 10)) (1.16.0)
Requirement already satisfied: click in /home/user/.pyenv/versions/3.10.11/lib/python3.10/site-packages (from sacremoses->transformers==4.15.0->-r requirements.txt (line 10)) (8.0.4)
Collecting joblib
Downloading joblib-1.2.0-py3-none-any.whl (297 kB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 298.0/298.0 kB 409.1 MB/s eta 0:00:00
Collecting mpmath>=0.19
Downloading mpmath-1.3.0-py3-none-any.whl (536 kB)
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 536.2/536.2 kB 397.4 MB/s eta 0:00:00
Building wheels for collected packages: tokenizers, blip-ci, fairscale, sacremoses, lit
Building wheel for tokenizers (pyproject.toml): started
Building wheel for tokenizers (pyproject.toml): finished with status 'error'
error: subprocess-exited-with-error
ร Building wheel for tokenizers (pyproject.toml) did not run successfully.
โ exit code: 1
โฐโ> [51 lines of output]
running bdist_wheel
running build
running build_py
creating build
creating build/lib.linux-x86_64-cpython-310
creating build/lib.linux-x86_64-cpython-310/tokenizers
copying py_src/tokenizers/__init__.py -> build/lib.linux-x86_64-cpython-310/tokenizers
creating build/lib.linux-x86_64-cpython-310/tokenizers/models
copying py_src/tokenizers/models/__init__.py -> build/lib.linux-x86_64-cpython-310/tokenizers/models
creating build/lib.linux-x86_64-cpython-310/tokenizers/decoders
copying py_src/tokenizers/decoders/__init__.py -> build/lib.linux-x86_64-cpython-310/tokenizers/decoders
creating build/lib.linux-x86_64-cpython-310/tokenizers/normalizers
copying py_src/tokenizers/normalizers/__init__.py -> build/lib.linux-x86_64-cpython-310/tokenizers/normalizers
creating build/lib.linux-x86_64-cpython-310/tokenizers/pre_tokenizers
copying py_src/tokenizers/pre_tokenizers/__init__.py -> build/lib.linux-x86_64-cpython-310/tokenizers/pre_tokenizers
creating build/lib.linux-x86_64-cpython-310/tokenizers/processors
copying py_src/tokenizers/processors/__init__.py -> build/lib.linux-x86_64-cpython-310/tokenizers/processors
creating build/lib.linux-x86_64-cpython-310/tokenizers/trainers
copying py_src/tokenizers/trainers/__init__.py -> build/lib.linux-x86_64-cpython-310/tokenizers/trainers
creating build/lib.linux-x86_64-cpython-310/tokenizers/implementations
copying py_src/tokenizers/implementations/__init__.py -> build/lib.linux-x86_64-cpython-310/tokenizers/implementations
copying py_src/tokenizers/implementations/base_tokenizer.py -> build/lib.linux-x86_64-cpython-310/tokenizers/implementations
copying py_src/tokenizers/implementations/bert_wordpiece.py -> build/lib.linux-x86_64-cpython-310/tokenizers/implementations
copying py_src/tokenizers/implementations/byte_level_bpe.py -> build/lib.linux-x86_64-cpython-310/tokenizers/implementations
copying py_src/tokenizers/implementations/char_level_bpe.py -> build/lib.linux-x86_64-cpython-310/tokenizers/implementations
copying py_src/tokenizers/implementations/sentencepiece_bpe.py -> build/lib.linux-x86_64-cpython-310/tokenizers/implementations
copying py_src/tokenizers/implementations/sentencepiece_unigram.py -> build/lib.linux-x86_64-cpython-310/tokenizers/implementations
creating build/lib.linux-x86_64-cpython-310/tokenizers/tools
copying py_src/tokenizers/tools/__init__.py -> build/lib.linux-x86_64-cpython-310/tokenizers/tools
copying py_src/tokenizers/tools/visualizer.py -> build/lib.linux-x86_64-cpython-310/tokenizers/tools
copying py_src/tokenizers/__init__.pyi -> build/lib.linux-x86_64-cpython-310/tokenizers
copying py_src/tokenizers/models/__init__.pyi -> build/lib.linux-x86_64-cpython-310/tokenizers/models
copying py_src/tokenizers/decoders/__init__.pyi -> build/lib.linux-x86_64-cpython-310/tokenizers/decoders
copying py_src/tokenizers/normalizers/__init__.pyi -> build/lib.linux-x86_64-cpython-310/tokenizers/normalizers
copying py_src/tokenizers/pre_tokenizers/__init__.pyi -> build/lib.linux-x86_64-cpython-310/tokenizers/pre_tokenizers
copying py_src/tokenizers/processors/__init__.pyi -> build/lib.linux-x86_64-cpython-310/tokenizers/processors
copying py_src/tokenizers/trainers/__init__.pyi -> build/lib.linux-x86_64-cpython-310/tokenizers/trainers
copying py_src/tokenizers/tools/visualizer-styles.css -> build/lib.linux-x86_64-cpython-310/tokenizers/tools
running build_ext
running build_rust
error: can't find Rust compiler
If you are using an outdated pip version, it is possible a prebuilt wheel is available for this package but pip is not able to install from it. Installing from the wheel would avoid the need for a Rust compiler.
To update pip, run:
pip install --upgrade pip
and then retry package installation.
If you did intend to build this package from source, try installing a Rust compiler from your system package manager and ensure it is on the PATH during installation. Alternatively, rustup (available at https://rustup.rs) is the recommended way to download and update the Rust compiler toolchain.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for tokenizers
Building wheel for blip-ci (pyproject.toml): started
Building wheel for blip-ci (pyproject.toml): finished with status 'done'
Created wheel for blip-ci: filename=blip_ci-0.0.3-py3-none-any.whl size=55505 sha256=d4aaa2641b9128942d42a8eb2fc3d3cc2bd1e25b2784f1cbb06a40c8b88e5f46
Stored in directory: /tmp/pip-ephem-wheel-cache-m_sf4h3i/wheels/bc/b3/e5/d046f764d1e00d16c15627118b98d5074f84f7df66e7d0f722
Building wheel for fairscale (pyproject.toml): started
Building wheel for fairscale (pyproject.toml): finished with status 'done'
Created wheel for fairscale: filename=fairscale-0.4.4-py3-none-any.whl size=292837 sha256=41cf8f5b05952ddbc0651bf3a1627b7f420b14eb7da0b5796cbe610ca2cf84d9
Stored in directory: /tmp/pip-ephem-wheel-cache-m_sf4h3i/wheels/eb/a6/30/67ce96af10c2038bd71b851f60f388fc7922cc663ed954262d
Building wheel for sacremoses (setup.py): started
Building wheel for sacremoses (setup.py): finished with status 'done'
Created wheel for sacremoses: filename=sacremoses-0.0.53-py3-none-any.whl size=895241 sha256=7909881cc2938a5754eaefff233ab8d2b404a59d1a9d2220e6740f35e2744b35
Stored in directory: /tmp/pip-ephem-wheel-cache-m_sf4h3i/wheels/54/57/ca/1b7fc57cabefe89a4425649e77f8f6ce1b6b73340200180e16
Building wheel for lit (setup.py): started
Building wheel for lit (setup.py): finished with status 'done'
Created wheel for lit: filename=lit-16.0.5.post0-py3-none-any.whl size=88257 sha256=9b18731eb8a0efa7321d8f7870598fe5315990e9f0891770a85726a04b6c1bfd
Stored in directory: /tmp/pip-ephem-wheel-cache-m_sf4h3i/wheels/16/7d/f8/2b5c20c87dcdb0cbd163acde8a4c9897853f0052eb3651fed0
Successfully built blip-ci fairscale sacremoses lit
Failed to build tokenizers
ERROR: Could not build wheels for tokenizers, which is required to install pyproject.toml-based projects
[notice] A new release of pip available: 22.3.1 -> 23.1.2
[notice] To update, run: pip install --upgrade pip
--> ERROR: process "/bin/sh -c pip install --no-cache-dir -r requirements.txt" did not complete successfully: exit code: 1