caf324b09d
tests / check_code_quality (push) Waiting to run
tests / tests (ubuntu-latest, 3.10) (push) Blocked by required conditions
tests / tests (ubuntu-latest, 3.11) (push) Blocked by required conditions
Deploy "method_comparison" Gradio to Spaces / deploy (push) Waiting to run
Deploy "PEFT shop" Gradio app to Spaces / deploy (push) Waiting to run
tests on transformers main / tests (push) Waiting to run
tests / tests (ubuntu-latest, 3.12) (push) Blocked by required conditions
tests / tests (ubuntu-latest, 3.13) (push) Blocked by required conditions
tests / tests (windows-latest, 3.10) (push) Blocked by required conditions
tests / tests (windows-latest, 3.11) (push) Blocked by required conditions
tests / tests (windows-latest, 3.12) (push) Blocked by required conditions
tests / tests (windows-latest, 3.13) (push) Blocked by required conditions
Secret Leaks / trufflehog (push) Waiting to run
CI security linting / zizmor latest via Cargo (push) Waiting to run
Build documentation / build (push) Failing after 0s
47 lines
1.6 KiB
Docker
47 lines
1.6 KiB
Docker
# Builds GPU docker image of PyTorch
|
|
# Uses multi-staged approach to reduce size
|
|
# Stage 1
|
|
# Use base conda image to reduce time
|
|
FROM continuumio/miniconda3:latest AS compile-image
|
|
# Specify py version
|
|
ENV PYTHON_VERSION=3.11
|
|
# Install apt libs - copied from https://github.com/huggingface/accelerate/blob/main/docker/accelerate-gpu/Dockerfile
|
|
RUN apt-get update && \
|
|
apt-get install -y curl git wget git-lfs ffmpeg libsndfile1-dev && \
|
|
apt-get clean && \
|
|
rm -rf /var/lib/apt/lists*
|
|
|
|
RUN git lfs install
|
|
|
|
# Create our conda env - copied from https://github.com/huggingface/accelerate/blob/main/docker/accelerate-gpu/Dockerfile
|
|
RUN conda create --name peft python=${PYTHON_VERSION} ipython jupyter pip
|
|
RUN python3 -m pip install --no-cache-dir --upgrade pip
|
|
|
|
# Below is copied from https://github.com/huggingface/accelerate/blob/main/docker/accelerate-gpu/Dockerfile
|
|
# We don't install pytorch here yet since CUDA isn't available
|
|
# instead we use the direct torch wheel
|
|
ENV PATH=/opt/conda/envs/peft/bin:$PATH
|
|
# Activate our bash shell
|
|
RUN chsh -s /bin/bash
|
|
SHELL ["/bin/bash", "-c"]
|
|
# Activate the conda env and install transformers + accelerate from source
|
|
RUN source activate peft && \
|
|
python3 -m pip install --no-cache-dir \
|
|
librosa \
|
|
"soundfile>=0.12.1" \
|
|
scipy \
|
|
git+https://github.com/huggingface/transformers \
|
|
git+https://github.com/huggingface/accelerate \
|
|
peft[test]@git+https://github.com/huggingface/peft
|
|
|
|
# Install apt libs
|
|
RUN apt-get update && \
|
|
apt-get install -y curl git wget && \
|
|
apt-get clean && \
|
|
rm -rf /var/lib/apt/lists*
|
|
|
|
RUN echo "source activate peft" >> ~/.profile
|
|
|
|
# Activate the virtualenv
|
|
CMD ["/bin/bash"]
|