Skip to content

GitLab

Commit 45013b60 authored by Daniël de Kok's avatar Daniël de Kok
Browse files

Install compressed-tensors in Docker CPU builds

parent bd6e8b3c
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
Dockerfile_intel
View file @ 45013b60
...@@ -218,7 +218,7 @@ COPY server/Makefile server/Makefile ...@@ -218,7 +218,7 @@ COPY server/Makefile server/Makefile
RUN cd server && \ RUN cd server && \
make gen-server && \ make gen-server && \
pip install -r requirements_intel.txt && \ pip install -r requirements_intel.txt && \
pip install ".[accelerate, peft, outlines]" --no-cache-dir pip install ".[accelerate, compressed-tensors, peft, outlines]" --no-cache-dir
# Install benchmarker # Install benchmarker
COPY --from=builder /usr/src/target/release-opt/text-generation-benchmark /usr/local/bin/text-generation-benchmark COPY --from=builder /usr/src/target/release-opt/text-generation-benchmark /usr/local/bin/text-generation-benchmark
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment