Sign inSign up

ashahba/vllm-cpu:v0.12.0-avx512

Languages & frameworks
Machine learning & AI
Data science
Manifest digest

sha256:b5c637c7d1c6dd4f41cb4b2fbfdbf0cf1ddc214382a7df824a50e668acccd1c4

OS/ARCH

linux/amd64

Compressed size

959.61 MB

Last pushed

9 months by ashahba

Type

Image

Manifest digest

sha256:b5c637c7d1c6dd4f41cb4b2fbfdbf0cf1ddc214382a7df824a50e668acccd1c4

Image Layers

Image Layers

1ARG RELEASE0 B
2ARG LAUNCHPAD_BUILD_ARCH0 B
3LABEL org.opencontainers.image.ref.name=ubuntu0 B
4LABEL org.opencontainers.image.version=22.040 B
5ADD file ... in / 28.17 MB
6CMD ["/bin/bash"]0 B
7WORKDIR /workspace/97 B
8ARG PYTHON_VERSION=3.120 B
9ARG PIP_EXTRA_INDEX_URL=https://download.pytorch.org/whl/cpu0 B
10RUN |2 PYTHON_VERSION=3.12 PIP_EXTRA_INDEX_URL=https://download.pytorch.org/whl/cpu /bin/sh263.3 MB
11ENV CC=/usr/bin/gcc-12 CXX=/usr/bin/g++-120 B
12ENV CCACHE_DIR=/root/.cache/ccache0 B
13ENV CMAKE_CXX_COMPILER_LAUNCHER=ccache0 B
14ENV PATH=/root/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin0 B
15ENV VIRTUAL_ENV=/opt/venv0 B
16ENV UV_PYTHON_INSTALL_DIR=/opt/uv/python0 B
17RUN |2 PYTHON_VERSION=3.12 PIP_EXTRA_INDEX_URL=https://download.pytorch.org/whl/cpu /bin/sh33.31 MB
18ENV PATH=/opt/venv/bin:/root/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin0 B
19ENV UV_HTTP_TIMEOUT=5000 B
20ENV PIP_EXTRA_INDEX_URL=https://download.pytorch.org/whl/cpu0 B
21ENV UV_EXTRA_INDEX_URL=https://download.pytorch.org/whl/cpu0 B
22ENV UV_INDEX_STRATEGY=unsafe-best-match0 B
23ENV UV_LINK_MODE=copy0 B
24RUN |2 PYTHON_VERSION=3.12 PIP_EXTRA_INDEX_URL=https://download.pytorch.org/whl/cpu /bin/sh609.96 MB
25ARG TARGETARCH=amd640 B
26ENV TARGETARCH=amd640 B
27ENV LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libtcmalloc_minimal.so.4:/opt/venv/lib/libiomp5.so0 B
28RUN |3 PYTHON_VERSION=3.12 PIP_EXTRA_INDEX_URL=https://download.pytorch.org/whl/cpu TARGETARCH=amd641.55 KB
29WORKDIR /workspace/34 B
30RUN |3 PYTHON_VERSION=3.12 PIP_EXTRA_INDEX_URL=https://download.pytorch.org/whl/cpu TARGETARCH=amd6424.87 MB
31ENTRYPOINT ["vllm" "serve"]0 B

Command

 ARG RELEASE