Sign inSign up

alpayariyakrunpod/vllm-base:0.1.1

Manifest digest

sha256:704fc63ea592f0d50a16a1f84e83c45e4da213850be5764c1d70a77657f09dd5

OS/ARCH

linux/amd64

Compressed size

5.42 GB

Last pushed

over 2 years by alpayariyakrunpod

Type

Image

Manifest digest

sha256:704fc63ea592f0d50a16a1f84e83c45e4da213850be5764c1d70a77657f09dd5

Image Layers

Image Layers

1ARG RELEASE0 B
2ARG LAUNCHPAD_BUILD_ARCH0 B
3LABEL org.opencontainers.image.ref.name=ubuntu0 B
4LABEL org.opencontainers.image.version=22.040 B
5ADD file ... in / 28.17 MB
6CMD ["/bin/bash"]0 B
7ENV NVARCH=x86_640 B
8ENV NVIDIA_REQUIRE_CUDA=cuda>=11.8 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<4710 B
9ENV NV_CUDA_CUDART_VERSION=11.8.89-10 B
10ENV NV_CUDA_COMPAT_PACKAGE=cuda-compat-11-80 B
11ARG TARGETARCH0 B
12LABEL maintainer=NVIDIA CORPORATION <[email protected]>0 B
13RUN |1 TARGETARCH=amd64 /bin/sh -c4.41 MB
14ENV CUDA_VERSION=11.8.00 B
15RUN |1 TARGETARCH=amd64 /bin/sh -c53.62 MB
16RUN |1 TARGETARCH=amd64 /bin/sh -c188 B
17ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin0 B
18ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib640 B
19COPY NGC-DL-CONTAINER-LICENSE / # buildkit6.72 KB
20ENV NVIDIA_VISIBLE_DEVICES=all0 B
21ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility0 B
22COPY /usr/local/cuda-11.8 /usr/local/cuda-11.8 # buildkit2.5 GB
23RUN /bin/sh -c ln -s179 B
24RUN /bin/sh -c apt-get update89.4 MB
25ENV SHELL=/bin/bash PYTHONUNBUFFERED=True DEBIAN_FRONTEND=noninteractive HF_HOME=/runpod-volume/.cache/huggingface/hub0 B
26COPY builder/requirements.txt /requirements.txt # buildkit166 B
27RUN /bin/sh -c python3.11 -m49.6 MB
28COPY src . # buildkit3.5 KB
29ARG MODEL_NAME=0 B
30ARG MODEL_BASE_PATH=/runpod-volume/0 B
31ARG QUANTIZATION=0 B
32ENV MODEL_BASE_PATH=/runpod-volume/ MODEL_NAME= QUANTIZATION=0 B
33RUN |3 MODEL_NAME= MODEL_BASE_PATH=/runpod-volume/ QUANTIZATION=32 B
34COPY /usr/local /usr/local # buildkit2.7 GB
35CMD ["python3.11" "/handler.py"]0 B

Command

 ARG RELEASE