Sign inSign up

modular/max-openai-api:25.2.0.dev2025031805

Multi-platform
Machine learning & AI
Index digest

sha256:f3d3f1e80553d9d455c205f0b64fdb643d17ad49e20bac7c268cf3037cebb8d6

OS/ARCH

Compressed size

5.27 GB

Last pushed

over 1 year by modularbot

Type

Image

Manifest digest

sha256:7014ac71c452f45289f25266822a6111d43f17da6438878528fb759e3a9cf2e1

Image Layers

Image Layers

1ARG RELEASE0 B
2ARG LAUNCHPAD_BUILD_ARCH0 B
3LABEL org.opencontainers.image.ref.name=ubuntu0 B
4LABEL org.opencontainers.image.version=22.040 B
5ADD file ... in / 28.17 MB
6CMD ["/bin/bash"]0 B
7ENV NVARCH=x86_640 B
8ENV NVIDIA_REQUIRE_CUDA=cuda>=12.5 brand=unknown,driver>=470,driver<471 brand=grid,driver>=470,driver<471 brand=tesla,driver>=470,driver<4710 B
9ENV NV_CUDA_CUDART_VERSION=12.5.39-10 B
10ENV NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-50 B
11ARG TARGETARCH0 B
12LABEL maintainer=NVIDIA CORPORATION <[email protected]>0 B
13RUN |1 TARGETARCH=amd64 /bin/sh -c4.41 MB
14ENV CUDA_VERSION=12.5.00 B
15RUN |1 TARGETARCH=amd64 /bin/sh -c53.33 MB
16RUN |1 TARGETARCH=amd64 /bin/sh -c183 B
17ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin0 B
18ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib640 B
19COPY NGC-DL-CONTAINER-LICENSE / # buildkit6.72 KB
20ENV NVIDIA_VISIBLE_DEVICES=all0 B
21ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility0 B
22ARG CUDA_VERSION=12.5.00 B
23WORKDIR /app93 B
24ENV ENV_DIR=/opt/venv0 B
25COPY /opt/venv /opt/venv # buildkit5.18 GB
26COPY Licenses/MAX-Platform-Software-License ./MAX-Platform-Software-License.txt # buildkit4.28 KB
27COPY Licenses/Third-Party-Notices ./Third-Party-Notices.txt # buildkit5.23 KB
28COPY SDK/lib/API/python/max/serve/README.PUBLIC.md README.md # buildkit353 B
29COPY SDK/lib/API/python/max/serve/entrypoint.sh . # buildkit249 B
30RUN |1 CUDA_VERSION=12.5.0 /bin/sh -c190 B
31ENV PATH=/opt/venv/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin0 B
32ENV MODULAR_HOME=/opt/venv/share/max0 B
33ENV TRANSFORMERS_VERBOSITY=critical0 B
34ENV TRANSFORMERS_NO_ADVISORY_WARNINGS=10 B
35ENV MODULAR_STRUCTURED_LOGGING=10 B
36ENV PROMETHEUS_MULTIPROC_DIR=/tmp0 B
37ENV OTEL_SERVICE_NAME=max-serve0 B
38ENV OTEL_EXPORTER_OTLP_METRICS_DEFAULT_HISTOGRAM_AGGREGATION=base2_exponential_bucket_histogram0 B
39EXPOSE map[8000/tcp:{}]0 B
40ENTRYPOINT ["./entrypoint.sh"]0 B

Command

 ARG RELEASE