Sign inSign up

modular/max-openai-api:25.2.0.dev2025030905

Multi-platform
Machine learning & AI
Index digest

sha256:a607635b05869753527f9ead934d38483a151a43dba98ba0f8f29cd602c81ac4

OS/ARCH

Compressed size

5.07 GB

Last pushed

over 1 year by modularbot

Type

Image

Manifest digest

sha256:a7831a7fa2991d046be18ee898efb58b71a29298c57abed6c87092a0887ac266

Image Layers

1ARG RELEASE0 B
2ARG LAUNCHPAD_BUILD_ARCH0 B
3LABEL org.opencontainers.image.ref.name=ubuntu0 B
4LABEL org.opencontainers.image.version=22.040 B
5ADD file ... in / 26.09 MB
6CMD ["/bin/bash"]0 B
7ENV NVARCH=sbsa0 B
8ENV NVIDIA_REQUIRE_CUDA=cuda>=12.5 brand=unknown,driver>=470,driver<471 brand=grid,driver>=470,driver<471 brand=tesla,driver>=470,driver<4710 B
9ENV NV_CUDA_CUDART_VERSION=12.5.39-10 B
10ARG TARGETARCH0 B
11LABEL maintainer=NVIDIA CORPORATION <[email protected]>0 B
12RUN |1 TARGETARCH=arm64 /bin/sh -c4.36 MB
13ENV CUDA_VERSION=12.5.00 B
14RUN |1 TARGETARCH=arm64 /bin/sh -c373.06 KB
15RUN |1 TARGETARCH=arm64 /bin/sh -c186 B
16ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin0 B
17ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib640 B
18COPY NGC-DL-CONTAINER-LICENSE / # buildkit6.72 KB
19ENV NVIDIA_VISIBLE_DEVICES=all0 B
20ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility0 B
21ARG CUDA_VERSION=12.5.00 B
22WORKDIR /app93 B
23ENV ENV_DIR=/opt/venv0 B
24COPY /opt/venv /opt/venv # buildkit5.04 GB
25COPY Licenses/MAX-Platform-Software-License ./MAX-Platform-Software-License.txt # buildkit4.28 KB
26COPY Licenses/Third-Party-Notices ./Third-Party-Notices.txt # buildkit5.23 KB
27COPY SDK/lib/API/python/max/serve/README.PUBLIC.md README.md # buildkit352 B
28COPY SDK/lib/API/python/max/serve/entrypoint.sh . # buildkit249 B
29RUN |1 CUDA_VERSION=12.5.0 /bin/sh -c181 B
30ENV PATH=/opt/venv/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin0 B
31ENV MODULAR_HOME=/opt/venv/share/max0 B
32ENV TRANSFORMERS_VERBOSITY=critical0 B
33ENV TRANSFORMERS_NO_ADVISORY_WARNINGS=10 B
34ENV MODULAR_STRUCTURED_LOGGING=10 B
35ENV PROMETHEUS_MULTIPROC_DIR=/tmp0 B
36ENV OTEL_SERVICE_NAME=max-serve0 B
37ENV OTEL_EXPORTER_OTLP_METRICS_DEFAULT_HISTOGRAM_AGGREGATION=base2_exponential_bucket_histogram0 B
38EXPOSE map[8000/tcp:{}]0 B
39ENTRYPOINT ["./entrypoint.sh"]0 B

Command

 ARG RELEASE