Sign inSign up

modular/max-openai-api:25.3.0.dev2025032205

Multi-platform
Machine learning & AI
Index digest

sha256:359a55028aaa880b627cff1d0fc37ce638f288027c61223d980a8770278191b4

OS/ARCH

Compressed size

1.22 GB

Last pushed

over 1 year by modularbot

Type

Image

Manifest digest

sha256:fbe7f776649db4dfdad275ee8ba9e074501ffbe520c287b12dff7e87dda8203b

Image Layers

Image Layers

1ARG RELEASE0 B
2ARG LAUNCHPAD_BUILD_ARCH0 B
3LABEL org.opencontainers.image.ref.name=ubuntu0 B
4LABEL org.opencontainers.image.version=22.040 B
5ADD file ... in / 28.17 MB
6CMD ["/bin/bash"]0 B
7ENV NVARCH=x86_640 B
8ENV NVIDIA_REQUIRE_CUDA=cuda>=12.5 brand=unknown,driver>=470,driver<471 brand=grid,driver>=470,driver<471 brand=tesla,driver>=470,driver<4710 B
9ENV NV_CUDA_CUDART_VERSION=12.5.39-10 B
10ENV NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-50 B
11ARG TARGETARCH0 B
12LABEL maintainer=NVIDIA CORPORATION <[email protected]>0 B
13RUN |1 TARGETARCH=amd64 /bin/sh -c4.41 MB
14ENV CUDA_VERSION=12.5.00 B
15RUN |1 TARGETARCH=amd64 /bin/sh -c53.33 MB
16RUN |1 TARGETARCH=amd64 /bin/sh -c183 B
17ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin0 B
18ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib640 B
19COPY NGC-DL-CONTAINER-LICENSE / # buildkit6.72 KB
20ENV NVIDIA_VISIBLE_DEVICES=all0 B
21ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility0 B
22ARG CUDA_VERSION=12.5.00 B
23WORKDIR /app93 B
24ENV ENV_DIR=/opt/venv0 B
25COPY /opt/venv /opt/venv # buildkit1.13 GB
26COPY Licenses/MAX-Platform-Software-License ./MAX-Platform-Software-License.txt # buildkit4.28 KB
27COPY Licenses/Third-Party-Notices ./Third-Party-Notices.txt # buildkit5.23 KB
28COPY SDK/lib/API/python/max/serve/README.PUBLIC.md README.md # buildkit353 B
29COPY SDK/lib/API/python/max/serve/entrypoint.sh . # buildkit250 B
30RUN |1 CUDA_VERSION=12.5.0 /bin/sh -c190 B
31ENV PATH=/opt/venv/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin0 B
32ENV MODULAR_HOME=/opt/venv/share/max0 B
33ENV TRANSFORMERS_VERBOSITY=critical0 B
34ENV TRANSFORMERS_NO_ADVISORY_WARNINGS=10 B
35ENV MODULAR_STRUCTURED_LOGGING=10 B
36ENV PROMETHEUS_MULTIPROC_DIR=/tmp0 B
37ENV OTEL_SERVICE_NAME=max-serve0 B
38ENV OTEL_EXPORTER_OTLP_METRICS_DEFAULT_HISTOGRAM_AGGREGATION=base2_exponential_bucket_histogram0 B
39EXPOSE map[8000/tcp:{}]0 B
40ENTRYPOINT ["./entrypoint.sh"]0 B

Command

 ARG RELEASE