Sign inSign up

apache/spark-py:v3.4.0

Multi-platform
Languages & frameworks
Machine learning & AI
Data science
Index digest

sha256:5f6a8d82dd2667cedcdeb10d3c899ce2b91bc4e1c1bfc0abbc903829291ced6b

OS/ARCH

Compressed size

518.65 MB

Last pushed

over 3 years by dongjoon

Type

Image

Manifest digest

sha256:ade5bd162225f81e9891d08574651e182d7c96028996b236276af4004793c033

Image Layers

Image Layers

1ARG RELEASE0 B
2ARG LAUNCHPAD_BUILD_ARCH0 B
3LABEL org.opencontainers.image.ref.name=ubuntu0 B
4LABEL org.opencontainers.image.version=22.040 B
5ADD file ... in / 27.07 MB
6CMD ["/bin/bash"]0 B
7ENV JAVA_HOME=/opt/java/openjdk0 B
8ENV PATH=/opt/java/openjdk/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin0 B
9ENV LANG=en_US.UTF-8 LANGUAGE=en_US:en LC_ALL=en_US.UTF-80 B
10/bin/sh -c apt-get update 17.55 MB
11ENV JAVA_VERSION=jdk-17.0.6+100 B
12/bin/sh -c set -eux; 44.27 MB
13/bin/sh -c echo Verifying install159 B
14ARG spark_uid=1850 B
15RUN |1 spark_uid=185 /bin/sh -c20.11 MB
16COPY jars /opt/spark/jars # buildkit293.44 MB
17COPY bin /opt/spark/bin # buildkit10.56 KB
18COPY sbin /opt/spark/sbin # buildkit7.17 KB
19COPY kubernetes/dockerfiles/spark/entrypoint.sh /opt/ # buildkit1.81 KB
20COPY kubernetes/dockerfiles/spark/decom.sh /opt/ # buildkit945 B
21COPY examples /opt/spark/examples # buildkit1.67 MB
22COPY kubernetes/tests /opt/spark/tests # buildkit2.24 KB
23COPY data /opt/spark/data # buildkit356.14 KB
24ENV SPARK_HOME=/opt/spark0 B
25WORKDIR /opt/spark/work-dir32 B
26RUN |1 spark_uid=185 /bin/sh -c148 B
27RUN |1 spark_uid=185 /bin/sh -c32 B
28ENTRYPOINT ["/opt/entrypoint.sh"]0 B
29USER 1850 B
30WORKDIR /0 B
31USER 00 B
32RUN /bin/sh -c mkdir ${SPARK_HOME}/python145 B
33RUN /bin/sh -c apt-get update110.75 MB
34COPY python/pyspark /opt/spark/python/pyspark # buildkit1.54 MB
35COPY python/lib /opt/spark/python/lib # buildkit1.88 MB
36WORKDIR /opt/spark/work-dir32 B
37ENTRYPOINT ["/opt/entrypoint.sh"]0 B
38ARG spark_uid=1850 B
39USER 1850 B

Command

 ARG RELEASE