[SPARK-22866] [K8S] Fix path issue in Kubernetes dockerfile

[foxish]

What changes were proposed in this pull request?

The path was recently changed in #19946, but the dockerfile was not updated.
This is a trivial 1 line fix.

How was this patch tested?

./sbin/build-push-docker-images.sh -r spark-repo -t latest build

cc/ @vanzin@mridulm@rxin@jiangxb1987@liyinan926

[mridulm]

Do you mean this ? https://github.com/apache/spark/pull/19946/files#diff-cb1784535ec45c5b890bb16c5971be65R26

[foxish]

Yes, to elaborate, on our fork, we used to have dockerfiles/ in the root of the built distribution. But now, it's copied to kubernetes/dockerfiles which is a more logical place, since there is a yarn/ in the distribution as well.

[mridulm]

A grep indicates this is the full list:

• ./resource-managers/kubernetes/docker/src/main/dockerfiles/driver/Dockerfile:# docker build -t spark-driver:latest -f dockerfiles/spark-base/Dockerfile .
• ./resource-managers/kubernetes/docker/src/main/dockerfiles/spark-base/Dockerfile:# docker build -t spark-base:latest -f dockerfiles/spark-base/Dockerfile .
• ./resource-managers/kubernetes/docker/src/main/dockerfiles/spark-base/Dockerfile:COPY dockerfiles/spark-base/entrypoint.sh /opt/
• ./resource-managers/kubernetes/docker/src/main/dockerfiles/executor/Dockerfile:# docker build -t spark-executor:latest -f dockerfiles/spark-base/Dockerfile .

[foxish]

@mridulm thanks for looking into it! Looks like I missed updating the dockerfile comments. On it.

[foxish]

Done, comments updated. I'm setting up CI on the Kubernetes test infrastructure this week - should help catch these issues early on in future.

[mridulm]

Merged, thanks @foxish

[SparkQA]

Test build #85294 has finished for PR 20051 at commit f631331.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #85297 has finished for PR 20051 at commit 657b48a.

• This patch fails due to an unknown error code, -9.
• This patch merges cleanly.
• This patch adds no public classes.