[SPARK-47573][K8S] Support custom driver log url - #45728

Closed

EnricoMi wants to merge 17 commits into

apache:masterfrom

G-Research-Forks:k8s-custom-driver-log-url

Commits on Apr 28, 2025

Add option to set custom driver log url with pattern replacement
EnricoMi
committed
ae0f6f5
Support custom driver log urls
EnricoMi
committed
4a79b33
[SPARK-41667][K8S] Expose env var SPARK_DRIVER_POD_NAME in Driver Pod

pan3793
authored and
EnricoMi
committed
af0c1e8
Add pod name variable
EnricoMi
committed
87348a8
Add option to docs
EnricoMi
committed
fd89780
Add unit tests
EnricoMi
committed
bcd461e
Fix case of 'Spark' in option description
EnricoMi
committed
5367325
Refer to driver in docs, not executor
EnricoMi
committed
d285382
Revert documentation fixes
EnricoMi
committed
eb80803
Inject driver log url attributes via env vars if spark.ui.custom.driver.log.url set
EnricoMi
committed
4c2fa5d
Revert "[SPARK-41667][K8S] Expose env var SPARK_DRIVER_POD_NAME in Driver Pod"
EnricoMi
committed
a0971c3
Add some SPARK_DRIVER_ATTRIBUTE_* if CUSTOM_DRIVER_LOG_URL is set
EnricoMi
committed
e31336f
Amend docs
EnricoMi
committed
cd21fe0
Move getDriverLogUrls impl from CoarseGrainedSchedulerBackend to KubernetesClusterSchedulerBackend
EnricoMi
committed
06c141f
Prefix unit tests with SPARK ticket number
EnricoMi
committed
28e86c4
Move spark.executor.ExecutorLogUrlHandler to spark.LogUrlHandler
EnricoMi
committed
aebcc62
Update since-version
EnricoMi
committed
a974eb6