Skip to content

[Web UI] Remove no need loop in JobProgressListener - #18130

Closed
LiShuMing wants to merge 2 commits into
apache:masterfrom
LiShuMing:master
Closed

[Web UI] Remove no need loop in JobProgressListener#18130
LiShuMing wants to merge 2 commits into
apache:masterfrom
LiShuMing:master

Conversation

@LiShuMing

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

I found it's unnecessary to use the same loop twice, so changed them into one. It's a little change...

How was this patch tested?

./build/mvn -P... -Dtest=none -DwildcardSuites=org.apache.spark.ui.jobs.JobProgressListenerSuite test

@AmplabJenkins

Copy link
Copy Markdown

Can one of the admins verify this patch?

// If there's no information for a stage, store the StageInfo received from the scheduler
// so that we can display stage descriptions for pending stages:
for (stageInfo <- jobStart.stageInfos) {
stageIdToActiveJobIds.getOrElseUpdate(stageInfo.stageId,

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's not immediately clear to me they're equivalent. They'd have to contain the same set of stage IDs. Is it worth it?

@jiangxb1987

Copy link
Copy Markdown
Contributor

It seems to me that the older versions of SparkListenerJobStart don't store StageInfos, so it may be dangerous to apply this code change. @cloud-fan Should we close this?

@jerryshao

Copy link
Copy Markdown
Contributor

There's a JIRA planning to remove this JobProgressListener, so I'd suggest to not change this deprecated code unnecessarily.

@srowensrowen mentioned this pull request Jun 7, 2017
@asfgitasfgit closed this in b771fedJun 8, 2017
zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 22, 2025
# What changes were proposed in this pull request?
This PR proposes to close stale PRs, mostly the same instances with apache#18017Closesapache#11459Closesapache#13833Closesapache#13720Closesapache#12506Closesapache#12456Closesapache#12252Closesapache#17689Closesapache#17791Closesapache#18163Closesapache#17640Closesapache#17926Closesapache#18163Closesapache#12506Closesapache#18044Closesapache#14036Closesapache#15831Closesapache#14461Closesapache#17638Closesapache#18222
Added:
Closesapache#18045Closesapache#18061Closesapache#18010Closesapache#18041Closesapache#18124Closesapache#18130Closesapache#12217
Added:
Closesapache#16291Closesapache#17480Closesapache#14995
Added:
Closesapache#12835Closesapache#17141
## How was this patch tested?
N/A
Author: hyukjinkwon <gurwls223@gmail.com>
Closesapache#18223 from HyukjinKwon/close-stale-prs.
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@LiShuMing@AmplabJenkins@jiangxb1987@jerryshao@srowen