Uh oh!
There was an error while loading. Please reload this page.
[SPARK-14265] Get attempId of stage and transfer it to web - #12059
[SPARK-14265] Get attempId of stage and transfer it to web#12059KaiXinXiaoLei wants to merge 4 commits into
Conversation
SparkQA
commented
Mar 30, 2016
Test build #54506 has finished for PR 12059 at commit
|
holdenk
commented
Apr 19, 2016
My guess is that the PySpark test failure was unrelated, jenkins retest this please. |
holdenk
commented
Apr 19, 2016
cc @ajbozarth who has been working on a number of Spark UI changes lately. |
SparkQA
commented
Apr 19, 2016
Test build #56178 has finished for PR 12059 at commit
|
KaiXinXiaoLei
commented
Apr 19, 2016
@ajbozarth help me check, thanks |
ajbozarth
commented
Apr 19, 2016
I'll take a look this afternoon |
ajbozarth
commented
Apr 20, 2016
I'll have to take a look tomorrow, I've been blocked by local env issues all afternoon |
ajbozarth
commented
Apr 20, 2016
I can't seem to recreate the problem you're fixing so my input is limited. Just looking over your code though I don't see any glaring issues. Sorry I can't be more help. |
SparkQA
commented
Jul 26, 2016
Test build #62866 has finished for PR 12059 at commit
|
ajbozarth
commented
Feb 23, 2017
@KaiXinXiaoLei this pr has been stale for a long time, is this still an issue you wan to fix? If not could you close it? |
Closesapache#16819Closesapache#13467Closesapache#16083Closesapache#17135Closesapache#8785Closesapache#16278Closesapache#16997Closesapache#17073Closesapache#17220 Added: Closesapache#12059Closesapache#12524Closesapache#12888Closesapache#16061 Author: Sean Owen <sowen@cloudera.com> Closesapache#17386 from srowen/StalePRs.
What changes were proposed in this pull request?
if a stage is failed and attempt to start again, DAG visualization does not render correctly for this stage. Because in spark-dag-viz.js, the link of stage is ("#stage-" + stageId + "-" + attemptId), and the value of attemptId is 0 . So I think the attemptId of stage sholike this: stageopening spark web, the attemptId of stage should be transfer to web, and make the link of ("#stage-" + stageId + "-" + attemptId) is correct.
How was this patch tested?
Please test as fellow. Run spark app, and kill executor to make stage reSubmitted. Then check DAG visualization in web.