Uh oh!
There was an error while loading. Please reload this page.
Reload credentials file config when app starts with checkpoint file i… - #17937
Reload credentials file config when app starts with checkpoint file i…#17937jiasheng55 wants to merge 1 commit into
Conversation
AmplabJenkins
commented
May 10, 2017
Can one of the admins verify this patch? |
jiasheng55
commented
May 10, 2017
Comments on last PR, #17782. |
jerryshao
commented
May 11, 2017
@Victor-Wong can you please update the PR title like other PRs? By seeing your description, seems the log is from old Spark version, in the latest Spark there's no Also I would guess some more internal configurations should be excluded from checkpoint, like "spark.yarn.credentials.renewalTime", "spark.yarn.credentials.updateTime". |
jerryshao
commented
May 11, 2017
Besides I guess this issue only exists in yarn cluster mode, can you also verify it? |
HyukjinKwon
commented
Jun 2, 2017
ping @Victor-Wong, how it is going? |
gatorsmile
commented
Jun 27, 2017
We are closing it due to inactivity. please do reopen if you want to push it forward. Thanks! |
jerryshao
commented
Jun 27, 2017
This is already fix in #18230 CC @gatorsmile . |
## What changes were proposed in this pull request? This PR proposes to close stale PRs, mostly the same instances with apache#18017 I believe the author in apache#14807 removed his account. Closesapache#7075Closesapache#8927Closesapache#9202Closesapache#9366Closesapache#10861Closesapache#11420Closesapache#12356Closesapache#13028Closesapache#13506Closesapache#14191Closesapache#14198Closesapache#14330Closesapache#14807Closesapache#15839Closesapache#16225Closesapache#16685Closesapache#16692Closesapache#16995Closesapache#17181Closesapache#17211Closesapache#17235Closesapache#17237Closesapache#17248Closesapache#17341Closesapache#17708Closesapache#17716Closesapache#17721Closesapache#17937 Added: Closesapache#14739Closesapache#17139Closesapache#17445Closesapache#18042Closesapache#18359 Added: Closesapache#16450Closesapache#16525Closesapache#17738 Added: Closesapache#16458Closesapache#16508Closesapache#17714 Added: Closesapache#17830Closesapache#14742 ## How was this patch tested? N/A Author: hyukjinkwon <gurwls223@gmail.com> Closesapache#18417 from HyukjinKwon/close-stale-pr.
What changes were proposed in this pull request?
Currently credentials file configuration is recovered from checkpoint file when Spark Streaming applicatioin is restarted, which will lead to some unwanted behaviors, for example:
Some useful logs are shown below :
How was this patch tested?
manual tests