Uh oh!
There was an error while loading. Please reload this page.
[SPARK-19974][Block Manager] in-memory LRU for partitions of multiple RDDs testcase did a get that is no sense - #17313
[SPARK-19974][Block Manager] in-memory LRU for partitions of multiple RDDs testcase did a get that is no sense#17313jianran wants to merge 3 commits into
Conversation
AmplabJenkins
commented
Mar 16, 2017
Can one of the admins verify this patch? |
srowen
commented
Mar 16, 2017
I don't understand why you say this test doesn't make sense. The assertion is correct. You say you think the second assertion should always pass, but, isn't that the purpose of the test? |
jianran
commented
Mar 17, 2017
I am sorry,you are right, the second assertion is ok; but what do you think about the assertion comment:Do a get() on rdd_0_2 so that it is the most recently used item, what is the purpose of the test? lru or same rdd rule ; the reason for rdd_0_2 should not be dropped is the same rdd rule, not the comment said Do a get() on rdd_0_2 so that it is the most recently used item, so i think the comment is wrong or the assertion is wrong; I am sorry, if the purpose of the test is only to test rdd_0_2 was not in store, it is ok, I didn't understand the purpose or the comment of the assertion, I am sorry; |
srowen
commented
Mar 20, 2017
I'm also not sure about the intent of these lines and it is possible the comment doesn't quite reflect the call that follows because it refers to get(). However it seems like the tests are still valid. Unless you know they are wrong yet pass then i would leave it. |
jianran
commented
Mar 21, 2017
do you agree remove the comment is more appreciable? can i only remove the comment? |
srowen
commented
Mar 21, 2017
Unless we are sure, I don't think it is worth changing. |
Closesapache#11785Closesapache#13027Closesapache#13614Closesapache#13761Closesapache#15197Closesapache#14006Closesapache#12576Closesapache#15447Closesapache#13259Closesapache#15616Closesapache#14473Closesapache#16638Closesapache#16146Closesapache#17269Closesapache#17313Closesapache#17418Closesapache#17485Closesapache#17551Closesapache#17463Closesapache#17625Closesapache#10739Closesapache#15193Closesapache#15344Closesapache#14804Closesapache#16993Closesapache#17040Closesapache#15180Closesapache#17238
This pr proposed to close stale PRs. Currently, we have 400+ open PRs and there are some stale PRs whose JIRA tickets have been already closed and whose JIRA tickets does not exist (also, they seem not to be minor issues). // Open PRs whose JIRA tickets have been already closed Closesapache#11785Closesapache#13027Closesapache#13614Closesapache#13761Closesapache#15197Closesapache#14006Closesapache#12576Closesapache#15447Closesapache#13259Closesapache#15616Closesapache#14473Closesapache#16638Closesapache#16146Closesapache#17269Closesapache#17313Closesapache#17418Closesapache#17485Closesapache#17551Closesapache#17463Closesapache#17625 // Open PRs whose JIRA tickets does not exist and they are not minor issues Closesapache#10739Closesapache#15193Closesapache#15344Closesapache#14804Closesapache#16993Closesapache#17040Closesapache#15180Closesapache#17238 N/A Author: Takeshi Yamamuro <yamamuro@apache.org> Closesapache#17734 from maropu/resolved_pr. Change-Id: Id2e590aa7283fe5ac01424d30a40df06da6098b5
## What changes were proposed in this pull request? This pr proposed to close stale PRs. Currently, we have 400+ open PRs and there are some stale PRs whose JIRA tickets have been already closed and whose JIRA tickets does not exist (also, they seem not to be minor issues). // Open PRs whose JIRA tickets have been already closed Closesapache#11785Closesapache#13027Closesapache#13614Closesapache#13761Closesapache#15197Closesapache#14006Closesapache#12576Closesapache#15447Closesapache#13259Closesapache#15616Closesapache#14473Closesapache#16638Closesapache#16146Closesapache#17269Closesapache#17313Closesapache#17418Closesapache#17485Closesapache#17551Closesapache#17463Closesapache#17625 // Open PRs whose JIRA tickets does not exist and they are not minor issues Closesapache#10739Closesapache#15193Closesapache#15344Closesapache#14804Closesapache#16993Closesapache#17040Closesapache#15180Closesapache#17238 ## How was this patch tested? N/A Author: Takeshi Yamamuro <yamamuro@apache.org> Closesapache#17734 from maropu/resolved_pr.
What changes were proposed in this pull request?
in-memory LRU for partitions of multiple RDDs testcase did a get that is no sense; rdd_0_2 is the most recently used item that isn't the reason the rdd_0_2 is remain;
store.getSingleAndReleaseLock(rdd(0, 2)).isDefinedas same as the previous linestore.memoryStore.contains(rdd(0, 2)), so remove the no sense codeHow was this patch tested?
run the test
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)
Please review http://spark.apache.org/contributing.html before opening a pull request.