Uh oh!
There was an error while loading. Please reload this page.
[SPARK-21590][SS]Window start time should support negative values - #18903
[SPARK-21590][SS]Window start time should support negative values#18903KevinZwx wants to merge 4 commits into
Conversation
brkyvz
commented
Aug 11, 2017
ok to test |
| } | ||
| } | ||
| test("SPARK-21590: Start time works with negative values and return microseconds") { |
There was a problem hiding this comment.
could you also add a DataFrame test for this with a negative value? then I'll feel a lot more comfortable that we don't have to have the start offset as a positive number in the window calculation.
Look for DataFrameTimeWindowingSuite.scala
There was a problem hiding this comment.
Yeah thanks, I added some tests in DataFrameTimeWindowingSuite
brkyvz
commented
Aug 11, 2017
test this please |
KevinZwx
commented
Sep 6, 2017
test this please |
SparkQA
commented
Apr 23, 2018
Test build #4154 has finished for PR 18903 at commit
|
SparkQA
commented
May 13, 2018
Test build #4175 has finished for PR 18903 at commit
|
SparkQA
commented
May 14, 2018
Test build #4178 has finished for PR 18903 at commit
|
kiszk
commented
May 15, 2018
retest this please |
HyukjinKwon
commented
Jul 16, 2018
ok to test |
SparkQA
commented
Jul 16, 2018
Test build #93048 has finished for PR 18903 at commit
|
srowen
commented
Jul 17, 2018
Merged to master |
What changes were proposed in this pull request?
Remove the non-negative checks of window start time to make window support negative start time, and add a check to guarantee the absolute value of start time is less than slide duration.
How was this patch tested?
New unit tests.