Skip to content

[MINOR][REFACTORING] KeyValueGroupedDataset.mapGroupsWithState uses flatMapGroupsWithState - #18642

Closed
jaceklaskowski wants to merge 1 commit into
apache:masterfrom
jaceklaskowski:mapGroupsWithState
Closed

[MINOR][REFACTORING] KeyValueGroupedDataset.mapGroupsWithState uses flatMapGroupsWithState#18642
jaceklaskowski wants to merge 1 commit into
apache:masterfrom
jaceklaskowski:mapGroupsWithState

Conversation

@jaceklaskowski

@jaceklaskowskijaceklaskowski commented Jul 15, 2017

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Refactored KeyValueGroupedDataset.mapGroupsWithState to use flatMapGroupsWithState explicitly (so it's clear that the former is almost the latter).

/cc @zsxwing@tdas

How was this patch tested?

local build

@SparkQA

Copy link
Copy Markdown

Test build #79633 has finished for PR 18642 at commit ce51466.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@jaceklaskowski

Copy link
Copy Markdown
ContributorAuthor

@zsxwing@tdas Your friendly reminder to give the change a nice review. I'd appreciate. Thanks.

@jaceklaskowski

Copy link
Copy Markdown
ContributorAuthor

@zsxwing@tdas Could you review the change and let me know what you think? I'd appreciate. Thanks.

groupingAttributes,
dataAttributes,
OutputMode.Update,
isMapGroupsWithState = true,

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change is not correct. It will set isMapGroupsWithState to false. However, looks like we don't have a unit test covering this :(

@gatorsmile

Copy link
Copy Markdown
Member

Since the fix is not right, @jaceklaskowski Could you close this PR?

@srowensrowen mentioned this pull request Nov 6, 2017
@asfgitasfgit closed this in ed1478cNov 7, 2017
@jaceklaskowski
jaceklaskowski deleted the mapGroupsWithState branch November 18, 2017 14:11
zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 22, 2025
Closesapache#11494Closesapache#14158Closesapache#16803Closesapache#16864Closesapache#17455Closesapache#17936Closesapache#19377
Added:
Closesapache#19380Closesapache#18642Closesapache#18377Closesapache#19632
Added:
Closesapache#14471Closesapache#17402Closesapache#17953Closesapache#18607
Also cc srowen vanzin HyukjinKwon gatorsmile cloud-fan to see if you have other PRs to close.
Author: Xingbo Jiang <xingbo.jiang@databricks.com>
Closesapache#19669 from jiangxb1987/stale-prs.
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@jaceklaskowski@SparkQA@gatorsmile@zsxwing