Uh oh!
There was an error while loading. Please reload this page.
[SPARK-17177][SQL] Make grouping columns accessible from RelationalGroupedDataset - #14742
[SPARK-17177][SQL] Make grouping columns accessible from RelationalGroupedDataset#14742NarineK wants to merge 4 commits into
RelationalGroupedDataset#14742Conversation
SparkQA
commented
Aug 21, 2016
Test build #64169 has finished for PR 14742 at commit
|
NarineK
commented
Aug 22, 2016
cc: @shivaram, @liancheng |
NarineK
commented
Sep 6, 2016
@liancheng, @rxin, Do you think adding |
| * | ||
| * @since 2.1.0 | ||
| */ | ||
| def columns: Array[String] = { |
There was a problem hiding this comment.
This might not be a column (a named expression). Thus, this might not be useful to end users.
gatorsmile
commented
Jun 13, 2017
Could we please close this PR now? |
SparkQA
commented
Jun 14, 2017
Test build #78035 has started for PR 14742 at commit |
AmplabJenkins
commented
Jun 14, 2017
Test FAILed. |
NarineK
commented
Jun 19, 2017
Hi @gatorsmile, #14431 depends on this. Is there a way I can access the grouping columns from |
gatorsmile
commented
Jun 19, 2017
Let us close this one. We can discuss how to resolve the issue in #14431 |
yes, we can close this, but it would be great if you could help us to find a way to access the grouping columns from SparkR in #14431 |
## What changes were proposed in this pull request? This PR proposes to close stale PRs, mostly the same instances with apache#18017 I believe the author in apache#14807 removed his account. Closesapache#7075Closesapache#8927Closesapache#9202Closesapache#9366Closesapache#10861Closesapache#11420Closesapache#12356Closesapache#13028Closesapache#13506Closesapache#14191Closesapache#14198Closesapache#14330Closesapache#14807Closesapache#15839Closesapache#16225Closesapache#16685Closesapache#16692Closesapache#16995Closesapache#17181Closesapache#17211Closesapache#17235Closesapache#17237Closesapache#17248Closesapache#17341Closesapache#17708Closesapache#17716Closesapache#17721Closesapache#17937 Added: Closesapache#14739Closesapache#17139Closesapache#17445Closesapache#18042Closesapache#18359 Added: Closesapache#16450Closesapache#16525Closesapache#17738 Added: Closesapache#16458Closesapache#16508Closesapache#17714 Added: Closesapache#17830Closesapache#14742 ## How was this patch tested? N/A Author: hyukjinkwon <gurwls223@gmail.com> Closesapache#18417 from HyukjinKwon/close-stale-pr.
What changes were proposed in this pull request?
Currently, once we create
RelationalGroupedDataset, we cannot access the grouping columns from its instance.Analog to
Datasetwe can have a public method which returns the list of grouping columns.https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala#L457
This can be useful for instance in SparkR when we want to have certain logic associated with the grouping columns, accessible from
RelationalGroupedDataset.Similar to
Dataset.columnsI've addedRelationalGroupedDataset.columnsmethod which makes grouping column names accessible.How was this patch tested?
Unit tests in
DataFrameAggregateSuite