[SPARK-7591] [SQL] Partitioning support API tweaks by liancheng · Pull Request #6150 · apache/spark

liancheng · 2015-05-14T16:55:34Z

Please see SPARK-7591 for the details.

/cc @rxin @marmbrus @yhuai

…ck to ParquetRelation2

AmplabJenkins · 2015-05-14T16:57:10Z

Merged build triggered.

AmplabJenkins · 2015-05-14T16:57:17Z

Merged build started.

SparkQA · 2015-05-14T16:59:09Z

Test build #32713 has started for PR 6150 at commit 189ad23.

SparkQA · 2015-05-14T17:00:40Z

Test build #32713 has finished for PR 6150 at commit 189ad23.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

AmplabJenkins · 2015-05-14T17:00:41Z

Merged build finished. Test FAILed.

AmplabJenkins · 2015-05-14T17:00:41Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32713/
Test FAILed.

AmplabJenkins · 2015-05-14T17:17:11Z

Merged build triggered.

AmplabJenkins · 2015-05-14T17:17:17Z

Merged build started.

SparkQA · 2015-05-14T17:19:10Z

Test build #32714 has started for PR 6150 at commit 2fc680a.

SparkQA · 2015-05-14T18:18:12Z

Test build #32714 has finished for PR 6150 at commit 2fc680a.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

AmplabJenkins · 2015-05-14T18:18:16Z

Merged build finished. Test FAILed.

AmplabJenkins · 2015-05-14T18:18:17Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32714/
Test FAILed.

rxin · 2015-05-14T21:27:33Z

can the hive one reference this one?

Not sure whether this is a good idea, since we are trying to be Hive compatible... Definitions from official Hive code should be the "standard" here.

AmplabJenkins · 2015-05-15T06:07:16Z

Merged build triggered.

AmplabJenkins · 2015-05-15T06:07:24Z

Merged build started.

SparkQA · 2015-05-15T06:08:08Z

Test build #32781 has started for PR 6150 at commit 37d1738.

AmplabJenkins · 2015-05-15T07:17:12Z

Merged build triggered.

AmplabJenkins · 2015-05-15T07:17:20Z

Merged build started.

SparkQA · 2015-05-15T07:18:17Z

Test build #32794 has started for PR 6150 at commit 78b5eff.

SparkQA · 2015-05-15T07:19:56Z

Test build #32794 has finished for PR 6150 at commit 78b5eff.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

AmplabJenkins · 2015-05-15T07:19:58Z

Merged build finished. Test FAILed.

AmplabJenkins · 2015-05-15T07:19:59Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32794/
Test FAILed.

AmplabJenkins · 2015-05-15T07:42:10Z

Merged build triggered.

AmplabJenkins · 2015-05-15T07:42:15Z

Merged build started.

SparkQA · 2015-05-15T07:43:03Z

Test build #32798 has started for PR 6150 at commit af422e7.

SparkQA · 2015-05-15T08:02:16Z

Test build #32781 has finished for PR 6150 at commit 37d1738.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

AmplabJenkins · 2015-05-15T08:02:21Z

Merged build finished. Test PASSed.

AmplabJenkins · 2015-05-15T08:02:21Z

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32781/
Test PASSed.

liancheng · 2015-05-15T08:05:10Z

Merging to master and branch-1.4.

@rxin

Please see [SPARK-7591] [1] for the details. /cc rxin marmbrus yhuai [1]: https://issues.apache.org/jira/browse/SPARK-7591 Author: Cheng Lian <lian@databricks.com> Closes#6150 from liancheng/spark-7591 and squashes the following commits: af422e7 [Cheng Lian] Addresses @rxin's comments 37d1738 [Cheng Lian] Fixes HadoopFsRelation partition columns initialization 2fc680a [Cheng Lian] Fixes Scala style issue 189ad23 [Cheng Lian] Removes HadoopFsRelation constructor arguments 522c24e [Cheng Lian] Adds OutputWriterFactory 047d40d [Cheng Lian] Renames FSBased* to HadoopFs*, also renamed FSBasedParquetRelation back to ParquetRelation2 (cherry picked from commit fdf5bba) Signed-off-by: Cheng Lian <lian@databricks.com>

SparkQA · 2015-05-15T09:40:10Z

Test build #32798 has finished for PR 6150 at commit af422e7.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

AmplabJenkins · 2015-05-15T09:40:15Z

Merged build finished. Test PASSed.

AmplabJenkins · 2015-05-15T09:40:15Z

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32798/
Test PASSed.

@rxin

Please see [SPARK-7591] [1] for the details. /cc rxin marmbrus yhuai [1]: https://issues.apache.org/jira/browse/SPARK-7591 Author: Cheng Lian <lian@databricks.com> Closesapache#6150 from liancheng/spark-7591 and squashes the following commits: af422e7 [Cheng Lian] Addresses @rxin's comments 37d1738 [Cheng Lian] Fixes HadoopFsRelation partition columns initialization 2fc680a [Cheng Lian] Fixes Scala style issue 189ad23 [Cheng Lian] Removes HadoopFsRelation constructor arguments 522c24e [Cheng Lian] Adds OutputWriterFactory 047d40d [Cheng Lian] Renames FSBased* to HadoopFs*, also renamed FSBasedParquetRelation back to ParquetRelation2

@rxin

Please see [SPARK-7591] [1] for the details. /cc rxin marmbrus yhuai [1]: https://issues.apache.org/jira/browse/SPARK-7591 Author: Cheng Lian <lian@databricks.com> Closesapache#6150 from liancheng/spark-7591 and squashes the following commits: af422e7 [Cheng Lian] Addresses @rxin's comments 37d1738 [Cheng Lian] Fixes HadoopFsRelation partition columns initialization 2fc680a [Cheng Lian] Fixes Scala style issue 189ad23 [Cheng Lian] Removes HadoopFsRelation constructor arguments 522c24e [Cheng Lian] Adds OutputWriterFactory 047d40d [Cheng Lian] Renames FSBased* to HadoopFs*, also renamed FSBasedParquetRelation back to ParquetRelation2

@rxin

Please see [SPARK-7591] [1] for the details. /cc rxin marmbrus yhuai [1]: https://issues.apache.org/jira/browse/SPARK-7591 Author: Cheng Lian <lian@databricks.com> Closesapache#6150 from liancheng/spark-7591 and squashes the following commits: af422e7 [Cheng Lian] Addresses @rxin's comments 37d1738 [Cheng Lian] Fixes HadoopFsRelation partition columns initialization 2fc680a [Cheng Lian] Fixes Scala style issue 189ad23 [Cheng Lian] Removes HadoopFsRelation constructor arguments 522c24e [Cheng Lian] Adds OutputWriterFactory 047d40d [Cheng Lian] Renames FSBased* to HadoopFs*, also renamed FSBasedParquetRelation back to ParquetRelation2

liancheng added 3 commits May 14, 2015 16:38

Renames FSBased* to HadoopFs*, also renamed FSBasedParquetRelation ba…
047d40d
…ck to ParquetRelation2

Adds OutputWriterFactory
522c24e

Removes HadoopFsRelation constructor arguments
189ad23

Fixes Scala style issue
2fc680a

rxin reviewed May 14, 2015
View reviewed changes

Fixes HadoopFsRelation partition columns initialization
37d1738

Addresses@rxin's comments
af422e7

liancheng force-pushed the spark-7591 branch from 78b5eff to af422e7Compare May 15, 2015 07:37

asfgit closed this in fdf5bbaMay 15, 2015

liancheng mentioned this pull request May 15, 2015
[SPARK-2883] [SQL] ORC data source for Spark SQL #6194
Closed

Uh oh!

Conversation

liancheng commented May 14, 2015

Uh oh!

AmplabJenkins commented May 14, 2015

Uh oh!

AmplabJenkins commented May 14, 2015

Uh oh!

SparkQA commented May 14, 2015

Uh oh!

SparkQA commented May 14, 2015

Uh oh!

AmplabJenkins commented May 14, 2015

Uh oh!

AmplabJenkins commented May 14, 2015

Uh oh!

AmplabJenkins commented May 14, 2015

Uh oh!

AmplabJenkins commented May 14, 2015

Uh oh!

SparkQA commented May 14, 2015

Uh oh!

SparkQA commented May 14, 2015

Uh oh!

AmplabJenkins commented May 14, 2015

Uh oh!

AmplabJenkins commented May 14, 2015

Uh oh!

rxinMay 14, 2015

Choose a reason for hiding this comment

Uh oh!

lianchengMay 15, 2015

Choose a reason for hiding this comment

Uh oh!

AmplabJenkins commented May 15, 2015

Uh oh!

AmplabJenkins commented May 15, 2015

Uh oh!

SparkQA commented May 15, 2015

Uh oh!

AmplabJenkins commented May 15, 2015

Uh oh!

AmplabJenkins commented May 15, 2015

Uh oh!

SparkQA commented May 15, 2015

Uh oh!

SparkQA commented May 15, 2015

Uh oh!

AmplabJenkins commented May 15, 2015

Uh oh!

AmplabJenkins commented May 15, 2015

Uh oh!

AmplabJenkins commented May 15, 2015

Uh oh!

AmplabJenkins commented May 15, 2015

Uh oh!

SparkQA commented May 15, 2015

Uh oh!

SparkQA commented May 15, 2015

Uh oh!

AmplabJenkins commented May 15, 2015

Uh oh!

AmplabJenkins commented May 15, 2015

Uh oh!

liancheng commented May 15, 2015

Uh oh!

SparkQA commented May 15, 2015

Uh oh!

AmplabJenkins commented May 15, 2015

Uh oh!

AmplabJenkins commented May 15, 2015

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants