Skip to content

[SPARK-5193][SQL] Tighten up SQLContext API - #4049

Closed
rxin wants to merge 3 commits into
apache:masterfrom
rxin:sqlContext-refactor
Closed

[SPARK-5193][SQL] Tighten up SQLContext API#4049
rxin wants to merge 3 commits into
apache:masterfrom
rxin:sqlContext-refactor

Conversation

@rxin

@rxinrxin commented Jan 14, 2015

Copy link
Copy Markdown
Contributor
  1. Removed 2 implicits (logicalPlanToSparkQuery and baseRelationToSchemaRDD)
  2. Moved extraStrategies into ExperimentalMethods.
  3. Made private methods protected[sql] so they don't show up in javadocs.
  4. Removed createParquetFile.
  5. Added Java version of applySchema to SQLContext.

@rxin
[SPARK-5193][SQL] Tighten up SQLContext API
4a38c9b
1. Removed 2 implicits (logicalPlanToSparkQuery and baseRelationToSchemaRDD)
2. Moved extraStrategies into ExperimentalMethods.
3. Made private methods protected[sql] so they don't show up in javadocs.
@SparkQA

SparkQA commented Jan 14, 2015

Copy link
Copy Markdown

Test build #25564 has started for PR 4049 at commit 4a38c9b.

  • This patch merges cleanly.

@SparkQA

SparkQA commented Jan 14, 2015

Copy link
Copy Markdown

Test build #25564 has finished for PR 4049 at commit 4a38c9b.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class ExperimentalMethods protected[sql](sqlContext: SQLContext)

@AmplabJenkins

AmplabJenkins commented Jan 14, 2015

Copy link
Copy Markdown

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25564/
Test PASSed.

@SparkQA

SparkQA commented Jan 15, 2015

Copy link
Copy Markdown

Test build #25583 has started for PR 4049 at commit ecd6685.

  • This patch merges cleanly.

@SparkQA

SparkQA commented Jan 15, 2015

Copy link
Copy Markdown

Test build #25584 has started for PR 4049 at commit a326a1a.

  • This patch merges cleanly.

@rxin

rxin commented Jan 15, 2015

Copy link
Copy Markdown
ContributorAuthor

@marmbrus this is ready for review.

@SparkQA

SparkQA commented Jan 15, 2015

Copy link
Copy Markdown

Test build #25583 has finished for PR 4049 at commit ecd6685.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class ExperimentalMethods protected[sql](sqlContext: SQLContext)

@AmplabJenkins

AmplabJenkins commented Jan 15, 2015

Copy link
Copy Markdown

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25583/
Test PASSed.

@SparkQA

SparkQA commented Jan 15, 2015

Copy link
Copy Markdown

Test build #25584 has finished for PR 4049 at commit a326a1a.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class ExperimentalMethods protected[sql](sqlContext: SQLContext)

@AmplabJenkins

AmplabJenkins commented Jan 15, 2015

Copy link
Copy Markdown

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25584/
Test PASSed.

@rxinrxin mentioned this pull request Jan 16, 2015
Closed
asfgit pushed a commit that referenced this pull request Jan 17, 2015
@rxin
[SPARK-5193][SQL] Remove Spark SQL Java-specific API.
61b427d
After the following patches, the main (Scala) API is now usable for Java users directly.
#4056#4054#4049#4030#3965#3958
Author: Reynold Xin <rxin@databricks.com>
Closes#4065 from rxin/sql-java-api and squashes the following commits:
b1fd860 [Reynold Xin] Fix Mima
6d86578 [Reynold Xin] Ok one more attempt in fixing Python...
e8f1455 [Reynold Xin] Fix Python again...
3e53f91 [Reynold Xin] Fixed Python.
83735da [Reynold Xin] Fix BigDecimal test.
e9f1de3 [Reynold Xin] Use scala BigDecimal.
500d2c4 [Reynold Xin] Fix Decimal.
ba3bfa2 [Reynold Xin] Updated javadoc for RowFactory.
c4ae1c5 [Reynold Xin] [SPARK-5193][SQL] Remove Spark SQL Java-specific API.
andmarios pushed a commit to andmarios/spark-examples that referenced this pull request Mar 20, 2015
@rxin
[SPARK-5193][SQL] Remove Spark SQL Java-specific API.
3364cc8
After the following patches, the main (Scala) API is now usable for Java users directly.
apache/spark#4056apache/spark#4054apache/spark#4049apache/spark#4030apache/spark#3965apache/spark#3958
Author: Reynold Xin <rxin@databricks.com>
Closes #4065 from rxin/sql-java-api and squashes the following commits:
b1fd860 [Reynold Xin] Fix Mima
6d86578 [Reynold Xin] Ok one more attempt in fixing Python...
e8f1455 [Reynold Xin] Fix Python again...
3e53f91 [Reynold Xin] Fixed Python.
83735da [Reynold Xin] Fix BigDecimal test.
e9f1de3 [Reynold Xin] Use scala BigDecimal.
500d2c4 [Reynold Xin] Fix Decimal.
ba3bfa2 [Reynold Xin] Updated javadoc for RowFactory.
c4ae1c5 [Reynold Xin] [SPARK-5193][SQL] Remove Spark SQL Java-specific API.
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@rxin@SparkQA@AmplabJenkins