Skip to content

[SPARK-22191] [SQL] Add hive serde example with serde properties - #19420

Closed
crlalam wants to merge 2 commits into
apache:masterfrom
crlalam:SPARK-22191
Closed

[SPARK-22191] [SQL] Add hive serde example with serde properties#19420
crlalam wants to merge 2 commits into
apache:masterfrom
crlalam:SPARK-22191

Conversation

@crlalam

Copy link
Copy Markdown

What changes were proposed in this pull request?

Added an example for, specifying serde with serde properties for hive tables using OPTIONS.

How was this patch tested?

Verified manually by running examples with run-example.sh. Verified in Scala, java and python.

// $example off:spark_hive$

// Hive serde's are also supported with serde properties.
String sqlQuery = "CREATE TABLE src_serde(key decimal(38,18), value int) USING hive"

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi, @crlalam.
We use 2-space indentation in general.
FYI, maybe, you can see Scala Coding Style.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @dongjoon-hyun ,
Thanks for the review and pointing me to the coding style. Fixed coding style issues and updated the pull request. Please take a look.

@holdenk

Copy link
Copy Markdown
Contributor

Jenkins OK to test

// $example off:spark_hive$

// Hive serde's are also supported with serde properties.
String sqlQuery = "CREATE TABLE src_serde(key decimal(38,18), value int) USING hive" +

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The indentation here doesn't match the rest of the function.

@holdenk

Copy link
Copy Markdown
Contributor

I love more examples, but is there a place we plan to put this in the documentation?

@AmplabJenkins

Copy link
Copy Markdown

Can one of the admins verify this patch?

@HyukjinKwon

Copy link
Copy Markdown
Member

ping @crlalam for @holdenk's comment.

@HyukjinKwonHyukjinKwon mentioned this pull request Jul 16, 2018
zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 22, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@crlalam@holdenk@AmplabJenkins@HyukjinKwon@dongjoon-hyun