Skip to content

[SPARK-23139]Read eventLog file with mixed encodings - #20304

Closed
hellodengfei wants to merge 2 commits into
apache:masterfrom
hellodengfei:master
Closed

[SPARK-23139]Read eventLog file with mixed encodings#20304
hellodengfei wants to merge 2 commits into
apache:masterfrom
hellodengfei:master

Conversation

@hellodengfei

Copy link
Copy Markdown

What changes were proposed in this pull request?

EventLog may contain mixed encodings such as custom exception message, but caused to replay failure

How was this patch tested?

manual test

@jiangxb1987

Copy link
Copy Markdown
Contributor

Can you also add test case for this?

@hellodengfei

Copy link
Copy Markdown
Author

Sorry, it's too late for UT.

@vanzin

Copy link
Copy Markdown
Contributor

Do you plan to address the feedback provided in jira about forcing UTF8 on the read and write paths?

@AmplabJenkins

Copy link
Copy Markdown

Can one of the admins verify this patch?

@HyukjinKwon

Copy link
Copy Markdown
Member

ping @hellodengfei

@HyukjinKwonHyukjinKwon mentioned this pull request Jul 16, 2018
zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 22, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@hellodengfei@jiangxb1987@vanzin@AmplabJenkins@HyukjinKwon