Skip to content

[Broker Load] Ignore empty file when file format is parquet or orc. - #4810

Merged
yangzhg merged 4 commits into
apache:masterfrom
morningman:ignore_empty_file
Nov 10, 2020
Merged

[Broker Load] Ignore empty file when file format is parquet or orc.#4810
yangzhg merged 4 commits into
apache:masterfrom
morningman:ignore_empty_file

Conversation

@morningman

@morningmanmorningman commented Oct 28, 2020•
edited
Loading

Copy link
Copy Markdown
Contributor

Proposed changes

We can not read empty parquet or orc format file. So we should skip them
when doing broker load.

Types of changes

  • Bugfix (non-breaking change which fixes an issue)

Checklist

@morningman
[Broker Load] Ignore empty file when file format is parquet or orc.
2a759ae
We can not ready empty parquet or orc format file. So we should skip them
when doing broker load.
@morningmanmorningman added the kind/fix Categorizes issue or PR as related to a bug. label Oct 28, 2020
@morningmanmorningman self-assigned this Oct 28, 2020
@morningmanmorningman added the area/load Issues or PRs related to all kinds of load label Oct 28, 2020
kangkaisen
kangkaisen reviewed Oct 30, 2020
View reviewed changes
Comment threadfe/fe-core/src/main/java/org/apache/doris/load/loadv2/BrokerLoadPendingTask.java Outdated
kangkaisen
kangkaisen approved these changes Nov 9, 2020
View reviewed changes

@kangkaisenkangkaisen left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@kangkaisenkangkaisen added the approved Indicates a PR has been approved by one committer. label Nov 9, 2020
@yangzhg
yangzhg merged commit 53c570a into apache:masterNov 10, 2020
@yangzhgyangzhg mentioned this pull request Feb 9, 2021
Closed
yiguolei pushed a commit to yiguolei/incubator-doris that referenced this pull request Sep 28, 2025
@dataroaring
Revert "branch-selectdb-doris-3.0: [fix](es) Fix array not supporting…
00cf24d
… json subtype apache#55738" (apache#4810)
Reverts selectdb/selectdb-core#4667
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@kangkaisenkangkaisenkangkaisen approved these changes

Assignees

@morningmanmorningman

Labels

approvedIndicates a PR has been approved by one committer.area/loadIssues or PRs related to all kinds of loadkind/fixCategorizes issue or PR as related to a bug.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[Load] Error when reading empty Parquet or Orc files

3 participants

@morningman@kangkaisen@yangzhg