Skip to content

[Bug] IcebergScanNode throws exception "Split size must be > 0: 0" #44573

Description

@wenwj0

Search before asking

  • I had searched in the issues and found no similar issues.

Version

Doris 2.1.6

What's Wrong?

After I upgrade doris from 2.1.5 to 2.1.6, I occasionally encountered an exception when querying iceberg table.

image

The exception may be thrown in org.apache.iceberg.util.TableScanUtil

publicstaticCloseableIterable<FileScanTask> splitFiles(CloseableIterable<FileScanTask> tasks, longsplitSize) {
Preconditions.checkArgument(splitSize > 0L, "Split size must be > 0: %s", splitSize);
Iterable<FileScanTask> splitTasks = FluentIterable.from(tasks).transformAndConcat((input) -> {
returninput.split(splitSize);
});
returnCloseableIterable.combine(splitTasks, tasks);
}

What You Expected?

Expect no exeception

How to Reproduce?

QuerySQL is

SELECT*FROMdoris_hive_xxx.xxx.ods_xxx_event_iceberg_day LIMIT10;

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions