Uh oh!
There was an error while loading. Please reload this page.
[refactor](load): improve clarity of csv_reader error messages - #55864
Conversation
hello-stephen
commented
Sep 10, 2025
Thank you for your contribution to Apache Doris. Please clearly describe your PR:
|
kaijchen
commented
Sep 10, 2025
run buildall |
PR approved by at least one committer and no changes requested. |
PR approved by anyone and no changes requested. |
doris-robot
commented
Sep 10, 2025
TPC-H: Total hot run time: 34376 ms |
doris-robot
commented
Sep 10, 2025
TPC-DS: Total hot run time: 189871 ms |
doris-robot
commented
Sep 10, 2025
ClickBench: Total hot run time: 29.7 s |
hello-stephen
commented
Sep 10, 2025
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
hello-stephen
commented
Sep 10, 2025
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
kaijchen
commented
Sep 10, 2025
run buildall |
doris-robot
commented
Sep 10, 2025
TPC-H: Total hot run time: 34791 ms |
doris-robot
commented
Sep 10, 2025
TPC-DS: Total hot run time: 189100 ms |
doris-robot
commented
Sep 10, 2025
ClickBench: Total hot run time: 30.02 s |
doris-robot
commented
Sep 10, 2025
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
hello-stephen
commented
Sep 10, 2025
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
kaijchen
commented
Sep 11, 2025
run buildall |
doris-robot
commented
Sep 11, 2025
TPC-H: Total hot run time: 34508 ms |
doris-robot
commented
Sep 11, 2025
TPC-DS: Total hot run time: 186873 ms |
doris-robot
commented
Sep 11, 2025
ClickBench: Total hot run time: 29.6 s |
hello-stephen
commented
Sep 11, 2025
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
hello-stephen
commented
Sep 11, 2025
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
PR approved by at least one committer and no changes requested. |
Uh oh!
There was an error while loading. Please reload this page.
What problem does this PR solve?
Related PR: #25816
Problem Summary:
This commit refactors two common error messages reported by the CSV reader to be clearer, more concise, and less redundant. This improves log readability and helps users diagnose data loading issues more efficiently.
Column Count Mismatch Error:
The previous error was excessively verbose, printing a large data buffer. It is now a single, direct line stating the problem with the expected vs. actual counts and a truncated sample.
actual column number in csv file is more than schema column number.actual number: 19, schema column number: 18; ... result values:[...VERY LONG DATA DUMP...]Column count mismatch: expected 18, but found 19 (sep:| delim:\n). Src line: 57|2023-08-19|TRUE|...Invalid File Encoding Error:
The error for non-UTF-8 files was repetitive. It is now a single, direct statement of the requirement.
Unable to display, only support csv data in utf8 codec, please check the data encodingInvalid file encoding: all CSV files must be UTF-8 encodedRelease note
None
Check List (For Author)
Test
Behavior changed:
Does this need documentation?
Check List (For Reviewer who merge this PR)