Uh oh!
There was an error while loading. Please reload this page.
[charry-pick](branch3.0) support text hive - #41656
Conversation
doris-robot
commented
Oct 10, 2024
Thank you for your contribution to Apache Doris. Since 2024-03-18, the Document has been moved to doris-website. |
1. Support write hive text table 2. Add SessionVariable `hive_text_compression` to write compressed hive text table 3. Supported compression type: gzip, bzip2, snappy, lz4, zstd
followup apache#38549 If the large_block_len is 0, should not continue reading the block_len.
…#40291) ## Proposed changes related pr: apache#39700 support escape.delim and serialization.null.format for hive text
Impl ZstdDecompressor and support read hive text table which is compressed by zstd.
fcd45fe to
794c84cComparesuxiaogang223
commented
Oct 10, 2024
run buildall |
| ZstdDecompressor() : Decompressor(CompressType::ZSTD) {} | ||
| Status init() override; | ||
| private: |
There was a problem hiding this comment.
warning: redundant access specifier has the same accessibility as the previous access specifier [readability-redundant-access-specifiers]
| private: |
Additional context
be/src/exec/decompressor.h:149: previously declared here
private:
^| #pragma once | ||
| #include <gen_cpp/PlanNodes_types.h> |
There was a problem hiding this comment.
warning: 'gen_cpp/PlanNodes_types.h' file not found [clang-diagnostic-error]
#include<gen_cpp/PlanNodes_types.h>
^| } | ||
| } | ||
| void HiveCsvTextFieldSplitter::do_split(const Slice& line, std::vector<Slice>* splitted_values) { |
There was a problem hiding this comment.
warning: method 'do_split' can be made const [readability-make-member-function-const]
be/src/vec/exec/format/csv/csv_reader.cpp:177:
- values) {+ values) const {
Proposed changes
pick from master:
#40315
#40291
#40183
#38549