Skip to content

[Bug] core dump on compaction #11334

Description

@BiteTheDDDDt

Search before asking

  • I had searched in the issues and found no similar issues.

Version

master

What's Wrong?

CREATETABLEtest_sys_materialized_view_2_test_delete_with_mv_db.test_sys_materialized_view_2_test_delete_with_mv_tb ( k0 BOOLEANNOT NULL, k1 TINYINT NOT NULL, k2 SMALLINTNOT NULL, k3 INTNOT NULL, k4 BIGINTNOT NULL, k5 LARGEINT NOT NULL, k6 DECIMAL(9,3) NOT NULL, k7 CHAR(5) NOT NULL, k8 DATENOT NULL, k9 DATETIME NOT NULL, k10 VARCHAR(20) NOT NULL, k11 DOUBLE NOT NULL, k12 FLOAT NOT NULL ) PARTITION BY RANGE(k1) ( PARTITION p1 VALUES LESS THAN ("-10"), PARTITION p2 VALUES LESS THAN ("0"), PARTITION p3 VALUES LESS THAN ("10"), PARTITION p4 VALUES LESS THAN ("20") ) DISTRIBUTED BY HASH(k4, k5) BUCKETS 10 properties("replication_num"="1");
CREATE MATERIALIZED VIEW test_sys_materialized_view_2_test_delete_with_mv_index ASSELECT k0, max(k9), min(k11), sum(k12), count(k10), hll_union(hll_hash(k7)), bitmap_union(to_bitmap(k2)) fromtest_sys_materialized_view_2_test_delete_with_mv_db.test_sys_materialized_view_2_test_delete_with_mv_tbgroup by k0;
load baseall.txtDELETEFROMtest_sys_materialized_view_2_test_delete_with_mv_db.test_sys_materialized_view_2_test_delete_with_mv_tb PARTITION p3 WHERE k0 ="0";
F072914:34:34.18457836127 column.h:189] Method insert_many_fix_len_data is not supported forHLL
*** Query id: 0-0 ***
*** Aborted at 1659076474 (unix time) try"date -d @1659076474"if you are usingGNU date ***
*** Current BE git commitID: fd0e2d3 ***
*** SIGABRT unkown detail explain (@0x1f500008bea) received by PID 35818 (TID0x7f8e62d4f700) from PID 35818; stack trace: ***
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris-release/be/src/common/signal_handler.h:4201# 0x00007F8ED2661920 in /lib64/libc.so.62# __GI_raise in /lib64/libc.so.63# abort in /lib64/libc.so.64# 0x0000559A41D0F289 in /home/disk1/palo-qa/teamcity/local/9137/PALO-BE/be/lib/doris_be
5# 0x0000559A41D0489D at src/logging.cc:16506# google::LogMessage::SendToLog() at src/logging.cc:16077# google::LogMessage::Flush() at src/logging.cc:14778# google::LogMessageFatal::~LogMessageFatal() at src/logging.cc:22279# doris::vectorized::IColumn::insert_many_fix_len_data(charconst*, unsignedlong) at /root/doris-release/be/src/vec/columns/column.h:18910# doris::segment_v2::BitShufflePageDecoder<(doris::FieldType)15>::read_by_rowids(unsignedintconst*, unsignedlong, unsignedlong*, COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>&) at /root/doris-release/be/src/olap/rowset/segment_v2/bitshuffle_page.h:42311# doris::segment_v2::FileColumnIterator::read_by_rowids(unsignedintconst*, unsignedlong, COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>&) at /root/doris-release/be/src/olap/rowset/segment_v2/column_reader.cpp:78112# doris::segment_v2::SegmentIterator::_read_columns_by_rowids(std::vector<unsignedint, std::allocator<unsignedint> >&, std::vector<unsignedint, std::allocator<unsignedint> >&, unsignedshort*, unsignedlong, std::vector<COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>, std::allocator<COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn> > >*) at /root/doris-release/be/src/olap/rowset/segment_v2/segment_iterator.cpp:101513# doris::segment_v2::SegmentIterator::next_batch(doris::vectorized::Block*) at /root/doris-release/be/src/olap/rowset/segment_v2/segment_iterator.cpp:112114# doris::BetaRowsetReader::next_block(doris::vectorized::Block*) at /root/doris-release/be/src/olap/rowset/beta_rowset_reader.cpp:20515# doris::vectorized::VCollectIterator::Level0Iterator::_refresh_current_row() at /root/doris-release/be/src/vec/olap/vcollect_iterator.cpp:20916# doris::vectorized::VCollectIterator::Level0Iterator::init() at /root/doris-release/be/src/vec/olap/vcollect_iterator.cpp:19417# doris::vectorized::VCollectIterator::build_heap(std::vector<std::shared_ptr<doris::RowsetReader>, std::allocator<std::shared_ptr<doris::RowsetReader> > >&) at /root/doris-release/be/src/vec/olap/vcollect_iterator.cpp:7218# doris::vectorized::BlockReader::_init_collect_iter(doris::TabletReader::ReaderParams const&, std::vector<std::shared_ptr<doris::RowsetReader>, std::allocator<std::shared_ptr<doris::RowsetReader> > >*) at /root/doris-release/be/src/vec/olap/block_reader.cpp:6319# doris::vectorized::BlockReader::init(doris::TabletReader::ReaderParams const&) at /root/doris-release/be/src/vec/olap/block_reader.cpp:13520# doris::Merger::vmerge_rowsets(std::shared_ptr<doris::Tablet>, doris::ReaderType, doris::TabletSchema const*, std::vector<std::shared_ptr<doris::RowsetReader>, std::allocator<std::shared_ptr<doris::RowsetReader> > > const&, doris::RowsetWriter*, doris::Merger::Statistics*) at /root/doris-release/be/src/olap/merger.cpp:11421# doris::Compaction::do_compaction_impl(long) at /root/doris-release/be/src/olap/compaction.cpp:17022# doris::Compaction::do_compaction(long) at /root/doris-release/be/src/olap/compaction.cpp:12223# doris::BaseCompaction::execute_compact_impl() at /root/doris-release/be/src/olap/base_compaction.cpp:7024# doris::Compaction::execute_compact() at /root/doris-release/be/src/olap/compaction.cpp:6025# doris::Tablet::execute_compaction(doris::CompactionType) at /root/doris-release/be/src/olap/tablet.cpp:157126# std::_Function_handler<void (), doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::{lambda()#1}>::_M_invoke(std::_Any_data const&) at /var/local/ldb-toolchain/include/c++/11/bits/std_function.h:29127# doris::ThreadPool::dispatch_thread() at /root/doris-release/be/src/util/threadpool.cpp:54828# doris::Thread::supervise_thread(void*) at /root/doris-release/be/src/util/thread.cpp:40929# start_thread in /lib64/libpthread.so.030# clone in /lib64/libc.so.6

What You Expected?

fix

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions