Skip to content

[Bug] DCHECK failed caused by tls_ctx()->type() == ThreadContext::TaskType::UNKNOWN #9540

Description

@jacktengg

Search before asking

  • I had searched in the issues and found no similar issues.

Version

master-289608cc2

What's Wrong?

load coredumped:

start time: Thu May 12 06:38:30 PM CST 2022
*** Check failure stack trace: ***
@ 0x55a8476f53bd google::LogMessage::Fail()
@ 0x55a8476f78f9 google::LogMessage::SendToLog()
@ 0x55a8476f4f26 google::LogMessage::Flush()
@ 0x55a8476f7f69 google::LogMessageFatal::~LogMessageFatal()
@ 0x55a841e7f391 doris::SwitchThreadMemTracker<>::SwitchThreadMemTracker()
@ 0x55a841fda939 doris::LoadChannel::cancel()
@ 0x55a841fca4b0 doris::LoadChannelMgr::_start_load_channels_clean()
@ 0x55a841fc92c9 _ZZN5doris14LoadChannelMgr16_start_bg_workerEvENKUlvE_clEv
@ 0x55a841fcc196 _ZSt13__invoke_implIvRZN5doris14LoadChannelMgr16_start_bg_workerEvEUlvE_JEET_St14__invoke_otherOT0_DpOT1_
@ 0x55a841fcc000 _ZSt10__invoke_rIvRZN5doris14LoadChannelMgr16_start_bg_workerEvEUlvE_JEENSt9enable_ifIX16is_invocable_r_vIT_T0_DpT1_EES5_E4typeEOS6_DpOS7_
@ 0x55a841fcbc7a _ZNSt17_Function_handlerIFvvEZN5doris14LoadChannelMgr16_start_bg_workerEvEUlvE_E9_M_invokeERKSt9_Any_data
@ 0x55a841e11b36 std::function<>::operator()()
@ 0x55a8424a0b00 doris::Thread::supervise_thread()
@ 0x7fcedcfe2450 start_thread
@ 0x7fcedd112d53 clone
@ (nil) (unknown)
*** Aborted at 1652406931 (unix time) try "date -d @1652406931" if you are using GNU date ***
*** SIGABRT unkown detail explain (@0x1e8756) received by PID 2000726 (TID 0x7fce7821b640) from PID 2000726; stack trace: ***
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zhanglei/incubator-doris/be/src/common/signal_handler.h:407
1# 0x00007FCEDD03C040 in /lib/x86_64-linux-gnu/libc.so.6
2# raise in /lib/x86_64-linux-gnu/libc.so.6
3# abort in /lib/x86_64-linux-gnu/libc.so.6
4# google::ReadFromOffset(int, void*, unsigned long, long) [clone .cold] at src/symbolize.cc:146
5# 0x000055A8476F53BD at src/logging.cc:1650
6# google::LogMessage::SendToLog() at src/logging.cc:1607
7# google::LogMessage::Flush() at src/logging.cc:1477
8# google::LogMessageFatal::~LogMessageFatal() at src/logging.cc:2227
9# doris::SwitchThreadMemTracker<false>::SwitchThreadMemTracker(std::shared_ptr<doris::MemTracker> const&, bool) at /home/zhanglei/incubator-doris/be/src/runtime/thread_context.cpp:95
10# doris::LoadChannel::cancel() at /home/zhanglei/incubator-doris/be/src/runtime/load_channel.cpp:141
11# doris::LoadChannelMgr::_start_load_channels_clean() at /home/zhanglei/incubator-doris/be/src/runtime/load_channel_mgr.cpp:250
12# doris::LoadChannelMgr::_start_bg_worker()::{lambda()#1}::operator()() const at /home/zhanglei/incubator-doris/be/src/runtime/load_channel_mgr.cpp:202
13# void std::__invoke_impl<void, doris::LoadChannelMgr::_start_bg_worker()::{lambda()#1}&>(std::__invoke_other, doris::LoadChannelMgr::_start_bg_worker()::{lambda()#1}&) at /usr/include/c++/11/bits/invoke.h:61
14# std::enable_if<is_invocable_r_v<void, doris::LoadChannelMgr::_start_bg_worker()::{lambda()#1}&>, void>::type std::__invoke_r<void, doris::LoadChannelMgr::_start_bg_worker()::{lambda()#1}&>(doris::LoadChannelMgr::_start_bg_worker()::{lambda()#1}&) at /usr/include/c++/11/bits/invoke.h:117
15# std::_Function_handler<void (), doris::LoadChannelMgr::_start_bg_worker()::{lambda()#1}>::_M_invoke(std::_Any_data const&) at /usr/include/c++/11/bits/std_function.h:292
16# std::function<void ()>::operator()() const at /usr/include/c++/11/bits/std_function.h:560
17# doris::Thread::supervise_thread(void*) at /home/zhanglei/incubator-doris/be/src/util/thread.cpp:409
18# start_thread at ./nptl/pthread_create.c:474
19# clone in /lib/x86_64-linux-gnu/libc.so.6

log:

I0513 09:55:27.098309 2001220 snapshot_loader.cpp:353] finished to download snapshots. job: 32603, task id: 33692
I0513 09:55:27.098703 2001220 task_worker_pool.cpp:1344] finished download task, signature: 33692, job id:32603
I0513 09:55:30.596575 2001418 heartbeat_server.cpp:58] get heartbeat from FE.host:172.21.16.2, port:9420, cluster id:556303565, counter:10981
I0513 09:55:31.409724 2001141 load_channel_mgr.cpp:224] cleaning timed out load channels
I0513 09:55:31.409765 2001141 load_channel_mgr.cpp:242] erase timeout load channel: 6a47ab9692546a45-800190cfa6522188
F0513 09:55:31.409852 2001141 thread_context.cpp:95] Check failed: in_task == false || tls_ctx()->type() != ThreadContext::TaskType::UNKNOWN ,tls ctx type=0

qJVo3zuXZD

What You Expected?

no coredump

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions