[fix](agg) prevent core dump in ColumnArray::size_at when handling type mismatch in streaming_agg_serialize_to_column by felixwluo · Pull Request #50001 · apache/doris

felixwluo · 2025-04-12T14:31:36Z

What problem does this PR solve?

Problem Summary:
core

*** is nereids: 1 ***
*** tablet id: 0 ***
*** Aborted at 1744342233 (unix time) try "date -d @1744342233" if you are using GNU date ***
*** Current BE git commitID: 2503281 ***
*** SIGSEGV unknown detail explain (@0x0) received by PID 681431 (TID 683727 OR 0x7fcd153a0700) from PID 0; stack trace: ***
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) in /usr/local/service/doris/lib/be/doris_be
1# os::Linux::chained_handler(int, siginfo*, void*) in /usr/local/jdk/jre/lib/amd64/server/libjvm.so
2# JVM_handle_linux_signal in /usr/local/jdk/jre/lib/amd64/server/libjvm.so
3# signalHandler(int, siginfo*, void*) in /usr/local/jdk/jre/lib/amd64/server/libjvm.so
4# 0x00007FD26771E400 in /lib64/libc.so.6
5# doris::vectorized::ColumnArray::insert_from(doris::vectorized::IColumn const&, unsigned long) in /usr/local/service/doris/lib/be/doris_be
6# doris::vectorized::ColumnNullable::insert_from(doris::vectorized::IColumn const&, unsigned long) in /usr/local/service/doris/lib/be/doris_be
7# doris::vectorized::AggregateFunctionCollect<doris::vectorized::AggregateFunctionArrayAggData<void>, std::integral_constant<bool, false>, std::integral_constant<bool, true> >::streaming_agg_serialize_to_column(doris::vectorized::IColumn const**, COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>&, unsigned long, doris::vectorized::Arena*) const in /usr/local/service/doris/lib/be/doris_be
8# doris::vectorized::AggFnEvaluator::streaming_agg_serialize_to_column(doris::vectorized::Block*, COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>&, unsigned long, doris::vectorized::Arena*) in /usr/local/service/doris/lib/be/doris_be
9# _ZNSt8__detail9__variant17__gen_vtable_implINS0_12_Multi_arrayIPFNS0_21__deduce_visit_resultIN5doris6StatusEEEONS4_10vectorized8OverloadIJZNS4_8pipeline22StreamingAggLocalState28_pre_agg_with_serialized_keyEPNS7_5BlockESC_E3$_0ZNSA_28_pre_agg_with_serialized_keyESC_SC_E3$_1EEERSt7variantIJNS7_16MethodSerializedI9PHHashMapINS4_9StringRefEPc11DefaultHashISK_vELb0EEEENS7_15MethodOneNumberIhSJ_IhSL_SM_IhvELb0EEEENSQ_ItSJ_ItSL_SM_ItvELb0EEEENSQ_IjSJ_IjSL_9HashCRC32IjELb0EEEENSQ_ImSJ_ImSL_SX_ImELb0EEEENS7_19MethodStringNoCacheINS4_13StringHashMapISL_9AllocatorILb1ELb1ELb0E22DefaultMemoryAllocatorEEEEENSQ_INS7_7UInt128ESJ_IS1B_SL_SX_IS1B_ELb0EEEENSQ_IjSJ_IjSL_14HashMixWrapperIjSY_ELb0EEEENSQ_ImSJ_ImSL_S1F_ImS11_ELb0EEEENSQ_IS1B_SJ_IS1B_SL_S1F_IS1B_S1C_ELb0EEEENS7_26MethodSingleNullableColumnINSQ_IhNS7_15DataWithNullKeyISS_EEEEEENS1P_INSQ_ItNS1Q_ISV_EEEEEENS1P_INSQ_IjNS1Q_ISZ_EEEEEENS1P_INSQ_ImNS1Q_IS12_EEEEEENS1P_INSQ_IjNS1Q_IS1H_EEEEEENS1P_INSQ_ImNS1Q_IS1K_EEEEEENS1P_INSQ_IS1B_NS1Q_IS1D_EEEEEENS1P_INSQ_IS1B_NS1Q_IS1N_EEEEEENS1P_INS14_INS1Q_IS19_EEEEEENS7_15MethodKeysFixedIS12_Lb0EEENS2I_IS12_Lb1EEENS2I_IS1D_Lb0EEENS2I_IS1D_Lb1EEENS2I_ISJ_INS7_7UInt256ESL_SX_IS2N_ELb0EELb0EEENS2I_IS2P_Lb1EEENS2I_ISJ_INS7_7UInt136ESL_SX_IS2S_ELb0EELb0EEENS2I_IS2U_Lb1EEENS2I_IS1K_Lb0EEENS2I_IS1K_Lb1EEENS2I_IS1N_Lb0EEENS2I_IS1N_Lb1EEENS2I_ISJ_IS2N_SL_S1F_IS2N_S2O_ELb0EELb0EEENS2I_IS32_Lb1EEENS2I_ISJ_IS2S_SL_S1F_IS2S_S2T_ELb0EELb0EEENS2I_IS36_Lb1EEEEEEJEEESt16integer_sequenceImJLm0EEEE14__visit_invokeESG_S3A_ in /usr/local/service/doris/lib/be/doris_be
10# doris::pipeline::StreamingAggLocalState::_pre_agg_with_serialized_key(doris::vectorized::Block*, doris::vectorized::Block*) in /usr/local/service/doris/lib/be/doris_be
11# doris::pipeline::StreamingAggLocalState::do_pre_agg(doris::vectorized::Block*, doris::vectorized::Block*) in /usr/local/service/doris/lib/be/doris_be
12# doris::pipeline::StreamingAggOperatorX::push(doris::RuntimeState*, doris::vectorized::Block*, bool) const in /usr/local/service/doris/lib/be/doris_be
13# doris::pipeline::StatefulOperatorX<doris::pipeline::StreamingAggLocalState>::get_block(doris::RuntimeState*, doris::vectorized::Block*, bool*) in /usr/local/service/doris/lib/be/doris_be
14# doris::pipeline::OperatorXBase::get_block_after_projects(doris::RuntimeState*, doris::vectorized::Block*, bool*) in /usr/local/service/doris/lib/be/doris_be
15# doris::pipeline::PipelineXTask::execute(bool*) in /usr/local/service/doris/lib/be/doris_be
16# doris::pipeline::TaskScheduler::_do_work(unsigned long) in /usr/local/service/doris/lib/be/doris_be
17# doris::ThreadPool::dispatch_thread() in /usr/local/service/doris/lib/be/doris_be
18# doris::Thread::supervise_thread(void*) in /usr/local/service/doris/lib/be/doris_be
19# start_thread in /lib64/libpthread.so.0
20# __clone in /lib64/libc.so.6

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

…pe mismatch in streaming_agg_serialize_to_column

hello-stephen · 2025-04-12T14:31:41Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

felixwluo · 2025-04-12T14:31:52Z

run buildall

doris-robot · 2025-04-12T15:14:47Z

TPC-H: Total hot run time: 33528 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b537bf6f8f3af18b0be3694c3b493f07aa8c7d06, data reload: false
------ Round 1 ----------------------------------
q1	26182	5061	4974	4974
q2	2056	265	174	174
q3	10434	1219	669	669
q4	10228	995	521	521
q5	7539	2415	2229	2229
q6	184	163	130	130
q7	910	727	608	608
q8	9302	1249	1068	1068
q9	6865	5036	5032	5032
q10	6801	2331	1875	1875
q11	471	292	274	274
q12	344	340	223	223
q13	17754	3613	3068	3068
q14	228	220	211	211
q15	540	474	495	474
q16	624	609	583	583
q17	570	849	344	344
q18	7464	7095	6974	6974
q19	1224	940	536	536
q20	337	335	221	221
q21	3876	2687	2379	2379
q22	1027	1008	961	961
Total cold run time: 114960 ms
Total hot run time: 33528 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5078	5082	5079	5079
q2	234	325	233	233
q3	2147	2607	2294	2294
q4	1388	1780	1363	1363
q5	4336	4330	4330	4330
q6	216	166	127	127
q7	1975	1922	1742	1742
q8	2560	2486	2462	2462
q9	7275	7271	7123	7123
q10	2998	3167	2749	2749
q11	570	522	498	498
q12	680	783	615	615
q13	3454	3954	3293	3293
q14	294	298	268	268
q15	515	490	478	478
q16	631	691	642	642
q17	1150	1485	1411	1411
q18	7685	7667	7467	7467
q19	794	801	870	801
q20	1956	2011	1848	1848
q21	5237	4919	4740	4740
q22	1086	1039	1014	1014
Total cold run time: 52259 ms
Total hot run time: 50577 ms

doris-robot · 2025-04-12T15:27:02Z

TPC-DS: Total hot run time: 192691 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b537bf6f8f3af18b0be3694c3b493f07aa8c7d06, data reload: false
query1	1424	1062	1030	1030
query2	6327	1893	1914	1893
query3	11039	4547	4491	4491
query4	55426	25572	22955	22955
query5	5025	509	455	455
query6	370	213	192	192
query7	4947	514	290	290
query8	326	245	234	234
query9	6000	2601	2577	2577
query10	430	326	264	264
query11	14961	15097	14898	14898
query12	157	116	105	105
query13	1066	506	409	409
query14	10212	6405	6240	6240
query15	206	203	179	179
query16	7096	635	509	509
query17	1073	722	577	577
query18	1576	408	309	309
query19	191	190	161	161
query20	126	123	116	116
query21	212	120	110	110
query22	4469	4361	4367	4361
query23	34184	33594	33451	33451
query24	6669	2406	2396	2396
query25	463	477	396	396
query26	688	277	149	149
query27	2260	533	329	329
query28	3005	2448	2438	2438
query29	586	556	427	427
query30	279	224	196	196
query31	870	875	778	778
query32	72	65	59	59
query33	467	360	298	298
query34	759	844	520	520
query35	840	827	770	770
query36	947	1005	888	888
query37	137	106	75	75
query38	4301	4219	4315	4219
query39	1519	1467	1424	1424
query40	218	128	113	113
query41	59	61	70	61
query42	120	116	112	112
query43	514	495	489	489
query44	1361	838	861	838
query45	188	181	172	172
query46	850	1041	646	646
query47	1894	1888	1798	1798
query48	396	413	316	316
query49	731	531	438	438
query50	669	703	417	417
query51	4282	4347	4374	4347
query52	115	112	102	102
query53	239	267	187	187
query54	574	573	511	511
query55	82	89	90	89
query56	312	303	301	301
query57	1180	1191	1108	1108
query58	262	264	254	254
query59	2774	2867	2704	2704
query60	328	324	322	322
query61	133	120	127	120
query62	760	759	687	687
query63	222	188	185	185
query64	1479	1067	712	712
query65	4425	4211	4245	4211
query66	714	407	299	299
query67	15745	15477	15245	15245
query68	7366	869	505	505
query69	550	301	268	268
query70	1200	1120	1159	1120
query71	519	307	288	288
query72	5960	4729	4677	4677
query73	1385	610	343	343
query74	9302	9119	8893	8893
query75	3775	3206	2727	2727
query76	4208	1194	740	740
query77	623	364	291	291
query78	10076	10063	9283	9283
query79	2286	806	562	562
query80	608	499	469	469
query81	476	258	219	219
query82	464	125	95	95
query83	366	245	237	237
query84	291	99	79	79
query85	793	353	298	298
query86	385	295	300	295
query87	4508	4439	4394	4394
query88	3438	2222	2208	2208
query89	412	305	286	286
query90	1977	203	209	203
query91	146	191	112	112
query92	71	62	55	55
query93	1273	927	577	577
query94	695	411	278	278
query95	371	290	281	281
query96	495	567	272	272
query97	3145	3184	3182	3182
query98	240	202	202	202
query99	1414	1412	1300	1300
Total cold run time: 300149 ms
Total hot run time: 192691 ms

doris-robot · 2025-04-12T15:32:28Z

ClickBench: Total hot run time: 30.93 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b537bf6f8f3af18b0be3694c3b493f07aa8c7d06, data reload: false
query1	0.05	0.04	0.03
query2	0.13	0.10	0.11
query3	0.25	0.19	0.19
query4	1.59	0.19	0.20
query5	0.60	0.59	0.59
query6	1.19	0.72	0.74
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.58	0.55	0.51
query10	0.58	0.58	0.58
query11	0.15	0.10	0.11
query12	0.14	0.11	0.12
query13	0.61	0.60	0.58
query14	2.68	2.71	2.82
query15	0.92	0.84	0.85
query16	0.39	0.37	0.39
query17	1.02	1.04	1.04
query18	0.21	0.20	0.19
query19	1.93	1.95	1.83
query20	0.01	0.01	0.02
query21	15.39	0.88	0.55
query22	0.77	1.29	0.80
query23	14.74	1.38	0.65
query24	7.49	0.90	0.55
query25	0.50	0.17	0.07
query26	0.62	0.16	0.14
query27	0.05	0.05	0.05
query28	8.93	0.90	0.45
query29	12.88	3.88	3.31
query30	0.24	0.08	0.06
query31	2.82	0.59	0.38
query32	3.22	0.54	0.46
query33	2.96	3.12	3.03
query34	15.77	5.07	4.46
query35	4.48	4.44	4.50
query36	0.67	0.50	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.15	0.14	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.03
query43	0.03	0.03	0.03
Total cold run time: 105.08 s
Total hot run time: 30.93 s

hello-stephen · 2025-04-12T17:05:01Z

BE UT Coverage Report

Increment line coverage 0.00% (0/12) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.45% (14101/26883)
Line Coverage	41.26% (121903/295463)
Region Coverage	40.01% (62069/155132)
Branch Coverage	34.66% (31074/89656)

yiguolei

pls add some test

cambyzju · 2025-04-14T09:50:36Z

 col_src.get_nested_column());
 vec.insert_from(vec_src, i);
 } else if constexpr (std::is_same_v<Data, AggregateFunctionArrayAggData<void>>) {
- to_nested_col.insert_from(col_src.get_nested_column(), i);


auto& vec = col_null->get_nested_column(); vec.insert_from(col_src.get_nested_column(), i);

felixwluo · 2025-04-15T13:00:54Z

run buildall

doris-robot · 2025-04-15T13:42:45Z

TPC-H: Total hot run time: 33939 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 86e9c1503e4ba1e6d0810e4bd74149a8bd652d63, data reload: false
------ Round 1 ----------------------------------
q1	26035	5011	5016	5011
q2	2064	280	185	185
q3	10389	1259	690	690
q4	10217	1009	535	535
q5	7544	2319	2315	2315
q6	187	165	134	134
q7	912	733	625	625
q8	9317	1192	1072	1072
q9	6926	5116	5051	5051
q10	6855	2347	1888	1888
q11	489	291	275	275
q12	357	356	219	219
q13	17782	3712	3082	3082
q14	227	221	210	210
q15	527	488	481	481
q16	637	619	597	597
q17	604	834	391	391
q18	7430	7137	6980	6980
q19	1995	995	546	546
q20	339	341	228	228
q21	4031	3383	2444	2444
q22	1050	995	980	980
Total cold run time: 115914 ms
Total hot run time: 33939 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5169	5102	5116	5102
q2	245	333	229	229
q3	2201	2603	2266	2266
q4	1413	1806	1374	1374
q5	4481	4411	4356	4356
q6	220	170	133	133
q7	2005	1907	1749	1749
q8	2708	2556	2543	2543
q9	7280	7246	7039	7039
q10	2995	3226	2732	2732
q11	587	526	492	492
q12	723	756	582	582
q13	3578	3878	3264	3264
q14	294	316	294	294
q15	531	468	480	468
q16	640	693	663	663
q17	1158	1510	1419	1419
q18	7681	7607	7569	7569
q19	828	774	891	774
q20	1912	1968	1817	1817
q21	5295	4884	5014	4884
q22	1124	1098	1038	1038
Total cold run time: 53068 ms
Total hot run time: 50787 ms

doris-robot · 2025-04-15T13:55:01Z

TPC-DS: Total hot run time: 193317 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 86e9c1503e4ba1e6d0810e4bd74149a8bd652d63, data reload: false
query1	1429	1084	1040	1040
query2	6217	1900	1865	1865
query3	10991	4484	4501	4484
query4	55393	24785	23470	23470
query5	5086	492	465	465
query6	366	201	208	201
query7	4967	493	296	296
query8	347	261	243	243
query9	6201	2636	2655	2636
query10	426	319	256	256
query11	15036	15030	14845	14845
query12	161	112	106	106
query13	1111	553	412	412
query14	10194	6385	6344	6344
query15	203	210	184	184
query16	7105	653	486	486
query17	1109	763	609	609
query18	1617	423	322	322
query19	201	197	184	184
query20	135	136	131	131
query21	215	124	109	109
query22	4391	4324	4286	4286
query23	34080	33406	33406	33406
query24	6604	2435	2401	2401
query25	481	481	404	404
query26	686	281	154	154
query27	2244	514	357	357
query28	3098	2485	2433	2433
query29	589	577	426	426
query30	271	215	195	195
query31	893	885	806	806
query32	72	59	71	59
query33	449	355	300	300
query34	771	877	508	508
query35	791	892	783	783
query36	965	999	932	932
query37	118	105	74	74
query38	4320	4175	4095	4095
query39	1692	1408	1419	1408
query40	207	121	108	108
query41	56	56	53	53
query42	130	112	115	112
query43	495	515	482	482
query44	1405	836	836	836
query45	181	177	168	168
query46	863	1021	642	642
query47	1797	1908	1754	1754
query48	372	409	316	316
query49	682	522	413	413
query50	678	696	403	403
query51	4459	4353	4217	4217
query52	110	108	101	101
query53	226	260	194	194
query54	581	571	546	546
query55	93	83	89	83
query56	312	306	288	288
query57	1185	1188	1121	1121
query58	264	262	263	262
query59	2646	2839	2673	2673
query60	324	326	322	322
query61	169	132	139	132
query62	748	734	673	673
query63	236	193	194	193
query64	1502	1124	732	732
query65	4408	4210	4258	4210
query66	722	403	307	307
query67	15813	15480	15179	15179
query68	7946	889	513	513
query69	545	311	255	255
query70	1213	1080	1105	1080
query71	492	313	287	287
query72	5617	4898	4893	4893
query73	1325	634	353	353
query74	8935	9153	8952	8952
query75	3817	3192	2740	2740
query76	4281	1185	752	752
query77	627	374	288	288
query78	10091	10222	9369	9369
query79	1956	828	559	559
query80	612	514	448	448
query81	489	257	222	222
query82	464	133	94	94
query83	250	250	275	250
query84	286	103	89	89
query85	811	354	321	321
query86	429	314	291	291
query87	4505	4531	4363	4363
query88	3525	2232	2227	2227
query89	411	303	291	291
query90	1899	216	206	206
query91	146	144	115	115
query92	72	61	62	61
query93	1530	954	591	591
query94	679	410	302	302
query95	372	299	288	288
query96	495	553	277	277
query97	3152	3251	3141	3141
query98	228	205	196	196
query99	1437	1397	1268	1268
Total cold run time: 300326 ms
Total hot run time: 193317 ms

doris-robot · 2025-04-15T14:00:19Z

ClickBench: Total hot run time: 31.19 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 86e9c1503e4ba1e6d0810e4bd74149a8bd652d63, data reload: false
query1	0.04	0.04	0.02
query2	0.12	0.11	0.11
query3	0.26	0.20	0.19
query4	1.59	0.19	0.19
query5	0.60	0.61	0.59
query6	1.18	0.72	0.71
query7	0.02	0.02	0.02
query8	0.04	0.04	0.04
query9	0.58	0.51	0.50
query10	0.57	0.56	0.56
query11	0.15	0.11	0.11
query12	0.15	0.11	0.12
query13	0.61	0.60	0.60
query14	2.79	2.81	2.79
query15	0.93	0.83	0.85
query16	0.38	0.38	0.37
query17	1.01	1.02	0.98
query18	0.20	0.20	0.19
query19	1.85	1.93	1.84
query20	0.01	0.01	0.02
query21	15.37	0.93	0.55
query22	0.75	1.17	0.66
query23	14.96	1.40	0.65
query24	7.05	1.23	0.98
query25	0.52	0.20	0.07
query26	0.71	0.17	0.13
query27	0.05	0.04	0.05
query28	8.81	0.89	0.45
query29	12.55	3.99	3.29
query30	0.25	0.09	0.08
query31	2.81	0.59	0.38
query32	3.22	0.56	0.47
query33	3.00	2.99	3.08
query34	15.80	5.12	4.46
query35	4.46	4.51	4.43
query36	0.68	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.18	0.14	0.12
query41	0.07	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.57 s
Total hot run time: 31.19 s

hello-stephen · 2025-04-15T14:44:50Z

BE UT Coverage Report

Increment line coverage 0.00% (0/2) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.43% (14109/26908)
Line Coverage	41.35% (122324/295846)
Region Coverage	40.07% (62248/155348)
Branch Coverage	34.77% (31244/89858)

felixwluo · 2025-04-15T16:23:34Z

run buildall

felixwluo · 2025-04-15T17:00:38Z

run buildall

doris-robot · 2025-04-15T17:20:15Z

TPC-H: Total hot run time: 35277 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 073c9aaaaf80f0d605b7998aa572a0ae7389edf9, data reload: false
------ Round 1 ----------------------------------
q1	25928	5078	5121	5078
q2	420	306	209	209
q3	10036	1237	706	706
q4	10411	1015	537	537
q5	7562	2418	2290	2290
q6	194	159	130	130
q7	909	735	627	627
q8	9302	1258	1161	1161
q9	6851	5117	5108	5108
q10	6839	2317	1893	1893
q11	494	302	266	266
q12	352	359	222	222
q13	17748	3748	3207	3207
q14	227	228	214	214
q15	533	514	490	490
q16	635	634	586	586
q17	626	847	381	381
q18	7401	7137	7129	7129
q19	969	932	566	566
q20	352	343	241	241
q21	4564	3477	3272	3272
q22	1040	1038	964	964
Total cold run time: 113393 ms
Total hot run time: 35277 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5098	5116	5075	5075
q2	227	326	230	230
q3	2207	2691	2312	2312
q4	1465	1833	1423	1423
q5	4196	4120	4093	4093
q6	208	165	125	125
q7	1862	1845	1659	1659
q8	2497	2418	2448	2418
q9	6835	6765	6795	6765
q10	2888	3080	2665	2665
q11	559	505	475	475
q12	668	737	579	579
q13	3391	3746	3150	3150
q14	268	275	262	262
q15	517	467	469	467
q16	630	688	629	629
q17	1103	1375	1374	1374
q18	7281	7059	7067	7059
q19	819	851	863	851
q20	1909	1946	1839	1839
q21	5281	4636	4797	4636
q22	1084	1049	983	983
Total cold run time: 50993 ms
Total hot run time: 49069 ms

doris-robot · 2025-04-15T17:31:52Z

TPC-DS: Total hot run time: 186457 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 073c9aaaaf80f0d605b7998aa572a0ae7389edf9, data reload: false
query1	994	506	482	482
query2	6576	1926	1908	1908
query3	6738	218	220	218
query4	26520	23753	23499	23499
query5	5741	629	462	462
query6	282	203	192	192
query7	4615	480	281	281
query8	296	243	250	243
query9	8648	2627	2631	2627
query10	504	327	271	271
query11	15640	15125	14782	14782
query12	166	110	105	105
query13	1658	507	411	411
query14	10902	6223	6319	6223
query15	228	192	174	174
query16	7678	630	429	429
query17	1423	759	582	582
query18	2023	406	306	306
query19	229	205	170	170
query20	121	121	117	117
query21	214	130	109	109
query22	4231	4040	3915	3915
query23	33832	33095	33045	33045
query24	8001	2435	2380	2380
query25	506	450	387	387
query26	1217	265	146	146
query27	2719	488	342	342
query28	4289	2410	2389	2389
query29	701	561	423	423
query30	289	216	191	191
query31	932	866	785	785
query32	74	68	75	68
query33	544	352	319	319
query34	781	877	505	505
query35	791	831	725	725
query36	950	987	884	884
query37	120	105	76	76
query38	4118	4202	4172	4172
query39	1447	1385	1388	1385
query40	212	120	102	102
query41	56	51	51	51
query42	122	104	102	102
query43	503	510	471	471
query44	1276	798	796	796
query45	172	178	174	174
query46	827	1028	625	625
query47	1753	1825	1687	1687
query48	368	413	301	301
query49	785	494	446	446
query50	642	664	407	407
query51	4193	4091	4067	4067
query52	115	110	99	99
query53	227	251	191	191
query54	569	571	501	501
query55	88	82	85	82
query56	299	289	307	289
query57	1134	1158	1081	1081
query58	270	259	255	255
query59	2630	2653	2586	2586
query60	331	311	310	310
query61	128	126	172	126
query62	799	715	665	665
query63	221	189	189	189
query64	4270	1049	681	681
query65	4356	4230	4285	4230
query66	1016	428	313	313
query67	15606	15567	15234	15234
query68	8218	889	523	523
query69	482	300	270	270
query70	1219	1110	1124	1110
query71	485	330	296	296
query72	5489	4718	4704	4704
query73	667	596	339	339
query74	9041	8890	8784	8784
query75	3912	3171	2701	2701
query76	3564	1186	769	769
query77	774	383	356	356
query78	10034	10153	9261	9261
query79	2553	806	581	581
query80	691	526	431	431
query81	472	269	225	225
query82	471	130	99	99
query83	249	245	229	229
query84	261	107	89	89
query85	757	362	306	306
query86	330	313	314	313
query87	4461	4565	4351	4351
query88	3465	2190	2236	2190
query89	384	321	276	276
query90	1936	215	210	210
query91	147	139	111	111
query92	86	66	58	58
query93	2024	955	595	595
query94	661	421	306	306
query95	369	295	286	286
query96	478	572	276	276
query97	3132	3271	3122	3122
query98	237	211	205	205
query99	1478	1431	1296	1296
Total cold run time: 278233 ms
Total hot run time: 186457 ms

doris-robot · 2025-04-15T17:37:10Z

ClickBench: Total hot run time: 30.65 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 073c9aaaaf80f0d605b7998aa572a0ae7389edf9, data reload: false
query1	0.03	0.04	0.03
query2	0.14	0.10	0.12
query3	0.25	0.20	0.19
query4	1.59	0.20	0.19
query5	0.59	0.59	0.58
query6	1.20	0.72	0.72
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.58	0.55	0.51
query10	0.57	0.58	0.57
query11	0.16	0.11	0.11
query12	0.15	0.11	0.11
query13	0.61	0.60	0.60
query14	2.68	2.69	2.83
query15	0.91	0.85	0.87
query16	0.39	0.39	0.38
query17	1.02	1.01	1.03
query18	0.22	0.19	0.20
query19	1.84	1.98	1.82
query20	0.02	0.01	0.01
query21	15.36	0.96	0.54
query22	0.76	1.24	0.66
query23	14.94	1.39	0.60
query24	7.19	1.64	0.42
query25	0.49	0.14	0.09
query26	0.74	0.17	0.14
query27	0.05	0.05	0.05
query28	9.34	0.91	0.45
query29	12.58	4.01	3.33
query30	0.25	0.10	0.06
query31	2.84	0.60	0.38
query32	3.24	0.55	0.47
query33	2.99	3.10	3.01
query34	15.67	5.08	4.45
query35	4.56	4.53	4.50
query36	0.68	0.49	0.48
query37	0.09	0.07	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.17	0.14	0.13
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 105.17 s
Total hot run time: 30.65 s

hello-stephen · 2025-04-15T18:35:57Z

BE UT Coverage Report

Increment line coverage 0.00% (0/2) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.43% (14109/26908)
Line Coverage	41.36% (122374/295846)
Region Coverage	40.08% (62265/155348)
Branch Coverage	34.79% (31265/89858)

felixwluo · 2025-04-16T03:24:52Z

run beut

doris-robot · 2025-04-16T05:43:21Z

BE UT Coverage Report

Increment line coverage 0.00% (0/2) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.83% (14222/26921)
Line Coverage	41.71% (123416/295891)
Region Coverage	40.44% (62855/155415)
Branch Coverage	35.06% (31520/89892)

HappenLee

LGTM

github-actions · 2025-04-16T06:24:17Z

PR approved by at least one committer and no changes requested.

github-actions · 2025-04-16T06:24:19Z

PR approved by anyone and no changes requested.

yiguolei

LGTM

@0x0

…pe mismatch in streaming_agg_serialize_to_column (#50001) ### What problem does this PR solve? Problem Summary: core ``` *** is nereids: 1 *** *** tablet id: 0 *** *** Aborted at 1744342233 (unix time) try "date -d @1744342233" if you are using GNU date *** *** Current BE git commitID: 2503281 *** *** SIGSEGV unknown detail explain (@0x0) received by PID 681431 (TID 683727 OR 0x7fcd153a0700) from PID 0; stack trace: *** 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) in /usr/local/service/doris/lib/be/doris_be 1# os::Linux::chained_handler(int, siginfo*, void*) in /usr/local/jdk/jre/lib/amd64/server/libjvm.so 2# JVM_handle_linux_signal in /usr/local/jdk/jre/lib/amd64/server/libjvm.so 3# signalHandler(int, siginfo*, void*) in /usr/local/jdk/jre/lib/amd64/server/libjvm.so 4# 0x00007FD26771E400 in /lib64/libc.so.6 5# doris::vectorized::ColumnArray::insert_from(doris::vectorized::IColumn const&, unsigned long) in /usr/local/service/doris/lib/be/doris_be 6# doris::vectorized::ColumnNullable::insert_from(doris::vectorized::IColumn const&, unsigned long) in /usr/local/service/doris/lib/be/doris_be 7# doris::vectorized::AggregateFunctionCollect<doris::vectorized::AggregateFunctionArrayAggData<void>, std::integral_constant<bool, false>, std::integral_constant<bool, true> >::streaming_agg_serialize_to_column(doris::vectorized::IColumn const**, COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>&, unsigned long, doris::vectorized::Arena*) const in /usr/local/service/doris/lib/be/doris_be 8# doris::vectorized::AggFnEvaluator::streaming_agg_serialize_to_column(doris::vectorized::Block*, COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>&, unsigned long, doris::vectorized::Arena*) in /usr/local/service/doris/lib/be/doris_be 9# _ZNSt8__detail9__variant17__gen_vtable_implINS0_12_Multi_arrayIPFNS0_21__deduce_visit_resultIN5doris6StatusEEEONS4_10vectorized8OverloadIJZNS4_8pipeline22StreamingAggLocalState28_pre_agg_with_serialized_keyEPNS7_5BlockESC_E3$_0ZNSA_28_pre_agg_with_serialized_keyESC_SC_E3$_1EEERSt7variantIJNS7_16MethodSerializedI9PHHashMapINS4_9StringRefEPc11DefaultHashISK_vELb0EEEENS7_15MethodOneNumberIhSJ_IhSL_SM_IhvELb0EEEENSQ_ItSJ_ItSL_SM_ItvELb0EEEENSQ_IjSJ_IjSL_9HashCRC32IjELb0EEEENSQ_ImSJ_ImSL_SX_ImELb0EEEENS7_19MethodStringNoCacheINS4_13StringHashMapISL_9AllocatorILb1ELb1ELb0E22DefaultMemoryAllocatorEEEEENSQ_INS7_7UInt128ESJ_IS1B_SL_SX_IS1B_ELb0EEEENSQ_IjSJ_IjSL_14HashMixWrapperIjSY_ELb0EEEENSQ_ImSJ_ImSL_S1F_ImS11_ELb0EEEENSQ_IS1B_SJ_IS1B_SL_S1F_IS1B_S1C_ELb0EEEENS7_26MethodSingleNullableColumnINSQ_IhNS7_15DataWithNullKeyISS_EEEEEENS1P_INSQ_ItNS1Q_ISV_EEEEEENS1P_INSQ_IjNS1Q_ISZ_EEEEEENS1P_INSQ_ImNS1Q_IS12_EEEEEENS1P_INSQ_IjNS1Q_IS1H_EEEEEENS1P_INSQ_ImNS1Q_IS1K_EEEEEENS1P_INSQ_IS1B_NS1Q_IS1D_EEEEEENS1P_INSQ_IS1B_NS1Q_IS1N_EEEEEENS1P_INS14_INS1Q_IS19_EEEEEENS7_15MethodKeysFixedIS12_Lb0EEENS2I_IS12_Lb1EEENS2I_IS1D_Lb0EEENS2I_IS1D_Lb1EEENS2I_ISJ_INS7_7UInt256ESL_SX_IS2N_ELb0EELb0EEENS2I_IS2P_Lb1EEENS2I_ISJ_INS7_7UInt136ESL_SX_IS2S_ELb0EELb0EEENS2I_IS2U_Lb1EEENS2I_IS1K_Lb0EEENS2I_IS1K_Lb1EEENS2I_IS1N_Lb0EEENS2I_IS1N_Lb1EEENS2I_ISJ_IS2N_SL_S1F_IS2N_S2O_ELb0EELb0EEENS2I_IS32_Lb1EEENS2I_ISJ_IS2S_SL_S1F_IS2S_S2T_ELb0EELb0EEENS2I_IS36_Lb1EEEEEEJEEESt16integer_sequenceImJLm0EEEE14__visit_invokeESG_S3A_ in /usr/local/service/doris/lib/be/doris_be 10# doris::pipeline::StreamingAggLocalState::_pre_agg_with_serialized_key(doris::vectorized::Block*, doris::vectorized::Block*) in /usr/local/service/doris/lib/be/doris_be 11# doris::pipeline::StreamingAggLocalState::do_pre_agg(doris::vectorized::Block*, doris::vectorized::Block*) in /usr/local/service/doris/lib/be/doris_be 12# doris::pipeline::StreamingAggOperatorX::push(doris::RuntimeState*, doris::vectorized::Block*, bool) const in /usr/local/service/doris/lib/be/doris_be 13# doris::pipeline::StatefulOperatorX<doris::pipeline::StreamingAggLocalState>::get_block(doris::RuntimeState*, doris::vectorized::Block*, bool*) in /usr/local/service/doris/lib/be/doris_be 14# doris::pipeline::OperatorXBase::get_block_after_projects(doris::RuntimeState*, doris::vectorized::Block*, bool*) in /usr/local/service/doris/lib/be/doris_be 15# doris::pipeline::PipelineXTask::execute(bool*) in /usr/local/service/doris/lib/be/doris_be 16# doris::pipeline::TaskScheduler::_do_work(unsigned long) in /usr/local/service/doris/lib/be/doris_be 17# doris::ThreadPool::dispatch_thread() in /usr/local/service/doris/lib/be/doris_be 18# doris::Thread::supervise_thread(void*) in /usr/local/service/doris/lib/be/doris_be 19# start_thread in /lib64/libpthread.so.0 20# __clone in /lib64/libc.so.6 ```

… handling type mismatch in streaming_agg_serialize_to_column apache#50001

… handling type mismatch in streaming_agg_serialize_to_column #50001 (#50095) ### What problem does this PR solve? Cherry-picked from: #50001

@0x0

…pe mismatch in streaming_agg_serialize_to_column (apache#50001) ### What problem does this PR solve? Problem Summary: core ``` *** is nereids: 1 *** *** tablet id: 0 *** *** Aborted at 1744342233 (unix time) try "date -d @1744342233" if you are using GNU date *** *** Current BE git commitID: 2503281 *** *** SIGSEGV unknown detail explain (@0x0) received by PID 681431 (TID 683727 OR 0x7fcd153a0700) from PID 0; stack trace: *** 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) in /usr/local/service/doris/lib/be/doris_be 1# os::Linux::chained_handler(int, siginfo*, void*) in /usr/local/jdk/jre/lib/amd64/server/libjvm.so 2# JVM_handle_linux_signal in /usr/local/jdk/jre/lib/amd64/server/libjvm.so 3# signalHandler(int, siginfo*, void*) in /usr/local/jdk/jre/lib/amd64/server/libjvm.so 4# 0x00007FD26771E400 in /lib64/libc.so.6 5# doris::vectorized::ColumnArray::insert_from(doris::vectorized::IColumn const&, unsigned long) in /usr/local/service/doris/lib/be/doris_be 6# doris::vectorized::ColumnNullable::insert_from(doris::vectorized::IColumn const&, unsigned long) in /usr/local/service/doris/lib/be/doris_be 7# doris::vectorized::AggregateFunctionCollect<doris::vectorized::AggregateFunctionArrayAggData<void>, std::integral_constant<bool, false>, std::integral_constant<bool, true> >::streaming_agg_serialize_to_column(doris::vectorized::IColumn const**, COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>&, unsigned long, doris::vectorized::Arena*) const in /usr/local/service/doris/lib/be/doris_be 8# doris::vectorized::AggFnEvaluator::streaming_agg_serialize_to_column(doris::vectorized::Block*, COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>&, unsigned long, doris::vectorized::Arena*) in /usr/local/service/doris/lib/be/doris_be 9# _ZNSt8__detail9__variant17__gen_vtable_implINS0_12_Multi_arrayIPFNS0_21__deduce_visit_resultIN5doris6StatusEEEONS4_10vectorized8OverloadIJZNS4_8pipeline22StreamingAggLocalState28_pre_agg_with_serialized_keyEPNS7_5BlockESC_E3$_0ZNSA_28_pre_agg_with_serialized_keyESC_SC_E3$_1EEERSt7variantIJNS7_16MethodSerializedI9PHHashMapINS4_9StringRefEPc11DefaultHashISK_vELb0EEEENS7_15MethodOneNumberIhSJ_IhSL_SM_IhvELb0EEEENSQ_ItSJ_ItSL_SM_ItvELb0EEEENSQ_IjSJ_IjSL_9HashCRC32IjELb0EEEENSQ_ImSJ_ImSL_SX_ImELb0EEEENS7_19MethodStringNoCacheINS4_13StringHashMapISL_9AllocatorILb1ELb1ELb0E22DefaultMemoryAllocatorEEEEENSQ_INS7_7UInt128ESJ_IS1B_SL_SX_IS1B_ELb0EEEENSQ_IjSJ_IjSL_14HashMixWrapperIjSY_ELb0EEEENSQ_ImSJ_ImSL_S1F_ImS11_ELb0EEEENSQ_IS1B_SJ_IS1B_SL_S1F_IS1B_S1C_ELb0EEEENS7_26MethodSingleNullableColumnINSQ_IhNS7_15DataWithNullKeyISS_EEEEEENS1P_INSQ_ItNS1Q_ISV_EEEEEENS1P_INSQ_IjNS1Q_ISZ_EEEEEENS1P_INSQ_ImNS1Q_IS12_EEEEEENS1P_INSQ_IjNS1Q_IS1H_EEEEEENS1P_INSQ_ImNS1Q_IS1K_EEEEEENS1P_INSQ_IS1B_NS1Q_IS1D_EEEEEENS1P_INSQ_IS1B_NS1Q_IS1N_EEEEEENS1P_INS14_INS1Q_IS19_EEEEEENS7_15MethodKeysFixedIS12_Lb0EEENS2I_IS12_Lb1EEENS2I_IS1D_Lb0EEENS2I_IS1D_Lb1EEENS2I_ISJ_INS7_7UInt256ESL_SX_IS2N_ELb0EELb0EEENS2I_IS2P_Lb1EEENS2I_ISJ_INS7_7UInt136ESL_SX_IS2S_ELb0EELb0EEENS2I_IS2U_Lb1EEENS2I_IS1K_Lb0EEENS2I_IS1K_Lb1EEENS2I_IS1N_Lb0EEENS2I_IS1N_Lb1EEENS2I_ISJ_IS2N_SL_S1F_IS2N_S2O_ELb0EELb0EEENS2I_IS32_Lb1EEENS2I_ISJ_IS2S_SL_S1F_IS2S_S2T_ELb0EELb0EEENS2I_IS36_Lb1EEEEEEJEEESt16integer_sequenceImJLm0EEEE14__visit_invokeESG_S3A_ in /usr/local/service/doris/lib/be/doris_be 10# doris::pipeline::StreamingAggLocalState::_pre_agg_with_serialized_key(doris::vectorized::Block*, doris::vectorized::Block*) in /usr/local/service/doris/lib/be/doris_be 11# doris::pipeline::StreamingAggLocalState::do_pre_agg(doris::vectorized::Block*, doris::vectorized::Block*) in /usr/local/service/doris/lib/be/doris_be 12# doris::pipeline::StreamingAggOperatorX::push(doris::RuntimeState*, doris::vectorized::Block*, bool) const in /usr/local/service/doris/lib/be/doris_be 13# doris::pipeline::StatefulOperatorX<doris::pipeline::StreamingAggLocalState>::get_block(doris::RuntimeState*, doris::vectorized::Block*, bool*) in /usr/local/service/doris/lib/be/doris_be 14# doris::pipeline::OperatorXBase::get_block_after_projects(doris::RuntimeState*, doris::vectorized::Block*, bool*) in /usr/local/service/doris/lib/be/doris_be 15# doris::pipeline::PipelineXTask::execute(bool*) in /usr/local/service/doris/lib/be/doris_be 16# doris::pipeline::TaskScheduler::_do_work(unsigned long) in /usr/local/service/doris/lib/be/doris_be 17# doris::ThreadPool::dispatch_thread() in /usr/local/service/doris/lib/be/doris_be 18# doris::Thread::supervise_thread(void*) in /usr/local/service/doris/lib/be/doris_be 19# start_thread in /lib64/libpthread.so.0 20# __clone in /lib64/libc.so.6 ```

… handling type mismatch in streaming_agg_serialize_to_column #50001 (#50098) Cherry-picked from: #50001

@0x0

…pe mismatch in streaming_agg_serialize_to_column (apache#50001) ### What problem does this PR solve? Problem Summary: core ``` *** is nereids: 1 *** *** tablet id: 0 *** *** Aborted at 1744342233 (unix time) try "date -d @1744342233" if you are using GNU date *** *** Current BE git commitID: 2503281 *** *** SIGSEGV unknown detail explain (@0x0) received by PID 681431 (TID 683727 OR 0x7fcd153a0700) from PID 0; stack trace: *** 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) in /usr/local/service/doris/lib/be/doris_be 1# os::Linux::chained_handler(int, siginfo*, void*) in /usr/local/jdk/jre/lib/amd64/server/libjvm.so 2# JVM_handle_linux_signal in /usr/local/jdk/jre/lib/amd64/server/libjvm.so 3# signalHandler(int, siginfo*, void*) in /usr/local/jdk/jre/lib/amd64/server/libjvm.so 4# 0x00007FD26771E400 in /lib64/libc.so.6 5# doris::vectorized::ColumnArray::insert_from(doris::vectorized::IColumn const&, unsigned long) in /usr/local/service/doris/lib/be/doris_be 6# doris::vectorized::ColumnNullable::insert_from(doris::vectorized::IColumn const&, unsigned long) in /usr/local/service/doris/lib/be/doris_be 7# doris::vectorized::AggregateFunctionCollect<doris::vectorized::AggregateFunctionArrayAggData<void>, std::integral_constant<bool, false>, std::integral_constant<bool, true> >::streaming_agg_serialize_to_column(doris::vectorized::IColumn const**, COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>&, unsigned long, doris::vectorized::Arena*) const in /usr/local/service/doris/lib/be/doris_be 8# doris::vectorized::AggFnEvaluator::streaming_agg_serialize_to_column(doris::vectorized::Block*, COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>&, unsigned long, doris::vectorized::Arena*) in /usr/local/service/doris/lib/be/doris_be 9# _ZNSt8__detail9__variant17__gen_vtable_implINS0_12_Multi_arrayIPFNS0_21__deduce_visit_resultIN5doris6StatusEEEONS4_10vectorized8OverloadIJZNS4_8pipeline22StreamingAggLocalState28_pre_agg_with_serialized_keyEPNS7_5BlockESC_E3$_0ZNSA_28_pre_agg_with_serialized_keyESC_SC_E3$_1EEERSt7variantIJNS7_16MethodSerializedI9PHHashMapINS4_9StringRefEPc11DefaultHashISK_vELb0EEEENS7_15MethodOneNumberIhSJ_IhSL_SM_IhvELb0EEEENSQ_ItSJ_ItSL_SM_ItvELb0EEEENSQ_IjSJ_IjSL_9HashCRC32IjELb0EEEENSQ_ImSJ_ImSL_SX_ImELb0EEEENS7_19MethodStringNoCacheINS4_13StringHashMapISL_9AllocatorILb1ELb1ELb0E22DefaultMemoryAllocatorEEEEENSQ_INS7_7UInt128ESJ_IS1B_SL_SX_IS1B_ELb0EEEENSQ_IjSJ_IjSL_14HashMixWrapperIjSY_ELb0EEEENSQ_ImSJ_ImSL_S1F_ImS11_ELb0EEEENSQ_IS1B_SJ_IS1B_SL_S1F_IS1B_S1C_ELb0EEEENS7_26MethodSingleNullableColumnINSQ_IhNS7_15DataWithNullKeyISS_EEEEEENS1P_INSQ_ItNS1Q_ISV_EEEEEENS1P_INSQ_IjNS1Q_ISZ_EEEEEENS1P_INSQ_ImNS1Q_IS12_EEEEEENS1P_INSQ_IjNS1Q_IS1H_EEEEEENS1P_INSQ_ImNS1Q_IS1K_EEEEEENS1P_INSQ_IS1B_NS1Q_IS1D_EEEEEENS1P_INSQ_IS1B_NS1Q_IS1N_EEEEEENS1P_INS14_INS1Q_IS19_EEEEEENS7_15MethodKeysFixedIS12_Lb0EEENS2I_IS12_Lb1EEENS2I_IS1D_Lb0EEENS2I_IS1D_Lb1EEENS2I_ISJ_INS7_7UInt256ESL_SX_IS2N_ELb0EELb0EEENS2I_IS2P_Lb1EEENS2I_ISJ_INS7_7UInt136ESL_SX_IS2S_ELb0EELb0EEENS2I_IS2U_Lb1EEENS2I_IS1K_Lb0EEENS2I_IS1K_Lb1EEENS2I_IS1N_Lb0EEENS2I_IS1N_Lb1EEENS2I_ISJ_IS2N_SL_S1F_IS2N_S2O_ELb0EELb0EEENS2I_IS32_Lb1EEENS2I_ISJ_IS2S_SL_S1F_IS2S_S2T_ELb0EELb0EEENS2I_IS36_Lb1EEEEEEJEEESt16integer_sequenceImJLm0EEEE14__visit_invokeESG_S3A_ in /usr/local/service/doris/lib/be/doris_be 10# doris::pipeline::StreamingAggLocalState::_pre_agg_with_serialized_key(doris::vectorized::Block*, doris::vectorized::Block*) in /usr/local/service/doris/lib/be/doris_be 11# doris::pipeline::StreamingAggLocalState::do_pre_agg(doris::vectorized::Block*, doris::vectorized::Block*) in /usr/local/service/doris/lib/be/doris_be 12# doris::pipeline::StreamingAggOperatorX::push(doris::RuntimeState*, doris::vectorized::Block*, bool) const in /usr/local/service/doris/lib/be/doris_be 13# doris::pipeline::StatefulOperatorX<doris::pipeline::StreamingAggLocalState>::get_block(doris::RuntimeState*, doris::vectorized::Block*, bool*) in /usr/local/service/doris/lib/be/doris_be 14# doris::pipeline::OperatorXBase::get_block_after_projects(doris::RuntimeState*, doris::vectorized::Block*, bool*) in /usr/local/service/doris/lib/be/doris_be 15# doris::pipeline::PipelineXTask::execute(bool*) in /usr/local/service/doris/lib/be/doris_be 16# doris::pipeline::TaskScheduler::_do_work(unsigned long) in /usr/local/service/doris/lib/be/doris_be 17# doris::ThreadPool::dispatch_thread() in /usr/local/service/doris/lib/be/doris_be 18# doris::Thread::supervise_thread(void*) in /usr/local/service/doris/lib/be/doris_be 19# start_thread in /lib64/libpthread.so.0 20# __clone in /lib64/libc.so.6 ```

[fix](agg) prevent core dump in ColumnArray::size_at when handling ty…
b537bf6
…pe mismatch in streaming_agg_serialize_to_column

yiguolei reviewed Apr 14, 2025
View reviewed changes

cambyzju reviewed Apr 14, 2025
View reviewed changes

fix
8ffc405

fix case
61ebb0e

felixwluo force-pushed the fix-core-0412 branch from 86e9c15 to 61ebb0eCompare April 15, 2025 16:23

save
9aace24

felixwluo force-pushed the fix-core-0412 branch from 12185bb to 9aace24Compare April 15, 2025 17:00

Merge branch 'master' into fix-core-0412
073c9aa

felixwluo requested review from cambyzju and yiguolei April 16, 2025 06:04

HappenLee approved these changes Apr 16, 2025
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Apr 16, 2025

github-actionsBot added the reviewed label Apr 16, 2025

Gabriel39 approved these changes Apr 16, 2025
View reviewed changes

yiguolei approved these changes Apr 16, 2025
View reviewed changes

yiguolei added usercase Important user case type label p0_c dev/2.1.x dev/3.0.x labels Apr 16, 2025

yiguolei merged commit 40b3be8 into apache:masterApr 16, 2025

github-actionsBot added the dev/3.0.x-conflict label Apr 16, 2025

github-actionsBot mentioned this pull request Apr 16, 2025
branch-2.1: [fix](agg) prevent core dump in ColumnArray::size_at when handling type mismatch in streaming_agg_serialize_to_column #50001 #50091
Closed

felixwluo added a commit to felixwluo/doris that referenced this pull request Apr 16, 2025
branch-2.1: [fix](agg) prevent core dump in ColumnArray::size_at when…
20d0130
… handling type mismatch in streaming_agg_serialize_to_column apache#50001

yiguolei pushed a commit that referenced this pull request Apr 17, 2025
branch-2.1: [fix](agg) prevent core dump in ColumnArray::size_at when…
c3a201d
… handling type mismatch in streaming_agg_serialize_to_column #50001 (#50095) ### What problem does this PR solve? Cherry-picked from: #50001

yiguolei added dev/2.1.10-merged and removed dev/2.1.x labels Apr 17, 2025

dataroaring pushed a commit that referenced this pull request Apr 22, 2025
branch-3.0: [fix](agg) prevent core dump in ColumnArray::size_at when…
a461be6
… handling type mismatch in streaming_agg_serialize_to_column #50001 (#50098) Cherry-picked from: #50001

dataroaring added dev/3.0.6-merged and removed dev/3.0.x dev/3.0.x-conflict labels Apr 22, 2025

Uh oh!

Conversation

felixwluo commented Apr 12, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

hello-stephen commented Apr 12, 2025

Uh oh!

felixwluo commented Apr 12, 2025

Uh oh!

doris-robot commented Apr 12, 2025

Uh oh!

doris-robot commented Apr 12, 2025

Uh oh!

doris-robot commented Apr 12, 2025

Uh oh!

hello-stephen commented Apr 12, 2025

BE UT Coverage Report

Uh oh!

yiguolei left a comment

Choose a reason for hiding this comment

Uh oh!

cambyzjuApr 14, 2025

Choose a reason for hiding this comment

Uh oh!

felixwluo commented Apr 15, 2025

Uh oh!

doris-robot commented Apr 15, 2025

Uh oh!

doris-robot commented Apr 15, 2025

Uh oh!

doris-robot commented Apr 15, 2025

Uh oh!

hello-stephen commented Apr 15, 2025

BE UT Coverage Report

Uh oh!

felixwluo commented Apr 15, 2025

Uh oh!

felixwluo commented Apr 15, 2025

Uh oh!

doris-robot commented Apr 15, 2025

Uh oh!

doris-robot commented Apr 15, 2025

Uh oh!

doris-robot commented Apr 15, 2025

Uh oh!

hello-stephen commented Apr 15, 2025

BE UT Coverage Report

Uh oh!

felixwluo commented Apr 16, 2025

Uh oh!

doris-robot commented Apr 16, 2025

BE UT Coverage Report

Uh oh!

HappenLee left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Apr 16, 2025

Uh oh!

github-actionsBot commented Apr 16, 2025

Uh oh!

yiguolei left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

8 participants

felixwluo commented Apr 12, 2025•
edited
Loading