[fix](mtmv) Fix query err when calc mv functional dependency which has variant and log more detailed info for troubleshoot a problem by seawinde · Pull Request #59933 · apache/doris

seawinde · 2026-01-15T12:26:16Z

What problem does this PR solve?

Fix query err when calc mv fd by catch it and log more detailed info for troubleshoot a problem

originOutputs.size() should equlas targetOutputs.size(), if not would throw exception, this would cause query err,
should log err log and not cause query err
current log could not find the root cause, so add detail log
fix the problem by mapping the slot full path name between scan mv output and mv sql plan output

for example as following

CREATETABLEfact_var (
k INT,
v VARIANT
) ENGINE=OLAP
DUPLICATE KEY(k)
DISTRIBUTED BY HASH(k) BUCKETS 1
PROPERTIES ("replication_num"="1");
INSERT INTO fact_var VALUES
(1, '{"a":1,"b":{"c":10,"d":20}}'),
(2, '{"a":2,"b":{"c":30}}');
CREATE MATERIALIZED VIEW mv_var
BUILD IMMEDIATE REFRESH COMPLETE ON MANUAL
DISTRIBUTED BY RANDOM BUCKETS 2
PROPERTIES ('replication_num'='1') ASSELECT k, v
FROM fact_var;

if run query as fllowing, mv_var sacn would return k, v, v['a'] but mv_var def plan sql, would return k, v,
the size is different but also can work after the fix

SELECT v['a'] AS c_val FROM mv_var;

Issue Number: close #xxx

Related PR: #40106

Problem Summary:

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

Thearas · 2026-01-15T12:26:23Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

seawinde · 2026-01-15T12:26:26Z

run buildall

doris-robot · 2026-01-15T12:52:32Z

TPC-H: Total hot run time: 31730 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0462473f3dd36c2d0ac938ca0db7f08159f967ec, data reload: false
------ Round 1 ----------------------------------
q1	17614	4169	5011	4169
q2	2064	373	245	245
q3	10111	1320	706	706
q4	10220	893	314	314
q5	7578	2277	1829	1829
q6	187	172	139	139
q7	921	778	663	663
q8	9269	1357	1101	1101
q9	4878	4727	4629	4629
q10	6770	1794	1419	1419
q11	522	304	289	289
q12	711	745	584	584
q13	17772	3856	3085	3085
q14	292	303	279	279
q15	566	511	508	508
q16	694	674	642	642
q17	650	832	520	520
q18	6853	6478	6471	6471
q19	1246	981	647	647
q20	398	363	242	242
q21	3039	2449	2269	2269
q22	1037	1002	980	980
Total cold run time: 103392 ms
Total hot run time: 31730 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4130	4031	4053	4031
q2	354	388	313	313
q3	2076	2588	2185	2185
q4	1339	1747	1323	1323
q5	4101	4057	3982	3982
q6	207	170	131	131
q7	1822	1832	2065	1832
q8	2645	2462	2458	2458
q9	7138	7248	7108	7108
q10	2741	2739	2318	2318
q11	559	503	523	503
q12	806	745	637	637
q13	3569	4115	3316	3316
q14	314	329	270	270
q15	547	486	495	486
q16	666	703	651	651
q17	1190	1332	1348	1332
q18	8077	7856	7821	7821
q19	946	860	912	860
q20	2032	2104	1967	1967
q21	4839	4450	4385	4385
q22	1187	1120	1034	1034
Total cold run time: 51285 ms
Total hot run time: 48943 ms

doris-robot · 2026-01-15T13:03:21Z

TPC-DS: Total hot run time: 174122 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0462473f3dd36c2d0ac938ca0db7f08159f967ec, data reload: false
query5	4392	627	482	482
query6	325	262	209	209
query7	4211	441	252	252
query8	345	250	228	228
query9	8670	2905	2857	2857
query10	531	372	337	337
query11	15284	15198	14823	14823
query12	167	111	108	108
query13	1240	461	361	361
query14	5622	3065	2804	2804
query14_1	2655	2793	2631	2631
query15	205	192	175	175
query16	978	485	468	468
query17	1112	676	586	586
query18	2433	445	342	342
query19	224	224	199	199
query20	132	117	117	117
query21	208	136	126	126
query22	4060	4277	4053	4053
query23	16967	16318	15621	15621
query23_1	15893	15855	15788	15788
query24	7402	1583	1154	1154
query24_1	1165	1178	1163	1163
query25	557	466	414	414
query26	1249	255	146	146
query27	2785	432	278	278
query28	4593	2123	2102	2102
query29	758	543	443	443
query30	304	245	203	203
query31	793	620	557	557
query32	79	71	70	70
query33	516	386	293	293
query34	921	870	524	524
query35	709	771	676	676
query36	928	899	822	822
query37	133	90	77	77
query38	2697	2662	2587	2587
query39	769	778	713	713
query39_1	709	727	704	704
query40	217	134	115	115
query41	63	61	60	60
query42	98	98	95	95
query43	447	450	414	414
query44	1288	727	724	724
query45	182	180	173	173
query46	831	944	567	567
query47	1410	1441	1373	1373
query48	308	314	241	241
query49	595	410	323	323
query50	629	266	196	196
query51	3773	3824	3789	3789
query52	105	105	95	95
query53	291	321	271	271
query54	283	265	270	265
query55	78	79	75	75
query56	314	302	305	302
query57	1053	1030	897	897
query58	273	288	249	249
query59	2021	2159	2137	2137
query60	321	329	315	315
query61	161	154	154	154
query62	389	365	308	308
query63	291	264	263	263
query64	4859	1269	955	955
query65	3816	3763	3589	3589
query66	1458	401	321	321
query67	15564	15669	15300	15300
query68	2430	1073	738	738
query69	442	361	320	320
query70	1022	860	933	860
query71	316	309	288	288
query72	5403	3167	3314	3167
query73	589	713	302	302
query74	8762	8703	8669	8669
query75	2713	2825	2435	2435
query76	2279	1042	661	661
query77	361	377	296	296
query78	9725	9867	9131	9131
query79	2531	884	588	588
query80	1741	572	501	501
query81	544	264	222	222
query82	984	147	113	113
query83	328	250	242	242
query84	253	112	88	88
query85	932	482	455	455
query86	401	302	279	279
query87	2894	2871	2805	2805
query88	3473	2584	2551	2551
query89	368	340	320	320
query90	2014	169	170	169
query91	176	171	138	138
query92	72	71	67	67
query93	1178	888	527	527
query94	652	332	307	307
query95	585	377	315	315
query96	644	495	224	224
query97	2381	2346	2327	2327
query98	232	198	193	193
query99	602	561	524	524
Total cold run time: 250239 ms
Total hot run time: 174122 ms

doris-robot · 2026-01-15T13:08:22Z

ClickBench: Total hot run time: 26.96 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0462473f3dd36c2d0ac938ca0db7f08159f967ec, data reload: false
query1	0.05	0.05	0.05
query2	0.09	0.04	0.05
query3	0.26	0.08	0.09
query4	1.61	0.12	0.11
query5	0.27	0.26	0.26
query6	1.15	0.68	0.65
query7	0.03	0.02	0.02
query8	0.06	0.04	0.04
query9	0.56	0.51	0.49
query10	0.56	0.54	0.55
query11	0.14	0.09	0.10
query12	0.15	0.10	0.11
query13	0.61	0.59	0.59
query14	0.95	0.96	0.93
query15	0.79	0.78	0.79
query16	0.38	0.39	0.40
query17	1.05	1.06	1.04
query18	0.22	0.20	0.21
query19	1.89	1.80	1.89
query20	0.02	0.02	0.01
query21	15.44	0.28	0.13
query22	5.01	0.05	0.05
query23	15.89	0.27	0.10
query24	0.94	0.57	0.58
query25	0.11	0.06	0.06
query26	0.14	0.13	0.14
query27	0.09	0.06	0.07
query28	4.73	1.06	0.88
query29	12.53	3.91	3.19
query30	0.29	0.13	0.12
query31	2.81	0.64	0.39
query32	3.24	0.55	0.46
query33	2.92	2.95	3.03
query34	16.00	5.09	4.41
query35	4.45	4.41	4.40
query36	0.65	0.51	0.49
query37	0.11	0.07	0.07
query38	0.08	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.12
query41	0.09	0.04	0.03
query42	0.04	0.04	0.03
query43	0.04	0.04	0.04
Total cold run time: 96.65 s
Total hot run time: 26.96 s

seawinde · 2026-01-16T07:36:44Z

run buildall

doris-robot · 2026-01-16T08:22:43Z

TPC-H: Total hot run time: 32382 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e5a3283b4d77be1362ad984cd74e63c620bfb3f9, data reload: false
------ Round 1 ----------------------------------
q1	17593	4279	4073	4073
q2	2080	377	251	251
q3	10126	1292	775	775
q4	10235	964	325	325
q5	7528	2150	1868	1868
q6	188	167	137	137
q7	919	820	655	655
q8	9271	1609	1135	1135
q9	4914	4638	4662	4638
q10	6728	1850	1416	1416
q11	538	317	295	295
q12	714	774	615	615
q13	17757	3866	3084	3084
q14	302	292	280	280
q15	571	517	517	517
q16	689	689	633	633
q17	696	833	524	524
q18	6721	6600	7060	6600
q19	1172	1076	686	686
q20	432	397	280	280
q21	3342	2704	2538	2538
q22	1145	1061	1057	1057
Total cold run time: 103661 ms
Total hot run time: 32382 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4521	4341	4322	4322
q2	335	424	340	340
q3	2364	2780	2331	2331
q4	1438	1935	1452	1452
q5	4569	4296	4462	4296
q6	228	172	136	136
q7	2119	1911	1823	1823
q8	2637	2438	2541	2438
q9	7120	7492	7044	7044
q10	2637	2850	2301	2301
q11	560	470	470	470
q12	692	737	658	658
q13	3849	4137	3128	3128
q14	268	288	270	270
q15	521	491	486	486
q16	665	667	624	624
q17	1136	1281	1332	1281
q18	7601	7444	7209	7209
q19	911	833	812	812
q20	1898	1998	1864	1864
q21	4614	4295	4127	4127
q22	1115	1031	984	984
Total cold run time: 51798 ms
Total hot run time: 48396 ms

doris-robot · 2026-01-16T08:33:32Z

TPC-DS: Total hot run time: 174953 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e5a3283b4d77be1362ad984cd74e63c620bfb3f9, data reload: false
query5	4902	617	484	484
query6	332	232	232	232
query7	4234	459	270	270
query8	336	243	251	243
query9	8762	2947	2917	2917
query10	569	389	346	346
query11	15211	15192	14955	14955
query12	203	120	117	117
query13	1257	505	382	382
query14	6615	3052	2794	2794
query14_1	2669	2654	2640	2640
query15	203	195	180	180
query16	1003	483	472	472
query17	1068	675	567	567
query18	2728	437	346	346
query19	222	218	199	199
query20	120	117	115	115
query21	219	140	125	125
query22	3906	4109	3813	3813
query23	16189	15724	15264	15264
query23_1	15535	15503	15411	15411
query24	7127	1564	1191	1191
query24_1	1194	1248	1224	1224
query25	533	443	388	388
query26	1237	273	152	152
query27	2772	462	294	294
query28	4489	2371	2318	2318
query29	756	515	409	409
query30	313	246	206	206
query31	829	633	580	580
query32	83	75	77	75
query33	521	358	309	309
query34	943	876	543	543
query35	734	771	680	680
query36	914	934	858	858
query37	147	97	88	88
query38	2729	2722	2650	2650
query39	788	758	757	757
query39_1	714	720	724	720
query40	224	137	121	121
query41	68	63	62	62
query42	105	106	107	106
query43	467	446	417	417
query44	1339	761	755	755
query45	188	191	178	178
query46	849	942	596	596
query47	1437	1526	1379	1379
query48	340	331	241	241
query49	604	446	377	377
query50	646	273	207	207
query51	3775	3771	3776	3771
query52	117	111	99	99
query53	300	333	270	270
query54	300	275	255	255
query55	85	86	78	78
query56	320	335	336	335
query57	991	1013	942	942
query58	282	271	269	269
query59	2194	2333	2113	2113
query60	346	345	325	325
query61	148	149	149	149
query62	407	389	326	326
query63	303	275	268	268
query64	4854	1274	1008	1008
query65	3922	3785	3797	3785
query66	1400	427	325	325
query67	15669	15629	15524	15524
query68	2378	1158	880	880
query69	473	371	343	343
query70	1085	1017	986	986
query71	339	315	309	309
query72	5306	3278	3230	3230
query73	685	755	339	339
query74	8709	8820	8601	8601
query75	2744	2809	2466	2466
query76	2276	1083	672	672
query77	369	388	328	328
query78	9898	9980	9163	9163
query79	1106	932	604	604
query80	670	568	506	506
query81	493	266	232	232
query82	1340	158	120	120
query83	378	266	250	250
query84	253	117	95	95
query85	829	495	437	437
query86	362	311	301	301
query87	3001	2851	2764	2764
query88	3556	2630	2617	2617
query89	395	351	326	326
query90	1884	179	164	164
query91	169	164	139	139
query92	78	75	71	71
query93	930	943	554	554
query94	454	324	315	315
query95	592	336	324	324
query96	648	510	232	232
query97	2399	2416	2346	2346
query98	226	211	201	201
query99	611	580	503	503
Total cold run time: 248787 ms
Total hot run time: 174953 ms

doris-robot · 2026-01-16T08:38:32Z

ClickBench: Total hot run time: 27.08 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e5a3283b4d77be1362ad984cd74e63c620bfb3f9, data reload: false
query1	0.06	0.05	0.05
query2	0.11	0.05	0.05
query3	0.27	0.09	0.09
query4	1.61	0.11	0.11
query5	0.28	0.26	0.25
query6	1.16	0.68	0.66
query7	0.04	0.03	0.02
query8	0.06	0.04	0.04
query9	0.57	0.52	0.50
query10	0.56	0.55	0.55
query11	0.14	0.10	0.10
query12	0.15	0.11	0.11
query13	0.59	0.58	0.58
query14	0.96	0.95	0.95
query15	0.79	0.78	0.79
query16	0.38	0.43	0.39
query17	1.04	1.06	1.06
query18	0.22	0.21	0.21
query19	1.89	1.82	1.76
query20	0.02	0.05	0.01
query21	15.45	0.29	0.15
query22	5.36	0.06	0.05
query23	15.90	0.28	0.10
query24	0.99	0.63	0.50
query25	0.07	0.07	0.07
query26	0.15	0.15	0.13
query27	0.08	0.05	0.06
query28	3.45	1.10	0.88
query29	12.53	3.96	3.13
query30	0.27	0.14	0.12
query31	2.82	0.64	0.40
query32	3.29	0.56	0.46
query33	2.96	3.06	3.12
query34	15.98	5.10	4.43
query35	4.45	4.44	4.42
query36	0.66	0.50	0.50
query37	0.11	0.07	0.06
query38	0.08	0.04	0.04
query39	0.05	0.03	0.03
query40	0.18	0.14	0.14
query41	0.09	0.04	0.03
query42	0.05	0.03	0.03
query43	0.05	0.03	0.03
Total cold run time: 95.92 s
Total hot run time: 27.08 s

hello-stephen · 2026-01-16T08:45:46Z

FE UT Coverage Report

Increment line coverage 90.91% (20/22) 🎉
Increment coverage report
Complete coverage report

hello-stephen · 2026-01-16T10:33:58Z

FE Regression Coverage Report

Increment line coverage 90.91% (20/22) 🎉
Increment coverage report
Complete coverage report

seawinde · 2026-03-12T07:34:37Z

run buildall

seawinde · 2026-03-12T08:29:56Z

run buildall

seawinde · 2026-03-12T11:29:04Z

run buildall

doris-robot · 2026-03-12T11:50:20Z

TPC-H: Total hot run time: 27670 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 155f82ba3de60c0577a7c6850058fda293c8c1a3, data reload: false
------ Round 1 ----------------------------------
============================================
q1	17664	4520	4275	4275
q2	q3	10643	793	509	509
q4	4675	366	254	254
q5	7549	1205	1032	1032
q6	178	176	146	146
q7	773	827	669	669
q8	9466	1469	1299	1299
q9	4839	4747	4724	4724
q10	6335	1904	1680	1680
q11	453	281	250	250
q12	761	563	464	464
q13	18081	2999	2160	2160
q14	228	227	226	226
q15	936	799	819	799
q16	756	731	711	711
q17	709	839	445	445
q18	5975	5354	5217	5217
q19	1154	1003	622	622
q20	497	499	391	391
q21	4525	2119	1542	1542
q22	394	312	255	255
Total cold run time: 96591 ms
Total hot run time: 27670 ms
----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4757	4521	4549	4521
q2	q3	3888	4350	3858	3858
q4	887	1197	772	772
q5	4095	4326	4366	4326
q6	184	170	140	140
q7	1809	1644	1566	1566
q8	2493	2804	2562	2562
q9	7612	7444	7390	7390
q10	3732	3972	3675	3675
q11	528	437	418	418
q12	502	616	456	456
q13	2717	3280	2357	2357
q14	278	297	280	280
q15	907	780	822	780
q16	737	768	694	694
q17	1146	1580	1365	1365
q18	7212	7044	6589	6589
q19	893	893	912	893
q20	2129	2259	2046	2046
q21	3941	3463	3280	3280
q22	498	528	434	434
Total cold run time: 50945 ms
Total hot run time: 48402 ms

doris-robot · 2026-03-12T12:00:24Z

TPC-DS: Total hot run time: 153869 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 155f82ba3de60c0577a7c6850058fda293c8c1a3, data reload: false
query5	4324	642	510	510
query6	335	231	207	207
query7	4212	455	280	280
query8	349	258	239	239
query9	8696	2757	2738	2738
query10	544	395	362	362
query11	7333	5903	5667	5667
query12	184	126	127	126
query13	1259	460	365	365
query14	5760	3812	3569	3569
query14_1	2840	2815	2825	2815
query15	211	195	185	185
query16	972	478	460	460
query17	1069	753	634	634
query18	2444	452	349	349
query19	220	215	192	192
query20	136	130	129	129
query21	226	151	130	130
query22	5011	4918	4799	4799
query23	16905	16030	16009	16009
query23_1	16047	15787	15875	15787
query24	7257	1677	1254	1254
query24_1	1279	1274	1279	1274
query25	566	504	449	449
query26	1114	331	174	174
query27	3917	502	303	303
query28	4513	1887	1846	1846
query29	845	563	487	487
query30	315	247	207	207
query31	1388	1294	1221	1221
query32	85	76	68	68
query33	526	326	282	282
query34	901	930	571	571
query35	631	678	594	594
query36	1087	1149	948	948
query37	126	92	86	86
query38	2926	2937	2871	2871
query39	895	870	845	845
query39_1	847	840	827	827
query40	225	149	138	138
query41	63	60	58	58
query42	309	298	307	298
query43	241	266	233	233
query44 query45	200	190	181	181
query46	894	996	637	637
query47	2184	2175	2064	2064
query48	338	323	237	237
query49	682	475	375	375
query50	708	287	212	212
query51	4186	4184	4131	4131
query52	291	297	287	287
query53	297	343	281	281
query54	302	298	274	274
query55	91	90	88	88
query56	318	318	320	318
query57	1351	1356	1279	1279
query58	301	288	283	283
query59	1371	1503	1367	1367
query60	361	350	334	334
query61	149	140	148	140
query62	709	593	558	558
query63	317	282	275	275
query64	4693	1240	1012	1012
query65 query66	1397	446	348	348
query67	16522	16442	16446	16442
query68 query69	377	303	289	289
query70	988	959	981	959
query71	344	311	302	302
query72	2754	2655	2399	2399
query73	548	556	318	318
query74	9975	9952	9786	9786
query75	2842	2760	2488	2488
query76	2282	1049	665	665
query77	366	375	316	316
query78	11077	11189	10648	10648
query79	3016	809	588	588
query80	1710	630	542	542
query81	593	279	251	251
query82	1007	149	117	117
query83	331	277	248	248
query84	263	120	101	101
query85	890	490	430	430
query86	531	313	300	300
query87	3186	3095	3058	3058
query88	3627	2642	2630	2630
query89	424	368	349	349
query90	2089	178	173	173
query91	160	157	136	136
query92	85	76	73	73
query93	2717	824	495	495
query94	637	326	287	287
query95	582	335	385	335
query96	653	514	229	229
query97	2476	2489	2447	2447
query98	238	223	218	218
query99	1003	1003	927	927
Total cold run time: 238573 ms
Total hot run time: 153869 ms

hello-stephen · 2026-03-12T12:45:41Z

FE UT Coverage Report

Increment line coverage 90.91% (20/22) 🎉
Increment coverage report
Complete coverage report

seawinde · 2026-03-15T14:04:12Z

runbuildall

seawinde · 2026-03-15T23:56:32Z

run buildall

doris-robot · 2026-03-16T00:25:50Z

TPC-H: Total hot run time: 26814 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 657c01e1357cf3be6ac1339dba444a8ed80b0866, data reload: false
------ Round 1 ----------------------------------
orders	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	17648	4502	4337	4337
q2	q3	10648	803	508	508
q4	4670	368	250	250
q5	7563	1188	1018	1018
q6	178	178	152	152
q7	790	842	680	680
q8	9307	1447	1292	1292
q9	4875	4781	4694	4694
q10	6317	1900	1658	1658
q11	464	267	242	242
q12	750	571	477	477
q13	18039	2932	2169	2169
q14	233	227	218	218
q15	q16	737	746	672	672
q17	714	840	466	466
q18	5790	5399	5178	5178
q19	1119	987	631	631
q20	559	513	382	382
q21	4594	1870	1467	1467
q22	357	464	323	323
Total cold run time: 95352 ms
Total hot run time: 26814 ms
----- Round 2, with runtime_filter_mode=off -----
orders	Doris	NULL	NULL	150000000	42	6422171781	NULL	22778155	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	4778	4658	4574	4574
q2	q3	3899	4389	3844	3844
q4	900	1193	818	818
q5	4178	4393	4333	4333
q6	187	181	143	143
q7	1771	1665	1502	1502
q8	2502	2752	2955	2752
q9	7504	7385	7429	7385
q10	3744	3979	3703	3703
q11	537	452	424	424
q12	503	602	442	442
q13	2708	3291	2345	2345
q14	292	326	296	296
q15	q16	757	792	710	710
q17	1184	1443	1394	1394
q18	7068	6803	6537	6537
q19	876	962	927	927
q20	2045	2145	2001	2001
q21	4267	3518	3417	3417
q22	488	438	414	414
Total cold run time: 50188 ms
Total hot run time: 47961 ms

doris-robot · 2026-03-16T00:36:39Z

TPC-DS: Total hot run time: 168771 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 657c01e1357cf3be6ac1339dba444a8ed80b0866, data reload: false
query5	4317	640	506	506
query6	326	224	206	206
query7	4217	474	264	264
query8	340	253	237	237
query9	8715	2733	2749	2733
query10	530	404	353	353
query11	7040	5095	4900	4900
query12	190	126	123	123
query13	1274	478	355	355
query14	5761	3752	3507	3507
query14_1	2859	2844	2820	2820
query15	213	193	176	176
query16	980	469	466	466
query17	884	733	642	642
query18	2445	452	355	355
query19	214	212	187	187
query20	133	126	126	126
query21	221	138	121	121
query22	13443	14251	15048	14251
query23	16070	16104	15576	15576
query23_1	15615	15643	15896	15643
query24	7178	1648	1244	1244
query24_1	1228	1244	1251	1244
query25	583	519	437	437
query26	1249	273	148	148
query27	2775	501	298	298
query28	4992	1883	1864	1864
query29	864	599	513	513
query30	302	233	198	198
query31	1011	955	904	904
query32	83	69	68	68
query33	501	342	292	292
query34	897	899	537	537
query35	651	675	600	600
query36	1098	1168	1001	1001
query37	136	102	84	84
query38	3014	2943	2860	2860
query39	844	819	814	814
query39_1	812	790	807	790
query40	226	154	136	136
query41	63	59	57	57
query42	261	256	257	256
query43	240	253	212	212
query44 query45	199	190	191	190
query46	906	1005	625	625
query47	2129	2175	1999	1999
query48	320	315	230	230
query49	636	456	396	396
query50	679	270	216	216
query51	4023	4106	4001	4001
query52	268	276	253	253
query53	306	339	282	282
query54	296	276	268	268
query55	88	92	88	88
query56	320	320	341	320
query57	1909	1852	1806	1806
query58	286	281	273	273
query59	2795	2924	2768	2768
query60	347	339	321	321
query61	157	150	152	150
query62	619	596	540	540
query63	322	285	276	276
query64	5127	1241	983	983
query65 query66	1470	465	355	355
query67	24130	24340	24195	24195
query68 query69	399	318	301	301
query70	984	943	889	889
query71	341	314	303	303
query72	2719	2617	2396	2396
query73	548	540	313	313
query74	9583	9544	9398	9398
query75	2909	2754	2487	2487
query76	2294	1062	686	686
query77	361	392	307	307
query78	10883	11083	10422	10422
query79	2590	787	595	595
query80	1789	613	558	558
query81	557	262	228	228
query82	996	152	121	121
query83	337	267	245	245
query84	301	113	93	93
query85	907	486	436	436
query86	410	297	290	290
query87	3116	3096	2980	2980
query88	3592	2672	2645	2645
query89	431	375	353	353
query90	2038	187	180	180
query91	168	163	139	139
query92	78	74	73	73
query93	1158	866	505	505
query94	639	330	299	299
query95	588	393	315	315
query96	644	532	231	231
query97	2450	2505	2394	2394
query98	240	218	217	217
query99	1023	976	872	872
Total cold run time: 251604 ms
Total hot run time: 168771 ms

hello-stephen · 2026-03-16T01:21:56Z

FE UT Coverage Report

Increment line coverage 57.14% (16/28) 🎉
Increment coverage report
Complete coverage report

…tailed info for troubleshoot a problem

…against MV physical column size and add new workflow files.

…queue size immutable, and improve thread-safety documentation for lineage plugins.

…actor test column creation in `LogicalOlapScanTest`.

seawinde · 2026-03-16T05:34:22Z

run buildall

doris-robot · 2026-03-16T05:56:09Z

TPC-H: Total hot run time: 26925 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 436d7591560451c9680b900189241d03e5bf3812, data reload: false
------ Round 1 ----------------------------------
orders	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	17592	4483	4294	4294
q2	q3	10649	772	508	508
q4	4681	370	254	254
q5	7562	1191	1023	1023
q6	175	176	145	145
q7	777	846	668	668
q8	9291	1485	1323	1323
q9	4793	4755	4757	4755
q10	6247	1904	1651	1651
q11	443	264	237	237
q12	682	595	458	458
q13	18031	2970	2164	2164
q14	227	226	212	212
q15	q16	739	757	671	671
q17	704	843	448	448
q18	6056	5434	5376	5376
q19	1123	969	599	599
q20	524	495	368	368
q21	4387	1830	1427	1427
q22	346	450	344	344
Total cold run time: 95029 ms
Total hot run time: 26925 ms
----- Round 2, with runtime_filter_mode=off -----
orders	Doris	NULL	NULL	150000000	42	6422171781	NULL	22778155	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	4775	4623	4581	4581
q2	q3	3897	4395	3840	3840
q4	897	1237	763	763
q5	4045	4412	4334	4334
q6	183	174	143	143
q7	1775	1704	1528	1528
q8	2464	2728	2619	2619
q9	7673	7476	7484	7476
q10	3762	3986	3579	3579
q11	516	447	433	433
q12	463	590	450	450
q13	2813	3076	2313	2313
q14	318	297	270	270
q15	q16	709	794	747	747
q17	1191	1339	1319	1319
q18	7220	6729	6665	6665
q19	890	883	926	883
q20	2073	2170	2005	2005
q21	3945	3456	3463	3456
q22	459	455	390	390
Total cold run time: 50068 ms
Total hot run time: 47794 ms

doris-robot · 2026-03-16T06:06:55Z

TPC-DS: Total hot run time: 167842 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 436d7591560451c9680b900189241d03e5bf3812, data reload: false
query5	4322	628	509	509
query6	359	218	194	194
query7	4229	458	261	261
query8	345	229	215	215
query9	8760	2759	2711	2711
query10	518	386	350	350
query11	7003	5092	4871	4871
query12	179	127	126	126
query13	1255	445	348	348
query14	5800	3703	3441	3441
query14_1	2824	2826	2873	2826
query15	197	189	170	170
query16	999	454	471	454
query17	1080	697	595	595
query18	2494	425	328	328
query19	202	201	178	178
query20	132	125	123	123
query21	212	126	110	110
query22	13213	14018	14766	14018
query23	16378	15968	15635	15635
query23_1	15645	15499	15333	15333
query24	7348	1625	1219	1219
query24_1	1217	1219	1212	1212
query25	565	456	398	398
query26	1231	260	145	145
query27	2785	476	289	289
query28	4533	1856	1858	1856
query29	836	558	474	474
query30	333	221	187	187
query31	998	934	869	869
query32	84	69	66	66
query33	509	334	281	281
query34	885	866	544	544
query35	644	684	594	594
query36	1104	1157	989	989
query37	126	93	80	80
query38	2964	2913	2841	2841
query39	881	836	805	805
query39_1	803	799	797	797
query40	227	152	136	136
query41	62	60	58	58
query42	263	257	254	254
query43	236	251	223	223
query44 query45	194	187	180	180
query46	883	970	593	593
query47	2713	2180	2102	2102
query48	300	310	224	224
query49	628	462	380	380
query50	672	276	214	214
query51	4048	3976	3980	3976
query52	264	263	260	260
query53	293	339	285	285
query54	300	264	265	264
query55	91	87	82	82
query56	319	333	298	298
query57	1937	1815	1764	1764
query58	281	272	265	265
query59	2824	2955	2729	2729
query60	335	341	323	323
query61	150	147	146	146
query62	629	579	527	527
query63	307	282	282	282
query64	5167	1372	1097	1097
query65 query66	1463	469	379	379
query67	24201	24275	24205	24205
query68 query69	420	312	288	288
query70	942	865	986	865
query71	359	325	305	305
query72	3016	2859	2419	2419
query73	546	545	328	328
query74	9620	9604	9401	9401
query75	2829	2766	2485	2485
query76	2289	1023	678	678
query77	363	366	306	306
query78	10942	11074	10488	10488
query79	2302	765	573	573
query80	1674	633	531	531
query81	563	263	224	224
query82	1019	157	119	119
query83	331	260	248	248
query84	246	120	107	107
query85	891	486	434	434
query86	417	297	287	287
query87	3166	3121	3033	3033
query88	3529	2649	2632	2632
query89	429	376	340	340
query90	2024	180	171	171
query91	161	162	133	133
query92	75	80	70	70
query93	1015	852	492	492
query94	641	333	284	284
query95	573	402	323	323
query96	651	519	227	227
query97	2457	2465	2421	2421
query98	230	219	219	219
query99	1013	1011	910	910
Total cold run time: 251514 ms
Total hot run time: 167842 ms

github-actions · 2026-03-20T08:06:55Z

PR approved by at least one committer and no changes requested.

github-actions · 2026-03-20T08:06:57Z

PR approved by anyone and no changes requested.

yujun777

LGTM

seawinde · 2026-03-20T09:08:46Z

run buildall

doris-robot · 2026-03-20T09:51:57Z

TPC-H: Total hot run time: 26761 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 436d7591560451c9680b900189241d03e5bf3812, data reload: false
------ Round 1 ----------------------------------
orders	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	17639	4480	4279	4279
q2	q3	10642	801	524	524
q4	4680	358	245	245
q5	7565	1188	1037	1037
q6	172	185	147	147
q7	782	846	671	671
q8	9581	1434	1305	1305
q9	5228	4753	4711	4711
q10	6325	1912	1649	1649
q11	485	261	262	261
q12	746	589	460	460
q13	18032	2995	2182	2182
q14	225	239	210	210
q15	q16	761	741	659	659
q17	748	834	438	438
q18	5884	5337	5245	5245
q19	1170	985	604	604
q20	525	500	375	375
q21	4524	1843	1473	1473
q22	497	372	286	286
Total cold run time: 96211 ms
Total hot run time: 26761 ms
----- Round 2, with runtime_filter_mode=off -----
orders	Doris	NULL	NULL	150000000	42	6422171781	NULL	22778155	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	4772	4722	4563	4563
q2	q3	3878	4331	3828	3828
q4	860	1194	796	796
q5	4071	4470	4450	4450
q6	187	174	136	136
q7	1771	1657	1545	1545
q8	2507	2770	2647	2647
q9	7574	7308	7269	7269
q10	3739	3988	3584	3584
q11	543	478	443	443
q12	503	621	458	458
q13	2718	3325	2377	2377
q14	298	308	308	308
q15	q16	718	794	735	735
q17	1199	1360	1358	1358
q18	7141	6999	6815	6815
q19	914	933	939	933
q20	2067	2138	2038	2038
q21	3918	3448	3383	3383
q22	539	444	397	397
Total cold run time: 49917 ms
Total hot run time: 48063 ms

doris-robot · 2026-03-20T10:02:41Z

TPC-DS: Total hot run time: 168560 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 436d7591560451c9680b900189241d03e5bf3812, data reload: false
query5	4334	634	508	508
query6	331	240	204	204
query7	4217	489	264	264
query8	335	238	224	224
query9	8725	2770	2732	2732
query10	533	382	333	333
query11	6969	5132	4867	4867
query12	190	127	129	127
query13	1289	466	351	351
query14	5849	3727	3483	3483
query14_1	2843	2899	2827	2827
query15	215	194	176	176
query16	970	479	451	451
query17	905	729	628	628
query18	2474	462	364	364
query19	218	211	191	191
query20	136	131	128	128
query21	220	142	111	111
query22	13300	14215	14600	14215
query23	16312	15796	15606	15606
query23_1	15650	15584	15819	15584
query24	7212	1649	1245	1245
query24_1	1246	1240	1244	1240
query25	545	458	406	406
query26	1240	266	152	152
query27	2727	491	304	304
query28	4442	1849	1822	1822
query29	829	582	489	489
query30	299	227	194	194
query31	988	959	878	878
query32	83	69	69	69
query33	524	339	294	294
query34	907	868	542	542
query35	652	677	596	596
query36	1106	1094	1006	1006
query37	138	100	79	79
query38	2958	2891	2860	2860
query39	849	822	810	810
query39_1	791	803	786	786
query40	232	154	140	140
query41	66	61	57	57
query42	267	256	261	256
query43	245	255	224	224
query44 query45	193	198	181	181
query46	907	997	621	621
query47	2077	2144	2035	2035
query48	311	319	239	239
query49	629	456	394	394
query50	726	303	257	257
query51	4234	4020	3992	3992
query52	266	265	257	257
query53	290	359	280	280
query54	310	273	269	269
query55	86	91	86	86
query56	319	328	310	310
query57	1921	1715	1792	1715
query58	280	274	273	273
query59	2774	2927	2745	2745
query60	336	344	330	330
query61	155	152	154	152
query62	623	587	533	533
query63	316	280	274	274
query64	4854	1274	1005	1005
query65 query66	1441	460	355	355
query67	24272	24273	24156	24156
query68 query69	412	313	283	283
query70	933	914	938	914
query71	338	312	292	292
query72	2843	2674	2388	2388
query73	567	559	321	321
query74	9622	9500	9419	9419
query75	2859	2761	2478	2478
query76	2282	1038	700	700
query77	360	393	315	315
query78	10934	11031	10443	10443
query79	1172	774	581	581
query80	1315	656	544	544
query81	547	255	222	222
query82	984	158	119	119
query83	346	270	245	245
query84	300	130	100	100
query85	911	508	450	450
query86	416	333	292	292
query87	3128	3106	3020	3020
query88	3626	2680	2684	2680
query89	434	379	341	341
query90	2032	183	192	183
query91	170	171	142	142
query92	73	79	73	73
query93	1036	801	507	507
query94	645	325	283	283
query95	598	343	316	316
query96	660	553	231	231
query97	2484	2480	2372	2372
query98	233	221	228	221
query99	1014	999	918	918
Total cold run time: 249326 ms
Total hot run time: 168560 ms

hello-stephen · 2026-03-20T10:22:20Z

FE UT Coverage Report

Increment line coverage 75.00% (21/28) 🎉
Increment coverage report
Complete coverage report

…s variant and log more detailed info for troubleshoot a problem (#59933) Fix query err when calc mv fd by catch it and log more detailed info for troubleshoot a problem 1. originOutputs.size() should equlas targetOutputs.size(), if not would throw exception, this would cause query err, should log err log and not cause query err 2. current log could not find the root cause, so add detail log 3. fix the problem by mapping the slot full path name between scan mv output and mv sql plan output for example as following ```sql CREATE TABLE fact_var ( k INT, v VARIANT ) ENGINE=OLAP DUPLICATE KEY(k) DISTRIBUTED BY HASH(k) BUCKETS 1 PROPERTIES ("replication_num" = "1"); INSERT INTO fact_var VALUES (1, '{"a":1,"b":{"c":10,"d":20}}'), (2, '{"a":2,"b":{"c":30}}'); CREATE MATERIALIZED VIEW mv_var BUILD IMMEDIATE REFRESH COMPLETE ON MANUAL DISTRIBUTED BY RANDOM BUCKETS 2 PROPERTIES ('replication_num' = '1') AS SELECT k, v FROM fact_var; ``` if run query as fllowing, mv_var sacn would return k, v, v['a'] but mv_var def plan sql, would return k, v, the size is different but also can work after the fix ```sql SELECT v['a'] AS c_val FROM mv_var; ``` Related PR: #40106

…ncy which has variant and log more detailed info for troubleshoot a problem #59933 (#61659) Cherry-picked from #59933 Co-authored-by: seawinde <wusi@selectdb.com>

…ncy which has variant and log more detailed info for troubleshoot a problem #59933 (#61661) Cherry-picked from #59933 Co-authored-by: seawinde <wusi@selectdb.com>

…s variant and log more detailed info for troubleshoot a problem (apache#59933) Fix query err when calc mv fd by catch it and log more detailed info for troubleshoot a problem 1. originOutputs.size() should equlas targetOutputs.size(), if not would throw exception, this would cause query err, should log err log and not cause query err 2. current log could not find the root cause, so add detail log 3. fix the problem by mapping the slot full path name between scan mv output and mv sql plan output for example as following ```sql CREATE TABLE fact_var ( k INT, v VARIANT ) ENGINE=OLAP DUPLICATE KEY(k) DISTRIBUTED BY HASH(k) BUCKETS 1 PROPERTIES ("replication_num" = "1"); INSERT INTO fact_var VALUES (1, '{"a":1,"b":{"c":10,"d":20}}'), (2, '{"a":2,"b":{"c":30}}'); CREATE MATERIALIZED VIEW mv_var BUILD IMMEDIATE REFRESH COMPLETE ON MANUAL DISTRIBUTED BY RANDOM BUCKETS 2 PROPERTIES ('replication_num' = '1') AS SELECT k, v FROM fact_var; ``` if run query as fllowing, mv_var sacn would return k, v, v['a'] but mv_var def plan sql, would return k, v, the size is different but also can work after the fix ```sql SELECT v['a'] AS c_val FROM mv_var; ``` Related PR: apache#40106

seawinde changed the title ~~[fix](mtmv) Fix query err when calc mv fd by catch it and log more detailed info for troubleshoot a problem~~[fix](mtmv) Fix query err when calc mv functional dependency which has variant and log more detailed info for troubleshoot a problemJan 16, 2026

seawinde force-pushed the add_log_for_mv_fd_calc_and_catch_exception branch from e5a3283 to 6cac6c9Compare March 12, 2026 07:33

seawinde force-pushed the add_log_for_mv_fd_calc_and_catch_exception branch from c012b43 to 155f82bCompare March 12, 2026 11:28

seawinde added 5 commits March 16, 2026 13:33

[fix](mtmv) Fix query err when calc mv fd by catch it and log more de…
901d7b5
…tailed info for troubleshoot a problem

add test
72b2b54

opt code to support variant
9ef9ca5

feat: update LogicalOlapScanTest to validate constructReplaceMap …
792ee20
…against MV physical column size and add new workflow files.

feat: Add configurable lineage plugin activation, make lineage event …
f0ce291
…queue size immutable, and improve thread-safety documentation for lineage plugins.

docs: Add design document for nested MV predicate rewrite fix and ref…
436d759
…actor test column creation in `LogicalOlapScanTest`.

seawinde force-pushed the add_log_for_mv_fd_calc_and_catch_exception branch from 7eb51e0 to 436d759Compare March 16, 2026 05:33

morrySnow added dev/4.0.x dev/4.1.x labels Mar 20, 2026

morrySnow approved these changes Mar 20, 2026
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Mar 20, 2026

github-actionsBot added the reviewed label Mar 20, 2026

yujun777 approved these changes Mar 20, 2026
View reviewed changes

starocean999 merged commit 08203ba into apache:masterMar 24, 2026
30 of 32 checks passed

github-actionsBot mentioned this pull request Mar 24, 2026
branch-4.0: [fix](mtmv) Fix query err when calc mv functional dependency which has variant and log more detailed info for troubleshoot a problem #59933 #61659
Merged

github-actionsBot mentioned this pull request Mar 24, 2026
branch-4.1: [fix](mtmv) Fix query err when calc mv functional dependency which has variant and log more detailed info for troubleshoot a problem #59933 #61661
Merged

yiguolei added dev/4.0.5-merged dev/4.1.0-merged and removed dev/4.0.x dev/4.1.x labels Mar 24, 2026

yiguolei mentioned this pull request Mar 27, 2026
4.0.5 Release Notes #61817
Closed

Uh oh!

Conversation

seawinde commented Jan 15, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

Thearas commented Jan 15, 2026

Uh oh!

seawinde commented Jan 15, 2026

Uh oh!

doris-robot commented Jan 15, 2026

Uh oh!

doris-robot commented Jan 15, 2026

Uh oh!

doris-robot commented Jan 15, 2026

Uh oh!

seawinde commented Jan 16, 2026

Uh oh!

doris-robot commented Jan 16, 2026

Uh oh!

doris-robot commented Jan 16, 2026

Uh oh!

doris-robot commented Jan 16, 2026

Uh oh!

hello-stephen commented Jan 16, 2026

FE UT Coverage Report

Uh oh!

hello-stephen commented Jan 16, 2026

FE Regression Coverage Report

Uh oh!

seawinde commented Mar 12, 2026

Uh oh!

seawinde commented Mar 12, 2026

Uh oh!

seawinde commented Mar 12, 2026

Uh oh!

doris-robot commented Mar 12, 2026

Uh oh!

doris-robot commented Mar 12, 2026

Uh oh!

hello-stephen commented Mar 12, 2026

FE UT Coverage Report

Uh oh!

seawinde commented Mar 15, 2026

Uh oh!

seawinde commented Mar 15, 2026

Uh oh!

doris-robot commented Mar 16, 2026

Uh oh!

doris-robot commented Mar 16, 2026

Uh oh!

hello-stephen commented Mar 16, 2026

FE UT Coverage Report

Uh oh!

seawinde commented Mar 16, 2026

Uh oh!

doris-robot commented Mar 16, 2026

Uh oh!

doris-robot commented Mar 16, 2026

Uh oh!

github-actionsBot commented Mar 20, 2026

Uh oh!

github-actionsBot commented Mar 20, 2026

Uh oh!

yujun777 left a comment

Choose a reason for hiding this comment

Uh oh!

seawinde commented Mar 20, 2026

Uh oh!

doris-robot commented Mar 20, 2026

Uh oh!

doris-robot commented Mar 20, 2026

Uh oh!

hello-stephen commented Mar 20, 2026

FE UT Coverage Report

Uh oh!

Uh oh!

seawinde commented Jan 15, 2026•
edited
Loading