Skip to content

[feat](join) support outer join reorder in dphyper - #61146

Merged
starocean999 merged 27 commits into
apache:masterfrom
starocean999:dphyperv2
May 7, 2026
Merged

[feat](join) support outer join reorder in dphyper#61146
starocean999 merged 27 commits into
apache:masterfrom
starocean999:dphyperv2

Conversation

@starocean999

@starocean999starocean999 commented Mar 9, 2026

Copy link
Copy Markdown
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen

hello-stephen commented Mar 9, 2026

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@starocean999

starocean999 commented Mar 9, 2026

Copy link
Copy Markdown
ContributorAuthor

run buildall

@starocean999

starocean999 commented Mar 9, 2026

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Mar 9, 2026

Copy link
Copy Markdown
TPC-H: Total hot run time: 28409 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2bbaea10353cdb35e4f172620c799950350f246c, data reload: false
------ Round 1 ----------------------------------
============================================
q1	17628	4537	4297	4297
q2	q3	10651	809	546	546
q4	4677	362	253	253
q5	7543	1210	1026	1026
q6	171	174	143	143
q7	1344	1385	1196	1196
q8	9285	1454	1353	1353
q9	4869	4780	4661	4661
q10	6743	1373	1103	1103
q11	457	259	242	242
q12	705	566	469	469
q13	18046	2944	2210	2210
q14	233	230	212	212
q15	837	773	772	772
q16	723	717	672	672
q17	698	847	432	432
q18	5864	5425	5341	5341
q19	1261	967	603	603
q20	558	495	396	396
q21	4709	2199	2275	2199
q22	389	319	283	283
Total cold run time: 97391 ms
Total hot run time: 28409 ms
----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4846	4557	4548	4548
q2	q3	3884	4387	3785	3785
q4	904	1216	781	781
q5	4035	4391	4329	4329
q6	182	180	136	136
q7	2241	2062	1926	1926
q8	2623	2715	2566	2566
q9	7433	7426	7537	7426
q10	3325	3468	3088	3088
q11	523	428	423	423
q12	482	615	510	510
q13	2860	3086	2338	2338
q14	283	285	276	276
q15	845	835	825	825
q16	731	752	706	706
q17	1170	1534	1358	1358
q18	7292	6803	6583	6583
q19	872	818	908	818
q20	2151	2163	2003	2003
q21	4152	3686	3455	3455
q22	446	430	382	382
Total cold run time: 51280 ms
Total hot run time: 48262 ms

@doris-robot

doris-robot commented Mar 9, 2026

Copy link
Copy Markdown
TPC-DS: Total hot run time: 151599 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2bbaea10353cdb35e4f172620c799950350f246c, data reload: false
query5	4333	647	520	520
query6	323	249	233	233
query7	4204	466	274	274
query8	344	238	224	224
query9	8717	2721	2731	2721
query10	560	478	431	431
query11	7215	5633	5447	5447
query12	189	131	132	131
query13	1273	472	350	350
query14	6071	3779	3550	3550
query14_1	2703	2701	2706	2701
query15	208	195	180	180
query16	995	467	354	354
query17	1069	698	585	585
query18	2562	438	342	342
query19	210	203	184	184
query20	144	135	131	131
query21	230	150	127	127
query22	4823	4988	4895	4895
query23	16075	15688	15503	15503
query23_1	15572	16173	16072	16072
query24	8024	1008	590	590
query24_1	623	593	642	593
query25	581	480	418	418
query26	1311	275	160	160
query27	3342	499	324	324
query28	4661	1999	1941	1941
query29	789	517	430	430
query30	253	202	170	170
query31	1404	1328	1220	1220
query32	79	72	74	72
query33	502	340	297	297
query34	914	917	570	570
query35	634	664	590	590
query36	1101	1125	994	994
query37	140	92	87	87
query38	2953	2916	2930	2916
query39	888	872	841	841
query39_1	831	837	819	819
query40	232	195	132	132
query41	67	59	61	59
query42	309	296	306	296
query43	233	254	219	219
query44 query45	201	191	194	191
query46	931	1012	626	626
query47	2113	2138	2116	2116
query48	320	316	222	222
query49	634	472	408	408
query50	697	272	210	210
query51	4148	4067	4066	4066
query52	287	292	277	277
query53	295	330	274	274
query54	281	256	257	256
query55	92	86	77	77
query56	307	298	292	292
query57	1362	1341	1313	1313
query58	279	275	268	268
query59	1321	1419	1339	1339
query60	337	321	308	308
query61	130	127	132	127
query62	602	586	542	542
query63	314	275	270	270
query64	4734	944	658	658
query65 query66	1429	449	357	357
query67	16470	16377	16313	16313
query68 query69	388	315	277	277
query70	1041	952	865	865
query71	344	327	305	305
query72	14773	14045	14194	14045
query73	494	576	334	334
query74	9911	9869	9777	9777
query75	2798	2785	2450	2450
query76	2296	1077	650	650
query77	363	384	309	309
query78 query79	967	1064	590	590
query80	611	610	516	516
query81	480	285	240	240
query82	214	143	116	116
query83	190	188	171	171
query84	250	111	101	101
query85	779	435	369	369
query86	315	325	300	300
query87	3075	3119	3024	3024
query88	3526	2651	2638	2638
query89	394	380	351	351
query90	1998	174	175	174
query91	158	149	124	124
query92	79	74	71	71
query93	877	889	511	511
query94	406	304	268	268
query95	518	312	299	299
query96	630	527	227	227
query97	2453	2524	2420	2420
query98	235	223	216	216
query99	1002	993	919	919
Total cold run time: 230556 ms
Total hot run time: 151599 ms

@hello-stephen

hello-stephen commented Mar 9, 2026

Copy link
Copy Markdown
Contributor

FE UT Coverage Report

Increment line coverage 85.99% (1356/1577) 🎉
Increment coverage report
Complete coverage report

@starocean999

starocean999 commented Mar 9, 2026

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Mar 9, 2026

Copy link
Copy Markdown
TPC-H: Total hot run time: 27382 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4169a8c8a747c8e888a3c93cbad5edf7acd0baae, data reload: false
------ Round 1 ----------------------------------
============================================
q1	17660	4531	4281	4281
q2	q3	10637	780	513	513
q4	4691	368	247	247
q5	7565	1184	982	982
q6	180	178	146	146
q7	779	844	659	659
q8	9403	1452	1270	1270
q9	4849	4733	4654	4654
q10	6314	1918	1650	1650
q11	492	258	250	250
q12	741	570	475	475
q13	18035	2921	2174	2174
q14	236	232	216	216
q15	918	798	801	798
q16	750	720	659	659
q17	691	828	437	437
q18	5985	5458	5223	5223
q19	1388	1005	601	601
q20	493	516	398	398
q21	4475	2082	1464	1464
q22	383	335	285	285
Total cold run time: 96665 ms
Total hot run time: 27382 ms
----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4593	4567	4576	4567
q2	q3	3892	4320	3814	3814
q4	890	1185	784	784
q5	4058	4356	4322	4322
q6	181	172	136	136
q7	1792	1684	1554	1554
q8	2528	2748	2505	2505
q9	7554	7250	7356	7250
q10	3806	4004	3596	3596
q11	508	432	415	415
q12	479	577	453	453
q13	2685	3209	2365	2365
q14	283	294	273	273
q15	841	833	809	809
q16	725	753	714	714
q17	1341	1429	1383	1383
q18	7210	6828	6587	6587
q19	1073	886	864	864
q20	2162	2203	2067	2067
q21	3912	3447	3331	3331
q22	448	451	367	367
Total cold run time: 50961 ms
Total hot run time: 48156 ms

@doris-robot

doris-robot commented Mar 9, 2026

Copy link
Copy Markdown
TPC-DS: Total hot run time: 152511 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4169a8c8a747c8e888a3c93cbad5edf7acd0baae, data reload: false
query5	4316	634	504	504
query6	324	231	209	209
query7	4213	466	267	267
query8	363	253	240	240
query9	8779	2755	2719	2719
query10	522	383	340	340
query11	7336	5928	5573	5573
query12	187	130	122	122
query13	1268	472	369	369
query14	5749	3851	3593	3593
query14_1	2810	2795	2825	2795
query15	210	195	175	175
query16	1000	476	453	453
query17	1104	731	634	634
query18	2450	454	352	352
query19	221	209	180	180
query20	140	136	129	129
query21	233	140	123	123
query22	4878	5060	4888	4888
query23	16783	16014	15721	15721
query23_1	15714	15778	15713	15713
query24	8499	1694	1270	1270
query24_1	1313	1251	1377	1251
query25	573	530	455	455
query26	1015	282	182	182
query27	2816	498	309	309
query28	4428	1851	1847	1847
query29	843	563	462	462
query30	316	247	214	214
query31	1344	1296	1211	1211
query32	88	69	72	69
query33	508	323	267	267
query34	922	924	551	551
query35	648	666	615	615
query36	1095	1164	1010	1010
query37	134	92	86	86
query38	2972	2971	2835	2835
query39	942	878	854	854
query39_1	845	875	814	814
query40	228	149	137	137
query41	64	59	58	58
query42	308	298	292	292
query43	248	240	218	218
query44 query45	204	187	181	181
query46	895	977	622	622
query47	2121	2136	2062	2062
query48	306	327	232	232
query49	617	456	383	383
query50	676	279	210	210
query51	4143	4066	4016	4016
query52	288	295	284	284
query53	288	345	290	290
query54	291	266	271	266
query55	89	86	84	84
query56	326	319	312	312
query57	1363	1322	1297	1297
query58	284	275	275	275
query59	1320	1408	1318	1318
query60	336	343	314	314
query61	148	144	143	143
query62	618	572	540	540
query63	309	273	269	269
query64	4432	983	657	657
query65 query66	1435	497	358	358
query67	16351	16665	16321	16321
query68 query69	393	318	286	286
query70	984	975	968	968
query71	332	308	302	302
query72	2855	2696	2484	2484
query73	535	543	318	318
query74	10021	9881	9769	9769
query75	2843	2749	2480	2480
query76	2294	1038	672	672
query77	357	365	313	313
query78	11072	11246	10615	10615
query79	3260	778	584	584
query80	1722	624	547	547
query81	592	281	249	249
query82	989	148	116	116
query83	328	271	234	234
query84	256	111	94	94
query85	896	480	425	425
query86	502	301	290	290
query87	3140	3138	2987	2987
query88	4553	2643	2606	2606
query89	419	371	350	350
query90	2079	165	164	164
query91	166	164	132	132
query92	85	71	75	71
query93	2763	819	490	490
query94	660	285	291	285
query95	612	396	309	309
query96	629	515	225	225
query97	2468	2490	2400	2400
query98	259	221	216	216
query99	1029	1019	904	904
Total cold run time: 239702 ms
Total hot run time: 152511 ms

@hello-stephen

hello-stephen commented Mar 9, 2026

Copy link
Copy Markdown
Contributor

FE UT Coverage Report

Increment line coverage 85.14% (1335/1568) 🎉
Increment coverage report
Complete coverage report

@starocean999

starocean999 commented Mar 11, 2026

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Mar 11, 2026

Copy link
Copy Markdown
TPC-H: Total hot run time: 27761 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 48bc77792381e05a7eece5abe21cbd000382ddb8, data reload: false
------ Round 1 ----------------------------------
============================================
q1	17642	4557	4290	4290
q2	q3	10647	782	521	521
q4	4680	357	256	256
q5	7542	1205	1017	1017
q6	180	174	146	146
q7	796	834	678	678
q8	9311	1451	1519	1451
q9	4831	4693	4676	4676
q10	6260	1870	1644	1644
q11	472	255	239	239
q12	692	581	481	481
q13	18044	2882	2189	2189
q14	230	242	217	217
q15	893	795	795	795
q16	733	729	678	678
q17	729	852	437	437
q18	6012	5355	5223	5223
q19	1253	995	630	630
q20	496	498	397	397
q21	4698	2103	1507	1507
q22	393	326	289	289
Total cold run time: 96534 ms
Total hot run time: 27761 ms
----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4711	4555	4562	4555
q2	q3	3872	4304	3827	3827
q4	904	1192	762	762
q5	4100	4383	4320	4320
q6	181	177	141	141
q7	1868	1677	1526	1526
q8	2451	2778	2555	2555
q9	7531	7263	7376	7263
q10	3805	3978	3604	3604
q11	514	430	419	419
q12	484	602	437	437
q13	2695	3177	2270	2270
q14	276	368	394	368
q15	930	792	808	792
q16	713	768	721	721
q17	1144	1376	1376	1376
q18	7033	6699	6621	6621
q19	841	877	899	877
q20	2065	2155	2209	2155
q21	3942	3490	3415	3415
q22	461	421	397	397
Total cold run time: 50521 ms
Total hot run time: 48401 ms

@doris-robot

doris-robot commented Mar 11, 2026

Copy link
Copy Markdown
TPC-DS: Total hot run time: 152906 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 48bc77792381e05a7eece5abe21cbd000382ddb8, data reload: false
query5	4326	644	525	525
query6	342	232	219	219
query7	4206	494	276	276
query8	348	259	241	241
query9	8771	2785	2758	2758
query10	531	380	341	341
query11	7378	5953	5660	5660
query12	184	131	128	128
query13	1264	475	361	361
query14	5957	3945	3644	3644
query14_1	2885	2923	2887	2887
query15	215	189	177	177
query16	992	479	452	452
query17	1133	730	617	617
query18	2482	451	345	345
query19	221	210	187	187
query20	140	132	128	128
query21	228	161	126	126
query22	4984	4890	4836	4836
query23	15935	15500	15291	15291
query23_1	15416	16131	15839	15839
query24	7408	1726	1334	1334
query24_1	1322	1291	1321	1291
query25	623	534	486	486
query26	1425	277	167	167
query27	2911	510	301	301
query28	4992	2078	1915	1915
query29	912	594	497	497
query30	314	251	209	209
query31	1364	1296	1218	1218
query32	86	69	70	69
query33	515	331	267	267
query34	979	923	571	571
query35	641	678	589	589
query36	1097	1110	965	965
query37	133	95	80	80
query38	2963	2942	2942	2942
query39	898	890	855	855
query39_1	873	953	831	831
query40	228	153	137	137
query41	66	60	59	59
query42	311	302	291	291
query43	249	258	233	233
query44 query45	202	187	193	187
query46	887	1007	604	604
query47	2100	2092	1998	1998
query48	303	328	233	233
query49	632	465	404	404
query50	692	290	216	216
query51	4051	4100	4020	4020
query52	296	300	285	285
query53	286	334	288	288
query54	300	274	267	267
query55	95	95	88	88
query56	322	317	306	306
query57	1344	1306	1268	1268
query58	292	283	279	279
query59	1372	1469	1319	1319
query60	342	328	318	318
query61	149	151	141	141
query62	605	587	540	540
query63	316	280	285	280
query64	4760	932	665	665
query65 query66	1455	453	352	352
query67	16329	16545	16423	16423
query68 query69	400	325	282	282
query70	1005	978	909	909
query71	352	331	310	310
query72	2821	2654	2384	2384
query73	548	555	322	322
query74	10013	9907	9786	9786
query75	2853	2782	2490	2490
query76	2304	1055	696	696
query77	361	404	300	300
query78	11169	11410	10650	10650
query79	1137	799	609	609
query80	1556	623	540	540
query81	575	276	243	243
query82	1226	152	114	114
query83	341	269	240	240
query84	247	111	100	100
query85	1202	489	459	459
query86	419	318	298	298
query87	3246	3117	3097	3097
query88	3525	2657	2644	2644
query89	441	376	342	342
query90	1893	177	174	174
query91	176	187	132	132
query92	77	78	72	72
query93	940	882	503	503
query94	636	316	263	263
query95	577	404	321	321
query96	627	538	234	234
query97	2493	2481	2411	2411
query98	238	237	223	223
query99	1024	1000	905	905
Total cold run time: 234672 ms
Total hot run time: 152906 ms

@hello-stephen

hello-stephen commented Mar 11, 2026

Copy link
Copy Markdown
Contributor

FE UT Coverage Report

Increment line coverage 85.47% (1371/1604) 🎉
Increment coverage report
Complete coverage report

@starocean999

starocean999 commented Mar 13, 2026

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Mar 13, 2026

Copy link
Copy Markdown
TPC-H: Total hot run time: 26927 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d96ce294f381610ac73afdfed1f199cca996e633, data reload: false
------ Round 1 ----------------------------------
orders	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	17624	4424	4286	4286
q2	q3	10639	775	509	509
q4	4680	370	258	258
q5	7564	1200	1031	1031
q6	177	178	150	150
q7	772	844	675	675
q8	9290	1490	1337	1337
q9	4910	4792	4709	4709
q10	6255	1923	1646	1646
q11	449	270	249	249
q12	724	572	471	471
q13	18062	2925	2169	2169
q14	234	240	225	225
q15	q16	750	722	658	658
q17	731	819	493	493
q18	6094	5389	5343	5343
q19	1162	992	607	607
q20	546	499	390	390
q21	4408	1816	1407	1407
q22	496	421	314	314
Total cold run time: 95567 ms
Total hot run time: 26927 ms
----- Round 2, with runtime_filter_mode=off -----
orders	Doris	NULL	NULL	150000000	42	6422171781	NULL	22778155	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	4855	4544	4588	4544
q2	q3	3892	4317	3815	3815
q4	880	1238	801	801
q5	4066	4400	4369	4369
q6	190	184	145	145
q7	1772	1666	1531	1531
q8	2494	2757	2562	2562
q9	7869	7420	7485	7420
q10	3847	4041	3611	3611
q11	518	454	412	412
q12	477	602	449	449
q13	2687	3087	2325	2325
q14	275	286	269	269
q15	q16	707	776	755	755
q17	1186	1356	1356	1356
q18	7189	6659	6579	6579
q19	900	909	904	904
q20	2089	2237	2006	2006
q21	4080	3710	3339	3339
q22	453	443	388	388
Total cold run time: 50426 ms
Total hot run time: 47580 ms

@doris-robot

doris-robot commented Mar 13, 2026

Copy link
Copy Markdown
TPC-DS: Total hot run time: 167112 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d96ce294f381610ac73afdfed1f199cca996e633, data reload: false
query5	4324	626	515	515
query6	324	222	210	210
query7	4226	487	266	266
query8	335	254	224	224
query9	8800	2750	2724	2724
query10	519	363	335	335
query11	6992	5110	4881	4881
query12	187	127	128	127
query13	1267	458	342	342
query14	5539	3720	3442	3442
query14_1	2871	2822	2791	2791
query15	226	198	180	180
query16	1003	462	429	429
query17	984	717	633	633
query18	2448	455	356	356
query19	215	206	185	185
query20	138	130	126	126
query21	221	129	111	111
query22	13170	13902	14530	13902
query23	16258	15712	15617	15617
query23_1	15973	15531	15338	15338
query24	7324	1571	1223	1223
query24_1	1221	1235	1242	1235
query25	543	454	398	398
query26	1244	257	143	143
query27	2788	469	290	290
query28	4497	1862	1853	1853
query29	837	579	486	486
query30	297	227	193	193
query31	1013	940	870	870
query32	84	68	70	68
query33	503	365	279	279
query34	884	871	543	543
query35	638	700	592	592
query36	1075	1095	954	954
query37	132	99	82	82
query38	2944	2926	2888	2888
query39	857	833	820	820
query39_1	778	779	787	779
query40	230	150	135	135
query41	62	58	59	58
query42	259	258	255	255
query43	242	250	223	223
query44 query45	191	189	185	185
query46	860	990	609	609
query47	2088	2116	2045	2045
query48	320	308	227	227
query49	615	450	383	383
query50	675	275	222	222
query51	4060	4030	4011	4011
query52	266	264	255	255
query53	298	344	281	281
query54	293	258	256	256
query55	94	82	83	82
query56	314	320	308	308
query57	1934	1865	1728	1728
query58	310	273	272	272
query59	2814	2945	2733	2733
query60	343	331	320	320
query61	149	149	150	149
query62	633	586	526	526
query63	301	281	273	273
query64	4765	941	658	658
query65 query66	1456	445	352	352
query67	24248	24474	24148	24148
query68 query69	405	301	289	289
query70	988	1013	966	966
query71	347	307	311	307
query72	2756	2594	2281	2281
query73	524	542	310	310
query74	9578	9585	9351	9351
query75	2854	2730	2441	2441
query76	2281	1030	678	678
query77	351	363	302	302
query78	10809	11132	10438	10438
query79	1121	761	574	574
query80	670	626	552	552
query81	484	257	221	221
query82	1368	148	122	122
query83	375	264	250	250
query84	286	117	94	94
query85	863	479	445	445
query86	374	310	296	296
query87	3176	3103	3054	3054
query88	3526	2650	2630	2630
query89	433	372	358	358
query90	1988	173	168	168
query91	168	153	130	130
query92	78	74	73	73
query93	897	820	505	505
query94	458	308	287	287
query95	587	340	381	340
query96	625	512	227	227
query97	2501	2492	2358	2358
query98	240	221	227	221
query99	1000	962	922	922
Total cold run time: 247967 ms
Total hot run time: 167112 ms

@starocean999

starocean999 commented Mar 16, 2026

Copy link
Copy Markdown
ContributorAuthor

run buildall

@hello-stephen

hello-stephen commented Mar 16, 2026

Copy link
Copy Markdown
Contributor

FE UT Coverage Report

Increment line coverage 84.26% (1354/1607) 🎉
Increment coverage report
Complete coverage report

@doris-robot

doris-robot commented Mar 16, 2026

Copy link
Copy Markdown
TPC-H: Total hot run time: 26865 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 707151bd57c310c21b891070e8fa39bdfa8bed76, data reload: false
------ Round 1 ----------------------------------
orders	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	17577	4449	4298	4298
q2	q3	10644	788	521	521
q4	4682	359	251	251
q5	7562	1217	1013	1013
q6	177	176	146	146
q7	815	839	692	692
q8	9294	1454	1358	1358
q9	4911	4814	4729	4729
q10	6271	1923	1649	1649
q11	454	253	259	253
q12	712	581	464	464
q13	18036	2930	2193	2193
q14	234	222	211	211
q15	q16	731	745	670	670
q17	706	851	432	432
q18	6092	5437	5192	5192
q19	1111	994	615	615
q20	555	495	376	376
q21	4415	1865	1504	1504
q22	378	483	298	298
Total cold run time: 95357 ms
Total hot run time: 26865 ms
----- Round 2, with runtime_filter_mode=off -----
orders	Doris	NULL	NULL	150000000	42	6422171781	NULL	22778155	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	4772	4634	4592	4592
q2	q3	3875	4358	3830	3830
q4	886	1218	773	773
q5	4075	4463	4350	4350
q6	194	180	152	152
q7	1758	1684	1559	1559
q8	2507	2734	2598	2598
q9	7814	7462	7489	7462
q10	3799	3933	3615	3615
q11	510	432	413	413
q12	484	608	452	452
q13	2796	3172	2297	2297
q14	285	317	297	297
q15	q16	756	773	754	754
q17	1171	1328	1357	1328
q18	7269	6750	6788	6750
q19	928	880	881	880
q20	2040	2170	2165	2165
q21	4103	3475	3343	3343
q22	474	459	379	379
Total cold run time: 50496 ms
Total hot run time: 47989 ms

@doris-robot

doris-robot commented Mar 16, 2026

Copy link
Copy Markdown
TPC-DS: Total hot run time: 167837 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 707151bd57c310c21b891070e8fa39bdfa8bed76, data reload: false
query5	4314	628	503	503
query6	340	233	212	212
query7	4230	476	268	268
query8	337	244	237	237
query9	8752	2809	2774	2774
query10	525	378	356	356
query11	6998	5097	4911	4911
query12	186	127	125	125
query13	1270	460	345	345
query14	5788	3725	3457	3457
query14_1	2827	2807	2781	2781
query15	206	192	176	176
query16	974	476	465	465
query17	924	710	614	614
query18	2461	446	356	356
query19	224	219	190	190
query20	140	127	126	126
query21	210	138	114	114
query22	13245	14145	14605	14145
query23	16217	15913	15423	15423
query23_1	15593	15591	15385	15385
query24	7281	1589	1225	1225
query24_1	1185	1212	1215	1212
query25	535	462	396	396
query26	1244	262	146	146
query27	2781	489	293	293
query28	4491	1873	1859	1859
query29	834	550	507	507
query30	293	226	188	188
query31	1021	962	867	867
query32	81	70	71	70
query33	510	346	288	288
query34	908	875	530	530
query35	638	680	602	602
query36	1071	1178	1002	1002
query37	136	89	81	81
query38	2917	2953	2885	2885
query39	859	837	817	817
query39_1	789	790	797	790
query40	233	151	134	134
query41	61	60	58	58
query42	263	256	253	253
query43	243	245	224	224
query44 query45	202	193	179	179
query46	868	978	599	599
query47	3298	2129	2035	2035
query48	304	315	232	232
query49	627	455	368	368
query50	668	280	206	206
query51	4055	4089	4007	4007
query52	266	262	258	258
query53	283	331	286	286
query54	303	268	266	266
query55	93	85	84	84
query56	318	333	309	309
query57	1932	1680	1682	1680
query58	289	287	273	273
query59	2813	2916	2743	2743
query60	344	335	310	310
query61	155	144	148	144
query62	651	596	534	534
query63	316	281	273	273
query64	4708	934	678	678
query65 query66	1471	443	348	348
query67	24246	24231	24261	24231
query68 query69	408	325	288	288
query70	972	967	933	933
query71	347	323	306	306
query72	2758	2663	2392	2392
query73	525	532	319	319
query74	9632	9587	9414	9414
query75	2843	2738	2446	2446
query76	2291	1014	678	678
query77	361	390	318	318
query78	10955	11153	10471	10471
query79	1094	844	585	585
query80	713	625	533	533
query81	475	255	221	221
query82	1358	151	118	118
query83	376	266	251	251
query84	304	129	103	103
query85	928	558	515	515
query86	382	347	325	325
query87	3206	3107	3027	3027
query88	3621	2704	2700	2700
query89	426	370	346	346
query90	1984	179	177	177
query91	167	161	132	132
query92	74	75	70	70
query93	910	856	504	504
query94	440	320	285	285
query95	590	394	316	316
query96	635	510	234	234
query97	2459	2439	2382	2382
query98	228	222	225	222
query99	1025	996	929	929
Total cold run time: 249395 ms
Total hot run time: 167837 ms

@hello-stephen

hello-stephen commented Mar 16, 2026

Copy link
Copy Markdown
Contributor

FE UT Coverage Report

Increment line coverage 84.44% (1357/1607) 🎉
Increment coverage report
Complete coverage report

@starocean999

starocean999 commented Mar 17, 2026

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Mar 17, 2026

Copy link
Copy Markdown
TPC-H: Total hot run time: 26922 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ff5784f0f1c27c4c0dc48a9c6250186e905921dc, data reload: false
------ Round 1 ----------------------------------
orders	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	17633	4483	4268	4268
q2	q3	10647	808	516	516
q4	4706	365	258	258
q5	7789	1206	1017	1017
q6	217	173	148	148
q7	815	898	674	674
q8	10587	1491	1359	1359
q9	6281	4779	4740	4740
q10	6303	1940	1666	1666
q11	457	256	245	245
q12	742	601	463	463
q13	18061	2929	2174	2174
q14	229	232	207	207
q15	q16	751	726	682	682
q17	745	829	476	476
q18	5953	5508	5283	5283
q19	1214	977	617	617
q20	537	496	379	379
q21	4446	2356	1477	1477
q22	392	325	273	273
Total cold run time: 98505 ms
Total hot run time: 26922 ms
----- Round 2, with runtime_filter_mode=off -----
orders	Doris	NULL	NULL	150000000	42	6422171781	NULL	22778155	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL ============================================
q1	4758	4693	4626	4626
q2	q3	3929	4372	3845	3845
q4	897	1202	772	772
q5	4092	4435	4496	4435
q6	196	188	147	147
q7	1848	1643	1552	1552
q8	2490	2778	2619	2619
q9	7477	7229	7421	7229
q10	3746	4102	3699	3699
q11	514	445	431	431
q12	518	608	500	500
q13	2904	3228	2313	2313
q14	291	314	320	314
q15	q16	743	749	758	749
q17	1211	1424	1421	1421
q18	7143	6798	6598	6598
q19	998	933	914	914
q20	2076	2156	2069	2069
q21	3984	3587	3336	3336
q22	443	418	382	382
Total cold run time: 50258 ms
Total hot run time: 47951 ms

@doris-robot

doris-robot commented Mar 17, 2026

Copy link
Copy Markdown
TPC-DS: Total hot run time: 168082 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ff5784f0f1c27c4c0dc48a9c6250186e905921dc, data reload: false
query5	4326	652	520	520
query6	329	221	204	204
query7	4206	469	265	265
query8	346	239	222	222
query9	8794	2730	2749	2730
query10	522	379	344	344
query11	6934	5078	4891	4891
query12	191	135	130	130
query13	1268	450	361	361
query14	5767	3690	3483	3483
query14_1	2874	2851	2845	2845
query15	211	194	173	173
query16	982	432	470	432
query17	898	751	648	648
query18	2464	454	353	353
query19	223	225	198	198
query20	142	133	127	127
query21	217	142	117	117
query22	13280	13923	15039	13923
query23	16121	15930	15504	15504
query23_1	15737	15996	15575	15575
query24	8022	1815	1298	1298
query24_1	1282	1271	1211	1211
query25	587	461	440	440
query26	1245	264	148	148
query27	2767	489	294	294
query28	4486	1861	1866	1861
query29	899	581	476	476
query30	297	224	187	187
query31	1005	969	873	873
query32	98	71	69	69
query33	515	333	280	280
query34	897	884	542	542
query35	648	684	620	620
query36	1059	1132	985	985
query37	140	94	84	84
query38	2949	2991	2881	2881
query39	855	843	809	809
query39_1	780	820	793	793
query40	235	157	134	134
query41	64	61	58	58
query42	259	250	257	250
query43	242	243	224	224
query44 query45	201	195	185	185
query46	898	974	609	609
query47	2157	2139	2078	2078
query48	309	314	229	229
query49	648	464	379	379
query50	684	277	206	206
query51	4033	4080	3953	3953
query52	259	284	258	258
query53	293	341	285	285
query54	307	280	267	267
query55	98	85	84	84
query56	314	335	312	312
query57	1936	1712	1671	1671
query58	296	276	273	273
query59	2816	2943	2745	2745
query60	346	337	335	335
query61	160	166	154	154
query62	609	584	534	534
query63	316	285	278	278
query64	4933	967	669	669
query65 query66	1465	453	361	361
query67	24141	24242	24095	24095
query68 query69	425	339	293	293
query70	977	974	934	934
query71	354	315	308	308
query72	2740	2722	2524	2524
query73	536	540	324	324
query74	9599	9525	9392	9392
query75	2848	2734	2485	2485
query76	2294	1044	672	672
query77	360	385	309	309
query78	10938	11223	10506	10506
query79	1099	825	584	584
query80	708	634	561	561
query81	480	259	231	231
query82	1344	156	139	139
query83	380	267	244	244
query84	306	121	103	103
query85	875	523	505	505
query86	375	313	292	292
query87	3116	3066	3012	3012
query88	3559	2657	2649	2649
query89	438	387	349	349
query90	1975	175	167	167
query91	178	169	141	141
query92	84	75	74	74
query93	911	886	500	500
query94	446	325	297	297
query95	588	345	377	345
query96	658	516	233	233
query97	2487	2534	2390	2390
query98	233	221	216	216
query99	1029	992	919	919
Total cold run time: 248394 ms
Total hot run time: 168082 ms

@starocean999

starocean999 commented May 7, 2026

Copy link
Copy Markdown
ContributorAuthor

run buildall

@starocean999
starocean999 merged commit 5de1ed8 into apache:masterMay 7, 2026
30 of 31 checks passed
zhaorongsheng pushed a commit to zhaorongsheng/doris that referenced this pull request Jun 4, 2026
@starocean999zhaorongsheng
[feat](join) support outer join reorder in dphyper (apache#61146)
eb60c83
@starocean999starocean999 mentioned this pull request Jun 11, 2026
Merged
16 tasks
morrySnow pushed a commit that referenced this pull request Jun 16, 2026
@starocean999
[fix](fe) Add MergeProjectable after ColumnPruning in DPHyp join reor…
513bf29
…der to merge consecutive projects (#64409)
Related PR: (#61146)
After DPHyp join reorder, the ColumnPruning rule may produce consecutive
Project nodes in the plan tree. Subsequent optimization rules expect
normalized plan shapes and may not handle chains of consecutive projects
correctly, leading to plan corruption or incorrect results.
This is because the DPHyp reorder path runs a separate rewrite pipeline
(pushDownRewrite → columnPrune) on the reordered plan before
re-inserting it into the memo. Unlike the main rewrite pipeline which
includes MergeProjectable in its standard rule sequence, the DPHyp
post-reorder pipeline omitted this cleanup step.
Fix: Add MergeProjectable after ColumnPruning in the DPHyp rewrite
pipeline within Optimizer.dpHypOptimize(). This ensures that any
consecutive Project nodes generated by column pruning are merged into a
single project, maintaining a normalized plan shape for downstream
rules.
@starocean999starocean999 mentioned this pull request Jul 16, 2026
Merged
16 tasks
morrySnow pushed a commit that referenced this pull request Aug 4, 2026
@starocean999
[fix](dphyp) Fix DPHyp join reorder producing wrong results for alias…
3347ea6
…es on nullable side of outer join (#65682)
Related PR: #61146
#### Problem Summary:
When enable_dphyp_optimizer=true, DPHyp join reorder can produce wrong
results for queries where the nullable side of an outer join contains
Alias/Project expressions with functions like COALESCE, IFNULL, or
CAST(COALESCE(...)).
#### Root Cause: HyperGraph.Builder.addAlias() unconditionally adds all aliases to
aliasReplaceMap, including those defined on the nullable side of outer
joins. This causes their defining expressions to be "unwrapped" and
later reconstructed by PlanReceiver.proposeProject() ABOVE the outer
join via finalProjects. The expression then operates on null-extended
values, changing semantics — e.g., COALESCE(NULL, 0) = 0 instead of the
correct NULL for non-matching outer join rows.
#### Fix: Added an isNullableSide context flag that propagates through
buildForDPhyper() and addAlias() during graph construction. When
processing an outer join:
LEFT OUTER JOIN → right child flagged as nullable
RIGHT OUTER JOIN → left child flagged as nullable
FULL OUTER JOIN → both children flagged as nullable
The flag propagates through nested projects and inner joins
Aliases on the nullable side are not added to aliasReplaceMap,
preserving the original Project boundary below the outer join so that
expressions execute before null-extension.
wyxxxcat pushed a commit to wyxxxcat/doris that referenced this pull request Aug 17, 2026
@starocean999@wyxxxcat
[fix](dphyp) Fix DPHyp join reorder producing wrong results for alias…
f44aaec
…es on nullable side of outer join (apache#65682)
Related PR: apache#61146
#### Problem Summary:
When enable_dphyp_optimizer=true, DPHyp join reorder can produce wrong
results for queries where the nullable side of an outer join contains
Alias/Project expressions with functions like COALESCE, IFNULL, or
CAST(COALESCE(...)).
#### Root Cause: HyperGraph.Builder.addAlias() unconditionally adds all aliases to
aliasReplaceMap, including those defined on the nullable side of outer
joins. This causes their defining expressions to be "unwrapped" and
later reconstructed by PlanReceiver.proposeProject() ABOVE the outer
join via finalProjects. The expression then operates on null-extended
values, changing semantics — e.g., COALESCE(NULL, 0) = 0 instead of the
correct NULL for non-matching outer join rows.
#### Fix: Added an isNullableSide context flag that propagates through
buildForDPhyper() and addAlias() during graph construction. When
processing an outer join:
LEFT OUTER JOIN → right child flagged as nullable
RIGHT OUTER JOIN → left child flagged as nullable
FULL OUTER JOIN → both children flagged as nullable
The flag propagates through nested projects and inner joins
Aliases on the nullable side are not added to aliasReplaceMap,
preserving the original Project boundary below the outer join so that
expressions execute before null-extension.
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morrySnowmorrySnowmorrySnow approved these changes

Assignees

No one assigned

Labels

dev/5.0.x

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@starocean999@hello-stephen@doris-robot@morrySnow