Skip to content

[feature](nereids)support stream load, routine load and broker load in nereids - #49116

Merged
starocean999 merged 35 commits into
apache:masterfrom
starocean999:master_new_nereids
Apr 29, 2025
Merged

[feature](nereids)support stream load, routine load and broker load in nereids#49116
starocean999 merged 35 commits into
apache:masterfrom
starocean999:master_new_nereids

Conversation

@starocean999

@starocean999starocean999 commented Mar 16, 2025

Copy link
Copy Markdown
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen

hello-stephen commented Mar 16, 2025

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@starocean999

starocean999 commented Mar 16, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

1 similar comment
@starocean999

starocean999 commented Mar 16, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Mar 16, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 33094 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 65d57dd7d24d4c86f3cd57069ecc9ae68aec8431, data reload: false
------ Round 1 ----------------------------------
q1	17616	5634	5161	5161
q2	2035	295	169	169
q3	10414	1316	753	753
q4	10221	1070	587	587
q5	7540	2391	2441	2391
q6	206	179	135	135
q7	952	796	627	627
q8	9319	1400	1152	1152
q9	5260	4705	4854	4705
q10	6871	2328	1948	1948
q11	491	289	263	263
q12	370	373	225	225
q13	17786	3831	3178	3178
q14	239	235	211	211
q15	562	495	500	495
q16	635	637	596	596
q17	585	908	360	360
q18	6862	6556	6379	6379
q19	1217	956	573	573
q20	335	345	199	199
q21	2844	2309	1999	1999
q22	1064	1042	988	988
Total cold run time: 103424 ms
Total hot run time: 33094 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5544	5264	5268	5264
q2	254	341	238	238
q3	2205	2722	2295	2295
q4	1588	1936	1449	1449
q5	4407	4206	4227	4206
q6	232	182	127	127
q7	2135	1983	1801	1801
q8	2828	2878	2782	2782
q9	7104	7115	7162	7115
q10	3113	3319	2843	2843
q11	620	531	524	524
q12	728	807	614	614
q13	3550	3947	3448	3448
q14	288	298	290	290
q15	529	485	496	485
q16	651	720	638	638
q17	1213	1699	1451	1451
q18	7967	7721	7457	7457
q19	858	848	1050	848
q20	2050	2019	1904	1904
q21	5770	5133	5054	5054
q22	1126	1068	1019	1019
Total cold run time: 54760 ms
Total hot run time: 51852 ms

@doris-robot

doris-robot commented Mar 16, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 184549 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 65d57dd7d24d4c86f3cd57069ecc9ae68aec8431, data reload: false
query1	982	403	390	390
query2	6538	1915	1907	1907
query3	6789	217	219	217
query4	26952	23255	22854	22854
query5	4368	663	468	468
query6	300	204	183	183
query7	4604	494	289	289
query8	301	243	242	242
query9	8658	2617	2598	2598
query10	481	320	251	251
query11	15476	15532	14916	14916
query12	152	111	104	104
query13	1662	531	406	406
query14	8634	6561	6114	6114
query15	203	186	170	170
query16	7141	634	493	493
query17	1008	719	570	570
query18	1942	401	308	308
query19	199	184	161	161
query20	125	118	114	114
query21	213	125	107	107
query22	4072	4287	4169	4169
query23	33900	32833	32960	32833
query24	7701	2362	2383	2362
query25	537	445	380	380
query26	1226	267	155	155
query27	2629	464	326	326
query28	4365	2397	2385	2385
query29	779	543	424	424
query30	283	217	189	189
query31	939	857	766	766
query32	71	68	60	60
query33	565	350	292	292
query34	796	837	507	507
query35	791	870	748	748
query36	942	967	886	886
query37	115	100	77	77
query38	4109	4237	4210	4210
query39	1483	1403	1394	1394
query40	203	112	102	102
query41	54	50	55	50
query42	126	106	106	106
query43	473	494	478	478
query44	1276	778	769	769
query45	174	167	166	166
query46	819	1019	618	618
query47	1736	1811	1729	1729
query48	378	402	295	295
query49	783	495	401	401
query50	691	724	399	399
query51	4224	4200	4126	4126
query52	108	113	91	91
query53	223	252	186	186
query54	481	493	410	410
query55	79	81	81	81
query56	294	272	276	272
query57	1116	1166	1037	1037
query58	250	235	234	234
query59	2553	2705	2841	2705
query60	271	275	267	267
query61	125	116	115	115
query62	806	746	678	678
query63	234	186	181	181
query64	4367	1048	660	660
query65	4457	4366	4342	4342
query66	1141	403	290	290
query67	15974	15487	15224	15224
query68	8605	867	510	510
query69	469	298	261	261
query70	1175	1113	1102	1102
query71	445	279	267	267
query72	5391	3535	3720	3535
query73	772	716	346	346
query74	8918	8794	8767	8767
query75	3809	3181	2727	2727
query76	3670	1187	752	752
query77	794	382	295	295
query78	10030	10315	9249	9249
query79	2327	834	629	629
query80	639	537	450	450
query81	463	260	233	233
query82	669	127	97	97
query83	179	182	163	163
query84	276	90	143	90
query85	768	351	300	300
query86	335	294	275	275
query87	4389	4468	4360	4360
query88	3491	2283	2272	2272
query89	394	316	298	298
query90	1923	215	217	215
query91	145	138	112	112
query92	74	60	60	60
query93	1252	1087	590	590
query94	672	419	293	293
query95	363	275	260	260
query96	493	568	277	277
query97	3315	3405	3280	3280
query98	237	208	200	200
query99	1454	1427	1247	1247
Total cold run time: 273383 ms
Total hot run time: 184549 ms

@doris-robot

doris-robot commented Mar 16, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.61 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 65d57dd7d24d4c86f3cd57069ecc9ae68aec8431, data reload: false
query1	0.04	0.03	0.04
query2	0.08	0.03	0.03
query3	0.23	0.07	0.07
query4	1.63	0.10	0.11
query5	0.55	0.54	0.54
query6	1.21	0.73	0.73
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.60	0.51	0.52
query10	0.57	0.59	0.58
query11	0.16	0.10	0.11
query12	0.15	0.10	0.12
query13	0.61	0.62	0.59
query14	2.79	2.68	2.75
query15	0.92	0.85	0.85
query16	0.40	0.38	0.38
query17	1.01	1.05	1.01
query18	0.21	0.19	0.20
query19	1.97	1.77	1.99
query20	0.01	0.01	0.02
query21	15.36	0.91	0.57
query22	0.74	1.14	0.95
query23	14.69	1.38	0.62
query24	6.70	2.19	1.28
query25	0.52	0.20	0.16
query26	0.67	0.16	0.12
query27	0.05	0.04	0.05
query28	10.28	0.81	0.42
query29	12.56	4.00	3.28
query30	0.26	0.09	0.06
query31	2.81	0.58	0.39
query32	3.22	0.55	0.46
query33	3.01	3.07	3.24
query34	15.76	5.15	4.54
query35	4.59	4.56	4.55
query36	0.65	0.49	0.48
query37	0.08	0.06	0.06
query38	0.05	0.03	0.04
query39	0.03	0.02	0.02
query40	0.18	0.13	0.13
query41	0.07	0.03	0.02
query42	0.04	0.02	0.03
query43	0.04	0.04	0.03
Total cold run time: 105.56 s
Total hot run time: 31.61 s

@starocean999

starocean999 commented Mar 18, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Mar 18, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 32545 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 865aeefdc50334222c3d4f117b8f389eb8c3286f, data reload: false
------ Round 1 ----------------------------------
q1	24080	5030	5023	5023
q2	2054	299	179	179
q3	10386	1217	678	678
q4	10224	1035	539	539
q5	7562	2380	2364	2364
q6	182	165	133	133
q7	904	735	598	598
q8	9313	1320	1130	1130
q9	5155	4770	4773	4770
q10	6798	2299	1893	1893
q11	489	281	268	268
q12	354	348	216	216
q13	17760	3672	3102	3102
q14	240	224	206	206
q15	533	475	490	475
q16	617	614	593	593
q17	576	876	340	340
q18	6770	6644	6371	6371
q19	1219	958	571	571
q20	313	339	189	189
q21	2896	2094	1916	1916
q22	1024	1067	991	991
Total cold run time: 109449 ms
Total hot run time: 32545 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5157	5121	5116	5116
q2	243	327	232	232
q3	2149	2690	2294	2294
q4	1391	1814	1344	1344
q5	4237	4117	4409	4117
q6	208	166	125	125
q7	1983	1934	1757	1757
q8	2630	2605	2543	2543
q9	7263	7227	7168	7168
q10	2975	3227	2765	2765
q11	566	505	488	488
q12	668	773	608	608
q13	3442	3868	3313	3313
q14	289	295	273	273
q15	516	481	469	469
q16	638	668	641	641
q17	1145	1590	1355	1355
q18	7806	7651	7395	7395
q19	798	797	902	797
q20	1978	1983	1895	1895
q21	5489	4832	4700	4700
q22	1060	1031	1022	1022
Total cold run time: 52631 ms
Total hot run time: 50417 ms

@doris-robot

doris-robot commented Mar 18, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 185292 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 865aeefdc50334222c3d4f117b8f389eb8c3286f, data reload: false
query1	984	480	489	480
query2	6566	1944	1909	1909
query3	6794	225	215	215
query4	26174	24057	23180	23180
query5	4326	638	479	479
query6	294	206	197	197
query7	4601	507	301	301
query8	302	245	230	230
query9	8616	2641	2631	2631
query10	469	322	262	262
query11	15548	15169	14875	14875
query12	161	110	99	99
query13	1667	508	382	382
query14	8898	6717	6313	6313
query15	213	189	176	176
query16	7108	630	488	488
query17	906	706	576	576
query18	1954	387	288	288
query19	190	177	151	151
query20	121	116	111	111
query21	205	122	104	104
query22	4147	4235	4232	4232
query23	33912	32977	32944	32944
query24	7839	2415	2390	2390
query25	552	436	390	390
query26	1242	269	148	148
query27	2447	486	323	323
query28	4169	2425	2386	2386
query29	759	546	458	458
query30	285	216	195	195
query31	933	871	769	769
query32	76	62	69	62
query33	548	366	322	322
query34	785	832	528	528
query35	807	809	732	732
query36	963	986	858	858
query37	129	102	77	77
query38	4158	4066	3965	3965
query39	1473	1400	1419	1400
query40	215	116	103	103
query41	55	52	49	49
query42	124	106	101	101
query43	503	518	474	474
query44	1331	781	854	781
query45	172	167	165	165
query46	836	1022	621	621
query47	1731	1791	1707	1707
query48	380	412	298	298
query49	789	507	417	417
query50	702	742	416	416
query51	4154	4178	4134	4134
query52	106	105	98	98
query53	229	269	188	188
query54	496	500	408	408
query55	83	81	83	81
query56	261	251	242	242
query57	1141	1144	1065	1065
query58	251	252	244	244
query59	2684	2848	2534	2534
query60	293	286	278	278
query61	146	143	143	143
query62	787	731	661	661
query63	228	194	201	194
query64	4461	1083	765	765
query65	4468	4349	4337	4337
query66	1147	416	310	310
query67	15846	15550	15202	15202
query68	8982	869	520	520
query69	471	305	262	262
query70	1211	1121	1124	1121
query71	449	290	268	268
query72	5875	3596	3716	3596
query73	800	743	357	357
query74	8972	8980	8951	8951
query75	4038	3180	2670	2670
query76	3606	1175	740	740
query77	825	390	285	285
query78	10000	10100	9246	9246
query79	2496	866	577	577
query80	656	540	450	450
query81	463	259	222	222
query82	609	127	93	93
query83	206	173	152	152
query84	290	91	71	71
query85	787	357	317	317
query86	328	292	279	279
query87	4400	4676	4404	4404
query88	3481	2264	2283	2264
query89	393	314	278	278
query90	1933	205	208	205
query91	145	137	106	106
query92	75	62	57	57
query93	1627	1059	580	580
query94	670	431	298	298
query95	351	266	258	258
query96	493	558	279	279
query97	3308	3389	3284	3284
query98	218	200	194	194
query99	1450	1396	1266	1266
Total cold run time: 274548 ms
Total hot run time: 185292 ms

@doris-robot

doris-robot commented Mar 18, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.4 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 865aeefdc50334222c3d4f117b8f389eb8c3286f, data reload: false
query1	0.03	0.04	0.03
query2	0.12	0.11	0.11
query3	0.25	0.19	0.19
query4	1.59	0.20	0.18
query5	0.59	0.58	0.59
query6	1.21	0.72	0.72
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.58	0.52	0.53
query10	0.59	0.60	0.57
query11	0.15	0.11	0.12
query12	0.15	0.11	0.12
query13	0.61	0.60	0.60
query14	2.71	2.70	2.70
query15	0.90	0.84	0.85
query16	0.39	0.38	0.39
query17	1.03	1.08	1.05
query18	0.20	0.20	0.19
query19	1.94	1.89	1.89
query20	0.01	0.01	0.01
query21	15.36	0.91	0.55
query22	0.75	1.24	0.70
query23	14.81	1.37	0.61
query24	6.82	1.04	0.92
query25	0.49	0.24	0.10
query26	0.52	0.16	0.13
query27	0.05	0.05	0.05
query28	9.37	0.89	0.43
query29	12.57	3.90	3.26
query30	0.24	0.08	0.07
query31	2.83	0.58	0.38
query32	3.22	0.53	0.47
query33	3.05	3.04	3.08
query34	15.83	5.11	4.51
query35	4.55	4.55	4.56
query36	0.67	0.49	0.49
query37	0.08	0.06	0.06
query38	0.06	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.13	0.13
query41	0.09	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 104.73 s
Total hot run time: 31.4 s

@starocean999

starocean999 commented Mar 19, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Mar 19, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 32864 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 492d4ed8daa28c62dd1003ef7b948d3e3406f391, data reload: false
------ Round 1 ----------------------------------
q1	24327	5094	5035	5035
q2	2043	303	177	177
q3	10397	1280	724	724
q4	10229	1024	537	537
q5	7560	2373	2414	2373
q6	189	164	133	133
q7	910	757	613	613
q8	9320	1308	1212	1212
q9	5000	4947	4914	4914
q10	6824	2296	1875	1875
q11	475	276	254	254
q12	349	360	220	220
q13	17752	3719	3116	3116
q14	236	226	206	206
q15	524	473	474	473
q16	614	613	584	584
q17	581	884	367	367
q18	7023	6489	6332	6332
q19	1215	958	564	564
q20	329	327	196	196
q21	2950	2337	1960	1960
q22	1040	999	999	999
Total cold run time: 109887 ms
Total hot run time: 32864 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5181	5143	5168	5143
q2	248	323	230	230
q3	2118	2699	2314	2314
q4	1436	1798	1411	1411
q5	4239	4148	4497	4148
q6	218	164	127	127
q7	2046	1902	1795	1795
q8	2625	2554	2576	2554
q9	7157	7331	7134	7134
q10	3049	3218	2763	2763
q11	584	491	476	476
q12	718	735	600	600
q13	3562	3858	3356	3356
q14	286	306	271	271
q15	526	477	478	477
q16	658	682	626	626
q17	1188	1588	1369	1369
q18	7857	7759	7514	7514
q19	852	860	954	860
q20	1964	2012	1873	1873
q21	5482	4731	4824	4731
q22	1106	1044	982	982
Total cold run time: 53100 ms
Total hot run time: 50754 ms

@doris-robot

doris-robot commented Mar 19, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 185716 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 492d4ed8daa28c62dd1003ef7b948d3e3406f391, data reload: false
query1	1025	497	483	483
query2	6559	1938	1934	1934
query3	6795	215	222	215
query4	26238	23723	23720	23720
query5	5456	673	487	487
query6	306	211	181	181
query7	4609	488	285	285
query8	289	248	257	248
query9	8638	2638	2619	2619
query10	497	308	261	261
query11	15879	14946	15308	14946
query12	171	109	105	105
query13	1666	526	398	398
query14	11215	6167	6139	6139
query15	214	191	171	171
query16	7642	656	475	475
query17	1506	752	568	568
query18	1985	414	311	311
query19	193	181	165	165
query20	119	115	121	115
query21	208	121	109	109
query22	4246	4263	4150	4150
query23	33857	32998	32920	32920
query24	7584	2385	2365	2365
query25	529	448	423	423
query26	1240	267	152	152
query27	2525	476	326	326
query28	4285	2447	2384	2384
query29	715	558	423	423
query30	284	217	187	187
query31	929	864	796	796
query32	73	61	65	61
query33	551	350	308	308
query34	773	829	507	507
query35	780	808	760	760
query36	958	996	916	916
query37	110	100	77	77
query38	4196	4093	4091	4091
query39	1443	1415	1386	1386
query40	208	112	106	106
query41	56	52	51	51
query42	116	102	103	102
query43	512	501	479	479
query44	1265	781	789	781
query45	179	170	165	165
query46	839	1026	614	614
query47	1742	1793	1742	1742
query48	379	412	316	316
query49	788	489	404	404
query50	704	729	395	395
query51	4206	4167	4092	4092
query52	112	109	108	108
query53	230	249	189	189
query54	491	489	421	421
query55	86	85	88	85
query56	286	269	251	251
query57	1148	1140	1055	1055
query58	243	236	239	236
query59	2801	2879	2682	2682
query60	284	268	293	268
query61	129	127	126	126
query62	778	724	637	637
query63	223	188	195	188
query64	4261	1033	688	688
query65	4429	4453	4330	4330
query66	1000	451	294	294
query67	15890	15395	15217	15217
query68	8578	862	497	497
query69	505	294	263	263
query70	1215	1114	1007	1007
query71	484	306	268	268
query72	5685	3587	3805	3587
query73	795	747	343	343
query74	8916	9074	8734	8734
query75	3936	3149	2679	2679
query76	3757	1172	761	761
query77	783	378	273	273
query78	10084	10295	9371	9371
query79	2344	831	582	582
query80	629	520	493	493
query81	490	253	227	227
query82	555	126	94	94
query83	170	175	149	149
query84	242	85	73	73
query85	753	377	315	315
query86	336	296	299	296
query87	4488	4525	4432	4432
query88	3383	2249	2258	2249
query89	402	321	281	281
query90	1976	208	215	208
query91	166	141	118	118
query92	73	62	62	62
query93	1276	1059	581	581
query94	681	401	307	307
query95	352	269	255	255
query96	485	560	277	277
query97	3364	3401	3291	3291
query98	231	207	200	200
query99	1485	1390	1254	1254
Total cold run time: 278292 ms
Total hot run time: 185716 ms

@doris-robot

doris-robot commented Mar 19, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.24 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 492d4ed8daa28c62dd1003ef7b948d3e3406f391, data reload: false
query1	0.04	0.04	0.04
query2	0.12	0.10	0.10
query3	0.24	0.20	0.19
query4	1.59	0.20	0.19
query5	0.59	0.58	0.59
query6	1.19	0.73	0.73
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.53	0.52
query10	0.57	0.58	0.57
query11	0.15	0.11	0.11
query12	0.14	0.11	0.11
query13	0.61	0.60	0.60
query14	2.78	2.73	2.77
query15	0.92	0.85	0.86
query16	0.40	0.36	0.38
query17	1.03	1.03	1.04
query18	0.22	0.20	0.19
query19	1.88	1.98	1.81
query20	0.01	0.01	0.01
query21	15.36	0.89	0.53
query22	0.76	1.13	0.68
query23	14.94	1.36	0.63
query24	6.99	2.12	0.91
query25	0.50	0.11	0.08
query26	0.62	0.16	0.13
query27	0.05	0.05	0.05
query28	9.49	0.84	0.42
query29	12.54	4.00	3.32
query30	0.24	0.09	0.07
query31	2.84	0.59	0.38
query32	3.22	0.55	0.48
query33	3.02	3.01	3.08
query34	15.74	5.13	4.49
query35	4.52	4.53	4.51
query36	0.67	0.50	0.47
query37	0.09	0.07	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.18	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.12 s
Total hot run time: 31.24 s

@starocean999

starocean999 commented Mar 19, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Mar 19, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 32705 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3c94794c4e4ba250237eaa1495a49ca6cae004c3, data reload: false
------ Round 1 ----------------------------------
q1	24240	5201	5117	5117
q2	2038	297	180	180
q3	10389	1252	722	722
q4	10227	1032	571	571
q5	7526	2358	2446	2358
q6	193	168	134	134
q7	914	751	621	621
q8	9308	1282	1127	1127
q9	5149	4623	4686	4623
q10	6871	2300	1875	1875
q11	484	288	259	259
q12	367	364	234	234
q13	17778	3737	3116	3116
q14	246	225	215	215
q15	546	482	486	482
q16	652	607	600	600
q17	596	865	351	351
q18	6843	6440	6395	6395
q19	1220	951	609	609
q20	330	331	213	213
q21	3053	2171	1936	1936
q22	1068	1040	967	967
Total cold run time: 110038 ms
Total hot run time: 32705 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5237	5203	5163	5163
q2	246	330	241	241
q3	2172	2754	2296	2296
q4	1430	1861	1364	1364
q5	4247	4159	4185	4159
q6	210	166	125	125
q7	1910	1809	1705	1705
q8	2515	2593	2482	2482
q9	6848	6807	6751	6751
q10	2917	3123	2681	2681
q11	560	496	499	496
q12	685	736	591	591
q13	3309	3767	3128	3128
q14	263	295	255	255
q15	529	469	456	456
q16	647	683	638	638
q17	1131	1586	1289	1289
q18	7284	7179	7187	7179
q19	828	832	979	832
q20	1904	1936	1789	1789
q21	5272	4724	4832	4724
q22	1088	1026	1021	1021
Total cold run time: 51232 ms
Total hot run time: 49365 ms

@doris-robot

doris-robot commented Mar 19, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 184274 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3c94794c4e4ba250237eaa1495a49ca6cae004c3, data reload: false
query1	1014	485	468	468
query2	5974	1950	1873	1873
query3	5992	213	213	213
query4	26887	23252	22973	22973
query5	4669	671	484	484
query6	292	199	192	192
query7	4533	489	291	291
query8	294	247	229	229
query9	8101	2615	2633	2615
query10	510	316	249	249
query11	15940	15290	15024	15024
query12	166	103	107	103
query13	1592	498	378	378
query14	8509	6118	6104	6104
query15	206	211	160	160
query16	6022	625	462	462
query17	1047	687	533	533
query18	1263	396	296	296
query19	180	171	150	150
query20	113	111	111	111
query21	188	121	102	102
query22	4160	4091	4225	4091
query23	33661	32933	33038	32933
query24	8001	2370	2311	2311
query25	514	443	376	376
query26	1207	265	151	151
query27	2697	491	318	318
query28	4457	2408	2378	2378
query29	702	572	423	423
query30	289	218	194	194
query31	938	868	753	753
query32	73	66	65	65
query33	555	358	314	314
query34	767	847	492	492
query35	774	815	745	745
query36	947	996	886	886
query37	122	113	75	75
query38	4233	4124	4013	4013
query39	1453	1391	1356	1356
query40	204	119	105	105
query41	59	51	49	49
query42	115	102	103	102
query43	488	498	491	491
query44	1268	784	764	764
query45	174	170	160	160
query46	817	1024	614	614
query47	1731	1811	1779	1779
query48	364	418	293	293
query49	789	508	407	407
query50	686	769	415	415
query51	4148	4220	4158	4158
query52	104	103	96	96
query53	229	254	183	183
query54	471	475	397	397
query55	78	76	76	76
query56	275	266	246	246
query57	1135	1131	1065	1065
query58	248	232	228	228
query59	2937	2982	2696	2696
query60	278	290	252	252
query61	124	121	121	121
query62	797	734	663	663
query63	227	186	189	186
query64	4202	1038	651	651
query65	4445	4305	4363	4305
query66	1039	401	296	296
query67	15809	15756	15217	15217
query68	5852	864	496	496
query69	485	292	256	256
query70	1149	1103	1101	1101
query71	409	280	255	255
query72	5513	3667	3758	3667
query73	715	725	343	343
query74	9043	9054	8802	8802
query75	3152	3209	2679	2679
query76	3318	1170	770	770
query77	473	370	273	273
query78	9992	10040	9204	9204
query79	1901	822	582	582
query80	679	526	446	446
query81	497	257	218	218
query82	191	127	96	96
query83	169	166	152	152
query84	259	89	75	75
query85	753	350	296	296
query86	357	312	284	284
query87	4324	4402	4352	4352
query88	2839	2249	2290	2249
query89	380	329	286	286
query90	1843	207	208	207
query91	141	133	106	106
query92	67	61	56	56
query93	1329	1047	575	575
query94	647	409	300	300
query95	353	266	254	254
query96	482	554	274	274
query97	3279	3391	3279	3279
query98	227	201	196	196
query99	1327	1403	1246	1246
Total cold run time: 264428 ms
Total hot run time: 184274 ms

@doris-robot

doris-robot commented Mar 19, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.82 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3c94794c4e4ba250237eaa1495a49ca6cae004c3, data reload: false
query1	0.04	0.04	0.03
query2	0.12	0.10	0.11
query3	0.24	0.19	0.19
query4	1.59	0.19	0.20
query5	0.59	0.60	0.60
query6	1.21	0.72	0.72
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.59	0.53	0.53
query10	0.58	0.59	0.57
query11	0.16	0.11	0.10
query12	0.15	0.12	0.11
query13	0.62	0.60	0.61
query14	2.80	2.68	2.71
query15	0.93	0.86	0.84
query16	0.38	0.38	0.38
query17	1.07	1.04	1.05
query18	0.22	0.20	0.19
query19	1.91	1.99	1.82
query20	0.01	0.01	0.01
query21	15.36	0.90	0.55
query22	0.76	1.15	0.58
query23	15.06	1.36	0.59
query24	6.61	1.77	1.38
query25	0.50	0.26	0.20
query26	0.58	0.15	0.12
query27	0.06	0.05	0.04
query28	10.17	0.86	0.43
query29	12.52	3.98	3.29
query30	0.26	0.10	0.07
query31	2.81	0.58	0.39
query32	3.23	0.53	0.47
query33	2.99	3.04	3.03
query34	15.77	5.17	4.61
query35	4.55	4.58	4.54
query36	0.66	0.49	0.48
query37	0.08	0.06	0.06
query38	0.05	0.03	0.03
query39	0.04	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.02	0.03
query42	0.04	0.02	0.03
query43	0.03	0.03	0.03
Total cold run time: 105.64 s
Total hot run time: 31.82 s

@starocean999

starocean999 commented Mar 24, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Mar 24, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 34203 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f69eb7069ebc6441ca850809d500d81215613f91, data reload: false
------ Round 1 ----------------------------------
q1	25802	5086	5008	5008
q2	2066	275	168	168
q3	10420	1260	710	710
q4	10220	1029	524	524
q5	7512	2335	2410	2335
q6	189	163	132	132
q7	899	741	600	600
q8	9326	1315	1129	1129
q9	7436	5201	5150	5150
q10	6810	2296	1912	1912
q11	472	282	261	261
q12	343	347	220	220
q13	17758	3650	3133	3133
q14	222	222	210	210
q15	531	482	488	482
q16	624	598	609	598
q17	557	848	349	349
q18	7670	7321	7132	7132
q19	1215	944	539	539
q20	321	330	195	195
q21	4204	3387	2439	2439
q22	1073	1022	977	977
Total cold run time: 115670 ms
Total hot run time: 34203 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5135	5133	5061	5061
q2	237	329	227	227
q3	2131	2666	2267	2267
q4	1423	1832	1416	1416
q5	4535	4471	4415	4415
q6	227	165	127	127
q7	1986	1954	1788	1788
q8	2647	2665	2472	2472
q9	7154	7215	7161	7161
q10	2984	3175	2738	2738
q11	562	510	507	507
q12	686	749	582	582
q13	3600	3980	3391	3391
q14	284	295	267	267
q15	523	488	455	455
q16	677	698	639	639
q17	1137	1508	1425	1425
q18	7800	7636	7208	7208
q19	798	808	851	808
q20	2003	2027	1896	1896
q21	5453	5095	4847	4847
q22	1111	1099	1010	1010
Total cold run time: 53093 ms
Total hot run time: 50707 ms

@doris-robot

doris-robot commented Mar 24, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 193556 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f69eb7069ebc6441ca850809d500d81215613f91, data reload: false
query1	1328	1061	1050	1050
query2	6287	2031	1988	1988
query3	11188	4519	4346	4346
query4	57772	25620	23396	23396
query5	4748	531	461	461
query6	330	190	178	178
query7	4885	509	268	268
query8	310	236	229	229
query9	6130	2598	2586	2586
query10	404	310	258	258
query11	15090	15131	15022	15022
query12	155	110	105	105
query13	1034	487	384	384
query14	10048	6392	6247	6247
query15	217	189	179	179
query16	7081	674	497	497
query17	1009	770	602	602
query18	1632	416	324	324
query19	208	200	166	166
query20	125	128	120	120
query21	212	133	110	110
query22	4732	4787	4425	4425
query23	33662	33465	33515	33465
query24	6513	2414	2414	2414
query25	449	471	410	410
query26	697	271	155	155
query27	2182	505	328	328
query28	3061	2443	2448	2443
query29	604	589	484	484
query30	278	230	193	193
query31	853	884	855	855
query32	76	66	67	66
query33	474	374	320	320
query34	750	852	508	508
query35	786	857	769	769
query36	954	1022	936	936
query37	131	106	83	83
query38	4342	4259	4171	4171
query39	1507	1464	1434	1434
query40	232	123	114	114
query41	62	55	96	55
query42	123	106	113	106
query43	505	512	471	471
query44	1358	829	804	804
query45	187	172	169	169
query46	862	1033	650	650
query47	1886	1819	1736	1736
query48	371	396	294	294
query49	678	488	443	443
query50	669	734	413	413
query51	4160	4180	4122	4122
query52	104	107	94	94
query53	217	244	179	179
query54	487	476	403	403
query55	85	82	77	77
query56	276	277	254	254
query57	1163	1154	1087	1087
query58	246	238	247	238
query59	2631	2805	2711	2711
query60	269	272	265	265
query61	128	128	126	126
query62	791	709	651	651
query63	213	176	181	176
query64	1709	1007	758	758
query65	4418	4372	4328	4328
query66	731	399	301	301
query67	16121	15646	15361	15361
query68	6308	895	505	505
query69	555	307	279	279
query70	1224	1136	1112	1112
query71	527	294	279	279
query72	5575	5138	5254	5138
query73	1462	649	341	341
query74	9057	9096	8691	8691
query75	4039	3217	2691	2691
query76	4429	1178	745	745
query77	634	362	278	278
query78	10079	10233	9315	9315
query79	1989	859	573	573
query80	613	564	451	451
query81	472	257	217	217
query82	465	132	97	97
query83	177	179	167	167
query84	282	99	78	78
query85	788	354	324	324
query86	365	328	309	309
query87	4490	4471	4440	4440
query88	3661	2222	2226	2222
query89	419	305	273	273
query90	1860	227	218	218
query91	145	148	121	121
query92	74	62	59	59
query93	1541	1067	588	588
query94	665	417	312	312
query95	362	276	259	259
query96	485	572	279	279
query97	3379	3402	3358	3358
query98	232	208	204	204
query99	1466	1399	1272	1272
Total cold run time: 300745 ms
Total hot run time: 193556 ms

@doris-robot

doris-robot commented Mar 24, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.06 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f69eb7069ebc6441ca850809d500d81215613f91, data reload: false
query1	0.03	0.03	0.03
query2	0.12	0.11	0.11
query3	0.25	0.20	0.20
query4	1.60	0.19	0.20
query5	0.60	0.58	0.60
query6	1.18	0.74	0.71
query7	0.03	0.02	0.02
query8	0.04	0.03	0.03
query9	0.57	0.52	0.53
query10	0.57	0.59	0.57
query11	0.15	0.11	0.11
query12	0.15	0.12	0.12
query13	0.62	0.61	0.60
query14	2.67	2.87	2.67
query15	0.94	0.84	0.86
query16	0.38	0.38	0.38
query17	1.01	1.05	1.05
query18	0.22	0.19	0.19
query19	1.98	1.94	1.83
query20	0.01	0.01	0.02
query21	15.35	0.88	0.56
query22	0.79	1.25	0.90
query23	14.75	1.43	0.61
query24	6.50	1.85	0.33
query25	0.30	0.27	0.09
query26	0.63	0.16	0.14
query27	0.05	0.05	0.05
query28	9.42	0.90	0.44
query29	12.53	3.97	3.30
query30	0.25	0.09	0.06
query31	2.82	0.57	0.39
query32	3.23	0.56	0.48
query33	3.06	3.17	3.07
query34	15.91	5.14	4.57
query35	4.57	4.53	4.57
query36	0.66	0.50	0.47
query37	0.09	0.07	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.43 s
Total hot run time: 31.06 s

@starocean999

starocean999 commented Mar 24, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Mar 24, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 34169 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 36f2d578dd7a7791b55cbcc3cd982b99938399d8, data reload: false
------ Round 1 ----------------------------------
q1	25919	5101	5004	5004
q2	2047	277	158	158
q3	10428	1226	669	669
q4	10227	998	514	514
q5	7514	2391	2293	2293
q6	183	162	130	130
q7	918	746	599	599
q8	9350	1286	1097	1097
q9	6854	5141	5126	5126
q10	6813	2314	1884	1884
q11	474	276	250	250
q12	347	348	225	225
q13	17772	3696	3097	3097
q14	235	235	212	212
q15	525	471	491	471
q16	642	600	592	592
q17	545	870	346	346
q18	7829	7248	7230	7230
q19	1831	972	556	556
q20	312	316	199	199
q21	3908	3406	2525	2525
q22	1047	997	992	992
Total cold run time: 115720 ms
Total hot run time: 34169 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5167	5127	5079	5079
q2	258	327	223	223
q3	2158	2629	2231	2231
q4	1388	1823	1432	1432
q5	4466	4462	4412	4412
q6	217	167	128	128
q7	1987	1938	1779	1779
q8	2575	2507	2580	2507
q9	7390	7261	7105	7105
q10	2949	3231	2720	2720
q11	571	500	492	492
q12	690	766	636	636
q13	3539	3857	3319	3319
q14	307	295	266	266
q15	532	476	468	468
q16	633	682	649	649
q17	1169	1526	1412	1412
q18	7762	7660	7501	7501
q19	818	797	858	797
q20	1914	2018	1832	1832
q21	5324	5085	4860	4860
q22	1114	1043	1014	1014
Total cold run time: 52928 ms
Total hot run time: 50862 ms

@doris-robot

doris-robot commented Mar 24, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 194216 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 36f2d578dd7a7791b55cbcc3cd982b99938399d8, data reload: false
query1	1399	1068	1066	1066
query2	6190	1968	1957	1957
query3	11032	4495	4547	4495
query4	25658	24004	23119	23119
query5	5450	655	506	506
query6	313	189	195	189
query7	3977	495	265	265
query8	291	233	229	229
query9	8547	2592	2595	2592
query10	528	322	267	267
query11	15596	15593	14892	14892
query12	159	107	107	107
query13	1668	514	377	377
query14	9753	6400	6356	6356
query15	203	183	172	172
query16	7665	660	509	509
query17	1186	708	577	577
query18	2042	447	301	301
query19	201	199	162	162
query20	128	122	123	122
query21	205	127	107	107
query22	4464	4581	4249	4249
query23	34152	33807	33293	33293
query24	8381	2500	2471	2471
query25	515	499	432	432
query26	741	280	153	153
query27	2883	506	331	331
query28	4574	2449	2416	2416
query29	667	619	461	461
query30	284	224	194	194
query31	865	876	809	809
query32	72	63	61	61
query33	537	392	309	309
query34	806	946	526	526
query35	799	876	800	800
query36	999	1042	927	927
query37	127	102	81	81
query38	4147	4223	4131	4131
query39	1478	1430	1480	1430
query40	205	120	113	113
query41	54	54	53	53
query42	120	109	111	109
query43	536	516	480	480
query44	1360	826	810	810
query45	187	180	175	175
query46	876	1044	662	662
query47	1849	1850	1773	1773
query48	389	415	312	312
query49	734	535	456	456
query50	718	744	431	431
query51	4287	4286	4287	4286
query52	112	111	99	99
query53	228	251	181	181
query54	531	498	426	426
query55	97	86	86	86
query56	286	272	281	272
query57	1197	1250	1126	1126
query58	258	259	248	248
query59	2781	2881	2720	2720
query60	324	332	296	296
query61	137	131	133	131
query62	772	727	670	670
query63	219	199	196	196
query64	3247	1058	696	696
query65	4538	4591	4542	4542
query66	773	410	311	311
query67	16641	15976	15922	15922
query68	8246	887	500	500
query69	515	304	259	259
query70	1218	1114	1128	1114
query71	476	290	256	256
query72	5230	4998	4937	4937
query73	649	559	351	351
query74	9307	9073	8762	8762
query75	4069	3243	2770	2770
query76	3671	1252	764	764
query77	794	388	281	281
query78	9967	10196	9288	9288
query79	2036	812	563	563
query80	634	528	464	464
query81	468	261	224	224
query82	491	127	99	99
query83	173	175	160	160
query84	244	97	82	82
query85	753	349	312	312
query86	357	302	291	291
query87	4509	4567	4560	4560
query88	3767	2259	2262	2259
query89	388	312	279	279
query90	1929	220	216	216
query91	139	143	119	119
query92	75	60	56	56
query93	1882	1046	585	585
query94	644	410	297	297
query95	356	270	279	270
query96	496	564	282	282
query97	3323	3397	3330	3330
query98	217	209	202	202
query99	1369	1387	1261	1261
Total cold run time: 280530 ms
Total hot run time: 194216 ms

@doris-robot

doris-robot commented Mar 24, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.55 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 36f2d578dd7a7791b55cbcc3cd982b99938399d8, data reload: false
query1	0.04	0.04	0.03
query2	0.12	0.10	0.10
query3	0.25	0.19	0.19
query4	1.59	0.19	0.19
query5	0.58	0.58	0.59
query6	1.18	0.72	0.73
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.57	0.53	0.54
query10	0.58	0.59	0.57
query11	0.15	0.11	0.11
query12	0.14	0.12	0.12
query13	0.61	0.60	0.61
query14	2.65	2.83	2.65
query15	0.94	0.86	0.85
query16	0.39	0.38	0.38
query17	1.05	1.03	1.01
query18	0.21	0.20	0.20
query19	1.86	1.96	1.87
query20	0.02	0.01	0.01
query21	15.35	0.90	0.54
query22	0.75	1.16	0.67
query23	14.96	1.37	0.63
query24	6.66	1.41	1.03
query25	0.56	0.21	0.20
query26	0.64	0.15	0.14
query27	0.05	0.06	0.04
query28	10.34	0.87	0.43
query29	12.60	4.01	3.33
query30	0.24	0.09	0.07
query31	2.81	0.59	0.39
query32	3.24	0.55	0.48
query33	2.99	3.10	3.05
query34	15.59	5.11	4.50
query35	4.50	4.51	4.50
query36	0.68	0.49	0.49
query37	0.09	0.07	0.06
query38	0.05	0.04	0.03
query39	0.04	0.02	0.02
query40	0.17	0.14	0.12
query41	0.09	0.03	0.02
query42	0.04	0.02	0.03
query43	0.03	0.03	0.03
Total cold run time: 105.46 s
Total hot run time: 31.55 s

@starocean999

starocean999 commented Mar 26, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Mar 26, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 34355 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b44b6d02206929c21212a4c7862242e20c419581, data reload: false
------ Round 1 ----------------------------------
q1	26331	5125	5056	5056
q2	2067	298	175	175
q3	10392	1275	702	702
q4	10234	1026	542	542
q5	7544	2370	2353	2353
q6	190	164	135	135
q7	918	754	612	612
q8	9329	1309	1098	1098
q9	6895	5135	5180	5135
q10	6863	2302	1899	1899
q11	487	287	270	270
q12	354	357	224	224
q13	17792	3707	3115	3115
q14	239	225	218	218
q15	532	492	494	492
q16	657	639	585	585
q17	597	874	362	362
q18	7877	7112	7145	7112
q19	2457	1097	611	611
q20	314	330	200	200
q21	3944	3345	2476	2476
q22	1104	1013	983	983
Total cold run time: 117117 ms
Total hot run time: 34355 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5325	5144	5197	5144
q2	245	322	227	227
q3	2151	2707	2294	2294
q4	1443	2001	1473	1473
q5	4493	4465	4471	4465
q6	214	170	135	135
q7	2024	1894	1767	1767
q8	2632	2481	2572	2481
q9	7398	7083	7275	7083
q10	3005	3212	2791	2791
q11	575	500	489	489
q12	679	741	611	611
q13	3538	3910	3409	3409
q14	304	302	273	273
q15	520	482	475	475
q16	674	680	658	658
q17	1202	1551	1439	1439
q18	7854	7739	7587	7587
q19	839	834	828	828
q20	1969	2005	1927	1927
q21	5415	5054	4916	4916
q22	1110	1032	1052	1032
Total cold run time: 53609 ms
Total hot run time: 51504 ms

@starocean999
starocean999 dismissed stale reviews from englefly and liaoxin01 via c88953eApril 29, 2025 04:37
@starocean999

starocean999 commented Apr 29, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@starocean999

starocean999 commented Apr 29, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Apr 29, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 33625 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ad43f5aa62e87efba99290952eb074f4aed5f86e, data reload: false
------ Round 1 ----------------------------------
q1	25959	5062	5203	5062
q2	2061	282	180	180
q3	10398	1232	696	696
q4	10225	1014	513	513
q5	7555	2413	2288	2288
q6	178	166	133	133
q7	912	753	618	618
q8	9305	1275	1004	1004
q9	6762	5071	5023	5023
q10	6804	2304	1873	1873
q11	474	284	262	262
q12	359	345	210	210
q13	17780	3683	3070	3070
q14	230	220	211	211
q15	520	468	487	468
q16	428	429	368	368
q17	606	848	371	371
q18	7477	7241	7060	7060
q19	1202	941	548	548
q20	339	330	215	215
q21	4377	3370	2463	2463
q22	1069	1001	989	989
Total cold run time: 115020 ms
Total hot run time: 33625 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5100	5078	5226	5078
q2	236	323	227	227
q3	2143	2600	2278	2278
q4	1344	1765	1316	1316
q5	4489	4502	4403	4403
q6	216	173	126	126
q7	1992	1916	1707	1707
q8	2583	2509	2493	2493
q9	7188	7014	7147	7014
q10	2970	3118	2751	2751
q11	567	498	482	482
q12	671	770	601	601
q13	3513	3881	3278	3278
q14	271	305	280	280
q15	506	479	478	478
q16	443	469	440	440
q17	1135	1610	1375	1375
q18	7737	7361	7415	7361
q19	803	785	891	785
q20	1939	1983	1822	1822
q21	5046	4609	4543	4543
q22	1053	1003	992	992
Total cold run time: 51945 ms
Total hot run time: 49830 ms

@doris-robot

doris-robot commented Apr 29, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 184903 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ad43f5aa62e87efba99290952eb074f4aed5f86e, data reload: false
query1	1008	480	486	480
query2	6556	1765	1791	1765
query3	6737	220	213	213
query4	26353	23682	23069	23069
query5	4318	595	462	462
query6	300	203	188	188
query7	4631	495	280	280
query8	301	254	229	229
query9	8643	2584	2576	2576
query10	487	310	265	265
query11	15693	15016	14828	14828
query12	162	129	114	114
query13	1663	523	404	404
query14	8837	6204	6221	6204
query15	203	198	169	169
query16	7148	632	453	453
query17	1218	718	579	579
query18	1963	417	302	302
query19	202	185	168	168
query20	118	119	121	119
query21	213	123	110	110
query22	4058	4166	3973	3973
query23	33849	33027	32858	32858
query24	8470	2402	2338	2338
query25	553	457	397	397
query26	1257	262	149	149
query27	2772	491	326	326
query28	4330	2070	2062	2062
query29	787	564	421	421
query30	279	214	194	194
query31	935	853	774	774
query32	73	69	61	61
query33	547	349	297	297
query34	800	880	505	505
query35	773	799	714	714
query36	975	994	894	894
query37	121	96	77	77
query38	4112	4090	3983	3983
query39	1450	1383	1396	1383
query40	211	121	107	107
query41	56	54	54	54
query42	118	106	109	106
query43	488	509	471	471
query44	1279	793	787	787
query45	180	173	166	166
query46	821	1013	623	623
query47	1754	1800	1726	1726
query48	367	397	290	290
query49	763	488	389	389
query50	624	688	385	385
query51	4113	4254	4166	4166
query52	108	107	93	93
query53	211	248	180	180
query54	562	576	502	502
query55	87	80	84	80
query56	295	312	314	312
query57	1128	1154	1063	1063
query58	263	249	250	249
query59	2512	2663	2577	2577
query60	324	310	308	308
query61	130	127	127	127
query62	785	725	678	678
query63	229	187	180	180
query64	4419	1041	677	677
query65	4290	4237	4245	4237
query66	1148	415	310	310
query67	15587	15502	15468	15468
query68	8225	875	515	515
query69	466	309	264	264
query70	1228	1052	1086	1052
query71	484	309	294	294
query72	5593	4664	4743	4664
query73	725	610	345	345
query74	8826	9119	8745	8745
query75	3851	3199	2689	2689
query76	3729	1197	759	759
query77	793	414	288	288
query78	9863	10060	9248	9248
query79	2358	806	566	566
query80	652	508	444	444
query81	475	249	211	211
query82	214	126	96	96
query83	293	256	232	232
query84	290	110	84	84
query85	753	353	316	316
query86	335	314	282	282
query87	4465	4458	4222	4222
query88	2850	2221	2238	2221
query89	411	297	279	279
query90	2059	215	214	214
query91	149	145	111	111
query92	75	58	57	57
query93	1947	930	571	571
query94	666	397	297	297
query95	366	291	283	283
query96	486	563	273	273
query97	3108	3179	3091	3091
query98	240	202	198	198
query99	1416	1389	1298	1298
Total cold run time: 273138 ms
Total hot run time: 184903 ms

@doris-robot

doris-robot commented Apr 29, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 29.23 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ad43f5aa62e87efba99290952eb074f4aed5f86e, data reload: false
query1	0.04	0.03	0.03
query2	0.12	0.11	0.10
query3	0.25	0.19	0.19
query4	1.60	0.19	0.20
query5	0.59	0.56	0.59
query6	1.18	0.71	0.72
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.51	0.50
query10	0.56	0.57	0.55
query11	0.16	0.10	0.10
query12	0.15	0.11	0.11
query13	0.61	0.60	0.59
query14	0.78	0.79	0.81
query15	0.88	0.85	0.86
query16	0.36	0.37	0.38
query17	1.01	1.04	1.00
query18	0.21	0.20	0.20
query19	1.94	1.80	1.76
query20	0.01	0.01	0.02
query21	15.42	0.88	0.54
query22	0.75	1.30	0.82
query23	14.72	1.37	0.61
query24	6.84	1.04	0.93
query25	0.46	0.13	0.16
query26	0.67	0.16	0.14
query27	0.05	0.05	0.05
query28	9.26	0.90	0.43
query29	12.58	3.90	3.23
query30	0.25	0.09	0.06
query31	2.82	0.58	0.38
query32	3.22	0.53	0.46
query33	3.02	3.02	3.00
query34	15.84	5.06	4.51
query35	4.51	4.50	4.51
query36	0.66	0.51	0.47
query37	0.08	0.06	0.07
query38	0.06	0.04	0.04
query39	0.04	0.02	0.02
query40	0.18	0.13	0.12
query41	0.08	0.03	0.03
query42	0.03	0.03	0.02
query43	0.03	0.03	0.02
Total cold run time: 102.66 s
Total hot run time: 29.23 s

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Apr 29, 2025
@github-actions

github-actionsBot commented Apr 29, 2025

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

github-actionsBot commented Apr 29, 2025

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@starocean999
starocean999 merged commit 6c7cab5 into apache:masterApr 29, 2025
@starocean999starocean999 mentioned this pull request Apr 29, 2025
Merged
16 tasks
BePPPower pushed a commit to BePPPower/doris that referenced this pull request May 7, 2025
@starocean999@BePPPower
[feature](nereids)support stream load, routine load and broker load i…
eae0017
…n nereids (apache#49116)
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
@starocean999koarz
[feature](nereids)support stream load, routine load and broker load i…
a49524a
…n nereids (apache#49116)
@924060929924060929 mentioned this pull request Jul 4, 2025
Merged
16 tasks
924060929 added a commit that referenced this pull request Jul 10, 2025
@924060929
[fix](nereids) fix insert into values throw 'Invalid call to sql on u…
2c01f69
…nbound object' and 'Insert has filtered data in strict mode' exception (#52802)
1. fix `Invalid call to sql on unbound object` when use `interval`,
introduced by #40202
```sql
CREATE TABLE `test_insert_cast_interval` (
`id` int NULL,
`dt` date NULL
) ENGINE=OLAP
DISTRIBUTED BY HASH(`id`) BUCKETS 10
PROPERTIES (
"replication_allocation" = "tag.location.default: 1"
);
INSERT INTO test_insert_cast_interval values(1, date_floor('2020-02-02', interval 1 second));
(1105, 'errCode = 2, detailMessage = Invalid call to sql on unbound object')
```
2. fix `Insert has filtered data in strict mode`, introduced by #49116
```sql
CREATE TABLE `test_insert_more_string` (
`r_regionkey` int NULL,
`r_name` varchar(25) NULL,
`r_comment` varchar(152) NULL
) ENGINE=OLAP
DISTRIBUTED BY HASH(`r_regionkey`) BUCKETS 1
PROPERTIES ( "replication_allocation" = "tag.location.default: 1");
insert into test_insert_more_string values (3, "akljalkjbalkjsldkrjewokjfalksdjflaksjfdlaskjfalsdkfjalsdfjkasfdl", "aa");
(1105, 'errCode = 2, detailMessage = Insert has filtered data in strict mode')
```
924060929 added a commit to 924060929/incubator-doris that referenced this pull request Jul 10, 2025
@924060929
[fix](nereids) fix insert into values throw 'Invalid call to sql on u…
c0e284a
…nbound object' and 'Insert has filtered data in strict mode' exception (apache#52802)
1. fix `Invalid call to sql on unbound object` when use `interval`,
introduced by apache#40202
```sql
CREATE TABLE `test_insert_cast_interval` (
`id` int NULL,
`dt` date NULL
) ENGINE=OLAP
DISTRIBUTED BY HASH(`id`) BUCKETS 10
PROPERTIES (
"replication_allocation" = "tag.location.default: 1"
);
INSERT INTO test_insert_cast_interval values(1, date_floor('2020-02-02', interval 1 second));
(1105, 'errCode = 2, detailMessage = Invalid call to sql on unbound object')
```
2. fix `Insert has filtered data in strict mode`, introduced by apache#49116
```sql
CREATE TABLE `test_insert_more_string` (
`r_regionkey` int NULL,
`r_name` varchar(25) NULL,
`r_comment` varchar(152) NULL
) ENGINE=OLAP
DISTRIBUTED BY HASH(`r_regionkey`) BUCKETS 1
PROPERTIES ( "replication_allocation" = "tag.location.default: 1");
insert into test_insert_more_string values (3, "akljalkjbalkjsldkrjewokjfalksdjflaksjfdlaskjfalsdkfjalsdfjkasfdl", "aa");
(1105, 'errCode = 2, detailMessage = Insert has filtered data in strict mode')
```
(cherry picked from commit 2c01f69)
924060929 added a commit to 924060929/incubator-doris that referenced this pull request Jul 14, 2025
@924060929
[fix](nereids) fix insert into values throw 'Invalid call to sql on u…
c261af6
…nbound object' and 'Insert has filtered data in strict mode' exception (apache#52802)
1. fix `Invalid call to sql on unbound object` when use `interval`,
introduced by apache#40202
```sql
CREATE TABLE `test_insert_cast_interval` (
`id` int NULL,
`dt` date NULL
) ENGINE=OLAP
DISTRIBUTED BY HASH(`id`) BUCKETS 10
PROPERTIES (
"replication_allocation" = "tag.location.default: 1"
);
INSERT INTO test_insert_cast_interval values(1, date_floor('2020-02-02', interval 1 second));
(1105, 'errCode = 2, detailMessage = Invalid call to sql on unbound object')
```
2. fix `Insert has filtered data in strict mode`, introduced by apache#49116
```sql
CREATE TABLE `test_insert_more_string` (
`r_regionkey` int NULL,
`r_name` varchar(25) NULL,
`r_comment` varchar(152) NULL
) ENGINE=OLAP
DISTRIBUTED BY HASH(`r_regionkey`) BUCKETS 1
PROPERTIES ( "replication_allocation" = "tag.location.default: 1");
insert into test_insert_more_string values (3, "akljalkjbalkjsldkrjewokjfalksdjflaksjfdlaskjfalsdkfjalsdfjkasfdl", "aa");
(1105, 'errCode = 2, detailMessage = Insert has filtered data in strict mode')
```
(cherry picked from commit 2c01f69)
@starocean999starocean999 mentioned this pull request Dec 2, 2025
Merged
16 tasks
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gavinchougavinchougavinchou approved these changes
@liaoxin01liaoxin01liaoxin01 approved these changes
@morrySnowmorrySnowmorrySnow approved these changes
@engleflyengleflyenglefly left review comments
@dataroaringdataroaringAwaiting requested review from dataroaring
@w41terw41terAwaiting requested review from w41ter

Assignees

No one assigned

Labels

approvedIndicates a PR has been approved by one committer.reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@starocean999@hello-stephen@doris-robot@englefly@gavinchou@liaoxin01@morrySnow