[feature](statistics)Support get row count for JDBC external table. by Jibing-Li · Pull Request #38889 · apache/doris

Jibing-Li · 2024-08-05T10:30:28Z

Support get row count for JDBC external table by executing select count(1) from table.
Return -1 when external table row count is unknown.

doris-robot · 2024-08-05T10:30:33Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

Jibing-Li · 2024-08-05T10:30:50Z

run buildall

doris-robot · 2024-08-05T10:56:36Z

TPC-H: Total hot run time: 41746 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9c7234108ac784fd670e071ddc2702b1999368bf, data reload: false
------ Round 1 ----------------------------------
q1	18001	4296	4172	4172
q2	2341	202	200	200
q3	10470	1252	1287	1252
q4	10155	828	926	828
q5	7650	2929	2985	2929
q6	227	142	136	136
q7	1062	616	624	616
q8	9442	1935	1959	1935
q9	8508	6613	6613	6613
q10	8712	3844	3846	3844
q11	433	255	250	250
q12	409	233	224	224
q13	17751	2957	2927	2927
q14	268	247	245	245
q15	524	483	502	483
q16	505	395	389	389
q17	970	927	929	927
q18	8123	7308	7223	7223
q19	1389	1236	1232	1232
q20	567	314	347	314
q21	5394	4771	4732	4732
q22	361	283	275	275
Total cold run time: 113262 ms
Total hot run time: 41746 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4064	4045	4061	4045
q2	329	226	218	218
q3	2987	3000	2975	2975
q4	1878	1880	1859	1859
q5	5260	5233	5227	5227
q6	221	130	128	128
q7	2072	1686	1682	1682
q8	3206	3291	3239	3239
q9	8291	8292	8230	8230
q10	3755	3816	3825	3816
q11	550	451	441	441
q12	730	554	531	531
q13	16687	2924	2921	2921
q14	293	256	256	256
q15	521	478	481	478
q16	435	394	399	394
q17	1721	1706	1699	1699
q18	7745	7244	7180	7180
q19	1667	1673	1675	1673
q20	1982	1772	1777	1772
q21	5474	5131	5237	5131
q22	514	459	440	440
Total cold run time: 70382 ms
Total hot run time: 54335 ms

doris-robot · 2024-08-05T11:07:15Z

TPC-DS: Total hot run time: 167733 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9c7234108ac784fd670e071ddc2702b1999368bf, data reload: false
query1	912	380	374	374
query2	6506	1624	1649	1624
query3	6668	213	217	213
query4	19977	17547	17125	17125
query5	4252	530	510	510
query6	273	171	169	169
query7	4607	294	292	292
query8	252	202	198	198
query9	8508	2372	2357	2357
query10	455	274	272	272
query11	10642	10068	10043	10043
query12	144	92	85	85
query13	1630	376	360	360
query14	9830	7393	6595	6595
query15	201	160	166	160
query16	7091	469	431	431
query17	931	550	540	540
query18	2172	275	288	275
query19	194	143	154	143
query20	97	88	106	88
query21	202	95	95	95
query22	4112	4159	4012	4012
query23	33692	33091	32926	32926
query24	10419	3081	2971	2971
query25	679	372	380	372
query26	1756	146	151	146
query27	2951	274	271	271
query28	6952	1989	1967	1967
query29	1337	412	406	406
query30	291	151	148	148
query31	918	742	751	742
query32	99	56	55	55
query33	697	306	305	305
query34	913	468	496	468
query35	859	725	726	725
query36	986	863	830	830
query37	289	76	76	76
query38	2883	2789	2779	2779
query39	841	794	788	788
query40	284	110	114	110
query41	49	44	53	44
query42	131	99	97	97
query43	452	411	402	402
query44	1191	736	726	726
query45	205	176	176	176
query46	1078	807	793	793
query47	1849	1749	1742	1742
query48	358	289	289	289
query49	1198	415	432	415
query50	904	435	464	435
query51	6794	6660	6658	6658
query52	107	89	94	89
query53	250	186	177	177
query54	626	458	442	442
query55	72	73	72	72
query56	283	262	261	261
query57	1173	1032	1049	1032
query58	293	272	265	265
query59	2434	2295	2260	2260
query60	287	274	273	273
query61	95	93	90	90
query62	907	658	660	658
query63	209	184	176	176
query64	5835	1940	1901	1901
query65	3150	3084	3084	3084
query66	1439	332	330	330
query67	15237	14832	14822	14822
query68	4337	567	570	567
query69	446	312	310	310
query70	1077	1032	1060	1032
query71	347	273	280	273
query72	7119	2693	2512	2512
query73	782	330	326	326
query74	6043	5708	5685	5685
query75	3332	2703	2743	2703
query76	2514	1191	1284	1191
query77	439	299	312	299
query78	9379	8880	8808	8808
query79	1630	540	538	538
query80	1302	513	500	500
query81	548	217	223	217
query82	1155	132	135	132
query83	236	171	173	171
query84	272	80	81	80
query85	1285	321	306	306
query86	418	283	289	283
query87	3297	3094	3092	3092
query88	2900	2402	2399	2399
query89	396	305	292	292
query90	1787	190	188	188
query91	122	161	103	103
query92	59	48	47	47
query93	1420	625	614	614
query94	879	297	307	297
query95	371	263	258	258
query96	606	277	274	274
query97	3225	3009	3030	3009
query98	218	201	193	193
query99	1632	1279	1299	1279
Total cold run time: 262681 ms
Total hot run time: 167733 ms

doris-robot · 2024-08-05T11:12:43Z

ClickBench: Total hot run time: 29.71 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9c7234108ac784fd670e071ddc2702b1999368bf, data reload: false
query1	0.04	0.04	0.03
query2	0.07	0.04	0.04
query3	0.22	0.04	0.04
query4	1.69	0.07	0.06
query5	0.52	0.49	0.47
query6	1.13	0.72	0.72
query7	0.02	0.01	0.02
query8	0.05	0.05	0.05
query9	0.57	0.52	0.52
query10	0.56	0.57	0.57
query11	0.16	0.12	0.11
query12	0.15	0.12	0.12
query13	0.62	0.60	0.61
query14	0.77	0.81	0.79
query15	0.89	0.87	0.86
query16	0.36	0.35	0.34
query17	0.99	0.99	0.95
query18	0.22	0.21	0.22
query19	1.78	1.71	1.73
query20	0.01	0.01	0.01
query21	15.41	0.77	0.66
query22	4.47	7.75	1.06
query23	17.93	1.43	1.31
query24	2.24	0.22	0.22
query25	0.18	0.08	0.09
query26	0.32	0.20	0.21
query27	0.45	0.22	0.23
query28	13.20	0.98	0.97
query29	12.52	3.30	3.30
query30	0.26	0.06	0.06
query31	2.87	0.40	0.40
query32	3.25	0.50	0.48
query33	2.97	2.95	2.97
query34	15.46	4.25	4.24
query35	4.26	4.28	4.31
query36	0.67	0.47	0.48
query37	0.19	0.16	0.16
query38	0.15	0.15	0.15
query39	0.04	0.03	0.04
query40	0.15	0.13	0.14
query41	0.10	0.05	0.05
query42	0.05	0.04	0.04
query43	0.04	0.04	0.04
Total cold run time: 108 s
Total hot run time: 29.71 s

Jibing-Li · 2024-08-05T16:14:07Z

run buildall

doris-robot · 2024-08-05T16:48:34Z

TPC-H: Total hot run time: 41529 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0f5a33c081fe54f5fc6fd4d087744f6e92b24932, data reload: false
------ Round 1 ----------------------------------
q1	17611	4125	4055	4055
q2	2019	201	196	196
q3	10463	1253	1288	1253
q4	10177	784	921	784
q5	7681	2936	2943	2936
q6	220	139	135	135
q7	1043	608	618	608
q8	9434	1816	1926	1816
q9	8512	6626	6598	6598
q10	8741	3868	3851	3851
q11	429	246	245	245
q12	453	234	233	233
q13	17764	2949	2959	2949
q14	272	253	248	248
q15	534	485	493	485
q16	528	386	381	381
q17	960	895	879	879
q18	7977	7329	7273	7273
q19	1496	1220	1216	1216
q20	568	320	355	320
q21	5306	4793	4930	4793
q22	343	279	275	275
Total cold run time: 112531 ms
Total hot run time: 41529 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4116	4058	4027	4027
q2	331	218	222	218
q3	3024	2975	3129	2975
q4	2034	2047	1986	1986
q5	5643	5475	5462	5462
q6	226	130	130	130
q7	2107	1770	1793	1770
q8	3288	3374	3343	3343
q9	8696	8668	8762	8668
q10	3962	4092	3983	3983
q11	557	457	468	457
q12	749	625	597	597
q13	16297	3094	3143	3094
q14	308	278	270	270
q15	529	487	480	480
q16	454	424	429	424
q17	1786	1753	1740	1740
q18	8209	7637	7701	7637
q19	1748	1750	1728	1728
q20	2059	1860	1833	1833
q21	5859	5376	5412	5376
q22	517	467	466	466
Total cold run time: 72499 ms
Total hot run time: 56664 ms

doris-robot · 2024-08-05T16:59:27Z

TPC-DS: Total hot run time: 170353 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0f5a33c081fe54f5fc6fd4d087744f6e92b24932, data reload: false
query1	908	372	376	372
query2	6468	1717	1768	1717
query3	6675	217	225	217
query4	19939	17636	17389	17389
query5	3629	508	523	508
query6	267	164	164	164
query7	4605	304	290	290
query8	250	195	185	185
query9	8509	2368	2359	2359
query10	436	282	281	281
query11	10459	10055	10045	10045
query12	118	92	89	89
query13	1629	374	375	374
query14	8693	6945	7305	6945
query15	194	161	169	161
query16	6929	457	450	450
query17	919	578	542	542
query18	1866	285	275	275
query19	198	144	145	144
query20	93	88	83	83
query21	200	108	107	107
query22	4185	4127	3936	3936
query23	33766	33599	33637	33599
query24	10254	3180	3158	3158
query25	709	439	435	435
query26	1718	154	156	154
query27	3175	299	288	288
query28	7528	2050	2002	2002
query29	1299	465	473	465
query30	245	160	155	155
query31	954	793	813	793
query32	110	57	62	57
query33	703	352	334	334
query34	941	507	519	507
query35	888	766	773	766
query36	1084	882	928	882
query37	303	84	91	84
query38	2920	2783	2774	2774
query39	877	825	832	825
query40	252	115	115	115
query41	47	46	47	46
query42	125	103	106	103
query43	481	434	443	434
query44	1193	734	735	734
query45	213	177	182	177
query46	1078	809	798	798
query47	1805	1737	1737	1737
query48	369	294	296	294
query49	958	438	433	433
query50	906	447	438	438
query51	6850	6687	6719	6687
query52	101	94	90	90
query53	259	180	181	180
query54	608	466	470	466
query55	77	76	80	76
query56	288	260	263	260
query57	1155	1040	1039	1039
query58	273	281	293	281
query59	2587	2452	2389	2389
query60	302	290	283	283
query61	120	115	113	113
query62	870	673	678	673
query63	212	188	184	184
query64	5734	2000	1956	1956
query65	3170	3134	3110	3110
query66	1313	454	336	336
query67	15608	14777	14845	14777
query68	6181	579	597	579
query69	774	375	326	326
query70	1117	1077	1075	1075
query71	540	276	275	275
query72	8093	2697	2509	2509
query73	931	328	330	328
query74	6053	5658	5704	5658
query75	4412	2733	2711	2711
query76	4286	1258	1287	1258
query77	750	315	313	313
query78	9491	9104	8835	8835
query79	3284	535	551	535
query80	1377	515	517	515
query81	568	231	236	231
query82	927	138	128	128
query83	306	165	192	165
query84	270	79	79	79
query85	1425	335	305	305
query86	412	294	322	294
query87	3314	3103	3083	3083
query88	3707	2418	2418	2418
query89	403	301	292	292
query90	2002	194	191	191
query91	125	102	99	99
query92	63	50	53	50
query93	4582	610	622	610
query94	897	299	301	299
query95	376	277	270	270
query96	627	285	281	281
query97	3272	3017	3056	3017
query98	255	198	190	190
query99	1610	1324	1314	1314
Total cold run time: 274027 ms
Total hot run time: 170353 ms

doris-robot · 2024-08-05T17:04:58Z

ClickBench: Total hot run time: 29.83 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0f5a33c081fe54f5fc6fd4d087744f6e92b24932, data reload: false
query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.04
query4	1.67	0.06	0.06
query5	0.48	0.47	0.48
query6	1.14	0.73	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.05
query9	0.57	0.51	0.51
query10	0.57	0.57	0.56
query11	0.16	0.12	0.11
query12	0.14	0.12	0.13
query13	0.62	0.61	0.60
query14	0.78	0.79	0.80
query15	0.91	0.87	0.86
query16	0.35	0.36	0.35
query17	0.98	0.99	0.98
query18	0.23	0.22	0.22
query19	1.88	1.71	1.71
query20	0.01	0.01	0.01
query21	15.46	0.75	0.66
query22	4.31	8.20	1.12
query23	17.95	1.38	1.34
query24	2.26	0.23	0.21
query25	0.18	0.08	0.08
query26	0.31	0.22	0.21
query27	0.46	0.23	0.23
query28	13.17	1.00	0.98
query29	12.56	3.32	3.30
query30	0.26	0.07	0.06
query31	2.86	0.41	0.40
query32	3.25	0.48	0.49
query33	2.93	2.92	3.00
query34	15.44	4.26	4.29
query35	4.33	4.29	4.27
query36	0.67	0.49	0.47
query37	0.19	0.17	0.16
query38	0.16	0.17	0.15
query39	0.04	0.03	0.04
query40	0.17	0.13	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.04
query43	0.05	0.04	0.04
Total cold run time: 108.09 s
Total hot run time: 29.83 s

Jibing-Li · 2024-08-06T03:32:34Z

run buildall

doris-robot · 2024-08-06T03:50:11Z

TPC-H: Total hot run time: 41803 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 78dc2c417b0200cd90b93a31291d77ec1c929e7e, data reload: false
------ Round 1 ----------------------------------
q1	18142	4230	4200	4200
q2	2259	204	203	203
q3	11250	1300	1322	1300
q4	10265	833	953	833
q5	8083	3030	2996	2996
q6	226	144	150	144
q7	1076	631	635	631
q8	9852	1897	1955	1897
q9	8402	6508	6553	6508
q10	8675	3836	3837	3836
q11	429	262	251	251
q12	418	238	232	232
q13	17768	2983	2958	2958
q14	273	240	250	240
q15	525	493	491	491
q16	498	402	389	389
q17	981	896	886	886
q18	7956	7299	7195	7195
q19	1446	1207	1210	1207
q20	573	312	346	312
q21	5500	4812	4822	4812
q22	351	282	283	282
Total cold run time: 114948 ms
Total hot run time: 41803 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4084	4026	4042	4026
q2	332	238	228	228
q3	2973	2988	2986	2986
q4	1849	1885	1875	1875
q5	5220	5227	5211	5211
q6	219	135	132	132
q7	2080	1686	1673	1673
q8	3162	3263	3243	3243
q9	8263	8225	8250	8225
q10	3763	3846	3790	3790
q11	546	465	445	445
q12	727	588	538	538
q13	13785	2956	2940	2940
q14	281	255	260	255
q15	524	477	471	471
q16	442	390	393	390
q17	1731	1697	1708	1697
q18	7695	7361	7144	7144
q19	1703	1654	1664	1654
q20	1944	1738	1747	1738
q21	5463	5175	5315	5175
q22	513	454	450	450
Total cold run time: 67299 ms
Total hot run time: 54286 ms

doris-robot · 2024-08-06T04:00:54Z

TPC-DS: Total hot run time: 168476 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 78dc2c417b0200cd90b93a31291d77ec1c929e7e, data reload: false
query1	914	381	373	373
query2	6497	1721	1744	1721
query3	6688	216	223	216
query4	20047	17543	17227	17227
query5	4276	529	515	515
query6	314	199	182	182
query7	4618	294	287	287
query8	248	200	196	196
query9	8505	2377	2363	2363
query10	481	289	279	279
query11	10441	10026	10035	10026
query12	139	91	92	91
query13	1648	388	380	380
query14	11216	7396	6951	6951
query15	222	168	168	168
query16	6698	459	477	459
query17	964	577	566	566
query18	1124	290	296	290
query19	203	157	155	155
query20	95	87	87	87
query21	216	104	105	104
query22	4569	4251	3910	3910
query23	33764	32873	32845	32845
query24	10357	3076	2979	2979
query25	687	398	407	398
query26	1726	153	152	152
query27	2855	278	279	278
query28	6896	1996	1977	1977
query29	1039	439	484	439
query30	292	151	151	151
query31	952	756	746	746
query32	100	54	57	54
query33	716	312	308	308
query34	918	470	482	470
query35	861	735	741	735
query36	997	882	875	875
query37	248	82	79	79
query38	2825	2738	2732	2732
query39	859	809	808	808
query40	280	114	123	114
query41	47	43	45	43
query42	124	107	102	102
query43	478	421	414	414
query44	1202	734	731	731
query45	205	175	179	175
query46	1076	822	791	791
query47	1809	1714	1722	1714
query48	356	300	300	300
query49	1163	426	439	426
query50	897	439	433	433
query51	6886	6711	6725	6711
query52	100	93	87	87
query53	272	183	174	174
query54	646	463	454	454
query55	77	73	75	73
query56	275	259	247	247
query57	1157	1073	1045	1045
query58	283	287	270	270
query59	2640	2443	2372	2372
query60	301	275	289	275
query61	102	98	119	98
query62	919	669	658	658
query63	215	183	177	177
query64	6005	1931	1884	1884
query65	3137	3108	3080	3080
query66	1314	337	333	333
query67	15292	14674	14544	14544
query68	4526	576	586	576
query69	460	313	309	309
query70	1124	1074	1086	1074
query71	456	285	282	282
query72	7174	2652	2503	2503
query73	757	324	322	322
query74	5956	5624	5585	5585
query75	3396	2731	2726	2726
query76	2856	1214	1271	1214
query77	459	321	324	321
query78	9428	8926	8867	8867
query79	2480	539	548	539
query80	1899	529	510	510
query81	568	227	230	227
query82	1023	131	131	131
query83	285	171	179	171
query84	280	83	77	77
query85	1382	310	360	310
query86	449	289	318	289
query87	3262	3125	3118	3118
query88	3162	2429	2439	2429
query89	382	281	290	281
query90	1893	195	193	193
query91	130	102	106	102
query92	69	51	52	51
query93	1920	626	614	614
query94	954	299	299	299
query95	379	268	267	267
query96	614	287	280	280
query97	3225	3031	3024	3024
query98	225	203	203	203
query99	1711	1293	1285	1285
Total cold run time: 266357 ms
Total hot run time: 168476 ms

doris-robot · 2024-08-06T04:06:23Z

ClickBench: Total hot run time: 30.03 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 78dc2c417b0200cd90b93a31291d77ec1c929e7e, data reload: false
query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.08	0.07
query5	0.50	0.49	0.48
query6	1.12	0.72	0.71
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.57	0.51	0.52
query10	0.58	0.56	0.56
query11	0.15	0.12	0.12
query12	0.14	0.12	0.13
query13	0.62	0.60	0.60
query14	0.77	0.80	0.81
query15	0.90	0.88	0.86
query16	0.36	0.35	0.36
query17	0.98	0.98	0.97
query18	0.23	0.21	0.21
query19	1.82	1.77	1.72
query20	0.01	0.01	0.00
query21	15.40	0.74	0.65
query22	4.18	8.17	1.36
query23	17.79	1.33	1.30
query24	2.27	0.22	0.22
query25	0.18	0.08	0.08
query26	0.32	0.22	0.22
query27	0.46	0.23	0.23
query28	13.16	0.99	0.97
query29	12.51	3.31	3.27
query30	0.26	0.06	0.07
query31	2.84	0.42	0.40
query32	3.21	0.50	0.49
query33	2.92	2.92	2.95
query34	15.42	4.27	4.25
query35	4.29	4.26	4.27
query36	0.69	0.49	0.48
query37	0.19	0.16	0.16
query38	0.16	0.15	0.15
query39	0.04	0.04	0.04
query40	0.16	0.14	0.13
query41	0.10	0.04	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 107.5 s
Total hot run time: 30.03 s

Jibing-Li · 2024-08-06T05:56:03Z

run cloud_p0

Jibing-Li · 2024-08-29T08:39:19Z

run buildall

doris-robot · 2024-08-29T09:19:18Z

TPC-H: Total hot run time: 38112 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 812dea70e19abff886ab7cf797d3a0d0920d8a0a, data reload: false
------ Round 1 ----------------------------------
q1	17636	4343	4274	4274
q2	2031	186	171	171
q3	11692	957	1046	957
q4	10519	794	796	794
q5	7762	2851	2855	2851
q6	231	136	136	136
q7	969	625	597	597
q8	9321	2084	2098	2084
q9	7216	6550	6586	6550
q10	6996	2266	2187	2187
q11	463	245	236	236
q12	401	228	231	228
q13	17976	3005	3030	3005
q14	277	248	247	247
q15	522	481	490	481
q16	578	507	514	507
q17	978	722	676	676
q18	7393	6881	6927	6881
q19	1397	1073	1025	1025
q20	677	338	335	335
q21	3938	3225	2876	2876
q22	1086	1071	1014	1014
Total cold run time: 110059 ms
Total hot run time: 38112 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4388	4412	4263	4263
q2	378	280	265	265
q3	2927	2671	2690	2671
q4	1945	1644	1685	1644
q5	5668	5664	5716	5664
q6	230	142	140	140
q7	2233	1879	1827	1827
q8	3301	3419	3442	3419
q9	8864	8916	8848	8848
q10	3580	3424	3398	3398
q11	589	520	517	517
q12	838	698	658	658
q13	16137	3171	3239	3171
q14	331	284	289	284
q15	539	497	469	469
q16	610	606	592	592
q17	1848	1565	1527	1527
q18	8064	7937	7946	7937
q19	1730	1600	1597	1597
q20	2217	1884	1934	1884
q21	5680	5343	5424	5343
q22	1112	1032	1001	1001
Total cold run time: 73209 ms
Total hot run time: 57119 ms

doris-robot · 2024-08-29T09:31:28Z

TPC-DS: Total hot run time: 192567 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 812dea70e19abff886ab7cf797d3a0d0920d8a0a, data reload: false
query1	1328	896	851	851
query2	6351	1996	1908	1908
query3	10593	4010	3934	3934
query4	59383	24064	23313	23313
query5	5341	500	489	489
query6	399	163	157	157
query7	5783	305	303	303
query8	290	215	209	209
query9	9010	2491	2482	2482
query10	504	280	260	260
query11	18330	15157	15309	15157
query12	165	111	100	100
query13	1618	399	417	399
query14	10276	7169	7286	7169
query15	237	173	174	173
query16	7546	474	495	474
query17	1112	573	566	566
query18	2038	298	294	294
query19	287	158	147	147
query20	121	110	112	110
query21	209	110	110	110
query22	4705	4415	4510	4415
query23	34426	33332	33443	33332
query24	5954	2938	2878	2878
query25	540	382	387	382
query26	688	162	153	153
query27	1799	280	283	280
query28	3635	2105	2080	2080
query29	713	414	401	401
query30	234	148	155	148
query31	967	765	773	765
query32	82	52	57	52
query33	454	303	288	288
query34	864	493	507	493
query35	841	717	718	717
query36	1062	933	918	918
query37	143	95	96	95
query38	3980	3876	3821	3821
query39	1434	1392	1395	1392
query40	193	117	117	117
query41	46	49	44	44
query42	120	96	96	96
query43	507	469	464	464
query44	1114	754	751	751
query45	199	164	164	164
query46	1086	772	741	741
query47	1890	1839	1785	1785
query48	377	296	295	295
query49	761	424	428	424
query50	830	431	417	417
query51	7182	6939	7036	6939
query52	101	91	88	88
query53	259	183	185	183
query54	579	468	464	464
query55	81	80	130	80
query56	293	287	262	262
query57	1179	1078	1082	1078
query58	227	233	222	222
query59	3175	2808	2733	2733
query60	299	274	272	272
query61	106	102	100	100
query62	775	654	647	647
query63	225	187	189	187
query64	2823	729	649	649
query65	3183	3127	3125	3125
query66	687	341	343	341
query67	15372	15082	15290	15082
query68	2998	594	600	594
query69	409	286	278	278
query70	1208	1073	1125	1073
query71	360	275	287	275
query72	5355	4144	3990	3990
query73	754	334	338	334
query74	9176	8985	8817	8817
query75	3389	2659	2747	2659
query76	1550	1048	967	967
query77	499	332	317	317
query78	9728	9076	8967	8967
query79	1055	552	534	534
query80	682	511	556	511
query81	462	232	235	232
query82	242	149	147	147
query83	169	150	149	149
query84	255	80	75	75
query85	682	301	285	285
query86	319	305	291	291
query87	4457	4250	4465	4250
query88	3409	2358	2344	2344
query89	381	282	282	282
query90	1944	205	204	204
query91	123	100	104	100
query92	60	52	54	52
query93	1064	539	552	539
query94	720	299	309	299
query95	339	272	271	271
query96	585	269	274	269
query97	3239	3073	3052	3052
query98	211	211	198	198
query99	1508	1329	1247	1247
Total cold run time: 304443 ms
Total hot run time: 192567 ms

doris-robot · 2024-08-29T09:37:04Z

ClickBench: Total hot run time: 32.13 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 812dea70e19abff886ab7cf797d3a0d0920d8a0a, data reload: false
query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.09	0.10
query5	0.52	0.50	0.50
query6	1.13	0.73	0.74
query7	0.02	0.01	0.01
query8	0.05	0.05	0.04
query9	0.55	0.48	0.48
query10	0.54	0.55	0.53
query11	0.16	0.12	0.12
query12	0.15	0.12	0.12
query13	0.60	0.59	0.59
query14	2.04	2.07	2.04
query15	0.86	0.82	0.81
query16	0.37	0.37	0.38
query17	1.10	1.06	1.07
query18	0.21	0.20	0.21
query19	1.91	1.79	1.87
query20	0.01	0.01	0.01
query21	15.39	0.67	0.66
query22	4.07	6.79	1.84
query23	18.20	1.43	1.31
query24	2.10	0.22	0.21
query25	0.15	0.10	0.08
query26	0.27	0.18	0.18
query27	0.08	0.08	0.07
query28	13.32	1.00	1.00
query29	12.65	3.38	3.37
query30	0.24	0.06	0.05
query31	2.87	0.41	0.39
query32	3.25	0.48	0.48
query33	3.02	3.01	3.02
query34	16.88	4.37	4.35
query35	4.40	4.41	4.44
query36	0.66	0.48	0.47
query37	0.19	0.16	0.16
query38	0.16	0.16	0.16
query39	0.05	0.04	0.04
query40	0.17	0.13	0.13
query41	0.09	0.05	0.05
query42	0.07	0.06	0.05
query43	0.05	0.04	0.04
Total cold run time: 110.58 s
Total hot run time: 32.13 s

morningman

LGTM

github-actions · 2024-08-30T06:01:25Z

PR approved by at least one committer and no changes requested.

github-actions · 2024-08-30T06:01:27Z

PR approved by anyone and no changes requested.

…pache#38889) Support get row count for JDBC external table by executing select count(1) from table. Return -1 when external table row count is unknown.

…38889) (#40248) backport: #38889

…38889) Support get row count for JDBC external table by executing select count(1) from table. Return -1 when external table row count is unknown.

…pache#38889) Support get row count for JDBC external table by executing select count(1) from table. Return -1 when external table row count is unknown.

github-actionsBot added the doing label Aug 5, 2024

Jibing-Li force-pushed the jdbc branch from 9c72341 to 0f5a33cCompare August 5, 2024 16:13

Jibing-Li marked this pull request as ready for review August 5, 2024 16:13

Jibing-Li force-pushed the jdbc branch from 0f5a33c to 78dc2c4Compare August 6, 2024 03:13

Jibing-Li force-pushed the jdbc branch 6 times, most recently from 57d9569 to f2df30fCompare August 29, 2024 07:24

Get row count for JDBC external table.
812dea7

Jibing-Li force-pushed the jdbc branch from f2df30f to 812dea7Compare August 29, 2024 08:26

morningman approved these changes Aug 30, 2024
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Aug 30, 2024

github-actionsBot added the reviewed label Aug 30, 2024

morrySnow approved these changes Aug 30, 2024
View reviewed changes

morrySnow merged commit 8e44e50 into apache:masterAug 30, 2024

morrySnow added the dev/2.1.x label Aug 30, 2024

Jibing-Li deleted the jdbc branch August 30, 2024 12:18

Jibing-Li mentioned this pull request Sep 2, 2024
[feature](statistics) Support get row count for JDBC external table. (#38889) #40248
Merged

Jibing-Li added a commit that referenced this pull request Sep 2, 2024
[feature](statistics) Support get row count for JDBC external table. (#…
8ff068e
…38889) (#40248) backport: #38889

Jibing-Li added dev/2.1.6-merged and removed dev/2.1.x labels Sep 2, 2024

morningman mentioned this pull request Sep 23, 2024
[fix](jdbc catalog) Fixed FE memory leak by enabling weak references in HikariCP #40773
Merged

morrySnow added dev/3.0.3-merged and removed doing labels Oct 10, 2024

Uh oh!

Conversation

Jibing-Li commented Aug 5, 2024• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

doris-robot commented Aug 5, 2024

Uh oh!

Jibing-Li commented Aug 5, 2024

Uh oh!

doris-robot commented Aug 5, 2024

Uh oh!

doris-robot commented Aug 5, 2024

Uh oh!

doris-robot commented Aug 5, 2024

Uh oh!

Jibing-Li commented Aug 5, 2024

Uh oh!

doris-robot commented Aug 5, 2024

Uh oh!

doris-robot commented Aug 5, 2024

Uh oh!

doris-robot commented Aug 5, 2024

Uh oh!

Jibing-Li commented Aug 6, 2024

Uh oh!

doris-robot commented Aug 6, 2024

Uh oh!

doris-robot commented Aug 6, 2024

Uh oh!

doris-robot commented Aug 6, 2024

Uh oh!

Jibing-Li commented Aug 6, 2024

Uh oh!

Jibing-Li commented Aug 29, 2024

Uh oh!

doris-robot commented Aug 29, 2024

Uh oh!

doris-robot commented Aug 29, 2024

Uh oh!

doris-robot commented Aug 29, 2024

Uh oh!

morningman left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Aug 30, 2024

Uh oh!

github-actionsBot commented Aug 30, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Jibing-Li commented Aug 5, 2024•
edited
Loading