[Feature](dictionary) Support Dictionary Table by zclllyybb · Pull Request #45926 · apache/doris

zclllyybb · 2024-12-25T07:41:58Z

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

We supported:

create, drop, show and explain dictionary
load data to all BE manually
clean data for all BE when dropping the dictionary

Release note

Support Dictionary Table(Experimental Function)

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes. [docs] Support Dictionary doris-website#2071

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

hello-stephen · 2024-12-25T07:42:03Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

zclllyybb · 2024-12-25T07:42:06Z

run buildall

zclllyybb · 2024-12-25T09:14:07Z

run buildall

doris-robot · 2024-12-26T08:30:37Z

TPC-H: Total hot run time: 32648 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2d10132b06bbde190fb1da9f06af3569ba73eaef, data reload: false
------ Round 1 ----------------------------------
q1	17910	6210	6143	6143
q2	2054	314	169	169
q3	10677	1251	728	728
q4	10234	873	437	437
q5	7997	2113	1965	1965
q6	207	185	152	152
q7	900	762	618	618
q8	9239	1363	1132	1132
q9	5240	4951	4913	4913
q10	6758	2296	1861	1861
q11	484	276	254	254
q12	351	362	229	229
q13	17795	3619	2991	2991
q14	225	234	205	205
q15	569	515	491	491
q16	637	609	591	591
q17	580	843	326	326
q18	7110	6440	6399	6399
q19	2563	968	557	557
q20	310	316	184	184
q21	2805	2193	1992	1992
q22	367	336	311	311
Total cold run time: 105012 ms
Total hot run time: 32648 ms
----- Round 2, with runtime_filter_mode=off -----
q1	6371	6223	6210	6210
q2	229	333	226	226
q3	2239	2646	2340	2340
q4	1395	1827	1334	1334
q5	4317	4705	4879	4705
q6	186	182	145	145
q7	2060	1963	1796	1796
q8	2624	2817	2678	2678
q9	7291	7281	7285	7281
q10	3055	3337	2743	2743
q11	567	510	492	492
q12	615	749	602	602
q13	3482	3852	3184	3184
q14	313	316	295	295
q15	565	509	505	505
q16	646	687	665	665
q17	1215	1730	1257	1257
q18	7638	7400	7362	7362
q19	850	1052	1137	1052
q20	2036	2027	1885	1885
q21	5706	5206	4944	4944
q22	616	629	602	602
Total cold run time: 54016 ms
Total hot run time: 52303 ms

doris-robot · 2024-12-26T08:43:00Z

TPC-DS: Total hot run time: 196728 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2d10132b06bbde190fb1da9f06af3569ba73eaef, data reload: false
query1	1273	962	969	962
query2	6490	2387	2299	2299
query3	10929	4786	4624	4624
query4	33256	24101	23355	23355
query5	4058	606	459	459
query6	306	209	184	184
query7	3979	488	317	317
query8	326	250	238	238
query9	9347	2765	2733	2733
query10	467	303	251	251
query11	17989	15342	15213	15213
query12	165	105	110	105
query13	1591	557	415	415
query14	10312	7456	6972	6972
query15	257	220	186	186
query16	7759	663	469	469
query17	1584	775	601	601
query18	1970	402	359	359
query19	224	182	167	167
query20	131	112	122	112
query21	210	133	106	106
query22	4639	4569	4555	4555
query23	34661	33771	33695	33695
query24	6472	2255	2422	2255
query25	484	435	385	385
query26	840	275	158	158
query27	2071	467	331	331
query28	5829	2537	2495	2495
query29	650	554	426	426
query30	220	213	150	150
query31	1000	940	854	854
query32	93	56	87	56
query33	481	360	311	311
query34	766	855	538	538
query35	833	834	776	776
query36	1012	1053	964	964
query37	124	104	78	78
query38	4291	4322	4063	4063
query39	1549	1476	1466	1466
query40	214	114	102	102
query41	46	43	46	43
query42	125	103	102	102
query43	511	509	474	474
query44	1311	833	833	833
query45	187	180	174	174
query46	890	1058	670	670
query47	2058	2008	1929	1929
query48	391	418	323	323
query49	706	473	379	379
query50	642	698	405	405
query51	7298	7343	7299	7299
query52	112	102	93	93
query53	241	254	187	187
query54	478	494	434	434
query55	87	88	88	88
query56	277	258	242	242
query57	1222	1229	1174	1174
query58	234	222	230	222
query59	3106	3242	3194	3194
query60	272	253	258	253
query61	107	104	120	104
query62	865	850	759	759
query63	246	202	206	202
query64	3705	1021	697	697
query65	3344	3308	3255	3255
query66	798	408	302	302
query67	16504	15867	15519	15519
query68	10275	760	539	539
query69	488	317	250	250
query70	1207	1081	1088	1081
query71	437	297	266	266
query72	6218	3788	3904	3788
query73	679	735	365	365
query74	10383	9374	9101	9101
query75	4490	3140	2647	2647
query76	5525	1194	761	761
query77	1050	383	275	275
query78	10292	10174	9443	9443
query79	3535	894	583	583
query80	728	519	424	424
query81	484	270	227	227
query82	641	148	126	126
query83	191	157	143	143
query84	283	86	68	68
query85	778	349	297	297
query86	344	314	292	292
query87	4692	4398	4384	4384
query88	3296	2283	2204	2204
query89	468	330	293	293
query90	1999	192	187	187
query91	134	132	101	101
query92	64	67	49	49
query93	2135	882	541	541
query94	670	377	279	279
query95	342	265	252	252
query96	492	600	281	281
query97	2780	2813	2693	2693
query98	222	197	188	188
query99	1672	1575	1459	1459
Total cold run time: 301609 ms
Total hot run time: 196728 ms

doris-robot · 2024-12-26T08:48:21Z

ClickBench: Total hot run time: 31.62 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2d10132b06bbde190fb1da9f06af3569ba73eaef, data reload: false
query1	0.03	0.03	0.03
query2	0.09	0.05	0.05
query3	0.23	0.06	0.05
query4	1.64	0.08	0.09
query5	0.42	0.41	0.42
query6	1.13	0.67	0.67
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.55	0.49	0.50
query10	0.55	0.58	0.57
query11	0.16	0.12	0.12
query12	0.16	0.13	0.13
query13	0.62	0.62	0.59
query14	2.73	2.72	2.75
query15	0.92	0.85	0.85
query16	0.38	0.37	0.37
query17	1.08	1.07	1.08
query18	0.19	0.18	0.19
query19	1.86	1.73	2.07
query20	0.02	0.02	0.02
query21	15.37	0.95	0.66
query22	0.77	0.79	0.73
query23	14.94	1.44	0.69
query24	2.15	0.38	0.23
query25	0.14	0.08	0.08
query26	0.28	0.19	0.18
query27	0.08	0.08	0.08
query28	13.46	1.79	1.14
query29	12.69	4.02	3.39
query30	0.24	0.08	0.07
query31	2.83	0.61	0.41
query32	3.22	0.57	0.47
query33	3.14	3.14	3.14
query34	16.64	5.16	4.49
query35	4.54	4.57	4.54
query36	0.62	0.50	0.48
query37	0.19	0.16	0.17
query38	0.16	0.15	0.16
query39	0.06	0.05	0.05
query40	0.18	0.14	0.13
query41	0.10	0.06	0.06
query42	0.06	0.06	0.06
query43	0.05	0.06	0.05
Total cold run time: 104.74 s
Total hot run time: 31.62 s

HappenLee

LGTM

github-actions · 2024-12-27T10:09:36Z

PR approved by at least one committer and no changes requested.

github-actions · 2024-12-27T10:09:38Z

PR approved by anyone and no changes requested.

Mryange · 2025-01-02T03:42:20Z

run buildall

doris-robot · 2025-01-02T05:48:10Z

TeamCity be ut coverage result:
Function Coverage: 38.93% (10153/26079)
Line Coverage: 29.94% (85880/286823)
Region Coverage: 29.05% (43825/150852)
Branch Coverage: 25.60% (22377/87426)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0dc1cf8c55a8a430ad785e934effe02bdb34fe67_0dc1cf8c55a8a430ad785e934effe02bdb34fe67/report/index.html

Mryange · 2025-01-06T08:33:57Z

run buildall

Mryange · 2025-01-06T08:42:42Z

run buildall

Mryange · 2025-01-09T07:36:32Z

run buildall

doris-robot · 2025-01-09T09:50:14Z

TeamCity be ut coverage result:
Function Coverage: 38.91% (10167/26127)
Line Coverage: 30.00% (86170/287229)
Region Coverage: 29.07% (43889/150956)
Branch Coverage: 25.63% (22415/87466)
Coverage Report: http://coverage.selectdb-in.cc/coverage/c7ef16e874266f999ce8277ed48f3a139fca7c83_c7ef16e874266f999ce8277ed48f3a139fca7c83/report/index.html

Mryange · 2025-01-10T11:47:28Z

run buildall

zclllyybb · 2025-01-12T17:47:55Z

run buildall

doris-robot · 2025-04-30T11:08:19Z

TPC-DS: Total hot run time: 193044 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 70bc13ae8dcd8c812cf905aa5c9fa6b442784e1f, data reload: false
query1	1430	1085	1095	1085
query2	6134	1791	1804	1791
query3	11000	4507	4497	4497
query4	52822	26069	23517	23517
query5	5045	630	484	484
query6	371	221	214	214
query7	4894	534	305	305
query8	378	309	291	291
query9	5587	2596	2610	2596
query10	463	339	300	300
query11	15065	15013	14885	14885
query12	174	120	110	110
query13	1048	548	418	418
query14	10240	6379	6442	6379
query15	218	197	175	175
query16	7182	681	494	494
query17	1097	797	619	619
query18	1573	436	346	346
query19	207	195	176	176
query20	136	128	126	126
query21	208	131	111	111
query22	4328	4521	4299	4299
query23	34051	33314	33535	33314
query24	6674	2444	2482	2444
query25	500	486	429	429
query26	710	292	159	159
query27	2402	513	343	343
query28	3117	2150	2163	2150
query29	643	625	494	494
query30	273	223	199	199
query31	880	892	827	827
query32	79	73	68	68
query33	483	402	336	336
query34	778	874	540	540
query35	820	844	765	765
query36	930	994	898	898
query37	117	143	83	83
query38	4173	4286	4223	4223
query39	1537	1446	1477	1446
query40	211	125	115	115
query41	71	69	67	67
query42	133	114	111	111
query43	513	514	485	485
query44	1327	828	842	828
query45	195	176	179	176
query46	855	1044	665	665
query47	1880	1883	1845	1845
query48	401	432	314	314
query49	737	585	475	475
query50	687	707	421	421
query51	4274	4318	4189	4189
query52	126	110	110	110
query53	236	265	189	189
query54	619	610	530	530
query55	86	85	86	85
query56	337	322	323	322
query57	1182	1223	1107	1107
query58	284	279	270	270
query59	2730	2790	2640	2640
query60	349	349	337	337
query61	161	154	158	154
query62	743	715	671	671
query63	239	193	191	191
query64	1787	1050	684	684
query65	4298	4221	4219	4219
query66	730	388	309	309
query67	15940	15554	15211	15211
query68	6952	822	512	512
query69	548	300	264	264
query70	1176	1084	1063	1063
query71	502	322	286	286
query72	6016	4761	5070	4761
query73	1498	664	350	350
query74	9240	9056	8643	8643
query75	3989	3177	2705	2705
query76	4239	1194	763	763
query77	732	380	286	286
query78	10117	10032	9334	9334
query79	2772	809	575	575
query80	623	504	450	450
query81	480	259	224	224
query82	442	127	99	99
query83	308	247	236	236
query84	314	105	83	83
query85	807	347	301	301
query86	358	291	303	291
query87	4510	4431	4312	4312
query88	3300	2202	2207	2202
query89	423	312	275	275
query90	1975	220	220	220
query91	151	152	110	110
query92	76	62	61	61
query93	1538	923	569	569
query94	662	410	300	300
query95	377	297	286	286
query96	490	563	271	271
query97	3164	3207	3130	3130
query98	231	205	209	205
query99	1435	1392	1221	1221
Total cold run time: 298343 ms
Total hot run time: 193044 ms

doris-robot · 2025-04-30T11:13:35Z

ClickBench: Total hot run time: 29.66 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 70bc13ae8dcd8c812cf905aa5c9fa6b442784e1f, data reload: false
query1	0.04	0.04	0.03
query2	0.15	0.11	0.11
query3	0.35	0.21	0.21
query4	1.60	0.07	0.08
query5	0.55	0.55	0.54
query6	1.18	0.73	0.72
query7	0.04	0.02	0.02
query8	0.05	0.05	0.05
query9	0.63	0.53	0.52
query10	0.56	0.59	0.58
query11	0.25	0.13	0.13
query12	0.26	0.13	0.13
query13	0.65	0.63	0.61
query14	0.79	0.81	0.82
query15	0.96	0.88	0.86
query16	0.37	0.37	0.37
query17	1.07	1.04	1.02
query18	0.18	0.18	0.19
query19	1.98	1.80	1.85
query20	0.02	0.02	0.01
query21	15.41	0.98	0.70
query22	0.93	1.06	0.93
query23	14.69	1.52	0.75
query24	5.54	0.55	0.28
query25	0.17	0.10	0.09
query26	0.55	0.22	0.18
query27	0.09	0.09	0.09
query28	11.10	1.16	0.57
query29	12.58	3.95	3.31
query30	0.28	0.09	0.06
query31	2.79	0.62	0.42
query32	3.23	0.59	0.51
query33	3.04	3.05	3.06
query34	16.23	5.11	4.38
query35	4.41	4.42	4.43
query36	0.65	0.52	0.49
query37	0.19	0.17	0.17
query38	0.16	0.15	0.16
query39	0.05	0.04	0.04
query40	0.20	0.16	0.16
query41	0.11	0.05	0.05
query42	0.07	0.05	0.05
query43	0.05	0.05	0.04
Total cold run time: 104.2 s
Total hot run time: 29.66 s

hello-stephen · 2025-04-30T12:41:53Z

BE UT Coverage Report

Increment line coverage 65.21% (714/1095) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	55.01% (14891/27068)
Line Coverage	44.14% (130870/296462)
Region Coverage	42.81% (66676/155750)
Branch Coverage	37.36% (33618/89984)

hello-stephen · 2025-04-30T17:40:51Z

BE Regression && UT Coverage Report

Increment line coverage 83.56% (930/1113) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	80.20% (21307/26568)
Line Coverage	74.29% (219884/295972)
Region Coverage	72.63% (132337/182202)
Branch Coverage	65.93% (67627/102568)

zclllyybb · 2025-05-01T04:51:23Z

run buildall

doris-robot · 2025-05-01T05:19:32Z

TeamCity cloud ut coverage result:
Function Coverage: 83.08% (1100/1324)
Line Coverage: 65.93% (18421/27940)
Region Coverage: 65.36% (9129/13967)
Branch Coverage: 55.30% (4908/8876)
Coverage Report: http://coverage.selectdb-in.cc/coverage/cd835d8730e3cf0d970f25b974239961dfa91a41_cd835d8730e3cf0d970f25b974239961dfa91a41_cloud/report/index.html

doris-robot · 2025-05-01T05:47:25Z

TPC-H: Total hot run time: 33844 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cd835d8730e3cf0d970f25b974239961dfa91a41, data reload: false
------ Round 1 ----------------------------------
q1	25955	5118	5043	5043
q2	2076	276	178	178
q3	10735	1226	702	702
q4	10266	1023	529	529
q5	8059	2387	2302	2302
q6	181	167	131	131
q7	913	746	619	619
q8	9325	1290	1060	1060
q9	6717	5063	5141	5063
q10	6804	2316	1884	1884
q11	462	274	267	267
q12	347	351	209	209
q13	17775	3662	3202	3202
q14	230	229	219	219
q15	521	487	497	487
q16	416	442	381	381
q17	606	853	352	352
q18	7636	7065	7154	7065
q19	1421	955	562	562
q20	341	327	206	206
q21	3903	3338	2419	2419
q22	1028	1015	964	964
Total cold run time: 115717 ms
Total hot run time: 33844 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5142	5313	5094	5094
q2	252	325	230	230
q3	2159	2669	2272	2272
q4	1383	1813	1373	1373
q5	4449	4476	4412	4412
q6	224	173	129	129
q7	2047	1934	1738	1738
q8	2635	2553	2619	2553
q9	7252	7119	7006	7006
q10	3037	3230	2752	2752
q11	577	489	505	489
q12	675	763	615	615
q13	3537	3912	3343	3343
q14	301	316	287	287
q15	574	500	496	496
q16	446	487	453	453
q17	1141	1542	1406	1406
q18	7844	7635	7659	7635
q19	801	839	1070	839
q20	1979	2010	1833	1833
q21	5152	4871	4735	4735
q22	1120	1054	1031	1031
Total cold run time: 52727 ms
Total hot run time: 50721 ms

doris-robot · 2025-05-01T05:59:40Z

TPC-DS: Total hot run time: 192353 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cd835d8730e3cf0d970f25b974239961dfa91a41, data reload: false
query1	1414	1106	1052	1052
query2	6323	1833	1808	1808
query3	11129	4567	4489	4489
query4	55745	25455	23437	23437
query5	5018	523	489	489
query6	340	207	199	199
query7	4916	508	285	285
query8	333	256	234	234
query9	5855	2548	2565	2548
query10	423	315	269	269
query11	15015	15026	14921	14921
query12	165	107	117	107
query13	1049	514	402	402
query14	10166	6321	6348	6321
query15	201	213	190	190
query16	7105	663	532	532
query17	1128	754	620	620
query18	1572	417	324	324
query19	203	193	176	176
query20	128	123	125	123
query21	207	137	111	111
query22	4442	4429	4424	4424
query23	34315	33344	33465	33344
query24	6592	2404	2415	2404
query25	487	460	423	423
query26	690	271	150	150
query27	2252	509	342	342
query28	3064	2148	2094	2094
query29	571	584	426	426
query30	271	212	195	195
query31	871	891	803	803
query32	78	75	66	66
query33	446	372	308	308
query34	761	870	512	512
query35	818	825	762	762
query36	938	1018	902	902
query37	110	97	79	79
query38	4117	4346	4077	4077
query39	1502	1443	1418	1418
query40	218	124	110	110
query41	56	56	51	51
query42	127	112	112	112
query43	491	502	478	478
query44	1309	810	815	810
query45	184	176	168	168
query46	833	1013	649	649
query47	1866	1906	1804	1804
query48	389	418	302	302
query49	682	511	436	436
query50	648	700	409	409
query51	4183	4155	4234	4155
query52	117	112	104	104
query53	230	267	190	190
query54	583	605	512	512
query55	79	85	78	78
query56	295	310	297	297
query57	1203	1210	1140	1140
query58	262	264	249	249
query59	2698	2891	2672	2672
query60	329	330	304	304
query61	128	125	128	125
query62	756	742	668	668
query63	226	189	190	189
query64	1685	1102	686	686
query65	4409	4297	4215	4215
query66	736	402	307	307
query67	15746	15805	15307	15307
query68	6827	871	512	512
query69	537	305	258	258
query70	1160	1118	1088	1088
query71	495	322	291	291
query72	5828	4878	4983	4878
query73	1432	699	340	340
query74	8961	9205	8722	8722
query75	3770	3192	2687	2687
query76	4194	1179	750	750
query77	617	358	281	281
query78	10046	10006	9289	9289
query79	2687	810	559	559
query80	694	576	436	436
query81	492	256	222	222
query82	463	127	97	97
query83	373	250	234	234
query84	304	104	84	84
query85	778	345	309	309
query86	379	308	280	280
query87	4317	4494	4258	4258
query88	3427	2189	2194	2189
query89	395	318	292	292
query90	1801	201	208	201
query91	145	139	110	110
query92	80	60	57	57
query93	2367	927	576	576
query94	652	422	297	297
query95	416	291	291	291
query96	496	566	270	270
query97	3148	3195	3122	3122
query98	230	203	199	199
query99	1455	1401	1281	1281
Total cold run time: 300194 ms
Total hot run time: 192353 ms

doris-robot · 2025-05-01T06:04:55Z

ClickBench: Total hot run time: 29.8 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cd835d8730e3cf0d970f25b974239961dfa91a41, data reload: false
query1	0.04	0.03	0.03
query2	0.16	0.10	0.11
query3	0.34	0.21	0.20
query4	1.59	0.20	0.20
query5	0.62	0.60	0.61
query6	1.19	0.71	0.71
query7	0.03	0.02	0.02
query8	0.06	0.06	0.05
query9	0.63	0.51	0.50
query10	0.59	0.58	0.58
query11	0.26	0.12	0.12
query12	0.26	0.14	0.14
query13	0.62	0.61	0.62
query14	0.79	0.82	0.82
query15	0.94	0.89	0.87
query16	0.36	0.37	0.38
query17	1.03	1.03	1.04
query18	0.19	0.20	0.18
query19	1.88	1.78	1.81
query20	0.02	0.02	0.02
query21	15.40	1.00	0.69
query22	0.93	1.05	0.81
query23	14.69	1.56	0.74
query24	5.38	0.57	0.29
query25	0.17	0.09	0.08
query26	0.55	0.22	0.19
query27	0.08	0.08	0.09
query28	11.07	1.24	0.57
query29	12.54	4.12	3.42
query30	0.28	0.09	0.07
query31	2.82	0.62	0.42
query32	3.23	0.58	0.51
query33	3.06	3.00	3.12
query34	16.81	5.16	4.42
query35	4.48	4.47	4.46
query36	0.63	0.50	0.49
query37	0.19	0.17	0.17
query38	0.17	0.14	0.15
query39	0.05	0.04	0.04
query40	0.21	0.16	0.15
query41	0.11	0.05	0.05
query42	0.06	0.04	0.04
query43	0.05	0.05	0.04
Total cold run time: 104.56 s
Total hot run time: 29.8 s

doris-robot · 2025-05-01T06:50:35Z

BE UT Coverage Report

Increment line coverage 65.21% (714/1095) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	55.03% (14895/27069)
Line Coverage	44.17% (130943/296484)
Region Coverage	42.83% (66712/155759)
Branch Coverage	37.38% (33638/89990)

zclllyybb · 2025-05-01T07:53:45Z

run buildall

doris-robot · 2025-05-01T08:12:44Z

TeamCity cloud ut coverage result:
Function Coverage: 83.08% (1100/1324)
Line Coverage: 65.89% (18411/27940)
Region Coverage: 65.32% (9123/13967)
Branch Coverage: 55.24% (4903/8876)
Coverage Report: http://coverage.selectdb-in.cc/coverage/47cc263d1b979b27146bcfb0f940571d1172c8b2_47cc263d1b979b27146bcfb0f940571d1172c8b2_cloud/report/index.html

doris-robot · 2025-05-01T08:51:25Z

TPC-H: Total hot run time: 34078 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 47cc263d1b979b27146bcfb0f940571d1172c8b2, data reload: false
------ Round 1 ----------------------------------
q1	26245	5106	5033	5033
q2	2092	291	185	185
q3	10457	1244	711	711
q4	10216	997	518	518
q5	7561	2407	2379	2379
q6	186	172	140	140
q7	954	766	632	632
q8	9330	1382	1200	1200
q9	6760	5052	5104	5052
q10	6879	2320	1895	1895
q11	486	282	276	276
q12	352	349	215	215
q13	17760	3687	3090	3090
q14	232	229	218	218
q15	529	480	484	480
q16	415	439	378	378
q17	606	867	363	363
q18	7673	7140	7049	7049
q19	1450	985	562	562
q20	351	336	221	221
q21	4006	3383	2516	2516
q22	1043	1006	965	965
Total cold run time: 115583 ms
Total hot run time: 34078 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5143	5080	5088	5080
q2	241	324	228	228
q3	2146	2657	2310	2310
q4	1356	1822	1469	1469
q5	4481	4408	4394	4394
q6	226	170	134	134
q7	2010	1951	1797	1797
q8	2637	2651	2546	2546
q9	7242	7172	7081	7081
q10	2975	3187	2766	2766
q11	590	495	508	495
q12	669	754	624	624
q13	3558	3845	3323	3323
q14	304	303	287	287
q15	523	477	476	476
q16	440	476	457	457
q17	1192	1537	1411	1411
q18	7887	7549	7468	7468
q19	824	898	1106	898
q20	2047	2045	1826	1826
q21	5234	4778	4759	4759
q22	1130	1073	998	998
Total cold run time: 52855 ms
Total hot run time: 50827 ms

doris-robot · 2025-05-01T09:03:37Z

TPC-DS: Total hot run time: 192548 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 47cc263d1b979b27146bcfb0f940571d1172c8b2, data reload: false
query1	1412	1092	1078	1078
query2	6430	1787	1796	1787
query3	10983	4438	4504	4438
query4	55648	25756	23034	23034
query5	4890	464	468	464
query6	343	202	206	202
query7	4900	531	295	295
query8	321	243	258	243
query9	5614	2577	2546	2546
query10	440	326	266	266
query11	15265	15038	14825	14825
query12	160	113	109	109
query13	1040	511	382	382
query14	10229	6365	6427	6365
query15	205	191	177	177
query16	7207	657	513	513
query17	1058	740	579	579
query18	1673	402	309	309
query19	203	201	181	181
query20	138	129	120	120
query21	207	127	106	106
query22	4325	4471	4293	4293
query23	34212	33502	33644	33502
query24	6586	2459	2474	2459
query25	472	480	405	405
query26	682	274	160	160
query27	2200	499	344	344
query28	3092	2128	2122	2122
query29	577	575	457	457
query30	279	221	187	187
query31	853	901	789	789
query32	80	68	66	66
query33	467	405	337	337
query34	788	867	560	560
query35	820	822	784	784
query36	949	969	927	927
query37	112	99	73	73
query38	4200	4314	4166	4166
query39	1490	1446	1439	1439
query40	217	133	109	109
query41	55	54	53	53
query42	123	106	112	106
query43	512	507	484	484
query44	1333	833	847	833
query45	187	177	173	173
query46	852	1036	658	658
query47	1828	1851	1762	1762
query48	385	408	305	305
query49	703	515	445	445
query50	662	701	406	406
query51	4280	4168	4178	4168
query52	121	115	102	102
query53	228	250	184	184
query54	613	606	561	561
query55	87	78	82	78
query56	330	289	280	280
query57	1145	1187	1109	1109
query58	270	267	258	258
query59	2658	2848	2715	2715
query60	339	335	311	311
query61	137	139	132	132
query62	744	767	652	652
query63	234	192	196	192
query64	1737	1080	825	825
query65	4430	4299	4231	4231
query66	707	420	324	324
query67	15844	15368	15225	15225
query68	5654	896	517	517
query69	539	314	286	286
query70	1207	1129	1133	1129
query71	463	321	301	301
query72	6131	4795	4917	4795
query73	1343	665	359	359
query74	9164	8844	8734	8734
query75	3411	3179	2729	2729
query76	3708	1192	758	758
query77	552	362	367	362
query78	10079	10134	9287	9287
query79	2387	809	559	559
query80	642	522	451	451
query81	495	256	236	236
query82	472	130	96	96
query83	252	244	236	236
query84	296	99	83	83
query85	807	354	313	313
query86	435	313	291	291
query87	4364	4434	4339	4339
query88	3582	2230	2216	2216
query89	404	308	278	278
query90	1907	219	213	213
query91	141	142	113	113
query92	72	61	56	56
query93	1936	951	568	568
query94	653	422	308	308
query95	366	308	290	290
query96	493	569	276	276
query97	3173	3230	3116	3116
query98	247	201	213	201
query99	1453	1406	1282	1282
Total cold run time: 298139 ms
Total hot run time: 192548 ms

doris-robot · 2025-05-01T09:08:54Z

ClickBench: Total hot run time: 29.79 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 47cc263d1b979b27146bcfb0f940571d1172c8b2, data reload: false
query1	0.04	0.04	0.03
query2	0.14	0.11	0.11
query3	0.35	0.20	0.20
query4	1.60	0.21	0.07
query5	0.57	0.53	0.55
query6	1.18	0.72	0.73
query7	0.02	0.02	0.02
query8	0.06	0.04	0.05
query9	0.62	0.52	0.52
query10	0.57	0.59	0.57
query11	0.25	0.13	0.13
query12	0.26	0.14	0.13
query13	0.63	0.62	0.62
query14	0.79	0.83	0.82
query15	0.96	0.86	0.89
query16	0.37	0.37	0.37
query17	1.07	1.04	1.05
query18	0.18	0.18	0.18
query19	1.97	1.77	1.79
query20	0.02	0.02	0.02
query21	15.40	0.98	0.68
query22	0.92	1.06	0.81
query23	14.69	1.49	0.76
query24	5.27	0.65	0.32
query25	0.16	0.09	0.09
query26	0.55	0.22	0.18
query27	0.08	0.09	0.09
query28	11.09	1.17	0.57
query29	12.53	4.14	3.38
query30	0.29	0.08	0.06
query31	2.81	0.63	0.43
query32	3.25	0.59	0.50
query33	3.02	3.11	3.10
query34	16.53	5.08	4.46
query35	4.44	4.42	4.50
query36	0.63	0.50	0.50
query37	0.20	0.17	0.17
query38	0.17	0.17	0.16
query39	0.05	0.04	0.05
query40	0.19	0.17	0.16
query41	0.11	0.06	0.06
query42	0.06	0.05	0.06
query43	0.05	0.05	0.05
Total cold run time: 104.14 s
Total hot run time: 29.79 s

hello-stephen · 2025-05-01T09:42:15Z

BE UT Coverage Report

Increment line coverage 65.21% (714/1095) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	55.02% (14894/27069)
Line Coverage	44.16% (130924/296485)
Region Coverage	42.83% (66706/155759)
Branch Coverage	37.37% (33631/89990)

hello-stephen · 2025-05-01T10:56:52Z

BE Regression && UT Coverage Report

Increment line coverage 85.62% (953/1113) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	80.30% (21333/26568)
Line Coverage	74.38% (220142/295972)
Region Coverage	72.68% (132422/182202)
Branch Coverage	65.94% (67637/102568)

github-actions · 2025-05-01T12:43:20Z

PR approved by at least one committer and no changes requested.

HappenLee

LGTM

We supported: 1. create, drop, show and explain dictionary 2. load data to all BE manually 3. clean data for all BE when dropping the dictionary

…7561) Cherry-pick all docker/runtime/ changes from apache/doris master that are missing in branch-hotfix-selectdb-doris-3.1-hubspot. Includes changes from PRs: apache#42068 apache#42208 apache#42564 apache#42605 apache#43040 apache#43085 apache#43200 apache#45503 apache#45926 apache#46387 apache#47342 apache#47837 apache#48183 apache#48839 apache#48898 apache#49343 apache#49874 apache#50247 apache#50536 apache#50604 apache#50745 apache#50922 apache#51357 apache#51693 apache#54321 apache#54392 apache#54950 apache#55299 apache#55548 apache#55615 apache#55671 apache#55824 apache#56471 apache#56757 apache#56917 apache#57113 apache#57236 apache#57345 apache#57374 apache#57695 apache#58229 apache#58565 apache#58638 apache#59039 apache#59292 apache#59480 apache#59553 apache#60060 apache#60458 ## Proposed changes Issue Number: close #xxx  Co-authored-by: catpineapple <catpineapple@users.noreply.github.com>

zclllyybb requested review from CalvinKirs, dataroaring and morningman as code owners December 25, 2024 07:41

zclllyybb force-pushed the dictionary branch from 44503f6 to 2d10132Compare December 25, 2024 09:06

HappenLee previously approved these changes Dec 27, 2024
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Dec 27, 2024

github-actionsBot added the reviewed label Dec 27, 2024

zclllyybb dismissed HappenLee’s stale review via e3981eaDecember 30, 2024 03:46

zclllyybb force-pushed the dictionary branch from 2d10132 to e3981eaCompare December 30, 2024 03:46

zclllyybb marked this pull request as draft December 30, 2024 03:47

github-actionsBot removed the approved Indicates a PR has been approved by one committer. label Dec 30, 2024

zclllyybb force-pushed the dictionary branch from 48fc076 to ffd052cCompare December 31, 2024 11:19

zclllyybb force-pushed the dictionary branch from 2696e6f to 43126bcCompare January 8, 2025 10:50

zclllyybb force-pushed the dictionary branch from bf1eae6 to 0f82df0Compare January 12, 2025 17:01

fix original load and make testcases more robust
47cc263

zclllyybb force-pushed the dictionary branch from cd835d8 to 47cc263Compare May 1, 2025 07:53

zclllyybb requested review from 924060929 and HappenLee May 1, 2025 11:22

yiguolei approved these changes May 1, 2025
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label May 1, 2025

HappenLee approved these changes May 1, 2025
View reviewed changes

morningman approved these changes May 1, 2025
View reviewed changes

morningman merged commit 12d5da1 into apache:masterMay 1, 2025

zclllyybb deleted the dictionary branch May 2, 2025 06:19

Uh oh!

Conversation

zclllyybb commented Dec 25, 2024• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

hello-stephen commented Dec 25, 2024

Uh oh!

zclllyybb commented Dec 25, 2024

Uh oh!

zclllyybb commented Dec 25, 2024

Uh oh!

doris-robot commented Dec 26, 2024

Uh oh!

doris-robot commented Dec 26, 2024

Uh oh!

doris-robot commented Dec 26, 2024

Uh oh!

HappenLee left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Dec 27, 2024

Uh oh!

github-actionsBot commented Dec 27, 2024

Uh oh!

Mryange commented Jan 2, 2025

Uh oh!

doris-robot commented Jan 2, 2025

Uh oh!

Mryange commented Jan 6, 2025

Uh oh!

Mryange commented Jan 6, 2025

Uh oh!

Mryange commented Jan 9, 2025

Uh oh!

doris-robot commented Jan 9, 2025

Uh oh!

Mryange commented Jan 10, 2025

Uh oh!

zclllyybb commented Jan 12, 2025

Uh oh!

doris-robot commented Apr 30, 2025

Uh oh!

doris-robot commented Apr 30, 2025

Uh oh!

hello-stephen commented Apr 30, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Apr 30, 2025

BE Regression && UT Coverage Report

Uh oh!

zclllyybb commented May 1, 2025

Uh oh!

doris-robot commented May 1, 2025

Uh oh!

doris-robot commented May 1, 2025

Uh oh!

doris-robot commented May 1, 2025

Uh oh!

doris-robot commented May 1, 2025

Uh oh!

doris-robot commented May 1, 2025

BE UT Coverage Report

Uh oh!

zclllyybb commented May 1, 2025

Uh oh!

doris-robot commented May 1, 2025

Uh oh!

doris-robot commented May 1, 2025

Uh oh!

doris-robot commented May 1, 2025

Uh oh!

doris-robot commented May 1, 2025

Uh oh!

hello-stephen commented May 1, 2025

BE UT Coverage Report

Uh oh!

zclllyybb commented Dec 25, 2024•
edited
Loading