[enhancement](metrics) add some table metrics by yagagagaga · Pull Request #49930 · apache/doris

yagagagaga · 2025-04-09T15:16:35Z

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

add these metrics in Doris' FE:

# HELP doris_fe_min_tablet_size_bytes minimal local data size of all (internal) tables' tablets# TYPE doris_fe_min_tablet_size_bytes gauge
doris_fe_min_tablet_size_bytes 0
# HELP doris_fe_min_partition_size_bytes minimal local data size of all (internal) tables' partitions# TYPE doris_fe_min_partition_size_bytes gauge
doris_fe_min_partition_size_bytes 0
# HELP doris_fe_min_table_size_bytes minimal local data size of all (internal) tables# TYPE doris_fe_min_table_size_bytes gauge
doris_fe_min_table_size_bytes 1360
# HELP doris_fe_max_tablet_size_bytes maximal local data size of all (internal) tables' tablets# TYPE doris_fe_max_tablet_size_bytes gauge
doris_fe_max_tablet_size_bytes 4739
# HELP doris_fe_max_partition_size_bytes maximal local data size of all (internal) tables' partitions# TYPE doris_fe_max_partition_size_bytes gauge
doris_fe_max_partition_size_bytes 9431
# HELP doris_fe_max_table_size_bytes maximal local data size of all (internal) tables# TYPE doris_fe_max_table_size_bytes gauge
doris_fe_max_table_size_bytes 9431
# HELP doris_fe_avg_tablet_size_bytes average local data size of all (internal) tables' tablets# TYPE doris_fe_avg_tablet_size_bytes gauge
doris_fe_avg_tablet_size_bytes 830
# HELP doris_fe_avg_partition_size_bytes average local data size of all (internal) tables' partitions# TYPE doris_fe_avg_partition_size_bytes gauge
doris_fe_avg_partition_size_bytes 1541
# HELP doris_fe_avg_table_size_bytes average local data size of all (internal) tables# TYPE doris_fe_avg_table_size_bytes gauge
doris_fe_avg_table_size_bytes 5395

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

Thearas · 2025-04-09T15:16:40Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

gavinchou · 2025-04-10T10:55:30Z

+ totalTableSize += tableDataSize;
 }
 }
+ MetricRepo.GAUGE_MAX_TABLE_SIZE_BYTES.setValue(maxTableSize);


LOG max min tablet table ids

doris-robot · 2025-04-10T13:50:06Z

TPC-H: Total hot run time: 34978 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ae62e32e53035b299e04298c3c55b26d40066e91, data reload: false
------ Round 1 ----------------------------------
q1	26471	5048	5032	5032
q2	2075	274	191	191
q3	10393	1288	708	708
q4	10235	1033	551	551
q5	7530	2364	2392	2364
q6	184	158	132	132
q7	917	742	605	605
q8	9315	1294	1127	1127
q9	6729	5155	5131	5131
q10	6817	2296	1887	1887
q11	476	284	275	275
q12	359	361	227	227
q13	17767	3672	3108	3108
q14	236	225	214	214
q15	544	479	493	479
q16	623	634	582	582
q17	626	871	385	385
q18	7569	7218	7082	7082
q19	1503	967	588	588
q20	335	344	236	236
q21	4295	3614	3116	3116
q22	1011	1006	958	958
Total cold run time: 116010 ms
Total hot run time: 34978 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5184	5116	5497	5116
q2	247	327	231	231
q3	2184	2634	2295	2295
q4	1446	1941	1469	1469
q5	4514	4394	4397	4394
q6	223	170	130	130
q7	2015	1933	1746	1746
q8	2598	2625	2538	2538
q9	7303	6979	7183	6979
q10	2969	3178	2772	2772
q11	565	505	502	502
q12	709	759	602	602
q13	3533	4002	3381	3381
q14	287	295	272	272
q15	524	485	488	485
q16	670	670	659	659
q17	1239	1563	1393	1393
q18	7735	7479	7340	7340
q19	897	913	975	913
q20	1915	1980	1861	1861
q21	5434	4957	4896	4896
q22	1072	1044	1026	1026
Total cold run time: 53263 ms
Total hot run time: 51000 ms

doris-robot · 2025-04-10T14:02:22Z

TPC-DS: Total hot run time: 193446 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ae62e32e53035b299e04298c3c55b26d40066e91, data reload: false
query1	1403	1075	1037	1037
query2	6111	1961	1916	1916
query3	11025	4540	4337	4337
query4	53935	24558	23026	23026
query5	5094	490	445	445
query6	369	199	204	199
query7	5055	497	285	285
query8	308	251	234	234
query9	6158	2611	2605	2605
query10	439	338	291	291
query11	15129	15188	14837	14837
query12	158	108	101	101
query13	1126	507	383	383
query14	10197	6433	6486	6433
query15	201	209	179	179
query16	7067	644	538	538
query17	1057	770	595	595
query18	1551	396	321	321
query19	193	193	190	190
query20	132	129	123	123
query21	213	126	111	111
query22	4445	4392	4321	4321
query23	34170	33810	33677	33677
query24	6569	2459	2481	2459
query25	519	536	447	447
query26	681	275	158	158
query27	2289	506	349	349
query28	3300	2481	2441	2441
query29	624	612	468	468
query30	289	239	205	205
query31	880	890	784	784
query32	76	69	114	69
query33	467	361	321	321
query34	784	870	539	539
query35	812	870	765	765
query36	960	997	917	917
query37	129	106	130	106
query38	4220	4222	4217	4217
query39	1473	1431	1433	1431
query40	207	120	107	107
query41	62	54	64	54
query42	120	105	109	105
query43	515	532	491	491
query44	1350	848	843	843
query45	181	174	171	171
query46	867	1039	650	650
query47	1842	1853	1785	1785
query48	377	446	308	308
query49	707	513	444	444
query50	679	705	401	401
query51	4272	4263	4223	4223
query52	115	114	98	98
query53	243	270	194	194
query54	594	583	525	525
query55	86	87	85	85
query56	323	297	293	293
query57	1124	1192	1128	1128
query58	282	279	290	279
query59	2771	2891	2832	2832
query60	348	347	322	322
query61	134	145	129	129
query62	753	737	667	667
query63	238	200	191	191
query64	1462	1049	707	707
query65	4307	4312	4211	4211
query66	754	407	318	318
query67	15846	15611	15359	15359
query68	7237	874	517	517
query69	531	353	270	270
query70	1193	1073	1105	1073
query71	514	325	278	278
query72	5909	4758	4843	4758
query73	1351	644	343	343
query74	9073	9170	8741	8741
query75	3858	3208	2683	2683
query76	4219	1200	751	751
query77	616	371	291	291
query78	10106	10157	9365	9365
query79	2839	796	563	563
query80	644	517	447	447
query81	493	256	220	220
query82	476	123	98	98
query83	369	252	234	234
query84	294	109	86	86
query85	792	358	309	309
query86	386	304	283	283
query87	4641	4496	4421	4421
query88	3615	2233	2229	2229
query89	419	311	292	292
query90	1791	209	221	209
query91	153	141	117	117
query92	149	59	53	53
query93	2152	946	565	565
query94	663	400	299	299
query95	366	298	282	282
query96	490	567	272	272
query97	3188	3221	3131	3131
query98	231	201	202	201
query99	1478	1391	1285	1285
Total cold run time: 300403 ms
Total hot run time: 193446 ms

doris-robot · 2025-04-10T14:07:49Z

ClickBench: Total hot run time: 31 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ae62e32e53035b299e04298c3c55b26d40066e91, data reload: false
query1	0.04	0.04	0.02
query2	0.12	0.10	0.11
query3	0.25	0.20	0.19
query4	1.59	0.19	0.20
query5	0.58	0.57	0.57
query6	1.17	0.71	0.72
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.58	0.53	0.53
query10	0.56	0.60	0.56
query11	0.16	0.12	0.11
query12	0.15	0.11	0.11
query13	0.61	0.60	0.60
query14	2.81	2.74	2.72
query15	0.93	0.84	0.86
query16	0.39	0.38	0.38
query17	1.04	1.01	1.02
query18	0.20	0.20	0.19
query19	1.95	2.00	1.80
query20	0.02	0.01	0.01
query21	15.35	0.91	0.55
query22	0.74	1.21	0.62
query23	14.93	1.37	0.66
query24	8.01	0.88	0.79
query25	0.52	0.23	0.11
query26	0.66	0.16	0.13
query27	0.06	0.05	0.04
query28	9.33	0.85	0.43
query29	12.53	4.03	3.30
query30	0.25	0.09	0.06
query31	2.81	0.58	0.38
query32	3.23	0.55	0.46
query33	3.02	3.09	3.07
query34	15.62	5.12	4.43
query35	4.55	4.52	4.49
query36	0.67	0.50	0.47
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.13	0.12
query41	0.09	0.03	0.03
query42	0.04	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.99 s
Total hot run time: 31 s

yagagagaga · 2025-04-15T06:47:21Z

run buildall

doris-robot · 2025-04-15T07:15:41Z

TPC-H: Total hot run time: 34138 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 647269ed87736766f830f0dad8308212cf7a8f8f, data reload: false
------ Round 1 ----------------------------------
q1	26096	5132	5030	5030
q2	2072	269	182	182
q3	10460	1245	699	699
q4	10253	1021	547	547
q5	8141	2445	2335	2335
q6	201	164	132	132
q7	916	787	617	617
q8	9320	1293	1115	1115
q9	6763	5306	5092	5092
q10	6817	2286	1888	1888
q11	483	285	270	270
q12	340	349	217	217
q13	17761	3633	3194	3194
q14	223	224	212	212
q15	532	484	488	484
q16	628	614	570	570
q17	600	858	357	357
q18	7503	7261	7032	7032
q19	1218	963	565	565
q20	323	338	223	223
q21	4007	3402	2384	2384
q22	1059	1025	993	993
Total cold run time: 115716 ms
Total hot run time: 34138 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5313	5076	5065	5065
q2	238	328	233	233
q3	2143	2605	2299	2299
q4	1433	1814	1507	1507
q5	4537	4462	4382	4382
q6	214	168	125	125
q7	1940	1858	1729	1729
q8	2573	2604	2527	2527
q9	7184	7103	7112	7103
q10	2977	3203	2705	2705
q11	570	512	482	482
q12	705	773	608	608
q13	3488	3905	3288	3288
q14	276	286	263	263
q15	510	482	465	465
q16	622	690	666	666
q17	1141	1518	1391	1391
q18	7563	7421	7481	7421
q19	811	851	903	851
q20	1963	1983	1818	1818
q21	5173	4785	4677	4677
q22	1081	1041	971	971
Total cold run time: 52455 ms
Total hot run time: 50576 ms

doris-robot · 2025-04-15T07:27:09Z

TPC-DS: Total hot run time: 185725 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 647269ed87736766f830f0dad8308212cf7a8f8f, data reload: false
query1	1003	479	489	479
query2	6551	1899	1882	1882
query3	6739	217	219	217
query4	26836	23774	23169	23169
query5	4341	621	457	457
query6	330	196	200	196
query7	4616	476	297	297
query8	282	238	223	223
query9	8609	2587	2592	2587
query10	455	324	249	249
query11	15259	15025	14836	14836
query12	150	114	99	99
query13	1646	510	385	385
query14	8770	6034	6142	6034
query15	204	193	172	172
query16	7148	640	478	478
query17	963	738	582	582
query18	1971	411	313	313
query19	191	185	158	158
query20	128	170	114	114
query21	212	120	103	103
query22	4150	4131	4146	4131
query23	33719	33077	33031	33031
query24	8555	2367	2363	2363
query25	524	449	407	407
query26	1240	264	146	146
query27	2771	502	321	321
query28	4398	2404	2382	2382
query29	772	554	420	420
query30	285	223	190	190
query31	928	869	774	774
query32	71	64	66	64
query33	557	358	310	310
query34	776	843	498	498
query35	790	817	729	729
query36	924	986	879	879
query37	116	101	78	78
query38	4103	4180	4051	4051
query39	1434	1387	1414	1387
query40	221	123	113	113
query41	66	58	59	58
query42	117	104	108	104
query43	491	529	475	475
query44	1272	811	807	807
query45	175	174	164	164
query46	837	1022	615	615
query47	1745	1797	1723	1723
query48	371	408	312	312
query49	787	515	416	416
query50	656	673	409	409
query51	4148	4168	4051	4051
query52	105	99	93	93
query53	233	259	185	185
query54	564	567	507	507
query55	86	83	78	78
query56	303	281	283	281
query57	1167	1141	1065	1065
query58	275	255	249	249
query59	2637	2606	2493	2493
query60	331	309	293	293
query61	126	129	127	127
query62	790	715	655	655
query63	236	189	187	187
query64	4417	1123	711	711
query65	4310	4246	4233	4233
query66	1134	413	303	303
query67	16039	15833	15411	15411
query68	7356	878	518	518
query69	472	279	254	254
query70	1181	1108	1079	1079
query71	414	313	302	302
query72	5653	4726	4654	4654
query73	644	593	341	341
query74	8878	8970	8616	8616
query75	3178	3195	2700	2700
query76	3163	1191	746	746
query77	480	378	286	286
query78	9952	10048	9289	9289
query79	1510	813	562	562
query80	581	516	448	448
query81	498	255	220	220
query82	214	131	96	96
query83	259	244	234	234
query84	298	118	85	85
query85	767	356	320	320
query86	378	286	290	286
query87	4545	4528	4417	4417
query88	2780	2239	2309	2239
query89	369	310	287	287
query90	1927	209	205	205
query91	142	142	108	108
query92	71	59	55	55
query93	1131	953	576	576
query94	678	382	311	311
query95	387	293	286	286
query96	496	558	278	278
query97	3129	3219	3141	3141
query98	231	216	205	205
query99	1294	1399	1272	1272
Total cold run time: 269212 ms
Total hot run time: 185725 ms

doris-robot · 2025-04-15T07:32:30Z

ClickBench: Total hot run time: 31.04 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 647269ed87736766f830f0dad8308212cf7a8f8f, data reload: false
query1	0.04	0.04	0.04
query2	0.13	0.11	0.11
query3	0.26	0.19	0.19
query4	1.60	0.18	0.11
query5	0.57	0.54	0.55
query6	1.19	0.71	0.71
query7	0.03	0.01	0.01
query8	0.05	0.04	0.03
query9	0.58	0.54	0.50
query10	0.57	0.57	0.56
query11	0.16	0.11	0.10
query12	0.15	0.11	0.11
query13	0.61	0.60	0.59
query14	2.81	2.81	2.84
query15	0.94	0.85	0.86
query16	0.39	0.38	0.37
query17	1.00	1.05	1.04
query18	0.21	0.19	0.20
query19	2.10	1.78	1.82
query20	0.01	0.02	0.01
query21	15.36	0.90	0.55
query22	0.75	1.36	0.79
query23	14.74	1.34	0.64
query24	6.99	0.93	0.57
query25	0.48	0.13	0.16
query26	0.64	0.16	0.13
query27	0.05	0.06	0.05
query28	9.50	0.92	0.42
query29	12.85	4.07	3.37
query30	0.25	0.08	0.07
query31	2.81	0.59	0.38
query32	3.22	0.55	0.47
query33	2.98	3.03	3.04
query34	15.79	5.21	4.49
query35	4.56	4.57	4.50
query36	0.65	0.49	0.48
query37	0.08	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.14	0.13
query41	0.09	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 105.51 s
Total hot run time: 31.04 s

gavinchou · 2025-04-15T13:31:07Z

pls add total_num_tablets
remove help info to reduce msg size

yagagagaga · 2025-04-15T13:37:49Z

# TYPE doris_fe_tablet_num gauge
doris_fe_tablet_num{backend="10.16.10.6:9050"} 5925
doris_fe_tablet_num{backend="127.0.0.1:9050"} 0

yagagagaga · 2025-04-15T13:44:11Z

run buildall

doris-robot · 2025-04-15T14:21:54Z

TPC-H: Total hot run time: 35055 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit aea32b497b62028b7cfcb54d71cdc7a0e242f1d1, data reload: false
------ Round 1 ----------------------------------
q1	25835	5405	5067	5067
q2	2091	294	194	194
q3	10352	1226	684	684
q4	10251	1002	527	527
q5	7508	2368	2324	2324
q6	192	162	133	133
q7	897	751	621	621
q8	9314	1283	1102	1102
q9	6910	5132	5060	5060
q10	6899	2300	1892	1892
q11	491	299	267	267
q12	356	367	222	222
q13	17784	3665	3092	3092
q14	224	229	215	215
q15	533	484	484	484
q16	625	613	587	587
q17	628	853	383	383
q18	7414	7176	7146	7146
q19	1377	941	571	571
q20	340	334	236	236
q21	4207	3376	3227	3227
q22	1098	1047	1021	1021
Total cold run time: 115326 ms
Total hot run time: 35055 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5201	5141	5157	5141
q2	266	333	230	230
q3	2288	2672	2301	2301
q4	1454	1835	1453	1453
q5	4477	4433	4406	4406
q6	225	172	129	129
q7	2015	1881	1786	1786
q8	2586	2481	2523	2481
q9	7248	7087	7220	7087
q10	3010	3187	2752	2752
q11	586	514	499	499
q12	704	788	626	626
q13	3498	3849	3395	3395
q14	266	308	268	268
q15	526	487	470	470
q16	653	735	671	671
q17	1146	1603	1400	1400
q18	7791	7476	7363	7363
q19	838	876	1131	876
q20	1931	1953	1868	1868
q21	5210	4998	4816	4816
q22	1077	1022	1007	1007
Total cold run time: 52996 ms
Total hot run time: 51025 ms

doris-robot · 2025-04-15T14:34:09Z

TPC-DS: Total hot run time: 193474 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit aea32b497b62028b7cfcb54d71cdc7a0e242f1d1, data reload: false
query1	1376	1091	1068	1068
query2	6191	1941	1922	1922
query3	10966	4596	4510	4510
query4	53311	25432	23522	23522
query5	5150	534	472	472
query6	370	200	180	180
query7	5000	504	291	291
query8	341	254	252	252
query9	6093	2615	2623	2615
query10	433	316	261	261
query11	15111	15086	14781	14781
query12	160	115	102	102
query13	1078	526	398	398
query14	10264	6367	6274	6274
query15	200	210	179	179
query16	6970	677	488	488
query17	1051	730	578	578
query18	1541	412	316	316
query19	235	209	169	169
query20	127	128	123	123
query21	210	131	104	104
query22	4420	4390	4204	4204
query23	34104	33353	33397	33353
query24	6661	2441	2479	2441
query25	461	491	393	393
query26	616	276	159	159
query27	2171	506	345	345
query28	3111	2448	2481	2448
query29	629	605	464	464
query30	276	234	203	203
query31	891	916	835	835
query32	83	65	67	65
query33	485	378	340	340
query34	817	862	545	545
query35	803	839	791	791
query36	950	999	890	890
query37	129	116	77	77
query38	4244	4283	4195	4195
query39	1508	1446	1459	1446
query40	218	126	115	115
query41	63	57	60	57
query42	140	119	110	110
query43	525	561	503	503
query44	1453	829	818	818
query45	187	181	166	166
query46	869	1022	653	653
query47	1810	1880	1784	1784
query48	390	434	324	324
query49	688	524	430	430
query50	686	691	405	405
query51	4220	4321	4256	4256
query52	114	119	108	108
query53	241	274	194	194
query54	606	576	520	520
query55	85	88	85	85
query56	325	315	310	310
query57	1182	1247	1103	1103
query58	268	269	262	262
query59	2758	2831	2640	2640
query60	347	337	323	323
query61	143	128	139	128
query62	726	754	668	668
query63	231	197	191	191
query64	1427	1062	724	724
query65	4374	4255	4287	4255
query66	782	397	312	312
query67	15736	15672	15412	15412
query68	7584	846	567	567
query69	536	312	261	261
query70	1225	1120	1062	1062
query71	501	330	304	304
query72	5797	4794	4857	4794
query73	1288	686	343	343
query74	9407	8851	8769	8769
query75	3884	3202	2713	2713
query76	4345	1183	772	772
query77	615	377	302	302
query78	10133	10157	9398	9398
query79	1955	803	570	570
query80	611	530	443	443
query81	492	256	226	226
query82	452	128	98	98
query83	256	256	237	237
query84	297	108	82	82
query85	793	355	312	312
query86	393	295	272	272
query87	4601	4454	4349	4349
query88	3396	2190	2213	2190
query89	397	311	286	286
query90	1924	227	224	224
query91	140	151	112	112
query92	79	67	56	56
query93	1709	980	589	589
query94	687	406	296	296
query95	365	301	286	286
query96	508	552	272	272
query97	3200	3245	3168	3168
query98	229	202	201	201
query99	1527	1424	1265	1265
Total cold run time: 298457 ms
Total hot run time: 193474 ms

doris-robot · 2025-04-15T14:39:27Z

ClickBench: Total hot run time: 30.9 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit aea32b497b62028b7cfcb54d71cdc7a0e242f1d1, data reload: false
query1	0.04	0.04	0.03
query2	0.12	0.11	0.12
query3	0.25	0.20	0.19
query4	1.59	0.20	0.19
query5	0.59	0.58	0.59
query6	1.18	0.72	0.71
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.57	0.52	0.51
query10	0.56	0.57	0.58
query11	0.16	0.10	0.10
query12	0.15	0.11	0.12
query13	0.62	0.59	0.60
query14	2.66	2.82	2.76
query15	0.93	0.86	0.85
query16	0.38	0.38	0.37
query17	1.03	1.03	0.99
query18	0.22	0.20	0.19
query19	1.87	1.89	1.88
query20	0.01	0.01	0.01
query21	15.38	0.91	0.53
query22	0.78	1.13	0.64
query23	15.05	1.38	0.62
query24	6.86	1.45	0.58
query25	0.45	0.18	0.07
query26	0.50	0.16	0.15
query27	0.06	0.05	0.04
query28	9.85	0.90	0.46
query29	12.58	4.04	3.32
query30	0.25	0.09	0.07
query31	2.83	0.63	0.38
query32	3.23	0.55	0.48
query33	3.04	2.97	3.04
query34	15.77	5.11	4.51
query35	4.48	4.58	4.47
query36	0.66	0.50	0.48
query37	0.09	0.07	0.07
query38	0.05	0.05	0.04
query39	0.04	0.03	0.03
query40	0.17	0.15	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 105.26 s
Total hot run time: 30.9 s

yagagagaga · 2025-04-15T15:40:55Z

run cloud_p0

yagagagaga · 2025-04-16T06:39:39Z

run cloud_p0

github-actions · 2025-05-01T16:57:51Z

PR approved by at least one committer and no changes requested.

github-actions · 2025-05-01T16:57:53Z

PR approved by anyone and no changes requested.

add these metrics in Doris' FE: ```properties # HELP doris_fe_min_tablet_size_bytes minimal local data size of all (internal) tables' tablets # TYPE doris_fe_min_tablet_size_bytes gauge doris_fe_min_tablet_size_bytes 0 # HELP doris_fe_min_partition_size_bytes minimal local data size of all (internal) tables' partitions # TYPE doris_fe_min_partition_size_bytes gauge doris_fe_min_partition_size_bytes 0 # HELP doris_fe_min_table_size_bytes minimal local data size of all (internal) tables # TYPE doris_fe_min_table_size_bytes gauge doris_fe_min_table_size_bytes 1360 # HELP doris_fe_max_tablet_size_bytes maximal local data size of all (internal) tables' tablets # TYPE doris_fe_max_tablet_size_bytes gauge doris_fe_max_tablet_size_bytes 4739 # HELP doris_fe_max_partition_size_bytes maximal local data size of all (internal) tables' partitions # TYPE doris_fe_max_partition_size_bytes gauge doris_fe_max_partition_size_bytes 9431 # HELP doris_fe_max_table_size_bytes maximal local data size of all (internal) tables # TYPE doris_fe_max_table_size_bytes gauge doris_fe_max_table_size_bytes 9431 # HELP doris_fe_avg_tablet_size_bytes average local data size of all (internal) tables' tablets # TYPE doris_fe_avg_tablet_size_bytes gauge doris_fe_avg_tablet_size_bytes 830 # HELP doris_fe_avg_partition_size_bytes average local data size of all (internal) tables' partitions # TYPE doris_fe_avg_partition_size_bytes gauge doris_fe_avg_partition_size_bytes 1541 # HELP doris_fe_avg_table_size_bytes average local data size of all (internal) tables # TYPE doris_fe_avg_table_size_bytes gauge doris_fe_avg_table_size_bytes 5395 ```

…50892) Cherry-picked from #49930

add these metrics in Doris' FE: ```properties # HELP doris_fe_min_tablet_size_bytes minimal local data size of all (internal) tables' tablets # TYPE doris_fe_min_tablet_size_bytes gauge doris_fe_min_tablet_size_bytes 0 # HELP doris_fe_min_partition_size_bytes minimal local data size of all (internal) tables' partitions # TYPE doris_fe_min_partition_size_bytes gauge doris_fe_min_partition_size_bytes 0 # HELP doris_fe_min_table_size_bytes minimal local data size of all (internal) tables # TYPE doris_fe_min_table_size_bytes gauge doris_fe_min_table_size_bytes 1360 # HELP doris_fe_max_tablet_size_bytes maximal local data size of all (internal) tables' tablets # TYPE doris_fe_max_tablet_size_bytes gauge doris_fe_max_tablet_size_bytes 4739 # HELP doris_fe_max_partition_size_bytes maximal local data size of all (internal) tables' partitions # TYPE doris_fe_max_partition_size_bytes gauge doris_fe_max_partition_size_bytes 9431 # HELP doris_fe_max_table_size_bytes maximal local data size of all (internal) tables # TYPE doris_fe_max_table_size_bytes gauge doris_fe_max_table_size_bytes 9431 # HELP doris_fe_avg_tablet_size_bytes average local data size of all (internal) tables' tablets # TYPE doris_fe_avg_tablet_size_bytes gauge doris_fe_avg_tablet_size_bytes 830 # HELP doris_fe_avg_partition_size_bytes average local data size of all (internal) tables' partitions # TYPE doris_fe_avg_partition_size_bytes gauge doris_fe_avg_partition_size_bytes 1541 # HELP doris_fe_avg_table_size_bytes average local data size of all (internal) tables # TYPE doris_fe_avg_table_size_bytes gauge doris_fe_avg_table_size_bytes 5395 ```

…) (apache#4054) Cherry-picked from apache#50892

add these metrics in Doris' FE: ```properties # HELP doris_fe_min_tablet_size_bytes minimal local data size of all (internal) tables' tablets # TYPE doris_fe_min_tablet_size_bytes gauge doris_fe_min_tablet_size_bytes 0 # HELP doris_fe_min_partition_size_bytes minimal local data size of all (internal) tables' partitions # TYPE doris_fe_min_partition_size_bytes gauge doris_fe_min_partition_size_bytes 0 # HELP doris_fe_min_table_size_bytes minimal local data size of all (internal) tables # TYPE doris_fe_min_table_size_bytes gauge doris_fe_min_table_size_bytes 1360 # HELP doris_fe_max_tablet_size_bytes maximal local data size of all (internal) tables' tablets # TYPE doris_fe_max_tablet_size_bytes gauge doris_fe_max_tablet_size_bytes 4739 # HELP doris_fe_max_partition_size_bytes maximal local data size of all (internal) tables' partitions # TYPE doris_fe_max_partition_size_bytes gauge doris_fe_max_partition_size_bytes 9431 # HELP doris_fe_max_table_size_bytes maximal local data size of all (internal) tables # TYPE doris_fe_max_table_size_bytes gauge doris_fe_max_table_size_bytes 9431 # HELP doris_fe_avg_tablet_size_bytes average local data size of all (internal) tables' tablets # TYPE doris_fe_avg_tablet_size_bytes gauge doris_fe_avg_tablet_size_bytes 830 # HELP doris_fe_avg_partition_size_bytes average local data size of all (internal) tables' partitions # TYPE doris_fe_avg_partition_size_bytes gauge doris_fe_avg_partition_size_bytes 1541 # HELP doris_fe_avg_table_size_bytes average local data size of all (internal) tables # TYPE doris_fe_avg_table_size_bytes gauge doris_fe_avg_table_size_bytes 5395 ``` (cherry picked from commit apache#49930)

[enhancement](metrics) add some table metrics
1623ab3

fix
a84c185

gavinchou reviewed Apr 10, 2025
View reviewed changes

yagagagaga added 6 commits April 10, 2025 19:32

add log
735e249

add log
dc5bea1

fix checkstyle
23288b7

clear
fb7ef7b

clean code
ae62e32

clean code
76bb942

Merge branch 'master' into CORE-5136
647269e

yagagagagaand others added 3 commits April 15, 2025 21:41

Update MetricRepo.java
14a7536

update
2ddd4a1

Merge branch 'master' into CORE-5136
aea32b4

gavinchou approved these changes May 1, 2025
View reviewed changes

gavinchou added usercase Important user case type label dev/3.0.x labels May 1, 2025

github-actionsBot added the approved Indicates a PR has been approved by one committer. label May 1, 2025

github-actionsBot added the reviewed label May 1, 2025

bobhan1 approved these changes May 9, 2025
View reviewed changes

Yukang-Lian approved these changes May 9, 2025
View reviewed changes

Hastyshell approved these changes May 9, 2025
View reviewed changes

gavinchou merged commit 1bebb90 into apache:masterMay 9, 2025

github-actionsBot mentioned this pull request May 9, 2025
branch-3.0: [enhancement](metrics) add some table metrics #49930 #50758
Closed

yagagagaga mentioned this pull request May 14, 2025
branch-3.0: [enhancement](metrics) add some table metrics (#49930) #50892
Merged

dataroaring pushed a commit that referenced this pull request May 14, 2025
branch-3.0: [enhancement](metrics) add some table metrics (#49930) (#…
610a37c
…50892) Cherry-picked from #49930

dataroaring added dev/3.0.6-merged and removed dev/3.0.x labels May 14, 2025

yagagagaga deleted the CORE-5136 branch May 15, 2025 04:07

Hastyshell pushed a commit to Hastyshell/doris that referenced this pull request Jul 21, 2025
branch-3.0: [enhancement](metrics) add some table metrics (apache#49930…
84e0ec9
…) (apache#4054) Cherry-picked from apache#50892

Uh oh!

Conversation

yagagagaga commented Apr 9, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

Thearas commented Apr 9, 2025

Uh oh!

gavinchouApr 10, 2025

Choose a reason for hiding this comment

Uh oh!

yagagagagaApr 10, 2025

Choose a reason for hiding this comment

Uh oh!

doris-robot commented Apr 10, 2025

Uh oh!

doris-robot commented Apr 10, 2025

Uh oh!

doris-robot commented Apr 10, 2025

Uh oh!

yagagagaga commented Apr 15, 2025

Uh oh!

doris-robot commented Apr 15, 2025

Uh oh!

doris-robot commented Apr 15, 2025

Uh oh!

doris-robot commented Apr 15, 2025

Uh oh!

gavinchou commented Apr 15, 2025

Uh oh!

yagagagaga commented Apr 15, 2025

Uh oh!

yagagagaga commented Apr 15, 2025

Uh oh!

doris-robot commented Apr 15, 2025

Uh oh!

doris-robot commented Apr 15, 2025

Uh oh!

doris-robot commented Apr 15, 2025

Uh oh!

yagagagaga commented Apr 15, 2025

Uh oh!

yagagagaga commented Apr 16, 2025

Uh oh!

github-actionsBot commented May 1, 2025

Uh oh!

github-actionsBot commented May 1, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

8 participants

yagagagaga commented Apr 9, 2025•
edited
Loading