branch-3.0: [fix](load) print real reason if fetching Kafka meta fail #51880 by github-actions[bot] · Pull Request #52058 · apache/doris

github-actions · 2025-06-20T07:52:29Z

Cherry-picked from #51880

### What problem does this PR solve? Print real reason if fetching Kafka meta fail, if set unknown topic： before msg ``` Failed to get all partitions of kafka topic: invalid_topic error: errCode = 2, detailMessage = Failed to get info. No alive backends. ``` fix msg: ``` failed to get info: [(172.16.0.232)[INTERNAL_ERROR]error: Broker: Unknown topic or partition], may be Kafka properties set in job is error or no partition in this topic that should check Kafka ```

Thearas · 2025-06-20T07:52:57Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

Thearas · 2025-06-20T07:53:01Z

run buildall

doris-robot · 2025-06-20T08:27:43Z

TPC-H: Total hot run time: 39662 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 504c31c7e101a02583d80e8e0f43ccfe9fb50a0f, data reload: false
------ Round 1 ----------------------------------
q1	17585	6740	6587	6587
q2	2060	165	165	165
q3	10601	1073	1140	1073
q4	10545	750	752	750
q5	7754	2820	2791	2791
q6	217	135	132	132
q7	978	621	608	608
q8	9361	1909	2063	1909
q9	6575	6371	6395	6371
q10	6938	2291	2329	2291
q11	457	260	253	253
q12	392	214	209	209
q13	17799	2970	2976	2970
q14	235	204	208	204
q15	518	460	459	459
q16	502	389	372	372
q17	967	564	657	564
q18	7276	6601	6684	6601
q19	1389	1090	1075	1075
q20	468	204	201	201
q21	3934	3147	3098	3098
q22	1091	1014	979	979
Total cold run time: 107642 ms
Total hot run time: 39662 ms
----- Round 2, with runtime_filter_mode=off -----
q1	6575	6572	6537	6537
q2	320	234	229	229
q3	2897	2778	2785	2778
q4	2040	1787	1788	1787
q5	5757	5753	5671	5671
q6	213	127	131	127
q7	2201	1833	1790	1790
q8	3438	3506	3540	3506
q9	8910	8777	8894	8777
q10	3562	3554	3521	3521
q11	598	489	496	489
q12	820	604	586	586
q13	9235	3120	3132	3120
q14	320	286	283	283
q15	534	466	473	466
q16	476	444	429	429
q17	1838	1608	1572	1572
q18	8205	7830	7766	7766
q19	1683	1527	1610	1527
q20	2127	1891	1810	1810
q21	5022	4920	4950	4920
q22	1144	1047	1028	1028
Total cold run time: 67915 ms
Total hot run time: 58719 ms

doris-robot · 2025-06-20T08:40:23Z

TPC-DS: Total hot run time: 198553 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 504c31c7e101a02583d80e8e0f43ccfe9fb50a0f, data reload: false
query1	1282	901	907	901
query2	6367	2016	1939	1939
query3	10829	4308	4252	4252
query4	61736	29395	24076	24076
query5	5184	458	474	458
query6	405	175	191	175
query7	5496	315	310	310
query8	302	214	206	206
query9	8590	2594	2574	2574
query10	466	276	271	271
query11	17514	15613	15619	15613
query12	161	107	109	107
query13	1471	474	448	448
query14	11188	6942	7549	6942
query15	205	182	182	182
query16	7332	477	494	477
query17	1251	591	597	591
query18	1904	343	321	321
query19	217	160	165	160
query20	113	120	114	114
query21	206	107	103	103
query22	4687	4687	4489	4489
query23	35045	34824	34320	34320
query24	6219	2901	2890	2890
query25	511	404	395	395
query26	653	164	164	164
query27	1959	355	355	355
query28	3883	2204	2134	2134
query29	668	447	443	443
query30	251	159	158	158
query31	981	812	829	812
query32	63	54	55	54
query33	414	309	298	298
query34	923	521	530	521
query35	867	749	738	738
query36	1077	987	964	964
query37	105	65	69	65
query38	4036	4003	4003	4003
query39	1514	1458	1474	1458
query40	210	98	104	98
query41	49	50	47	47
query42	116	96	102	96
query43	555	494	486	486
query44	1160	820	834	820
query45	191	178	168	168
query46	1163	716	772	716
query47	1998	1923	1920	1920
query48	476	389	378	378
query49	753	396	401	396
query50	845	440	434	434
query51	7430	7262	7386	7262
query52	101	97	87	87
query53	271	199	192	192
query54	577	464	481	464
query55	80	76	81	76
query56	266	257	264	257
query57	1362	1227	1211	1211
query58	222	216	216	216
query59	3296	3245	3171	3171
query60	287	261	272	261
query61	127	110	126	110
query62	801	695	702	695
query63	228	191	186	186
query64	1428	681	706	681
query65	3290	3187	3212	3187
query66	672	317	308	308
query67	15907	15575	15685	15575
query68	4184	591	600	591
query69	425	277	273	273
query70	1187	1108	1120	1108
query71	338	262	260	260
query72	6273	4214	4243	4214
query73	746	356	382	356
query74	10085	9011	8887	8887
query75	3354	2592	2673	2592
query76	2007	1086	1090	1086
query77	510	275	266	266
query78	10652	9704	9533	9533
query79	2105	588	603	588
query80	1328	423	434	423
query81	518	222	222	222
query82	1123	93	87	87
query83	274	142	145	142
query84	280	81	78	78
query85	1052	308	289	289
query86	406	301	304	301
query87	4415	4221	4289	4221
query88	3883	2404	2379	2379
query89	410	299	290	290
query90	1878	188	184	184
query91	178	150	148	148
query92	62	48	54	48
query93	2784	567	566	566
query94	751	264	286	264
query95	352	255	261	255
query96	638	285	292	285
query97	3402	3206	3134	3134
query98	217	212	203	203
query99	1576	1301	1341	1301
Total cold run time: 317329 ms
Total hot run time: 198553 ms

doris-robot · 2025-06-20T08:45:42Z

ClickBench: Total hot run time: 30.64 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 504c31c7e101a02583d80e8e0f43ccfe9fb50a0f, data reload: false
query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.61	0.10	0.10
query5	0.51	0.50	0.51
query6	1.13	0.74	0.74
query7	0.03	0.02	0.02
query8	0.04	0.05	0.03
query9	0.57	0.50	0.50
query10	0.56	0.55	0.55
query11	0.14	0.10	0.10
query12	0.15	0.11	0.11
query13	0.60	0.60	0.59
query14	0.77	0.79	0.81
query15	0.84	0.83	0.83
query16	0.40	0.37	0.37
query17	1.02	1.05	1.07
query18	0.23	0.22	0.21
query19	1.88	1.75	1.77
query20	0.02	0.01	0.01
query21	15.41	0.56	0.59
query22	2.19	2.36	1.91
query23	16.84	1.13	0.91
query24	2.62	1.49	1.35
query25	0.24	0.15	0.08
query26	0.38	0.14	0.14
query27	0.04	0.03	0.05
query28	9.99	0.54	0.45
query29	12.59	3.20	3.17
query30	0.24	0.08	0.06
query31	2.83	0.39	0.38
query32	3.25	0.46	0.45
query33	2.98	3.01	3.00
query34	17.20	4.48	4.49
query35	4.55	4.49	4.55
query36	0.67	0.48	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.35 s
Total hot run time: 30.64 s

dataroaring

LGTM

github-actions · 2025-06-23T13:57:42Z

PR approved by at least one committer and no changes requested.

github-actions · 2025-06-23T13:57:45Z

PR approved by anyone and no changes requested.

github-actionsBot requested a review from dataroaring as a code owner June 20, 2025 07:52

dataroaring closed this Jun 20, 2025

dataroaring reopened this Jun 20, 2025

dataroaring approved these changes Jun 23, 2025
View reviewed changes

github-actionsBot added approved Indicates a PR has been approved by one committer. reviewed labels Jun 23, 2025

dataroaring merged commit 7dbe244 into branch-3.0Jun 23, 2025

github-actionsBot deleted the auto-pick-51880-branch-3.0 branch June 23, 2025 14:04

Navigation Menu

Uh oh!

branch-3.0: [fix](load) print real reason if fetching Kafka meta fail #51880 - #52058

branch-3.0: [fix](load) print real reason if fetching Kafka meta fail #51880#52058
dataroaring merged 1 commit into
branch-3.0from
auto-pick-51880-branch-3.0

github-actionsBot commented Jun 20, 2025

Uh oh!

Thearas commented Jun 20, 2025

Uh oh!

Thearas commented Jun 20, 2025

Uh oh!

doris-robot commented Jun 20, 2025

Uh oh!

doris-robot commented Jun 20, 2025

Uh oh!

doris-robot commented Jun 20, 2025

Uh oh!

dataroaring left a comment

Uh oh!

github-actionsBot commented Jun 23, 2025

Uh oh!

github-actionsBot commented Jun 23, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Uh oh!

Conversation

github-actionsBot commented Jun 20, 2025

Uh oh!

Thearas commented Jun 20, 2025

Uh oh!

Thearas commented Jun 20, 2025

Uh oh!

doris-robot commented Jun 20, 2025

Uh oh!

doris-robot commented Jun 20, 2025

Uh oh!

doris-robot commented Jun 20, 2025

Uh oh!

dataroaring left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Jun 23, 2025

Uh oh!

github-actionsBot commented Jun 23, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants