[feature](meta) queries as table valued function (#) by Nitin-Kashyap · Pull Request #25052 · apache/doris

Nitin-Kashyap · 2023-10-06T12:56:25Z

Proposed changes

Add queries view as table function.
Proxy result to other FEs and return merged results back to BE.

Issue Number: close#25051

github-actions · 2023-10-06T13:04:32Z

clang-tidy review says "All clean, LGTM! 👍"

github-actions · 2023-10-06T13:06:58Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-09T05:34:03Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-09T07:39:52Z

clang-tidy review says "All clean, LGTM! 👍"

yiguolei

LGTM

yiguolei · 2023-10-10T01:12:05Z

run buildall

github-actions · 2023-10-10T01:12:47Z

PR approved by at least one committer and no changes requested.

github-actions · 2023-10-10T01:12:49Z

PR approved by anyone and no changes requested.

hf200012

LGTM

doris-robot · 2023-10-10T02:25:18Z

TeamCity be ut coverage result:
Function Coverage: 36.31% (8149/22443)
Line Coverage: 28.44% (65167/229170)
Region Coverage: 27.37% (33768/123394)
Branch Coverage: 24.04% (17205/71564)
Coverage Report: http://coverage.selectdb-in.cc/coverage/18b3ac0324db05fbb68ec2097d1c0031c23c2280_18b3ac0324db05fbb68ec2097d1c0031c23c2280/report/index.html

doris-robot · 2023-10-10T02:40:31Z

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.23 seconds
stream load tsv: 557 seconds loaded 74807831229 Bytes, about 128 MB/s
stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s
stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 33 seconds loaded 861443392 Bytes, about 24 MB/s
insert into select: 28.7 seconds inserted 10000000 Rows, about 348K ops/s
storage size: 17162285897 Bytes

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-10T04:41:58Z

clang-tidy review says "All clean, LGTM! 👍"

yiguolei · 2023-10-10T06:11:33Z

run buildall

doris-robot · 2023-10-10T06:48:28Z

TeamCity be ut coverage result:
Function Coverage: 36.28% (8149/22461)
Line Coverage: 28.42% (65177/229296)
Region Coverage: 27.35% (33773/123482)
Branch Coverage: 24.03% (17208/71620)
Coverage Report: http://coverage.selectdb-in.cc/coverage/e0c5eabe0d60c4fde96a31435993bc2dc6f73524_e0c5eabe0d60c4fde96a31435993bc2dc6f73524/report/index.html

doris-robot · 2023-10-10T07:07:00Z

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.73 seconds
stream load tsv: 558 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s
stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.0 seconds inserted 10000000 Rows, about 344K ops/s
storage size: 17162305550 Bytes

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-10T11:57:11Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-10T14:08:39Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-10T17:08:10Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-11T07:13:30Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-11T09:23:59Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-11T14:03:28Z

clang-tidy review says "All clean, LGTM! 👍"

github-actions · 2023-10-11T14:03:34Z

clang-tidy review says "All clean, LGTM! 👍"

1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

github-actions · 2023-10-11T17:07:48Z

clang-tidy review says "All clean, LGTM! 👍"

yiguolei · 2023-10-12T03:12:17Z

run buildall

yiguolei · 2023-10-12T03:12:31Z

run buildall

github-actions · 2023-10-12T03:21:30Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2023-10-12T04:23:29Z

TeamCity be ut coverage result:
Function Coverage: 36.22% (8154/22510)
Line Coverage: 28.34% (65285/230391)
Region Coverage: 27.05% (33810/124985)
Branch Coverage: 23.88% (17250/72234)
Coverage Report: http://coverage.selectdb-in.cc/coverage/7eed37ff2dda03e45f8515ff52ec05689d0f6a8a_7eed37ff2dda03e45f8515ff52ec05689d0f6a8a/report/index.html

doris-robot · 2023-10-12T04:41:09Z

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.17 seconds
stream load tsv: 561 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s
stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.1 seconds inserted 10000000 Rows, about 343K ops/s
storage size: 17162077919 Bytes

yiguolei

LGTM

…he#25052) 1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE. Co-authored-by: yiguolei <676222867@qq.com>

2 issues: - self fe check is not stable - rpc privilege check should use ADMIN instead of GRANT related PR: apache#25052 apache#50939

### What problem does this PR solve? Related PR: #25052 #50939 Problem Summary: 2 issues: - self fe check is not stable - rpc privilege check should use ADMIN instead of GRANT

Nitin-Kashyap force-pushed the feature-queryView branch from 3b49250 to 50372ccCompare October 6, 2023 12:57

yiguolei reviewed Oct 7, 2023
View reviewed changes

Comment threadgensrc/thrift/PlanNodes.thrift Outdated

Nitin-Kashyap force-pushed the feature-queryView branch from 50372cc to a385a28Compare October 9, 2023 05:24

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 9, 2023
[feature](meta) queries as table valued function (apache#25052)
a385a28
1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap requested a review from yiguolei October 9, 2023 05:26

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 9, 2023
[feature](meta) queries as table valued function (apache#25052)
18b3ac0
1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap force-pushed the feature-queryView branch from a385a28 to 18b3ac0Compare October 9, 2023 07:30

yiguolei approved these changes Oct 10, 2023
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Oct 10, 2023

github-actionsBot added the reviewed label Oct 10, 2023

hf200012 approved these changes Oct 10, 2023
View reviewed changes

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 10, 2023
[feature](meta) queries as table valued function (apache#25052)
e0c5eab
1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap force-pushed the feature-queryView branch from 18b3ac0 to e0c5eabCompare October 10, 2023 04:33

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 10, 2023
[feature](meta) queries as table valued function (apache#25052)
3e63ca7
1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap force-pushed the feature-queryView branch from e0c5eab to 3e63ca7Compare October 10, 2023 11:48

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 10, 2023
[feature](meta) queries as table valued function (apache#25052)
2fd275e
1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap force-pushed the feature-queryView branch from 2fd275e to 4d4dd10Compare October 10, 2023 16:58

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 10, 2023
[feature](meta) queries as table valued function (apache#25052)
4d4dd10
1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 11, 2023
[feature](meta) queries as table valued function (apache#25052)
3836ee0
1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap force-pushed the feature-queryView branch from 4d4dd10 to 3836ee0Compare October 11, 2023 07:01

Nitin-Kashyap force-pushed the feature-queryView branch from 3836ee0 to 4d0c4cbCompare October 11, 2023 09:15

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 11, 2023
[feature](meta) queries as table valued function (apache#25052)
4d0c4cb
1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap added a commit to Nitin-Kashyap/doris that referenced this pull request Oct 11, 2023
[feature](meta) queries as table valued function (apache#25052)
c0a62fc
1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap force-pushed the feature-queryView branch from 4d0c4cb to c0a62fcCompare October 11, 2023 13:55

[feature](meta) queries as table valued function (apache#25052)
42cd5b0
1. Add queries view as table function. 2. Proxy result to other FEs and return merged results back to BE.

Nitin-Kashyap force-pushed the feature-queryView branch from c0a62fc to 42cd5b0Compare October 11, 2023 16:58

Merge branch 'master' into feature-queryView
7eed37f

yiguolei approved these changes Oct 12, 2023
View reviewed changes

yiguolei merged commit bdb64ea into apache:masterOct 12, 2023

RoanHeNaN mentioned this pull request Dec 20, 2023
[fix](meta_scanner) fix meta_scanner process ColumnNullable #28711
Merged

morrySnow mentioned this pull request Jun 18, 2026
[fix](process list) return unexpected result in FULL mode #64631
Merged
16 tasks

Uh oh!

Conversation

Nitin-Kashyap commented Oct 6, 2023• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Proposed changes

Uh oh!

github-actionsBot commented Oct 6, 2023

Uh oh!

github-actionsBot commented Oct 6, 2023

Uh oh!

Uh oh!

github-actionsBot commented Oct 9, 2023

Uh oh!

github-actionsBot commented Oct 9, 2023

Uh oh!

yiguolei left a comment

Choose a reason for hiding this comment

Uh oh!

yiguolei commented Oct 10, 2023

Uh oh!

github-actionsBot commented Oct 10, 2023

Uh oh!

github-actionsBot commented Oct 10, 2023

Uh oh!

hf200012 left a comment

Choose a reason for hiding this comment

Uh oh!

doris-robot commented Oct 10, 2023

Uh oh!

doris-robot commented Oct 10, 2023

Uh oh!

github-actionsBot commented Oct 10, 2023

Uh oh!

yiguolei commented Oct 10, 2023

Uh oh!

doris-robot commented Oct 10, 2023

Uh oh!

doris-robot commented Oct 10, 2023

Uh oh!

github-actionsBot commented Oct 10, 2023

Uh oh!

github-actionsBot commented Oct 10, 2023

Uh oh!

github-actionsBot commented Oct 10, 2023

Uh oh!

github-actionsBot commented Oct 11, 2023

Uh oh!

github-actionsBot commented Oct 11, 2023

Uh oh!

github-actionsBot commented Oct 11, 2023

Uh oh!

github-actionsBot commented Oct 11, 2023

Uh oh!

github-actionsBot commented Oct 11, 2023

Uh oh!

yiguolei commented Oct 12, 2023

Uh oh!

yiguolei commented Oct 12, 2023

Uh oh!

github-actionsBot commented Oct 12, 2023

Uh oh!

doris-robot commented Oct 12, 2023

Uh oh!

doris-robot commented Oct 12, 2023

Uh oh!

yiguolei left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Nitin-Kashyap commented Oct 6, 2023•
edited
Loading