Skip to content

[fix](arrow-flight-sql) Arrow Flight support multiple endpoints - #44286

Merged
xinyiZzz merged 1 commit into
apache:masterfrom
xinyiZzz:20241119_fix_arrowflight_mutl_endpointr
Nov 25, 2024
Merged

[fix](arrow-flight-sql) Arrow Flight support multiple endpoints#44286
xinyiZzz merged 1 commit into
apache:masterfrom
xinyiZzz:20241119_fix_arrowflight_mutl_endpointr

Conversation

@xinyiZzz

@xinyiZzzxinyiZzz commented Nov 19, 2024•
edited
Loading

Copy link
Copy Markdown
Contributor

What problem does this PR solve?

Problem Summary:

By default, the query results of all BE nodes will be aggregated to one BE node. ADBC Client will only receive one endpoint and pull data from the BE node corresponding to this endpoint.

set global enable_parallel_result_sink=true; to allow each BE to return query results separately. ADBC Client will receive multiple endpoints and pull data from each endpoint.

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@doris-robot

doris-robot commented Nov 19, 2024

Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@xinyiZzz

xinyiZzz commented Nov 19, 2024

Copy link
Copy Markdown
ContributorAuthor

run buildall

@github-actions

github-actionsBot commented Nov 22, 2024

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Nov 22, 2024
@github-actions

github-actionsBot commented Nov 22, 2024

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

wangbo
wangbo approved these changes Nov 25, 2024
View reviewed changes

@wangbowangbo left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@xinyiZzz
xinyiZzz merged commit 05b48d6 into apache:masterNov 25, 2024
xinyiZzz added a commit to xinyiZzz/incubator-doris that referenced this pull request Dec 5, 2024
@xinyiZzz
[fix](arrow-flight-sql) Arrow Flight support multiple endpoints (apac…
b3d052c
…he#44286)
Problem Summary:
By default, the query results of all BE nodes will be aggregated to one
BE node. ADBC Client will only receive one endpoint and pull data from
the BE node corresponding to this endpoint.
`set global enable_parallel_result_sink=true;` to allow each BE to
return query results separately. ADBC Client will receive multiple
endpoints and pull data from each endpoint.
@xinyiZzzxinyiZzz mentioned this pull request Dec 5, 2024
Merged
16 tasks
yiguolei pushed a commit that referenced this pull request Dec 6, 2024
@xinyiZzz
[pick](branch-2.1) pick#44286(#45055)
2ed306d
xinyiZzz added a commit to xinyiZzz/incubator-doris that referenced this pull request Jan 12, 2025
@xinyiZzz
[fix](arrow-flight-sql) Arrow Flight support multiple endpoints (apac…
65853bd
…he#44286)
Problem Summary:
By default, the query results of all BE nodes will be aggregated to one
BE node. ADBC Client will only receive one endpoint and pull data from
the BE node corresponding to this endpoint.
`set global enable_parallel_result_sink=true;` to allow each BE to
return query results separately. ADBC Client will receive multiple
endpoints and pull data from each endpoint.
@xinyiZzzxinyiZzz mentioned this pull request Jan 12, 2025
Merged
yiguolei pushed a commit that referenced this pull request Jan 13, 2025
@xinyiZzz
[pick](branch-3.0) pick#44177#44286#44992#46217(#46842)
fe1bfe7
### What problem does this PR solve?
```
[fix](arrow-flight-sql) Fix conf public_host and arrow_flight_sql_proxy_port #44177
[fix](arrow-flight-sql) Arrow Flight support multiple endpoints #44286
[fix](arrow-flight-sql) Revert arrow_flight_sql group from regression test #44992
[opt](arrow-flight-sql) Support arrow-flight-sql protocol getStreamCatalogs, getStreamSchemas, getStreamTables #46217
```
HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Apr 24, 2026
@xinyiZzz@HappenLee
[fix](arrow-flight-sql) Arrow Flight support multiple endpoints (apac…
dda1706
…he#44286)
### What problem does this PR solve?
Problem Summary:
By default, the query results of all BE nodes will be aggregated to one
BE node. ADBC Client will only receive one endpoint and pull data from
the BE node corresponding to this endpoint.
`set global enable_parallel_result_sink=true;` to allow each BE to
return query results separately. ADBC Client will receive multiple
endpoints and pull data from each endpoint.
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@yiguoleiyiguoleiyiguolei approved these changes
@wangbowangbowangbo approved these changes

Assignees

No one assigned

Labels

approvedIndicates a PR has been approved by one committer.dev/2.1.8-mergeddev/3.0.4-mergedreviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@xinyiZzz@doris-robot@yiguolei@wangbo