Skip to content

branch-4.1: [improvement](be) Add instance ID to hash join profiles #66097 - #66453

Merged
yiguolei merged 1 commit into
branch-4.1from
auto-pick-66097-branch-4.1
Aug 6, 2026
Merged

branch-4.1: [improvement](be) Add instance ID to hash join profiles #66097#66453
yiguolei merged 1 commit into
branch-4.1from
auto-pick-66097-branch-4.1

Conversation

@github-actions

Copy link
Copy Markdown
Contributor

Cherry-picked from #66097

### What problem does this PR solve?
Issue Number: None
Related PR: #65761
Problem Summary:
This forward-ports #65761 from `opt_perf_4.1` to `master`.
Shuffle hash join build and probe operators run in separate pipelines,
so their per-instance profiles are difficult to correlate. Add the
fragment instance ID to both hash join build and probe custom profiles.
Profiles with the same join node ID and `InstanceID` now identify the
corresponding build/probe pair without relying on process-local hash
table addresses.
### Release note
None
### Check List (For Author)
- Test
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test
- [x] No need to test or manual test. The change only adds profile
metadata.
- `build-support/clang-format.sh` (passed)
- `build-support/check-format.sh` (passed)
- `git diff --check origin/master...HEAD` (passed)
- `BUILD_TYPE=ASAN ./build.sh --be` (attempted; CMake configured
successfully, but Ninja was blocked before compilation because this
worktree lacks `thirdparty/installed/lib64/liblance_c.a`)
- `thirdparty/build-thirdparty.sh lance_c` (attempted; blocked because
the required Rust/Cargo 1.91 toolchain is unavailable)
- `build-support/run-clang-tidy.sh --base origin/master --build-dir
be/build_ASAN` (attempted; blocked by the existing `core/types.h`
unmatched `NOLINTEND` and missing system `stddef.h`; no diagnostic
identified on the added lines)
- [ ] This is a refactor/code format and no logic has been changed.
- Behavior changed:
- [ ] No.
- [x] Yes. Hash join build and probe profiles include `InstanceID`.
- Does this need documentation?
- [x] No.
- [ ] Yes.
Co-authored-by: HappenLee <happenlee@selectdb.com>
@hello-stephen

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@hello-stephen

Copy link
Copy Markdown
Contributor

run buildall

@hello-stephen

Copy link
Copy Markdown
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (2/2) 🎉

Increment coverage report
Complete coverage report

CategoryCoverage
Function Coverage73.65% (30328/41178)
Line Coverage57.54% (332734/578227)
Region Coverage54.49% (277233/508774)
Branch Coverage55.40% (123884/223624)

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Aug 6, 2026
@github-actions

Copy link
Copy Markdown
ContributorAuthor

PR approved by at least one committer and no changes requested.

@github-actions

Copy link
Copy Markdown
ContributorAuthor

PR approved by anyone and no changes requested.

@yiguolei
yiguolei merged commit a15b79e into branch-4.1Aug 6, 2026
29 of 32 checks passed
@morrySnow
morrySnow deleted the auto-pick-66097-branch-4.1 branch August 20, 2026 03:59
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approvedIndicates a PR has been approved by one committer.reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@hello-stephen@yiguolei@mrhhsg