Skip to content

[fix](split) FileSystemCacheKey are always different in overload equals - #36431

Merged
AshinGau merged 1 commit into
apache:branch-2.1from
AshinGau:fs_cache_key_br21
Jun 20, 2024
Merged

[fix](split) FileSystemCacheKey are always different in overload equals#36431
AshinGau merged 1 commit into
apache:branch-2.1from
AshinGau:fs_cache_key_br21

Conversation

@AshinGau

@AshinGauAshinGau commented Jun 18, 2024

Copy link
Copy Markdown
Member

bp: #36432

Proposed changes

Fixed Bugs introduced from #34307

  1. FileSystemCacheKey.equals() compares properties by ==, resulting in creating new file system in each partition
  2. dfsFileSystem is not synchronized, resulting in creating more file systems than need.
  3. jobConf.iterator() will produce more than 2000 pairs of key-value

@doris-robot

Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@AshinGau

Copy link
Copy Markdown
MemberAuthor

run buildall

2 similar comments
@AshinGau

Copy link
Copy Markdown
MemberAuthor

run buildall

@AshinGau

Copy link
Copy Markdown
MemberAuthor

run buildall

@AshinGau

Copy link
Copy Markdown
MemberAuthor

run buildall

@AshinGau
AshinGau merged commit 7b36e81 into apache:branch-2.1Jun 20, 2024
@morningmanmorningman mentioned this pull request Jun 22, 2024
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@AshinGau@doris-robot