Skip to content

[fix](fe) Support IAM role auth in S3 filesystem - #62584

Merged
w41ter merged 1 commit into
apache:masterfrom
w41ter:feat/fs_spi_arn_role
Apr 20, 2026
Merged

[fix](fe) Support IAM role auth in S3 filesystem#62584
w41ter merged 1 commit into
apache:masterfrom
w41ter:feat/fs_spi_arn_role

Conversation

@w41ter

@w41terw41ter commented Apr 17, 2026

Copy link
Copy Markdown
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

the S3 filesystem accepts AWS_ROLE_ARN-based configuration and can build STS assume-role credentials.

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@w41ter
[fix](fe) Support IAM role auth in S3 filesystem
176606d
the S3 filesystem accepts AWS_ROLE_ARN-based configuration
and can build STS assume-role credentials.
@hello-stephen

hello-stephen commented Apr 17, 2026

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@w41ter

w41ter commented Apr 17, 2026

Copy link
Copy Markdown
ContributorAuthor

run buildall

@hello-stephen

hello-stephen commented Apr 17, 2026

Copy link
Copy Markdown
Contributor

FE Regression Coverage Report

Increment line coverage 0.00% (0/7) 🎉
Increment coverage report
Complete coverage report

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Apr 20, 2026
@github-actions

github-actionsBot commented Apr 20, 2026

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

github-actionsBot commented Apr 20, 2026

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@w41ter
w41ter merged commit 3721683 into apache:masterApr 20, 2026
34 of 35 checks passed
@w41ter
w41ter deleted the feat/fs_spi_arn_role branch April 20, 2026 06:36
w41ter added a commit to w41ter/incubator-doris that referenced this pull request Apr 20, 2026
@w41ter
[fix](fe) Support IAM role auth in S3 filesystem
41a1ca4
Cherry-pick apache#62584
the S3 filesystem accepts AWS_ROLE_ARN-based configuration and can build
STS assume-role credentials.
@w41terw41ter mentioned this pull request Apr 20, 2026
Merged
yiguolei pushed a commit that referenced this pull request Apr 21, 2026
@w41ter
branch-4.1: [fix](fe) Support IAM role auth in S3 filesystem (#62622)
07e4b90
Cherry-pick #62584
the S3 filesystem accepts AWS_ROLE_ARN-based configuration and can build
STS assume-role credentials.
@mymeiyimymeiyi mentioned this pull request Apr 21, 2026
Merged
@gavinchougavinchou mentioned this pull request Apr 24, 2026
Merged
yiguolei pushed a commit that referenced this pull request Apr 25, 2026
@w41ter
[fix](fe) Fix IAM role auth not working in S3 FS#62584(#62775)
7e1b753
pick #62584
w41ter added a commit to w41ter/incubator-doris that referenced this pull request Apr 27, 2026
@w41ter
[fix](fe) Preserve AWS role props in ObjectInfo adapter
b172004
### What problem does this PR solve?
Issue Number: None
Related PR: apache#62584
Problem Summary: Preserve AWS role ARN and external ID when building ObjectInfo for internal-stage usage and when converting ObjectInfo to storage properties, so snapshot-related S3 access keeps the expected IAM role context on doris/master.
### Release note
None
### Check List (For Author)
- Test: ./run-fe-ut.sh --run org.apache.doris.cloud.storage.ObjectInfoAdapterTest
- Unit Test
- Behavior changed: Yes (ObjectInfoAdapter now exports canonical AWS_ROLE_ARN/AWS_EXTERNAL_ID properties, and ObjectInfo preserves role data from ObjectStoreInfoPB for internal-stage flows)
- Does this need documentation: No
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@w41terw41ter mentioned this pull request Apr 27, 2026
Merged
16 tasks
gavinchou pushed a commit that referenced this pull request Apr 27, 2026
@w41ter
[fix](fe) Preserve AWS role props in ObjectInfo adapter (#62857)
2497a49
Related PR: #62584
Problem Summary: Preserve AWS role ARN and external ID when building
ObjectInfo for internal-stage usage and when converting ObjectInfo to
storage properties, so snapshot-related S3 access keeps the expected IAM
role context.
@yiguoleiyiguolei mentioned this pull request May 20, 2026
Closed
zhaorongsheng pushed a commit to zhaorongsheng/doris that referenced this pull request Jun 4, 2026
@w41terzhaorongsheng
[fix](fe) Support IAM role auth in S3 filesystem (apache#62584)
ec61877
the S3 filesystem accepts AWS_ROLE_ARN-based configuration and can build
STS assume-role credentials.
zhaorongsheng pushed a commit to zhaorongsheng/doris that referenced this pull request Jun 4, 2026
@w41terzhaorongsheng
[fix](fe) Preserve AWS role props in ObjectInfo adapter (apache#62857)
b4b000b
Related PR: apache#62584
Problem Summary: Preserve AWS role ARN and external ID when building
ObjectInfo for internal-stage usage and when converting ObjectInfo to
storage properties, so snapshot-related S3 access keeps the expected IAM
role context.
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gavinchougavinchougavinchou approved these changes
+1 more reviewer
@wyxxxcatwyxxxcatwyxxxcat approved these changes
Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

approvedIndicates a PR has been approved by one committer.clouddev/4.1.1-mergedreviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@w41ter@hello-stephen@gavinchou@wyxxxcat@yiguolei