Release v3 by nargokul · Pull Request #109 · aws/sagemaker-hyperpod-cli

nargokul · 2025-07-10T14:36:38Z

PR Approval Steps

For Requester

Description
- Check the PR title and description for clarity. It should describe the changes made and the reason behind them.
- Ensure that the PR follows the contribution guidelines, if applicable.
Security requirements
- Ensure that a Pull Request (PR) does not expose passwords and other sensitive information by using git-secrets and upload relevant evidence: https://github.com/awslabs/git-secrets
- Ensure commit has GitHub Commit Signature
Manual review
1. Click on the Files changed tab to see the code changes. Review the changes thoroughly:
  - Code Quality: Check for coding standards, naming conventions, and readability.
  - Functionality: Ensure that the changes meet the requirements and that all necessary code paths are tested.
  - Security: Check for any security issues or vulnerabilities.
  - Documentation: Confirm that any necessary documentation (code comments, README updates, etc.) has been updated.
Check for Merge Conflicts:
- Verify if there are any merge conflicts with the base branch. GitHub will usually highlight this. If there are conflicts, you should resolve them.

For Reviewer

Go through For Requester section to double check each item.
Request Changes or Approve the PR:
1. If the PR is ready to be merged, click Review changes and select Approve.
2. If changes are required, select Request changes and provide feedback. Be constructive and clear in your feedback.
Merging the PR
1. Check the Merge Method:
  1. Decide on the appropriate merge method based on your repository's guidelines (e.g., Squash and merge, Rebase and merge, or Merge).
2. Merge the PR:
  1. Click the Merge pull request button.
  2. Confirm the merge by clicking Confirm merge.

… references.

1. update image tag 2. Remove IAM policies for execution role 3. Rename to hyperpod-inference-operator prefix instead of deploymentoperator prefix

Introduce helm charts for hyperpod inference operator

* Add CRDs and setup for region * Change annotation for SA * Remove default region

Update sync branch

**Description** Support jumpstart and custom model endpoints **Testing Done** Tested manually, will add unit tests in next few PRs

**Description** Refactor ModelEndpoint classes to let create happen in separate method instead of constructor **Testing Done** Manually tested in demo notebook

Tested manually in demo jupyter notebook

**Description** **Testing Done** Unit test passes

Add hyperpod inference classes

Make function classmethod and update unit tests

Fix bugs for inference endpoint

…as dependencies feat: add pv and pvc creation as part of helm

…t disabled

Add additional required dependencies for the HyperPod Inference Operator

…ommand (#116)

* Bring HyperPodManager class util functions Unit tests pass and verified in notebook * Update init

… test) (#120) * baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header

…ime (#122) Updated unit tests and verified in notebook

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates

#125) * Update inference and training to only check kubeconfig on the first time Updated unit tests and verified in notebook * Remove old unit tests * Revert "Remove old unit tests" This reverts commit e728e9864c853635f724e9a377fbe870f0f2e2a4. * Move observability utils and constants; Rename set_context/get_context

* Changelog updates * Rebase and update * Fix

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates * Readme updates * Fix README.md * Remove Orchestrator from List Cluster * Changes to README.md * Fix the link * Remove orchestrator from README.md

* use unique basename for test file modules * fix unit tests * remove append_uuid test * fix failing test_invoke tests --------- Co-authored-by: adishaa <adishaa@amazon.com>

* Fix get_cluster_context runtime error * Remove Py38 fromtests

* Fix get_cluster_context runtime error * Remove Py38 fromtests * Fix * Unit test fixes

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account * integ test passing on beta account

* Test PR * Fix is_kubeconfig_loaded Class attribute bug

# Conflicts: # helm_chart/readme.md # src/hyperpod_cli/commands/job.py

jam-jee · 2025-07-10T15:47:25Z

 on:
 pull_request_target:
 branches:
+ - "master*"


nit: may not need master branch here, CI would be running on main

nargokul · 2025-07-10T14:36:38Z

PR Approval Steps

For Requester

Description
- Check the PR title and description for clarity. It should describe the changes made and the reason behind them.
- Ensure that the PR follows the contribution guidelines, if applicable.
Security requirements
- Ensure that a Pull Request (PR) does not expose passwords and other sensitive information by using git-secrets and upload relevant evidence: https://github.com/awslabs/git-secrets
- Ensure commit has GitHub Commit Signature
Manual review
1. Click on the Files changed tab to see the code changes. Review the changes thoroughly:
  - Code Quality: Check for coding standards, naming conventions, and readability.
  - Functionality: Ensure that the changes meet the requirements and that all necessary code paths are tested.
  - Security: Check for any security issues or vulnerabilities.
  - Documentation: Confirm that any necessary documentation (code comments, README updates, etc.) has been updated.
Check for Merge Conflicts:
- Verify if there are any merge conflicts with the base branch. GitHub will usually highlight this. If there are conflicts, you should resolve them.

For Reviewer

Go through For Requester section to double check each item.
Request Changes or Approve the PR:
1. If the PR is ready to be merged, click Review changes and select Approve.
2. If changes are required, select Request changes and provide feedback. Be constructive and clear in your feedback.
Merging the PR
1. Check the Merge Method:
  1. Decide on the appropriate merge method based on your repository's guidelines (e.g., Squash and merge, Rebase and merge, or Merge).
2. Merge the PR:
  1. Click the Merge pull request button.
  2. Confirm the merge by clicking Confirm merge.

… references.

1. update image tag 2. Remove IAM policies for execution role 3. Rename to hyperpod-inference-operator prefix instead of deploymentoperator prefix

Introduce helm charts for hyperpod inference operator

* Add CRDs and setup for region * Change annotation for SA * Remove default region

Update sync branch

**Description** Support jumpstart and custom model endpoints **Testing Done** Tested manually, will add unit tests in next few PRs

**Description** Refactor ModelEndpoint classes to let create happen in separate method instead of constructor **Testing Done** Manually tested in demo notebook

Tested manually in demo jupyter notebook

**Description** **Testing Done** Unit test passes

Add hyperpod inference classes

Make function classmethod and update unit tests

Fix bugs for inference endpoint

…as dependencies feat: add pv and pvc creation as part of helm

…t disabled

Add additional required dependencies for the HyperPod Inference Operator

…ommand (#116)

* Bring HyperPodManager class util functions Unit tests pass and verified in notebook * Update init

… test) (#120) * baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header

…ime (#122) Updated unit tests and verified in notebook

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates

#125) * Update inference and training to only check kubeconfig on the first time Updated unit tests and verified in notebook * Remove old unit tests * Revert "Remove old unit tests" This reverts commit e728e9864c853635f724e9a377fbe870f0f2e2a4. * Move observability utils and constants; Rename set_context/get_context

* Changelog updates * Rebase and update * Fix

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates * Readme updates * Fix README.md * Remove Orchestrator from List Cluster * Changes to README.md * Fix the link * Remove orchestrator from README.md

* use unique basename for test file modules * fix unit tests * remove append_uuid test * fix failing test_invoke tests --------- Co-authored-by: adishaa <adishaa@amazon.com>

* Fix get_cluster_context runtime error * Remove Py38 fromtests

* Fix get_cluster_context runtime error * Remove Py38 fromtests * Fix * Unit test fixes

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account * integ test passing on beta account

* Test PR * Fix is_kubeconfig_loaded Class attribute bug

# Conflicts: # helm_chart/readme.md # src/hyperpod_cli/commands/job.py

jam-jee · 2025-07-10T15:47:25Z

 on:
 pull_request_target:
 branches:
+ - "master*"


nit: may not need master branch here, CI would be running on main

nargokul · 2025-07-10T14:36:38Z

PR Approval Steps

For Requester

Description
- Check the PR title and description for clarity. It should describe the changes made and the reason behind them.
- Ensure that the PR follows the contribution guidelines, if applicable.
Security requirements
- Ensure that a Pull Request (PR) does not expose passwords and other sensitive information by using git-secrets and upload relevant evidence: https://github.com/awslabs/git-secrets
- Ensure commit has GitHub Commit Signature
Manual review
1. Click on the Files changed tab to see the code changes. Review the changes thoroughly:
  - Code Quality: Check for coding standards, naming conventions, and readability.
  - Functionality: Ensure that the changes meet the requirements and that all necessary code paths are tested.
  - Security: Check for any security issues or vulnerabilities.
  - Documentation: Confirm that any necessary documentation (code comments, README updates, etc.) has been updated.
Check for Merge Conflicts:
- Verify if there are any merge conflicts with the base branch. GitHub will usually highlight this. If there are conflicts, you should resolve them.

For Reviewer

Go through For Requester section to double check each item.
Request Changes or Approve the PR:
1. If the PR is ready to be merged, click Review changes and select Approve.
2. If changes are required, select Request changes and provide feedback. Be constructive and clear in your feedback.
Merging the PR
1. Check the Merge Method:
  1. Decide on the appropriate merge method based on your repository's guidelines (e.g., Squash and merge, Rebase and merge, or Merge).
2. Merge the PR:
  1. Click the Merge pull request button.
  2. Confirm the merge by clicking Confirm merge.

… references.

1. update image tag 2. Remove IAM policies for execution role 3. Rename to hyperpod-inference-operator prefix instead of deploymentoperator prefix

Introduce helm charts for hyperpod inference operator

* Add CRDs and setup for region * Change annotation for SA * Remove default region

Update sync branch

**Description** Support jumpstart and custom model endpoints **Testing Done** Tested manually, will add unit tests in next few PRs

**Description** Refactor ModelEndpoint classes to let create happen in separate method instead of constructor **Testing Done** Manually tested in demo notebook

Tested manually in demo jupyter notebook

**Description** **Testing Done** Unit test passes

Add hyperpod inference classes

Make function classmethod and update unit tests

Fix bugs for inference endpoint

…as dependencies feat: add pv and pvc creation as part of helm

…t disabled

Add additional required dependencies for the HyperPod Inference Operator

…ommand (#116)

* Bring HyperPodManager class util functions Unit tests pass and verified in notebook * Update init

… test) (#120) * baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header

…ime (#122) Updated unit tests and verified in notebook

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates

#125) * Update inference and training to only check kubeconfig on the first time Updated unit tests and verified in notebook * Remove old unit tests * Revert "Remove old unit tests" This reverts commit e728e9864c853635f724e9a377fbe870f0f2e2a4. * Move observability utils and constants; Rename set_context/get_context

* Changelog updates * Rebase and update * Fix

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates * Readme updates * Fix README.md * Remove Orchestrator from List Cluster * Changes to README.md * Fix the link * Remove orchestrator from README.md

* use unique basename for test file modules * fix unit tests * remove append_uuid test * fix failing test_invoke tests --------- Co-authored-by: adishaa <adishaa@amazon.com>

* Fix get_cluster_context runtime error * Remove Py38 fromtests

* Fix get_cluster_context runtime error * Remove Py38 fromtests * Fix * Unit test fixes

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account * integ test passing on beta account

* Test PR * Fix is_kubeconfig_loaded Class attribute bug

# Conflicts: # helm_chart/readme.md # src/hyperpod_cli/commands/job.py

jam-jee · 2025-07-10T15:47:25Z

 on:
 pull_request_target:
 branches:
+ - "master*"


nit: may not need master branch here, CI would be running on main

nargokul · 2025-07-10T14:36:38Z

PR Approval Steps

For Requester

Description
- Check the PR title and description for clarity. It should describe the changes made and the reason behind them.
- Ensure that the PR follows the contribution guidelines, if applicable.
Security requirements
- Ensure that a Pull Request (PR) does not expose passwords and other sensitive information by using git-secrets and upload relevant evidence: https://github.com/awslabs/git-secrets
- Ensure commit has GitHub Commit Signature
Manual review
1. Click on the Files changed tab to see the code changes. Review the changes thoroughly:
  - Code Quality: Check for coding standards, naming conventions, and readability.
  - Functionality: Ensure that the changes meet the requirements and that all necessary code paths are tested.
  - Security: Check for any security issues or vulnerabilities.
  - Documentation: Confirm that any necessary documentation (code comments, README updates, etc.) has been updated.
Check for Merge Conflicts:
- Verify if there are any merge conflicts with the base branch. GitHub will usually highlight this. If there are conflicts, you should resolve them.

For Reviewer

Go through For Requester section to double check each item.
Request Changes or Approve the PR:
1. If the PR is ready to be merged, click Review changes and select Approve.
2. If changes are required, select Request changes and provide feedback. Be constructive and clear in your feedback.
Merging the PR
1. Check the Merge Method:
  1. Decide on the appropriate merge method based on your repository's guidelines (e.g., Squash and merge, Rebase and merge, or Merge).
2. Merge the PR:
  1. Click the Merge pull request button.
  2. Confirm the merge by clicking Confirm merge.

… references.

1. update image tag 2. Remove IAM policies for execution role 3. Rename to hyperpod-inference-operator prefix instead of deploymentoperator prefix

Introduce helm charts for hyperpod inference operator

* Add CRDs and setup for region * Change annotation for SA * Remove default region

Update sync branch

**Description** Support jumpstart and custom model endpoints **Testing Done** Tested manually, will add unit tests in next few PRs

**Description** Refactor ModelEndpoint classes to let create happen in separate method instead of constructor **Testing Done** Manually tested in demo notebook

Tested manually in demo jupyter notebook

**Description** **Testing Done** Unit test passes

Add hyperpod inference classes

Make function classmethod and update unit tests

Fix bugs for inference endpoint

…as dependencies feat: add pv and pvc creation as part of helm

…t disabled

Add additional required dependencies for the HyperPod Inference Operator

…ommand (#116)

* Bring HyperPodManager class util functions Unit tests pass and verified in notebook * Update init

… test) (#120) * baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header

…ime (#122) Updated unit tests and verified in notebook

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates

#125) * Update inference and training to only check kubeconfig on the first time Updated unit tests and verified in notebook * Remove old unit tests * Revert "Remove old unit tests" This reverts commit e728e9864c853635f724e9a377fbe870f0f2e2a4. * Move observability utils and constants; Rename set_context/get_context

* Changelog updates * Rebase and update * Fix

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates * Readme updates * Fix README.md * Remove Orchestrator from List Cluster * Changes to README.md * Fix the link * Remove orchestrator from README.md

* use unique basename for test file modules * fix unit tests * remove append_uuid test * fix failing test_invoke tests --------- Co-authored-by: adishaa <adishaa@amazon.com>

* Fix get_cluster_context runtime error * Remove Py38 fromtests

* Fix get_cluster_context runtime error * Remove Py38 fromtests * Fix * Unit test fixes

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account * integ test passing on beta account

* Test PR * Fix is_kubeconfig_loaded Class attribute bug

# Conflicts: # helm_chart/readme.md # src/hyperpod_cli/commands/job.py

jam-jee · 2025-07-10T15:47:25Z

 on:
 pull_request_target:
 branches:
+ - "master*"


nit: may not need master branch here, CI would be running on main

nargokul · 2025-07-10T14:36:38Z

PR Approval Steps

For Requester

Description
- Check the PR title and description for clarity. It should describe the changes made and the reason behind them.
- Ensure that the PR follows the contribution guidelines, if applicable.
Security requirements
- Ensure that a Pull Request (PR) does not expose passwords and other sensitive information by using git-secrets and upload relevant evidence: https://github.com/awslabs/git-secrets
- Ensure commit has GitHub Commit Signature
Manual review
1. Click on the Files changed tab to see the code changes. Review the changes thoroughly:
  - Code Quality: Check for coding standards, naming conventions, and readability.
  - Functionality: Ensure that the changes meet the requirements and that all necessary code paths are tested.
  - Security: Check for any security issues or vulnerabilities.
  - Documentation: Confirm that any necessary documentation (code comments, README updates, etc.) has been updated.
Check for Merge Conflicts:
- Verify if there are any merge conflicts with the base branch. GitHub will usually highlight this. If there are conflicts, you should resolve them.

For Reviewer

Go through For Requester section to double check each item.
Request Changes or Approve the PR:
1. If the PR is ready to be merged, click Review changes and select Approve.
2. If changes are required, select Request changes and provide feedback. Be constructive and clear in your feedback.
Merging the PR
1. Check the Merge Method:
  1. Decide on the appropriate merge method based on your repository's guidelines (e.g., Squash and merge, Rebase and merge, or Merge).
2. Merge the PR:
  1. Click the Merge pull request button.
  2. Confirm the merge by clicking Confirm merge.

… references.

1. update image tag 2. Remove IAM policies for execution role 3. Rename to hyperpod-inference-operator prefix instead of deploymentoperator prefix

Introduce helm charts for hyperpod inference operator

* Add CRDs and setup for region * Change annotation for SA * Remove default region

Update sync branch

**Description** Support jumpstart and custom model endpoints **Testing Done** Tested manually, will add unit tests in next few PRs

**Description** Refactor ModelEndpoint classes to let create happen in separate method instead of constructor **Testing Done** Manually tested in demo notebook

Tested manually in demo jupyter notebook

**Description** **Testing Done** Unit test passes

Add hyperpod inference classes

Make function classmethod and update unit tests

Fix bugs for inference endpoint

…as dependencies feat: add pv and pvc creation as part of helm

…t disabled

Add additional required dependencies for the HyperPod Inference Operator

…ommand (#116)

* Bring HyperPodManager class util functions Unit tests pass and verified in notebook * Update init

… test) (#120) * baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header

…ime (#122) Updated unit tests and verified in notebook

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates

#125) * Update inference and training to only check kubeconfig on the first time Updated unit tests and verified in notebook * Remove old unit tests * Revert "Remove old unit tests" This reverts commit e728e9864c853635f724e9a377fbe870f0f2e2a4. * Move observability utils and constants; Rename set_context/get_context

* Changelog updates * Rebase and update * Fix

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates * Readme updates * Fix README.md * Remove Orchestrator from List Cluster * Changes to README.md * Fix the link * Remove orchestrator from README.md

* use unique basename for test file modules * fix unit tests * remove append_uuid test * fix failing test_invoke tests --------- Co-authored-by: adishaa <adishaa@amazon.com>

* Fix get_cluster_context runtime error * Remove Py38 fromtests

* Fix get_cluster_context runtime error * Remove Py38 fromtests * Fix * Unit test fixes

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account * integ test passing on beta account

* Test PR * Fix is_kubeconfig_loaded Class attribute bug

# Conflicts: # helm_chart/readme.md # src/hyperpod_cli/commands/job.py

jam-jee · 2025-07-10T15:47:25Z

 on:
 pull_request_target:
 branches:
+ - "master*"


nit: may not need master branch here, CI would be running on main

nargokul · 2025-07-10T14:36:38Z

PR Approval Steps

For Requester

Description
- Check the PR title and description for clarity. It should describe the changes made and the reason behind them.
- Ensure that the PR follows the contribution guidelines, if applicable.
Security requirements
- Ensure that a Pull Request (PR) does not expose passwords and other sensitive information by using git-secrets and upload relevant evidence: https://github.com/awslabs/git-secrets
- Ensure commit has GitHub Commit Signature
Manual review
1. Click on the Files changed tab to see the code changes. Review the changes thoroughly:
  - Code Quality: Check for coding standards, naming conventions, and readability.
  - Functionality: Ensure that the changes meet the requirements and that all necessary code paths are tested.
  - Security: Check for any security issues or vulnerabilities.
  - Documentation: Confirm that any necessary documentation (code comments, README updates, etc.) has been updated.
Check for Merge Conflicts:
- Verify if there are any merge conflicts with the base branch. GitHub will usually highlight this. If there are conflicts, you should resolve them.

For Reviewer

Go through For Requester section to double check each item.
Request Changes or Approve the PR:
1. If the PR is ready to be merged, click Review changes and select Approve.
2. If changes are required, select Request changes and provide feedback. Be constructive and clear in your feedback.
Merging the PR
1. Check the Merge Method:
  1. Decide on the appropriate merge method based on your repository's guidelines (e.g., Squash and merge, Rebase and merge, or Merge).
2. Merge the PR:
  1. Click the Merge pull request button.
  2. Confirm the merge by clicking Confirm merge.

… references.

1. update image tag 2. Remove IAM policies for execution role 3. Rename to hyperpod-inference-operator prefix instead of deploymentoperator prefix

Introduce helm charts for hyperpod inference operator

* Add CRDs and setup for region * Change annotation for SA * Remove default region

Update sync branch

**Description** Support jumpstart and custom model endpoints **Testing Done** Tested manually, will add unit tests in next few PRs

**Description** Refactor ModelEndpoint classes to let create happen in separate method instead of constructor **Testing Done** Manually tested in demo notebook

Tested manually in demo jupyter notebook

**Description** **Testing Done** Unit test passes

Add hyperpod inference classes

Make function classmethod and update unit tests

Fix bugs for inference endpoint

…as dependencies feat: add pv and pvc creation as part of helm

…t disabled

Add additional required dependencies for the HyperPod Inference Operator

…ommand (#116)

* Bring HyperPodManager class util functions Unit tests pass and verified in notebook * Update init

… test) (#120) * baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header

…ime (#122) Updated unit tests and verified in notebook

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates

#125) * Update inference and training to only check kubeconfig on the first time Updated unit tests and verified in notebook * Remove old unit tests * Revert "Remove old unit tests" This reverts commit e728e9864c853635f724e9a377fbe870f0f2e2a4. * Move observability utils and constants; Rename set_context/get_context

* Changelog updates * Rebase and update * Fix

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates * Readme updates * Fix README.md * Remove Orchestrator from List Cluster * Changes to README.md * Fix the link * Remove orchestrator from README.md

* use unique basename for test file modules * fix unit tests * remove append_uuid test * fix failing test_invoke tests --------- Co-authored-by: adishaa <adishaa@amazon.com>

* Fix get_cluster_context runtime error * Remove Py38 fromtests

* Fix get_cluster_context runtime error * Remove Py38 fromtests * Fix * Unit test fixes

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account * integ test passing on beta account

* Test PR * Fix is_kubeconfig_loaded Class attribute bug

# Conflicts: # helm_chart/readme.md # src/hyperpod_cli/commands/job.py

jam-jee · 2025-07-10T15:47:25Z

 on:
 pull_request_target:
 branches:
+ - "master*"


nit: may not need master branch here, CI would be running on main

nargokul · 2025-07-10T14:36:38Z

PR Approval Steps

For Requester

Description
- Check the PR title and description for clarity. It should describe the changes made and the reason behind them.
- Ensure that the PR follows the contribution guidelines, if applicable.
Security requirements
- Ensure that a Pull Request (PR) does not expose passwords and other sensitive information by using git-secrets and upload relevant evidence: https://github.com/awslabs/git-secrets
- Ensure commit has GitHub Commit Signature
Manual review
1. Click on the Files changed tab to see the code changes. Review the changes thoroughly:
  - Code Quality: Check for coding standards, naming conventions, and readability.
  - Functionality: Ensure that the changes meet the requirements and that all necessary code paths are tested.
  - Security: Check for any security issues or vulnerabilities.
  - Documentation: Confirm that any necessary documentation (code comments, README updates, etc.) has been updated.
Check for Merge Conflicts:
- Verify if there are any merge conflicts with the base branch. GitHub will usually highlight this. If there are conflicts, you should resolve them.

For Reviewer

Go through For Requester section to double check each item.
Request Changes or Approve the PR:
1. If the PR is ready to be merged, click Review changes and select Approve.
2. If changes are required, select Request changes and provide feedback. Be constructive and clear in your feedback.
Merging the PR
1. Check the Merge Method:
  1. Decide on the appropriate merge method based on your repository's guidelines (e.g., Squash and merge, Rebase and merge, or Merge).
2. Merge the PR:
  1. Click the Merge pull request button.
  2. Confirm the merge by clicking Confirm merge.

… references.

1. update image tag 2. Remove IAM policies for execution role 3. Rename to hyperpod-inference-operator prefix instead of deploymentoperator prefix

Introduce helm charts for hyperpod inference operator

* Add CRDs and setup for region * Change annotation for SA * Remove default region

Update sync branch

**Description** Support jumpstart and custom model endpoints **Testing Done** Tested manually, will add unit tests in next few PRs

**Description** Refactor ModelEndpoint classes to let create happen in separate method instead of constructor **Testing Done** Manually tested in demo notebook

Tested manually in demo jupyter notebook

**Description** **Testing Done** Unit test passes

Add hyperpod inference classes

Make function classmethod and update unit tests

Fix bugs for inference endpoint

…as dependencies feat: add pv and pvc creation as part of helm

…t disabled

Add additional required dependencies for the HyperPod Inference Operator

…ommand (#116)

* Bring HyperPodManager class util functions Unit tests pass and verified in notebook * Update init

… test) (#120) * baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header

…ime (#122) Updated unit tests and verified in notebook

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates

#125) * Update inference and training to only check kubeconfig on the first time Updated unit tests and verified in notebook * Remove old unit tests * Revert "Remove old unit tests" This reverts commit e728e9864c853635f724e9a377fbe870f0f2e2a4. * Move observability utils and constants; Rename set_context/get_context

* Changelog updates * Rebase and update * Fix

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates * Readme updates * Fix README.md * Remove Orchestrator from List Cluster * Changes to README.md * Fix the link * Remove orchestrator from README.md

* use unique basename for test file modules * fix unit tests * remove append_uuid test * fix failing test_invoke tests --------- Co-authored-by: adishaa <adishaa@amazon.com>

* Fix get_cluster_context runtime error * Remove Py38 fromtests

* Fix get_cluster_context runtime error * Remove Py38 fromtests * Fix * Unit test fixes

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account * integ test passing on beta account

* Test PR * Fix is_kubeconfig_loaded Class attribute bug

# Conflicts: # helm_chart/readme.md # src/hyperpod_cli/commands/job.py

jam-jee · 2025-07-10T15:47:25Z

 on:
 pull_request_target:
 branches:
+ - "master*"


nit: may not need master branch here, CI would be running on main

nargokul · 2025-07-10T14:36:38Z

PR Approval Steps

For Requester

Description
- Check the PR title and description for clarity. It should describe the changes made and the reason behind them.
- Ensure that the PR follows the contribution guidelines, if applicable.
Security requirements
- Ensure that a Pull Request (PR) does not expose passwords and other sensitive information by using git-secrets and upload relevant evidence: https://github.com/awslabs/git-secrets
- Ensure commit has GitHub Commit Signature
Manual review
1. Click on the Files changed tab to see the code changes. Review the changes thoroughly:
  - Code Quality: Check for coding standards, naming conventions, and readability.
  - Functionality: Ensure that the changes meet the requirements and that all necessary code paths are tested.
  - Security: Check for any security issues or vulnerabilities.
  - Documentation: Confirm that any necessary documentation (code comments, README updates, etc.) has been updated.
Check for Merge Conflicts:
- Verify if there are any merge conflicts with the base branch. GitHub will usually highlight this. If there are conflicts, you should resolve them.

For Reviewer

Go through For Requester section to double check each item.
Request Changes or Approve the PR:
1. If the PR is ready to be merged, click Review changes and select Approve.
2. If changes are required, select Request changes and provide feedback. Be constructive and clear in your feedback.
Merging the PR
1. Check the Merge Method:
  1. Decide on the appropriate merge method based on your repository's guidelines (e.g., Squash and merge, Rebase and merge, or Merge).
2. Merge the PR:
  1. Click the Merge pull request button.
  2. Confirm the merge by clicking Confirm merge.

… references.

1. update image tag 2. Remove IAM policies for execution role 3. Rename to hyperpod-inference-operator prefix instead of deploymentoperator prefix

Introduce helm charts for hyperpod inference operator

* Add CRDs and setup for region * Change annotation for SA * Remove default region

Update sync branch

**Description** Support jumpstart and custom model endpoints **Testing Done** Tested manually, will add unit tests in next few PRs

**Description** Refactor ModelEndpoint classes to let create happen in separate method instead of constructor **Testing Done** Manually tested in demo notebook

Tested manually in demo jupyter notebook

**Description** **Testing Done** Unit test passes

Add hyperpod inference classes

Make function classmethod and update unit tests

Fix bugs for inference endpoint

…as dependencies feat: add pv and pvc creation as part of helm

…t disabled

Add additional required dependencies for the HyperPod Inference Operator

…ommand (#116)

* Bring HyperPodManager class util functions Unit tests pass and verified in notebook * Update init

… test) (#120) * baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header

…ime (#122) Updated unit tests and verified in notebook

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates

#125) * Update inference and training to only check kubeconfig on the first time Updated unit tests and verified in notebook * Remove old unit tests * Revert "Remove old unit tests" This reverts commit e728e9864c853635f724e9a377fbe870f0f2e2a4. * Move observability utils and constants; Rename set_context/get_context

* Changelog updates * Rebase and update * Fix

* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates * Readme updates * Fix README.md * Remove Orchestrator from List Cluster * Changes to README.md * Fix the link * Remove orchestrator from README.md

* use unique basename for test file modules * fix unit tests * remove append_uuid test * fix failing test_invoke tests --------- Co-authored-by: adishaa <adishaa@amazon.com>

* Fix get_cluster_context runtime error * Remove Py38 fromtests

* Fix get_cluster_context runtime error * Remove Py38 fromtests * Fix * Unit test fixes

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account

* baseline inference integration test for CLI and SDK, minor bug fix for inference cli, clear inference sdk notebook output * update integ test in progress * update cli code, notebook, integ and unit test to add list_pods and get_logs * clean up merge header * inference integ tests all passing in chait's account * integ test passing on beta account

* Test PR * Fix is_kubeconfig_loaded Class attribute bug

# Conflicts: # helm_chart/readme.md # src/hyperpod_cli/commands/job.py

jam-jee · 2025-07-10T15:47:25Z

 on:
 pull_request_target:
 branches:
+ - "master*"


nit: may not need master branch here, CI would be running on main

mbnavaliand others added 30 commits June 10, 2025 14:58

Introduce helm charts for hyperpod inference operator
0139e19

Introduce helm charts for hyperpod inference operator
89d9f29

Introduce helm charts for hyperpod inference operator
d4fffa0

Update Helm charts for inference operator, clean up to remove bedrock…
f6d3949
… references.

Changes to
3cf3f8b
1. update image tag 2. Remove IAM policies for execution role 3. Rename to hyperpod-inference-operator prefix instead of deploymentoperator prefix

Removed binary from the code base.
716382f

Nit: Update the app name labels for sample yaml files.
c0acb09

Merge pull request#29from mbnavali/main
6868542
Introduce helm charts for hyperpod inference operator

Add crds, service account and region (#32)
6a9ddb4
* Add CRDs and setup for region * Change annotation for SA * Remove default region

Merge pull request#33from zhaoqizqwang/update-sync-branch
a5dec3e
Update sync branch

Add hyperpod inference classes
15242fe
**Description** Support jumpstart and custom model endpoints **Testing Done** Tested manually, will add unit tests in next few PRs

Refactor create inference function
984c820
**Description** Refactor ModelEndpoint classes to let create happen in separate method instead of constructor **Testing Done** Manually tested in demo notebook

Add List, Delete, Describe endpoint features
1af95ad
Tested manually in demo jupyter notebook

Add unit test and update class names
de55508
**Description** **Testing Done** Unit test passes

Add end and setup.py
0ab576f

Update gitignore
f104770

Add setup.cfg
05c374c

Fix HPEndpoint class and add optional values
bbf9570

remove utils.py
11faa90

Merge pull request#34from zhaoqizqwang/add-inference-classes
5430f3f
Add hyperpod inference classes

Make function classmethod and update unit tests
b22e4ad

Merge pull request#40from zhaoqizqwang/add-inference-classes
c3a8a16
Make function classmethod and update unit tests

Fix bugs for inference endpoint
b13c487

Small fixes
d13acdd

Merge pull request#41from zhaoqizqwang/add-inference-classes
6acb6f6
Fix bugs for inference endpoint

build: add mountpoint s3 csi driver, keda + cert-manager controllers …
1ab67ee
…as dependencies feat: add pv and pvc creation as part of helm

chore: add inference operator as dependency for HP Helm Chart, defaul…
68a9944
…t disabled

feat: add support for jumpstart gated models
d87dc59

Merge pull request#42from rvasahu-amazon/main-2
349f2ff
Add additional required dependencies for the HyperPod Inference Operator

fix: remove stray symbol
66df206

jam-jeeand others added 19 commits July 9, 2025 14:02

Bumping kubernetes python client version and updating observability c…
b64e7ea
…ommand (#116)

change: add prefix to convert bucket name to s3 URI (#109)
d749271

Added type check on commands before invoking subprocess run (#118)
bce58b3

Bring HyperPodManager class util functions (#119)
e9e749c
* Bring HyperPodManager class util functions Unit tests pass and verified in notebook * Update init

Update inference and training to only check kubeconfig on the first t…
1c9209a
…ime (#122) Updated unit tests and verified in notebook

Update Readme to include Inference and Training (#121)
6dc7013
* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates

Updating template packages name and structure (#126)
3463e98

Changelog updates (#128)
78d8c37
* Changelog updates * Rebase and update * Fix

Readme update (#129)
05fd213
* Update Readme to include Inference and Training * Update readme command * Documentation updates * Doc Updates * Readme updates * Fix README.md * Remove Orchestrator from List Cluster * Changes to README.md * Fix the link * Remove orchestrator from README.md

Unit test fix (#127)
9ee0c92
* use unique basename for test file modules * fix unit tests * remove append_uuid test * fix failing test_invoke tests --------- Co-authored-by: adishaa <adishaa@amazon.com>

Fix get_cluster_context runtime error (#130)
8d11346

Remove Py38 Tests (#131)
475b9f2
* Fix get_cluster_context runtime error * Remove Py38 fromtests

UNit test fixes (#132)
6d7975f
* Fix get_cluster_context runtime error * Remove Py38 fromtests * Fix * Unit test fixes

Update operator namespace string (#137)
d0c6f14

is_kubeconfig_loaded Fix (#139)
a9e8d59
* Test PR * Fix is_kubeconfig_loaded Class attribute bug

nargokul requested a review from a team as a code owner July 10, 2025 14:36

nargokul temporarily deployed to auto-approve July 10, 2025 14:37 — with GitHub Actions Inactive

Merge remote-tracking branch 'origin/main' into release_v3
966d4b5
# Conflicts: # helm_chart/readme.md # src/hyperpod_cli/commands/job.py

nargokul temporarily deployed to auto-approve July 10, 2025 14:41 — with GitHub Actions Inactive

Include main branch in pull request target
96b469b

nargokul temporarily deployed to auto-approve July 10, 2025 14:44 — with GitHub Actions Inactive

rsareddy0329 approved these changes Jul 10, 2025
View reviewed changes

sage-maker approved these changes Jul 10, 2025
View reviewed changes

jam-jee reviewed Jul 10, 2025
View reviewed changes

jam-jee approved these changes Jul 10, 2025
View reviewed changes

nargokul merged commit 95096e8 into mainJul 10, 2025