2707 configurable uid gid range/ebusto by ebusto · Pull Request #2737 · NVIDIA/OpenShell

ebusto · 2026-08-13T22:04:38Z

Summary

Operators can lower the sandbox UID/GID minima in gateway.toml so enterprise
system identities below 1000 (for example GID 30 or UID 500) are accepted.
Defaults stay 1000, and root (0) is still rejected.

Related Issue

Fixes#2707

Changes

Add [openshell.gateway] min_sandbox_uid and min_sandbox_gid (TOML only;
default 1000, minimum 1).
Thread those limits through policy validation on create, update, get, merge
retry, draft-chunk approval, and agent proposals.
Inject OPENSHELL_MIN_SANDBOX_UID / OPENSHELL_MIN_SANDBOX_GID into Docker,
Podman, and Kubernetes sandbox environments so the supervisor and OPA engine
use the same range.
Document the keys in docs/reference/gateway-config.mdx.

Testing

mise run pre-commit passes
Unit tests added/updated
E2E tests added/updated (if applicable)
Unit coverage includes default-min rejection, min=1 accepting GID 30 / UID
500, supervisor env parsing, OPA from_proto with env limits, and merge /
agent-proposal paths that previously re-validated against the default 1000
floor. Farm VM check: gateway with min_sandbox_uid = 1 / min_sandbox_gid = 1
and a UID/GID 500 user.

Checklist

Follows Conventional Commits
Commits are signed off (DCO)
Architecture docs updated (if applicable)

copy-pr-bot · 2026-08-13T22:04:41Z

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

github-actions · 2026-08-13T22:05:52Z

All contributors have signed the DCO ✍️ ✅
_{Posted by the DCO Assistant Lite bot.}

ebusto · 2026-08-13T22:14:49Z

I have read the DCO document and I hereby sign the DCO.

drew

gator-agent

PR Review Status

Validation: Project-valid implementation of validated issue #2707; the operator-configurable lower identity floor preserves the default of 1000 and rejects root.
Head SHA: b1b4bb32705432815f1cd0f9a1313698dbd942e9
Base SHA: c5498239e66581d5842b50773eff07ace65726f1
Merge base SHA: c5498239e66581d5842b50773eff07ace65726f1
Patch ID: a4928771b3cd59dd91c7902df8e2f7eda9552bd7
Gator payload: 4
Review mode: initial
Previous reviewed SHA: none
Review budget exhausted: no
Maintainer decision required: no

Blocking findings:

GATOR-b1b4bb32-01: Kubernetes still resolves and validates its authoritative workload identity against the fixed 1000 floor, so the advertised configured lower minima cannot survive that supported path.
GATOR-b1b4bb32-02: VM gateways accept policies using the lowered global minima but do not propagate the minima to the guest supervisor or reject that configuration.

Carried findings:

None

Non-blocking suggestions:

None

Docs: docs/reference/gateway-config.mdx is updated, but its stated backend coverage exposes the unresolved VM contract described above.

Next state: gator:in-review

drew · 2026-08-14T17:45:17Z

gator-agent

Blocked

Head SHA: af883c40f9e017b3ea4258bbcce7188379848fd5
Gator payload: 4

Gator is blocked because this PR is currently a draft.

Thanks @ebusto — I saw your update that you are taking a pass at VM and Kubernetes support, and the latest head includes changes in both driver paths. The independent follow-up review of those changes will resume once the PR is ready for review.

Next action: @ebusto, mark the PR ready for review when the implementation is ready for another pass.

ebusto · 2026-08-14T19:31:03Z

Added support for both the VM and Kubernetes drivers, and tested locally.

github-actions · 2026-08-14T19:41:54Z

Label test:e2e-kubernetes applied, but pull-request/2737 does not exist yet. A maintainer needs to comment /ok to test 2d85bfdac97ec5911e219a5a88a1cbcb4fdeb406 to mirror this PR. Once the mirror exists, re-apply the label or re-run Branch E2E Checks from the Actions tab.

github-actions · 2026-08-14T19:41:54Z

Label test:e2e applied, but pull-request/2737 does not exist yet. A maintainer needs to comment /ok to test 2d85bfdac97ec5911e219a5a88a1cbcb4fdeb406 to mirror this PR. Once the mirror exists, re-apply the label or re-run Branch E2E Checks from the Actions tab.

drew

gator-agent

PR Review Status

Validation: Project-valid implementation of validated issue #2707; the operator-configurable lower identity floor preserves the default of 1000 and rejects root.
Head SHA: 2d85bfdac97ec5911e219a5a88a1cbcb4fdeb406
Base SHA: c5498239e66581d5842b50773eff07ace65726f1
Merge base SHA: c5498239e66581d5842b50773eff07ace65726f1
Patch ID: 50892fef3f32f3547d6cba711be65c9c375a358d
Gator payload: 4
Review mode: follow_up
Previous reviewed SHA: b1b4bb32705432815f1cd0f9a1313698dbd942e9
Review budget exhausted: no
Maintainer decision required: no

Thanks @ebusto. I checked your VM and Kubernetes update against the two prior identity-propagation findings. The current delta now passes the configured minima into the VM guest, uses the configured minima for Kubernetes identity resolution, and adds render-level coverage proving UID 500/GID 30 survives the Kubernetes path.

Blocking findings:

No blocking findings remain.

Carried findings:

GATOR-b1b4bb32-01: Resolved by the Kubernetes minima propagation and render regression coverage.
GATOR-b1b4bb32-02: Resolved by VM driver argument and guest-environment propagation.

Docs: docs/reference/gateway-config.mdx documents the configured minima and supported backend propagation.

Required tests: test:e2e and test:e2e-kubernetes applied; test-dispatch helper runs are queued, but the actual required workflows are not yet confirmed queued.

Next state: gator:in-review pending required test dispatch.

drew · 2026-08-14T19:42:54Z

/ok to test 2d85bfd

ebusto · 2026-08-14T21:19:47Z

Regarding the failing checks, I don't think this has anything to do with my changes, as nothing credentials related was touched. Analysis from my buddies Cursor and Grok:

The failing check is not the 500/30 identity work. provider_credentials_are_stored_in_configured_backend died because the gateway never wrote a Kubernetes Secret.

What failed

mise run e2e:kubernetes:credential-drivers ran one test. It finished in 0.13s:

kubectl -n openshell get secret openshell-cred-3095bae637f808f79fa79ce7624c4bedb6a66ecb
Error from server (NotFound): secrets "..." not found

Gateway RPCs all returned 200:

DeleteProvider (cleanup)
CreateProvider (14ms)
GetProvider
DeleteProvider (teardown)

The gateway pod was 1/1 Running. Startup logs show the Kubernetes compute driver, not kubernetes-secrets. There is no log of a Secret create.

What that means

That test expects CreateProvider to persist OPENAI_API_KEY through the Kubernetes Secrets credential driver. Helm defaults leave that driver off, so credentials go to the encrypted DB store (db-credstore). CreateProvider still succeeds; no openshell-cred-* Secret is created; the assertion fails immediately.

The harness is supposed to layer deploy/helm/openshell/ci/values-credential-driver-kubernetes-secrets.yaml (credentialDrivers.kubernetesSecrets.enabled: true) when OPENSHELL_E2E_CREDENTIAL_DRIVERS=1. The mise task env was applied (the cargo command used --test credential_drivers and the credential-drivers feature), so the overlay should have been passed to Helm. The running gateway still behaved like the default store.

Relation to this PR

The committed UID/GID changes do not touch credential-driver code or the Helm credential templates. This is a credential-storage wiring failure, not an identity-minima failure. The suite never reached the Vault pass; it died on the first (kubernetes-secrets) run.

Most likely cause

The installed gateway.toml did not have an active credential_drivers = ["kubernetes-secrets"] (overlay not applied, or the gateway did not load that list), so it fell back to DB storage. A useful confirm on the next run is the ConfigMap:

kubectl -n openshell get cm openshell-config -o jsonpath='{.data.gateway\.toml}'

You want credential_drivers = ["kubernetes-secrets"] and [openshell.credential_drivers.kubernetes-secrets]. If those are missing, Helm did not take the overlay. If they are present, the gateway ignored them and still used db-credstore.

Operators can lower min_sandbox_uid and min_sandbox_gid in gateway.toml so enterprise system IDs such as GID 30 are accepted. Root remains rejected. Signed-off-by: Eric Busto <ebusto@nvidia.com>

Signed-off-by: Eric Busto <ebusto@nvidia.com>

Network-policy merge retries and agent proposals re-validated the full policy with the default UID/GID minimum, so a persisted run_as_user of 500 was rejected even when gateway.toml lowered the range. Signed-off-by: Eric Busto <ebusto@nvidia.com>

Production paths now pass configured identity limits, so the default wrapper was unused in non-test builds and triggered dead_code. Signed-off-by: Eric Busto <ebusto@nvidia.com>

Rename from_mins parameters to avoid similar_names, and use RangeInclusive::contains when parsing supervisor env minima. Signed-off-by: Eric Busto <ebusto@nvidia.com>

Rename apply_identity_limits_from_file parameters so pre-commit clippy -D warnings passes. Signed-off-by: Eric Busto <ebusto@nvidia.com>

Pass [openshell.gateway] min_sandbox_uid/gid to the VM driver subprocess and into the guest supervisor environment so a lowered range is enforced inside the microVM, matching Docker and Podman. Testing: - cargo test -p openshell-driver-vm --lib -- validate_sandbox_identity build_guest_environment_sets_supervisor_defaults build_guest_environment_includes_configured_identity_limits - cargo test -p openshell-server --lib -- vm_driver_command_includes_identity_limits - mise run gateway:vm with min_sandbox_uid/gid = 1; sandbox policy process.run_as_user/group 500; guest `id` reported uid=500 gid=500 Signed-off-by: Eric Busto <ebusto@nvidia.com>

Use configured min_sandbox_uid/gid for driver identity, OpenShift SCC start IDs, sidecar proxy_uid, and network-init so a lowered range is enforced in combined and sidecar pods, matching Docker, Podman, and VM. Testing: - cargo test -p openshell-driver-kubernetes --lib -- identity OpenShift proxy_uid combined_and_sidecar_inject parse_openshift validate_sandbox_identity validate_proxy_uid resolve_sandbox_uid_uses_openshift - cargo check -p openshell-driver-kubernetes --bins - mise run helm:skaffold:dev with min_sandbox_uid/gid = 1 and namespace annotations openshift.io/sa.scc.uid-range=500/50000 and supplemental-groups=500/50000; sandbox id reported uid=500 gid=500 - mise run helm:skaffold:dev:sidecar with the same mins and annotations; agent ran as UID 500, network-init --proxy-gid 500 succeeded Signed-off-by: Eric Busto <ebusto@nvidia.com>

Add validation, SCC, and combined/sidecar render regressions so a configured pair below the old 1000 floor is accepted and emitted instead of falling back to 1000/1000. Testing: - cargo test -p openshell-driver-kubernetes --lib -- validate_sandbox_identity_config_accepts_uid_500 parse_openshift_supplemental combined_and_sidecar_render_resolved_identity_500_30 Signed-off-by: Eric Busto <ebusto@nvidia.com>

pimlock · 2026-08-17T22:54:16Z

/ok to test b2a3dd7

ebusto · 2026-08-18T01:16:39Z

@drew's PR is vastly superior due to its simplicity. Closing this one.

ebusto requested review from a team, derekwaynecarr, maxamillion and mrunalp as code owners August 13, 2026 22:04

drew reviewed Aug 13, 2026
View reviewed changes

Comment threadcrates/openshell-driver-kubernetes/src/config.rs
Comment threadcrates/openshell-server/src/grpc/sandbox.rs

drew added the gator:in-review Gator is reviewing or awaiting PR review feedback label Aug 13, 2026

ebusto marked this pull request as draft August 14, 2026 17:19

drew added gator:blocked Gator is blocked by process or repository gates and removed gator:in-review Gator is reviewing or awaiting PR review feedback labels Aug 14, 2026

ebusto marked this pull request as ready for review August 14, 2026 19:30

drew added test:e2e Requires end-to-end coverage test:e2e-kubernetes Requires Kubernetes end-to-end coverage labels Aug 14, 2026

drew reviewed Aug 14, 2026
View reviewed changes

drew added gator:in-review Gator is reviewing or awaiting PR review feedback and removed gator:blocked Gator is blocked by process or repository gates labels Aug 14, 2026

drew added gator:watch-pipeline Gator is monitoring PR CI/CD status gator:blocked Gator is blocked by process or repository gates and removed gator:in-review Gator is reviewing or awaiting PR review feedback gator:watch-pipeline Gator is monitoring PR CI/CD status labels Aug 14, 2026

ebusto force-pushed the 2707-configurable-uid-gid-range/ebusto branch from 2d85bfd to 61eecb5Compare August 14, 2026 22:08

ebusto requested a review from sjenning as a code owner August 14, 2026 22:08

ebusto added 9 commits August 17, 2026 08:36

feat(gateway): make sandbox UID/GID minima configurable
657df24
Operators can lower min_sandbox_uid and min_sandbox_gid in gateway.toml so enterprise system IDs such as GID 30 are accepted. Root remains rejected. Signed-off-by: Eric Busto <ebusto@nvidia.com>

Ensure the supervisor is using the same limits.
c243ae0
Signed-off-by: Eric Busto <ebusto@nvidia.com>

fix(gateway): gate default policy-safety helper to tests
df3c8ed
Production paths now pass configured identity limits, so the default wrapper was unused in non-test builds and triggered dead_code. Signed-off-by: Eric Busto <ebusto@nvidia.com>

fix(policy): satisfy clippy on sandbox identity limits
497bc09
Rename from_mins parameters to avoid similar_names, and use RangeInclusive::contains when parsing supervisor env minima. Signed-off-by: Eric Busto <ebusto@nvidia.com>

fix(gateway): avoid clippy similar_names on identity limits
c218a0a
Rename apply_identity_limits_from_file parameters so pre-commit clippy -D warnings passes. Signed-off-by: Eric Busto <ebusto@nvidia.com>

ebusto force-pushed the 2707-configurable-uid-gid-range/ebusto branch from 61eecb5 to b2a3dd7Compare August 17, 2026 15:37

drew mentioned this pull request Aug 17, 2026
feat(policy): allow non-root sandbox identities #2785
Merged
8 tasks

ebusto closed this Aug 18, 2026

Uh oh!

Conversation

ebusto commented Aug 13, 2026

Summary

Related Issue

Changes

Testing

Checklist

Uh oh!

copy-pr-botBot commented Aug 13, 2026

Uh oh!

github-actionsBot commented Aug 13, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

ebusto commented Aug 13, 2026

Uh oh!

drew left a comment

Choose a reason for hiding this comment

PR Review Status

Uh oh!

Uh oh!

Uh oh!

drew commented Aug 14, 2026

Blocked

Uh oh!

ebusto commented Aug 14, 2026

Uh oh!

github-actionsBot commented Aug 14, 2026

Uh oh!

github-actionsBot commented Aug 14, 2026

Uh oh!

drew left a comment

Choose a reason for hiding this comment

PR Review Status

Uh oh!

drew commented Aug 14, 2026

Uh oh!

ebusto commented Aug 14, 2026

Uh oh!

pimlock commented Aug 17, 2026

Uh oh!

ebusto commented Aug 18, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

github-actionsBot commented Aug 13, 2026•
edited
Loading