[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle - #162

Closed
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet
Closed

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle#162
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet

Conversation

@zeeshanlakhani

@zeeshanlakhanizeeshanlakhani commented Dec 1, 2025

Copy link
Copy Markdown
Contributor

This PR aligns with the implicit lifecycle work that was recently merged into Omicron: oxidecomputer/omicron#9450.

Previously, internal/underlay multicast groups accepted admin-configured addresses, including admin-local (ff04), site-local (ff05), and org-local (ff08). This narrows the scope to only admin-local (ff04::/16), with ff04::/64 reserved for Omicron's internal underlay allocation.

The first set of key changes included:

  • Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
    • Update P4 table entries to only match admin-local (size 4→2) Omicron-focused underlay
  • Update to from oxnet v0.1.4
  • Bump to API versions from 2->3 and 3->4.
  • Only ff04::/64 is reserved for Omicron's internal underlay multicast allocation
    • Customers can use other admin-local /64s (e.g., ff04:0:0:1::/64) for external groups
  • validate_not_underlay_subnet() blocks ff04::/64 for external group creation
  • validate_nat_target() requires NAT IPs be within ff04::/64
  • P4 mcast_tag_check matches only ff04::/64 (removed dead ULA entry)
  • Update README with OpenAPI generation instructions
  • Use new multicast subnet constants from omicron-common for validation

After the Omicron work finally landed, which this PR relied on, we also addressed ASM groups with sources and explicit tagging:

  • ASM source filtering: Source filters are now allowed on ASM addresses (previously SSM-only). IpSrc::Subnet was replaced with IpSrc::Any for any-source matching.

  • P4 source filter changes: The source filter tables changed from exact to lpm matching on IPv6, and the multicast check was broadened from SSM-only ranges (232.0.0.0/8, ff3x::/16) to all multicast (224.0.0.0/4, ff00::/8).

  • Tag ownership: Multicast groups now require tag-based validation for mutations (delete/update) in API v4 (current). Tags are assigned at creation (user-provided or auto-generated as {uuid}:{group_ip}). Tags cannot be changed post-creation and must match for mutations; this is enforced by requiring the existing tag, not by rejecting tag-change requests. This prevents accidental modification or deletion of groups associated with other components, and better works with Omicron's retry model.

The API structure is now modeled as:

  • v4 = TAG_OWNERSHIP: required tags for delete/update as query params, IpSrc::Any,
    underlay subnet restricted to ff04::/64 (not all of ff04::/16)
  • v3 = SOURCE_FILTER_ANY: optional tags, IpSrc::Any
  • v2 = DUAL_STACK_NAT_WORKFLOW: optional tags, IpSrc::Subnet (from main)
  • v1 = INITIAL (from main)

This PR is a precursor to a follow-up PR that leverages
updated code in `omicron-common`. This gets dendrite
in line with Omicron `main`, capturing an upstream
type change that we needed to accomodate.
Comment threadCargo.toml Outdated
Previously, internal multicast groups accepted admin-scoped addresses
including admin-local (ff04), site-local (ff05), and org-local (ff08).
This narrows the scope to only admin-local (ff04::/16), which is what
Omicron *now* dictates.
- [ ] This should be merged after
oxidecomputer/omicron#9450 is reviewed
and merged into Omicron. We now make Dendrite/Dpd match Omicron
consistently for validation.
Key changes:
- Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
- Update P4 table entries to only match admin-local (size 4→2)
- Add ADMIN_LOCAL_PREFIX const to dpd-types with RFC doc links
- Update validation to use `is_admin_local_multicast()` from oxnet v0.1.4
- Bump to API version 2 for doc changes (only)
- Update README with OpenAPI generation instructions
- Use new multicast subnet constants from `omicron-common` for validation
Base automatically changed from zl/omicron-changes-from-main to mainDecember 11, 2025 03:06
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow updated for your review.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Comment threaddpd/p4/port_bitmap_check.p4 Outdated
Comment threaddpd/p4/sidecar.p4 Outdated
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Yep. No questions, just my bad in context. Fixed.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing up those comments!

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow, let me know if you'd like another look at this. I'll be doing a follow-up PR as well on some ssm/asm updates.

//
// Copyright 2025 Oxide Computer Company

// Port Bitmap Check Table

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding this.

zeeshanlakhaniand others added 2 commits January 13, 2026 22:21
This diffset handles our move toward ASM groups being able to have source
IPs.
Includes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source multicast filtering
- Add source filter normalization: when Any is present, collapse to single
/0 entry; empty sources treated as allow-any
- API versioning
- Add tag ownership validation for group updates and deletes (v4 API)
- Add v2/v3 API version adapters for backward compatibility
- Fix test_service_ipv4_unknown_address to set NAT-only on correct port
- #172
- I had to fix this here, as it was failing consistently locally.
Comment thread.cargo/config.toml

# Workaround for omicron's bootstore transitive dependency on pq-sys
[env]
DEP_PQ_LIBDIRS = "1"

@zeeshanlakhanizeeshanlakhaniJan 14, 2026

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sadly, this is now always necessary, having updated to a new Omicron commit. It's on maghemite too: https://github.com/oxidecomputer/maghemite/blob/main/.cargo/config.toml#L13.

Comment threaddpd-client/tests/integration_tests/service.rs Outdated
@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow admin-scoped to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycleJan 14, 2026
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@FelixMcFelix@rcgoodfellow I had to rework the API mgmt here, but this is now ready for another look.

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

PR description updated btw to capture everything here.

@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycleJan 15, 2026
zeeshanlakhaniand others added 2 commits January 15, 2026 01:04
…4::/16
As per Omicron, customers can use admin-local IPv6 multicast addresses
(ff04::/16) for external groups, except for the reserved underlay subnet
(ff04::/64) which is used for internal underlay multicast allocation.
Changes:
- switch external-group validation from validate_not_admin_local_ipv6()
to validate_not_underlay_subnet()
- validate_not_underlay_subnet() now only rejects ff04::/64
- validate_nat_target() now requires NAT IPs in UNDERLAY_MULTICAST_SUBNET
- VLAN tagging logic uses UNDERLAY_MULTICAST_SUBNET,
removed dead is_unique_local() check (multicast IPs can't be ULA)
- removed unused IPV6_SCOPE_MASK, IPV6_ULA_MASK/PATTERN from P4
- removed dead ULA entry from mcast_tag_check table (const size = 1)
- Updated integration test assertions, added unit tests
API v4 (MCAST_STRICT_UNDERLAY) changes:
- Renamed AdminScopedIpv6 to UnderlayMulticastIpv6 to better reflect its
purpose as the underlay multicast subnet type
- Tightened validation from ff04::/16 (admin-local scope) to ff04::/64
to match Omicron's UNDERLAY_MULTICAST_SUBNET allocation
- Tag validation now required for update/delete operations (as before)
API v3 backward compatibility:
- Added v3::AdminScopedIpv6 type that accepts the broader ff04::/16 range
- v3 endpoints use v3::MulticastUnderlayGroupIpParam and convert to the
v4 type with appropriate error handling for out-of-range addresses
@zeeshanlakhanizeeshanlakhani self-assigned this Jan 20, 2026
@zeeshanlakhani

zeeshanlakhani commented Jan 21, 2026

Copy link
Copy Markdown
ContributorAuthor

Same thing here. I'll get to the API updates when ready, but it'd be good to get re-review here @FelixMcFelix@rcgoodfellow.

@zeeshanlakhani
zeeshanlakhani changed the base branch from main to zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:25
@zeeshanlakhani
zeeshanlakhani deleted the branch zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:26
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Going to close and re-open, due to so many merge commits.

zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@zeeshanlakhani@rcgoodfellow@FelixMcFelix
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle - #162

Closed
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet
Closed

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle#162
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet

Conversation

@zeeshanlakhani

@zeeshanlakhanizeeshanlakhani commented Dec 1, 2025

Copy link
Copy Markdown
Contributor

This PR aligns with the implicit lifecycle work that was recently merged into Omicron: oxidecomputer/omicron#9450.

Previously, internal/underlay multicast groups accepted admin-configured addresses, including admin-local (ff04), site-local (ff05), and org-local (ff08). This narrows the scope to only admin-local (ff04::/16), with ff04::/64 reserved for Omicron's internal underlay allocation.

The first set of key changes included:

  • Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
    • Update P4 table entries to only match admin-local (size 4→2) Omicron-focused underlay
  • Update to from oxnet v0.1.4
  • Bump to API versions from 2->3 and 3->4.
  • Only ff04::/64 is reserved for Omicron's internal underlay multicast allocation
    • Customers can use other admin-local /64s (e.g., ff04:0:0:1::/64) for external groups
  • validate_not_underlay_subnet() blocks ff04::/64 for external group creation
  • validate_nat_target() requires NAT IPs be within ff04::/64
  • P4 mcast_tag_check matches only ff04::/64 (removed dead ULA entry)
  • Update README with OpenAPI generation instructions
  • Use new multicast subnet constants from omicron-common for validation

After the Omicron work finally landed, which this PR relied on, we also addressed ASM groups with sources and explicit tagging:

  • ASM source filtering: Source filters are now allowed on ASM addresses (previously SSM-only). IpSrc::Subnet was replaced with IpSrc::Any for any-source matching.

  • P4 source filter changes: The source filter tables changed from exact to lpm matching on IPv6, and the multicast check was broadened from SSM-only ranges (232.0.0.0/8, ff3x::/16) to all multicast (224.0.0.0/4, ff00::/8).

  • Tag ownership: Multicast groups now require tag-based validation for mutations (delete/update) in API v4 (current). Tags are assigned at creation (user-provided or auto-generated as {uuid}:{group_ip}). Tags cannot be changed post-creation and must match for mutations; this is enforced by requiring the existing tag, not by rejecting tag-change requests. This prevents accidental modification or deletion of groups associated with other components, and better works with Omicron's retry model.

The API structure is now modeled as:

  • v4 = TAG_OWNERSHIP: required tags for delete/update as query params, IpSrc::Any,
    underlay subnet restricted to ff04::/64 (not all of ff04::/16)
  • v3 = SOURCE_FILTER_ANY: optional tags, IpSrc::Any
  • v2 = DUAL_STACK_NAT_WORKFLOW: optional tags, IpSrc::Subnet (from main)
  • v1 = INITIAL (from main)

This PR is a precursor to a follow-up PR that leverages
updated code in `omicron-common`. This gets dendrite
in line with Omicron `main`, capturing an upstream
type change that we needed to accomodate.
Comment threadCargo.toml Outdated
Previously, internal multicast groups accepted admin-scoped addresses
including admin-local (ff04), site-local (ff05), and org-local (ff08).
This narrows the scope to only admin-local (ff04::/16), which is what
Omicron *now* dictates.
- [ ] This should be merged after
oxidecomputer/omicron#9450 is reviewed
and merged into Omicron. We now make Dendrite/Dpd match Omicron
consistently for validation.
Key changes:
- Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
- Update P4 table entries to only match admin-local (size 4→2)
- Add ADMIN_LOCAL_PREFIX const to dpd-types with RFC doc links
- Update validation to use `is_admin_local_multicast()` from oxnet v0.1.4
- Bump to API version 2 for doc changes (only)
- Update README with OpenAPI generation instructions
- Use new multicast subnet constants from `omicron-common` for validation
Base automatically changed from zl/omicron-changes-from-main to mainDecember 11, 2025 03:06
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow updated for your review.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Comment threaddpd/p4/port_bitmap_check.p4 Outdated
Comment threaddpd/p4/sidecar.p4 Outdated
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Yep. No questions, just my bad in context. Fixed.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing up those comments!

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow, let me know if you'd like another look at this. I'll be doing a follow-up PR as well on some ssm/asm updates.

//
// Copyright 2025 Oxide Computer Company

// Port Bitmap Check Table

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding this.

zeeshanlakhaniand others added 2 commits January 13, 2026 22:21
This diffset handles our move toward ASM groups being able to have source
IPs.
Includes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source multicast filtering
- Add source filter normalization: when Any is present, collapse to single
/0 entry; empty sources treated as allow-any
- API versioning
- Add tag ownership validation for group updates and deletes (v4 API)
- Add v2/v3 API version adapters for backward compatibility
- Fix test_service_ipv4_unknown_address to set NAT-only on correct port
- #172
- I had to fix this here, as it was failing consistently locally.
Comment thread.cargo/config.toml

# Workaround for omicron's bootstore transitive dependency on pq-sys
[env]
DEP_PQ_LIBDIRS = "1"

@zeeshanlakhanizeeshanlakhaniJan 14, 2026

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sadly, this is now always necessary, having updated to a new Omicron commit. It's on maghemite too: https://github.com/oxidecomputer/maghemite/blob/main/.cargo/config.toml#L13.

Comment threaddpd-client/tests/integration_tests/service.rs Outdated
@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow admin-scoped to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycleJan 14, 2026
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@FelixMcFelix@rcgoodfellow I had to rework the API mgmt here, but this is now ready for another look.

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

PR description updated btw to capture everything here.

@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycleJan 15, 2026
zeeshanlakhaniand others added 2 commits January 15, 2026 01:04
…4::/16
As per Omicron, customers can use admin-local IPv6 multicast addresses
(ff04::/16) for external groups, except for the reserved underlay subnet
(ff04::/64) which is used for internal underlay multicast allocation.
Changes:
- switch external-group validation from validate_not_admin_local_ipv6()
to validate_not_underlay_subnet()
- validate_not_underlay_subnet() now only rejects ff04::/64
- validate_nat_target() now requires NAT IPs in UNDERLAY_MULTICAST_SUBNET
- VLAN tagging logic uses UNDERLAY_MULTICAST_SUBNET,
removed dead is_unique_local() check (multicast IPs can't be ULA)
- removed unused IPV6_SCOPE_MASK, IPV6_ULA_MASK/PATTERN from P4
- removed dead ULA entry from mcast_tag_check table (const size = 1)
- Updated integration test assertions, added unit tests
API v4 (MCAST_STRICT_UNDERLAY) changes:
- Renamed AdminScopedIpv6 to UnderlayMulticastIpv6 to better reflect its
purpose as the underlay multicast subnet type
- Tightened validation from ff04::/16 (admin-local scope) to ff04::/64
to match Omicron's UNDERLAY_MULTICAST_SUBNET allocation
- Tag validation now required for update/delete operations (as before)
API v3 backward compatibility:
- Added v3::AdminScopedIpv6 type that accepts the broader ff04::/16 range
- v3 endpoints use v3::MulticastUnderlayGroupIpParam and convert to the
v4 type with appropriate error handling for out-of-range addresses
@zeeshanlakhanizeeshanlakhani self-assigned this Jan 20, 2026
@zeeshanlakhani

zeeshanlakhani commented Jan 21, 2026

Copy link
Copy Markdown
ContributorAuthor

Same thing here. I'll get to the API updates when ready, but it'd be good to get re-review here @FelixMcFelix@rcgoodfellow.

@zeeshanlakhani
zeeshanlakhani changed the base branch from main to zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:25
@zeeshanlakhani
zeeshanlakhani deleted the branch zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:26
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Going to close and re-open, due to so many merge commits.

zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@zeeshanlakhani@rcgoodfellow@FelixMcFelix
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle - #162

Closed
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet
Closed

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle#162
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet

Conversation

@zeeshanlakhani

@zeeshanlakhanizeeshanlakhani commented Dec 1, 2025

Copy link
Copy Markdown
Contributor

This PR aligns with the implicit lifecycle work that was recently merged into Omicron: oxidecomputer/omicron#9450.

Previously, internal/underlay multicast groups accepted admin-configured addresses, including admin-local (ff04), site-local (ff05), and org-local (ff08). This narrows the scope to only admin-local (ff04::/16), with ff04::/64 reserved for Omicron's internal underlay allocation.

The first set of key changes included:

  • Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
    • Update P4 table entries to only match admin-local (size 4→2) Omicron-focused underlay
  • Update to from oxnet v0.1.4
  • Bump to API versions from 2->3 and 3->4.
  • Only ff04::/64 is reserved for Omicron's internal underlay multicast allocation
    • Customers can use other admin-local /64s (e.g., ff04:0:0:1::/64) for external groups
  • validate_not_underlay_subnet() blocks ff04::/64 for external group creation
  • validate_nat_target() requires NAT IPs be within ff04::/64
  • P4 mcast_tag_check matches only ff04::/64 (removed dead ULA entry)
  • Update README with OpenAPI generation instructions
  • Use new multicast subnet constants from omicron-common for validation

After the Omicron work finally landed, which this PR relied on, we also addressed ASM groups with sources and explicit tagging:

  • ASM source filtering: Source filters are now allowed on ASM addresses (previously SSM-only). IpSrc::Subnet was replaced with IpSrc::Any for any-source matching.

  • P4 source filter changes: The source filter tables changed from exact to lpm matching on IPv6, and the multicast check was broadened from SSM-only ranges (232.0.0.0/8, ff3x::/16) to all multicast (224.0.0.0/4, ff00::/8).

  • Tag ownership: Multicast groups now require tag-based validation for mutations (delete/update) in API v4 (current). Tags are assigned at creation (user-provided or auto-generated as {uuid}:{group_ip}). Tags cannot be changed post-creation and must match for mutations; this is enforced by requiring the existing tag, not by rejecting tag-change requests. This prevents accidental modification or deletion of groups associated with other components, and better works with Omicron's retry model.

The API structure is now modeled as:

  • v4 = TAG_OWNERSHIP: required tags for delete/update as query params, IpSrc::Any,
    underlay subnet restricted to ff04::/64 (not all of ff04::/16)
  • v3 = SOURCE_FILTER_ANY: optional tags, IpSrc::Any
  • v2 = DUAL_STACK_NAT_WORKFLOW: optional tags, IpSrc::Subnet (from main)
  • v1 = INITIAL (from main)

This PR is a precursor to a follow-up PR that leverages
updated code in `omicron-common`. This gets dendrite
in line with Omicron `main`, capturing an upstream
type change that we needed to accomodate.
Comment threadCargo.toml Outdated
Previously, internal multicast groups accepted admin-scoped addresses
including admin-local (ff04), site-local (ff05), and org-local (ff08).
This narrows the scope to only admin-local (ff04::/16), which is what
Omicron *now* dictates.
- [ ] This should be merged after
oxidecomputer/omicron#9450 is reviewed
and merged into Omicron. We now make Dendrite/Dpd match Omicron
consistently for validation.
Key changes:
- Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
- Update P4 table entries to only match admin-local (size 4→2)
- Add ADMIN_LOCAL_PREFIX const to dpd-types with RFC doc links
- Update validation to use `is_admin_local_multicast()` from oxnet v0.1.4
- Bump to API version 2 for doc changes (only)
- Update README with OpenAPI generation instructions
- Use new multicast subnet constants from `omicron-common` for validation
Base automatically changed from zl/omicron-changes-from-main to mainDecember 11, 2025 03:06
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow updated for your review.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Comment threaddpd/p4/port_bitmap_check.p4 Outdated
Comment threaddpd/p4/sidecar.p4 Outdated
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Yep. No questions, just my bad in context. Fixed.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing up those comments!

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow, let me know if you'd like another look at this. I'll be doing a follow-up PR as well on some ssm/asm updates.

//
// Copyright 2025 Oxide Computer Company

// Port Bitmap Check Table

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding this.

zeeshanlakhaniand others added 2 commits January 13, 2026 22:21
This diffset handles our move toward ASM groups being able to have source
IPs.
Includes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source multicast filtering
- Add source filter normalization: when Any is present, collapse to single
/0 entry; empty sources treated as allow-any
- API versioning
- Add tag ownership validation for group updates and deletes (v4 API)
- Add v2/v3 API version adapters for backward compatibility
- Fix test_service_ipv4_unknown_address to set NAT-only on correct port
- #172
- I had to fix this here, as it was failing consistently locally.
Comment thread.cargo/config.toml

# Workaround for omicron's bootstore transitive dependency on pq-sys
[env]
DEP_PQ_LIBDIRS = "1"

@zeeshanlakhanizeeshanlakhaniJan 14, 2026

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sadly, this is now always necessary, having updated to a new Omicron commit. It's on maghemite too: https://github.com/oxidecomputer/maghemite/blob/main/.cargo/config.toml#L13.

Comment threaddpd-client/tests/integration_tests/service.rs Outdated
@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow admin-scoped to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycleJan 14, 2026
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@FelixMcFelix@rcgoodfellow I had to rework the API mgmt here, but this is now ready for another look.

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

PR description updated btw to capture everything here.

@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycleJan 15, 2026
zeeshanlakhaniand others added 2 commits January 15, 2026 01:04
…4::/16
As per Omicron, customers can use admin-local IPv6 multicast addresses
(ff04::/16) for external groups, except for the reserved underlay subnet
(ff04::/64) which is used for internal underlay multicast allocation.
Changes:
- switch external-group validation from validate_not_admin_local_ipv6()
to validate_not_underlay_subnet()
- validate_not_underlay_subnet() now only rejects ff04::/64
- validate_nat_target() now requires NAT IPs in UNDERLAY_MULTICAST_SUBNET
- VLAN tagging logic uses UNDERLAY_MULTICAST_SUBNET,
removed dead is_unique_local() check (multicast IPs can't be ULA)
- removed unused IPV6_SCOPE_MASK, IPV6_ULA_MASK/PATTERN from P4
- removed dead ULA entry from mcast_tag_check table (const size = 1)
- Updated integration test assertions, added unit tests
API v4 (MCAST_STRICT_UNDERLAY) changes:
- Renamed AdminScopedIpv6 to UnderlayMulticastIpv6 to better reflect its
purpose as the underlay multicast subnet type
- Tightened validation from ff04::/16 (admin-local scope) to ff04::/64
to match Omicron's UNDERLAY_MULTICAST_SUBNET allocation
- Tag validation now required for update/delete operations (as before)
API v3 backward compatibility:
- Added v3::AdminScopedIpv6 type that accepts the broader ff04::/16 range
- v3 endpoints use v3::MulticastUnderlayGroupIpParam and convert to the
v4 type with appropriate error handling for out-of-range addresses
@zeeshanlakhanizeeshanlakhani self-assigned this Jan 20, 2026
@zeeshanlakhani

zeeshanlakhani commented Jan 21, 2026

Copy link
Copy Markdown
ContributorAuthor

Same thing here. I'll get to the API updates when ready, but it'd be good to get re-review here @FelixMcFelix@rcgoodfellow.

@zeeshanlakhani
zeeshanlakhani changed the base branch from main to zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:25
@zeeshanlakhani
zeeshanlakhani deleted the branch zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:26
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Going to close and re-open, due to so many merge commits.

zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@zeeshanlakhani@rcgoodfellow@FelixMcFelix
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle - #162

Closed
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet
Closed

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle#162
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet

Conversation

@zeeshanlakhani

@zeeshanlakhanizeeshanlakhani commented Dec 1, 2025

Copy link
Copy Markdown
Contributor

This PR aligns with the implicit lifecycle work that was recently merged into Omicron: oxidecomputer/omicron#9450.

Previously, internal/underlay multicast groups accepted admin-configured addresses, including admin-local (ff04), site-local (ff05), and org-local (ff08). This narrows the scope to only admin-local (ff04::/16), with ff04::/64 reserved for Omicron's internal underlay allocation.

The first set of key changes included:

  • Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
    • Update P4 table entries to only match admin-local (size 4→2) Omicron-focused underlay
  • Update to from oxnet v0.1.4
  • Bump to API versions from 2->3 and 3->4.
  • Only ff04::/64 is reserved for Omicron's internal underlay multicast allocation
    • Customers can use other admin-local /64s (e.g., ff04:0:0:1::/64) for external groups
  • validate_not_underlay_subnet() blocks ff04::/64 for external group creation
  • validate_nat_target() requires NAT IPs be within ff04::/64
  • P4 mcast_tag_check matches only ff04::/64 (removed dead ULA entry)
  • Update README with OpenAPI generation instructions
  • Use new multicast subnet constants from omicron-common for validation

After the Omicron work finally landed, which this PR relied on, we also addressed ASM groups with sources and explicit tagging:

  • ASM source filtering: Source filters are now allowed on ASM addresses (previously SSM-only). IpSrc::Subnet was replaced with IpSrc::Any for any-source matching.

  • P4 source filter changes: The source filter tables changed from exact to lpm matching on IPv6, and the multicast check was broadened from SSM-only ranges (232.0.0.0/8, ff3x::/16) to all multicast (224.0.0.0/4, ff00::/8).

  • Tag ownership: Multicast groups now require tag-based validation for mutations (delete/update) in API v4 (current). Tags are assigned at creation (user-provided or auto-generated as {uuid}:{group_ip}). Tags cannot be changed post-creation and must match for mutations; this is enforced by requiring the existing tag, not by rejecting tag-change requests. This prevents accidental modification or deletion of groups associated with other components, and better works with Omicron's retry model.

The API structure is now modeled as:

  • v4 = TAG_OWNERSHIP: required tags for delete/update as query params, IpSrc::Any,
    underlay subnet restricted to ff04::/64 (not all of ff04::/16)
  • v3 = SOURCE_FILTER_ANY: optional tags, IpSrc::Any
  • v2 = DUAL_STACK_NAT_WORKFLOW: optional tags, IpSrc::Subnet (from main)
  • v1 = INITIAL (from main)

This PR is a precursor to a follow-up PR that leverages
updated code in `omicron-common`. This gets dendrite
in line with Omicron `main`, capturing an upstream
type change that we needed to accomodate.
Comment threadCargo.toml Outdated
Previously, internal multicast groups accepted admin-scoped addresses
including admin-local (ff04), site-local (ff05), and org-local (ff08).
This narrows the scope to only admin-local (ff04::/16), which is what
Omicron *now* dictates.
- [ ] This should be merged after
oxidecomputer/omicron#9450 is reviewed
and merged into Omicron. We now make Dendrite/Dpd match Omicron
consistently for validation.
Key changes:
- Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
- Update P4 table entries to only match admin-local (size 4→2)
- Add ADMIN_LOCAL_PREFIX const to dpd-types with RFC doc links
- Update validation to use `is_admin_local_multicast()` from oxnet v0.1.4
- Bump to API version 2 for doc changes (only)
- Update README with OpenAPI generation instructions
- Use new multicast subnet constants from `omicron-common` for validation
Base automatically changed from zl/omicron-changes-from-main to mainDecember 11, 2025 03:06
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow updated for your review.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Comment threaddpd/p4/port_bitmap_check.p4 Outdated
Comment threaddpd/p4/sidecar.p4 Outdated
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Yep. No questions, just my bad in context. Fixed.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing up those comments!

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow, let me know if you'd like another look at this. I'll be doing a follow-up PR as well on some ssm/asm updates.

//
// Copyright 2025 Oxide Computer Company

// Port Bitmap Check Table

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding this.

zeeshanlakhaniand others added 2 commits January 13, 2026 22:21
This diffset handles our move toward ASM groups being able to have source
IPs.
Includes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source multicast filtering
- Add source filter normalization: when Any is present, collapse to single
/0 entry; empty sources treated as allow-any
- API versioning
- Add tag ownership validation for group updates and deletes (v4 API)
- Add v2/v3 API version adapters for backward compatibility
- Fix test_service_ipv4_unknown_address to set NAT-only on correct port
- #172
- I had to fix this here, as it was failing consistently locally.
Comment thread.cargo/config.toml

# Workaround for omicron's bootstore transitive dependency on pq-sys
[env]
DEP_PQ_LIBDIRS = "1"

@zeeshanlakhanizeeshanlakhaniJan 14, 2026

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sadly, this is now always necessary, having updated to a new Omicron commit. It's on maghemite too: https://github.com/oxidecomputer/maghemite/blob/main/.cargo/config.toml#L13.

Comment threaddpd-client/tests/integration_tests/service.rs Outdated
@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow admin-scoped to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycleJan 14, 2026
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@FelixMcFelix@rcgoodfellow I had to rework the API mgmt here, but this is now ready for another look.

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

PR description updated btw to capture everything here.

@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycleJan 15, 2026
zeeshanlakhaniand others added 2 commits January 15, 2026 01:04
…4::/16
As per Omicron, customers can use admin-local IPv6 multicast addresses
(ff04::/16) for external groups, except for the reserved underlay subnet
(ff04::/64) which is used for internal underlay multicast allocation.
Changes:
- switch external-group validation from validate_not_admin_local_ipv6()
to validate_not_underlay_subnet()
- validate_not_underlay_subnet() now only rejects ff04::/64
- validate_nat_target() now requires NAT IPs in UNDERLAY_MULTICAST_SUBNET
- VLAN tagging logic uses UNDERLAY_MULTICAST_SUBNET,
removed dead is_unique_local() check (multicast IPs can't be ULA)
- removed unused IPV6_SCOPE_MASK, IPV6_ULA_MASK/PATTERN from P4
- removed dead ULA entry from mcast_tag_check table (const size = 1)
- Updated integration test assertions, added unit tests
API v4 (MCAST_STRICT_UNDERLAY) changes:
- Renamed AdminScopedIpv6 to UnderlayMulticastIpv6 to better reflect its
purpose as the underlay multicast subnet type
- Tightened validation from ff04::/16 (admin-local scope) to ff04::/64
to match Omicron's UNDERLAY_MULTICAST_SUBNET allocation
- Tag validation now required for update/delete operations (as before)
API v3 backward compatibility:
- Added v3::AdminScopedIpv6 type that accepts the broader ff04::/16 range
- v3 endpoints use v3::MulticastUnderlayGroupIpParam and convert to the
v4 type with appropriate error handling for out-of-range addresses
@zeeshanlakhanizeeshanlakhani self-assigned this Jan 20, 2026
@zeeshanlakhani

zeeshanlakhani commented Jan 21, 2026

Copy link
Copy Markdown
ContributorAuthor

Same thing here. I'll get to the API updates when ready, but it'd be good to get re-review here @FelixMcFelix@rcgoodfellow.

@zeeshanlakhani
zeeshanlakhani changed the base branch from main to zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:25
@zeeshanlakhani
zeeshanlakhani deleted the branch zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:26
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Going to close and re-open, due to so many merge commits.

zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@zeeshanlakhani@rcgoodfellow@FelixMcFelix
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle - #162

Closed
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet
Closed

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle#162
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet

Conversation

@zeeshanlakhani

@zeeshanlakhanizeeshanlakhani commented Dec 1, 2025

Copy link
Copy Markdown
Contributor

This PR aligns with the implicit lifecycle work that was recently merged into Omicron: oxidecomputer/omicron#9450.

Previously, internal/underlay multicast groups accepted admin-configured addresses, including admin-local (ff04), site-local (ff05), and org-local (ff08). This narrows the scope to only admin-local (ff04::/16), with ff04::/64 reserved for Omicron's internal underlay allocation.

The first set of key changes included:

  • Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
    • Update P4 table entries to only match admin-local (size 4→2) Omicron-focused underlay
  • Update to from oxnet v0.1.4
  • Bump to API versions from 2->3 and 3->4.
  • Only ff04::/64 is reserved for Omicron's internal underlay multicast allocation
    • Customers can use other admin-local /64s (e.g., ff04:0:0:1::/64) for external groups
  • validate_not_underlay_subnet() blocks ff04::/64 for external group creation
  • validate_nat_target() requires NAT IPs be within ff04::/64
  • P4 mcast_tag_check matches only ff04::/64 (removed dead ULA entry)
  • Update README with OpenAPI generation instructions
  • Use new multicast subnet constants from omicron-common for validation

After the Omicron work finally landed, which this PR relied on, we also addressed ASM groups with sources and explicit tagging:

  • ASM source filtering: Source filters are now allowed on ASM addresses (previously SSM-only). IpSrc::Subnet was replaced with IpSrc::Any for any-source matching.

  • P4 source filter changes: The source filter tables changed from exact to lpm matching on IPv6, and the multicast check was broadened from SSM-only ranges (232.0.0.0/8, ff3x::/16) to all multicast (224.0.0.0/4, ff00::/8).

  • Tag ownership: Multicast groups now require tag-based validation for mutations (delete/update) in API v4 (current). Tags are assigned at creation (user-provided or auto-generated as {uuid}:{group_ip}). Tags cannot be changed post-creation and must match for mutations; this is enforced by requiring the existing tag, not by rejecting tag-change requests. This prevents accidental modification or deletion of groups associated with other components, and better works with Omicron's retry model.

The API structure is now modeled as:

  • v4 = TAG_OWNERSHIP: required tags for delete/update as query params, IpSrc::Any,
    underlay subnet restricted to ff04::/64 (not all of ff04::/16)
  • v3 = SOURCE_FILTER_ANY: optional tags, IpSrc::Any
  • v2 = DUAL_STACK_NAT_WORKFLOW: optional tags, IpSrc::Subnet (from main)
  • v1 = INITIAL (from main)

This PR is a precursor to a follow-up PR that leverages
updated code in `omicron-common`. This gets dendrite
in line with Omicron `main`, capturing an upstream
type change that we needed to accomodate.
Comment threadCargo.toml Outdated
Previously, internal multicast groups accepted admin-scoped addresses
including admin-local (ff04), site-local (ff05), and org-local (ff08).
This narrows the scope to only admin-local (ff04::/16), which is what
Omicron *now* dictates.
- [ ] This should be merged after
oxidecomputer/omicron#9450 is reviewed
and merged into Omicron. We now make Dendrite/Dpd match Omicron
consistently for validation.
Key changes:
- Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
- Update P4 table entries to only match admin-local (size 4→2)
- Add ADMIN_LOCAL_PREFIX const to dpd-types with RFC doc links
- Update validation to use `is_admin_local_multicast()` from oxnet v0.1.4
- Bump to API version 2 for doc changes (only)
- Update README with OpenAPI generation instructions
- Use new multicast subnet constants from `omicron-common` for validation
Base automatically changed from zl/omicron-changes-from-main to mainDecember 11, 2025 03:06
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow updated for your review.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Comment threaddpd/p4/port_bitmap_check.p4 Outdated
Comment threaddpd/p4/sidecar.p4 Outdated
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Yep. No questions, just my bad in context. Fixed.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing up those comments!

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow, let me know if you'd like another look at this. I'll be doing a follow-up PR as well on some ssm/asm updates.

//
// Copyright 2025 Oxide Computer Company

// Port Bitmap Check Table

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding this.

zeeshanlakhaniand others added 2 commits January 13, 2026 22:21
This diffset handles our move toward ASM groups being able to have source
IPs.
Includes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source multicast filtering
- Add source filter normalization: when Any is present, collapse to single
/0 entry; empty sources treated as allow-any
- API versioning
- Add tag ownership validation for group updates and deletes (v4 API)
- Add v2/v3 API version adapters for backward compatibility
- Fix test_service_ipv4_unknown_address to set NAT-only on correct port
- #172
- I had to fix this here, as it was failing consistently locally.
Comment thread.cargo/config.toml

# Workaround for omicron's bootstore transitive dependency on pq-sys
[env]
DEP_PQ_LIBDIRS = "1"

@zeeshanlakhanizeeshanlakhaniJan 14, 2026

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sadly, this is now always necessary, having updated to a new Omicron commit. It's on maghemite too: https://github.com/oxidecomputer/maghemite/blob/main/.cargo/config.toml#L13.

Comment threaddpd-client/tests/integration_tests/service.rs Outdated
@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow admin-scoped to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycleJan 14, 2026
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@FelixMcFelix@rcgoodfellow I had to rework the API mgmt here, but this is now ready for another look.

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

PR description updated btw to capture everything here.

@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycleJan 15, 2026
zeeshanlakhaniand others added 2 commits January 15, 2026 01:04
…4::/16
As per Omicron, customers can use admin-local IPv6 multicast addresses
(ff04::/16) for external groups, except for the reserved underlay subnet
(ff04::/64) which is used for internal underlay multicast allocation.
Changes:
- switch external-group validation from validate_not_admin_local_ipv6()
to validate_not_underlay_subnet()
- validate_not_underlay_subnet() now only rejects ff04::/64
- validate_nat_target() now requires NAT IPs in UNDERLAY_MULTICAST_SUBNET
- VLAN tagging logic uses UNDERLAY_MULTICAST_SUBNET,
removed dead is_unique_local() check (multicast IPs can't be ULA)
- removed unused IPV6_SCOPE_MASK, IPV6_ULA_MASK/PATTERN from P4
- removed dead ULA entry from mcast_tag_check table (const size = 1)
- Updated integration test assertions, added unit tests
API v4 (MCAST_STRICT_UNDERLAY) changes:
- Renamed AdminScopedIpv6 to UnderlayMulticastIpv6 to better reflect its
purpose as the underlay multicast subnet type
- Tightened validation from ff04::/16 (admin-local scope) to ff04::/64
to match Omicron's UNDERLAY_MULTICAST_SUBNET allocation
- Tag validation now required for update/delete operations (as before)
API v3 backward compatibility:
- Added v3::AdminScopedIpv6 type that accepts the broader ff04::/16 range
- v3 endpoints use v3::MulticastUnderlayGroupIpParam and convert to the
v4 type with appropriate error handling for out-of-range addresses
@zeeshanlakhanizeeshanlakhani self-assigned this Jan 20, 2026
@zeeshanlakhani

zeeshanlakhani commented Jan 21, 2026

Copy link
Copy Markdown
ContributorAuthor

Same thing here. I'll get to the API updates when ready, but it'd be good to get re-review here @FelixMcFelix@rcgoodfellow.

@zeeshanlakhani
zeeshanlakhani changed the base branch from main to zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:25
@zeeshanlakhani
zeeshanlakhani deleted the branch zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:26
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Going to close and re-open, due to so many merge commits.

zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@zeeshanlakhani@rcgoodfellow@FelixMcFelix
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle - #162

Closed
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet
Closed

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle#162
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet

Conversation

@zeeshanlakhani

@zeeshanlakhanizeeshanlakhani commented Dec 1, 2025

Copy link
Copy Markdown
Contributor

This PR aligns with the implicit lifecycle work that was recently merged into Omicron: oxidecomputer/omicron#9450.

Previously, internal/underlay multicast groups accepted admin-configured addresses, including admin-local (ff04), site-local (ff05), and org-local (ff08). This narrows the scope to only admin-local (ff04::/16), with ff04::/64 reserved for Omicron's internal underlay allocation.

The first set of key changes included:

  • Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
    • Update P4 table entries to only match admin-local (size 4→2) Omicron-focused underlay
  • Update to from oxnet v0.1.4
  • Bump to API versions from 2->3 and 3->4.
  • Only ff04::/64 is reserved for Omicron's internal underlay multicast allocation
    • Customers can use other admin-local /64s (e.g., ff04:0:0:1::/64) for external groups
  • validate_not_underlay_subnet() blocks ff04::/64 for external group creation
  • validate_nat_target() requires NAT IPs be within ff04::/64
  • P4 mcast_tag_check matches only ff04::/64 (removed dead ULA entry)
  • Update README with OpenAPI generation instructions
  • Use new multicast subnet constants from omicron-common for validation

After the Omicron work finally landed, which this PR relied on, we also addressed ASM groups with sources and explicit tagging:

  • ASM source filtering: Source filters are now allowed on ASM addresses (previously SSM-only). IpSrc::Subnet was replaced with IpSrc::Any for any-source matching.

  • P4 source filter changes: The source filter tables changed from exact to lpm matching on IPv6, and the multicast check was broadened from SSM-only ranges (232.0.0.0/8, ff3x::/16) to all multicast (224.0.0.0/4, ff00::/8).

  • Tag ownership: Multicast groups now require tag-based validation for mutations (delete/update) in API v4 (current). Tags are assigned at creation (user-provided or auto-generated as {uuid}:{group_ip}). Tags cannot be changed post-creation and must match for mutations; this is enforced by requiring the existing tag, not by rejecting tag-change requests. This prevents accidental modification or deletion of groups associated with other components, and better works with Omicron's retry model.

The API structure is now modeled as:

  • v4 = TAG_OWNERSHIP: required tags for delete/update as query params, IpSrc::Any,
    underlay subnet restricted to ff04::/64 (not all of ff04::/16)
  • v3 = SOURCE_FILTER_ANY: optional tags, IpSrc::Any
  • v2 = DUAL_STACK_NAT_WORKFLOW: optional tags, IpSrc::Subnet (from main)
  • v1 = INITIAL (from main)

This PR is a precursor to a follow-up PR that leverages
updated code in `omicron-common`. This gets dendrite
in line with Omicron `main`, capturing an upstream
type change that we needed to accomodate.
Comment threadCargo.toml Outdated
Previously, internal multicast groups accepted admin-scoped addresses
including admin-local (ff04), site-local (ff05), and org-local (ff08).
This narrows the scope to only admin-local (ff04::/16), which is what
Omicron *now* dictates.
- [ ] This should be merged after
oxidecomputer/omicron#9450 is reviewed
and merged into Omicron. We now make Dendrite/Dpd match Omicron
consistently for validation.
Key changes:
- Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
- Update P4 table entries to only match admin-local (size 4→2)
- Add ADMIN_LOCAL_PREFIX const to dpd-types with RFC doc links
- Update validation to use `is_admin_local_multicast()` from oxnet v0.1.4
- Bump to API version 2 for doc changes (only)
- Update README with OpenAPI generation instructions
- Use new multicast subnet constants from `omicron-common` for validation
Base automatically changed from zl/omicron-changes-from-main to mainDecember 11, 2025 03:06
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow updated for your review.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Comment threaddpd/p4/port_bitmap_check.p4 Outdated
Comment threaddpd/p4/sidecar.p4 Outdated
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Yep. No questions, just my bad in context. Fixed.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing up those comments!

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow, let me know if you'd like another look at this. I'll be doing a follow-up PR as well on some ssm/asm updates.

//
// Copyright 2025 Oxide Computer Company

// Port Bitmap Check Table

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding this.

zeeshanlakhaniand others added 2 commits January 13, 2026 22:21
This diffset handles our move toward ASM groups being able to have source
IPs.
Includes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source multicast filtering
- Add source filter normalization: when Any is present, collapse to single
/0 entry; empty sources treated as allow-any
- API versioning
- Add tag ownership validation for group updates and deletes (v4 API)
- Add v2/v3 API version adapters for backward compatibility
- Fix test_service_ipv4_unknown_address to set NAT-only on correct port
- #172
- I had to fix this here, as it was failing consistently locally.
Comment thread.cargo/config.toml

# Workaround for omicron's bootstore transitive dependency on pq-sys
[env]
DEP_PQ_LIBDIRS = "1"

@zeeshanlakhanizeeshanlakhaniJan 14, 2026

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sadly, this is now always necessary, having updated to a new Omicron commit. It's on maghemite too: https://github.com/oxidecomputer/maghemite/blob/main/.cargo/config.toml#L13.

Comment threaddpd-client/tests/integration_tests/service.rs Outdated
@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow admin-scoped to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycleJan 14, 2026
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@FelixMcFelix@rcgoodfellow I had to rework the API mgmt here, but this is now ready for another look.

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

PR description updated btw to capture everything here.

@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycleJan 15, 2026
zeeshanlakhaniand others added 2 commits January 15, 2026 01:04
…4::/16
As per Omicron, customers can use admin-local IPv6 multicast addresses
(ff04::/16) for external groups, except for the reserved underlay subnet
(ff04::/64) which is used for internal underlay multicast allocation.
Changes:
- switch external-group validation from validate_not_admin_local_ipv6()
to validate_not_underlay_subnet()
- validate_not_underlay_subnet() now only rejects ff04::/64
- validate_nat_target() now requires NAT IPs in UNDERLAY_MULTICAST_SUBNET
- VLAN tagging logic uses UNDERLAY_MULTICAST_SUBNET,
removed dead is_unique_local() check (multicast IPs can't be ULA)
- removed unused IPV6_SCOPE_MASK, IPV6_ULA_MASK/PATTERN from P4
- removed dead ULA entry from mcast_tag_check table (const size = 1)
- Updated integration test assertions, added unit tests
API v4 (MCAST_STRICT_UNDERLAY) changes:
- Renamed AdminScopedIpv6 to UnderlayMulticastIpv6 to better reflect its
purpose as the underlay multicast subnet type
- Tightened validation from ff04::/16 (admin-local scope) to ff04::/64
to match Omicron's UNDERLAY_MULTICAST_SUBNET allocation
- Tag validation now required for update/delete operations (as before)
API v3 backward compatibility:
- Added v3::AdminScopedIpv6 type that accepts the broader ff04::/16 range
- v3 endpoints use v3::MulticastUnderlayGroupIpParam and convert to the
v4 type with appropriate error handling for out-of-range addresses
@zeeshanlakhanizeeshanlakhani self-assigned this Jan 20, 2026
@zeeshanlakhani

zeeshanlakhani commented Jan 21, 2026

Copy link
Copy Markdown
ContributorAuthor

Same thing here. I'll get to the API updates when ready, but it'd be good to get re-review here @FelixMcFelix@rcgoodfellow.

@zeeshanlakhani
zeeshanlakhani changed the base branch from main to zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:25
@zeeshanlakhani
zeeshanlakhani deleted the branch zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:26
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Going to close and re-open, due to so many merge commits.

zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@zeeshanlakhani@rcgoodfellow@FelixMcFelix
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle - #162

Closed
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet
Closed

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle#162
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet

Conversation

@zeeshanlakhani

@zeeshanlakhanizeeshanlakhani commented Dec 1, 2025

Copy link
Copy Markdown
Contributor

This PR aligns with the implicit lifecycle work that was recently merged into Omicron: oxidecomputer/omicron#9450.

Previously, internal/underlay multicast groups accepted admin-configured addresses, including admin-local (ff04), site-local (ff05), and org-local (ff08). This narrows the scope to only admin-local (ff04::/16), with ff04::/64 reserved for Omicron's internal underlay allocation.

The first set of key changes included:

  • Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
    • Update P4 table entries to only match admin-local (size 4→2) Omicron-focused underlay
  • Update to from oxnet v0.1.4
  • Bump to API versions from 2->3 and 3->4.
  • Only ff04::/64 is reserved for Omicron's internal underlay multicast allocation
    • Customers can use other admin-local /64s (e.g., ff04:0:0:1::/64) for external groups
  • validate_not_underlay_subnet() blocks ff04::/64 for external group creation
  • validate_nat_target() requires NAT IPs be within ff04::/64
  • P4 mcast_tag_check matches only ff04::/64 (removed dead ULA entry)
  • Update README with OpenAPI generation instructions
  • Use new multicast subnet constants from omicron-common for validation

After the Omicron work finally landed, which this PR relied on, we also addressed ASM groups with sources and explicit tagging:

  • ASM source filtering: Source filters are now allowed on ASM addresses (previously SSM-only). IpSrc::Subnet was replaced with IpSrc::Any for any-source matching.

  • P4 source filter changes: The source filter tables changed from exact to lpm matching on IPv6, and the multicast check was broadened from SSM-only ranges (232.0.0.0/8, ff3x::/16) to all multicast (224.0.0.0/4, ff00::/8).

  • Tag ownership: Multicast groups now require tag-based validation for mutations (delete/update) in API v4 (current). Tags are assigned at creation (user-provided or auto-generated as {uuid}:{group_ip}). Tags cannot be changed post-creation and must match for mutations; this is enforced by requiring the existing tag, not by rejecting tag-change requests. This prevents accidental modification or deletion of groups associated with other components, and better works with Omicron's retry model.

The API structure is now modeled as:

  • v4 = TAG_OWNERSHIP: required tags for delete/update as query params, IpSrc::Any,
    underlay subnet restricted to ff04::/64 (not all of ff04::/16)
  • v3 = SOURCE_FILTER_ANY: optional tags, IpSrc::Any
  • v2 = DUAL_STACK_NAT_WORKFLOW: optional tags, IpSrc::Subnet (from main)
  • v1 = INITIAL (from main)

This PR is a precursor to a follow-up PR that leverages
updated code in `omicron-common`. This gets dendrite
in line with Omicron `main`, capturing an upstream
type change that we needed to accomodate.
Comment threadCargo.toml Outdated
Previously, internal multicast groups accepted admin-scoped addresses
including admin-local (ff04), site-local (ff05), and org-local (ff08).
This narrows the scope to only admin-local (ff04::/16), which is what
Omicron *now* dictates.
- [ ] This should be merged after
oxidecomputer/omicron#9450 is reviewed
and merged into Omicron. We now make Dendrite/Dpd match Omicron
consistently for validation.
Key changes:
- Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
- Update P4 table entries to only match admin-local (size 4→2)
- Add ADMIN_LOCAL_PREFIX const to dpd-types with RFC doc links
- Update validation to use `is_admin_local_multicast()` from oxnet v0.1.4
- Bump to API version 2 for doc changes (only)
- Update README with OpenAPI generation instructions
- Use new multicast subnet constants from `omicron-common` for validation
Base automatically changed from zl/omicron-changes-from-main to mainDecember 11, 2025 03:06
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow updated for your review.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Comment threaddpd/p4/port_bitmap_check.p4 Outdated
Comment threaddpd/p4/sidecar.p4 Outdated
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Yep. No questions, just my bad in context. Fixed.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing up those comments!

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow, let me know if you'd like another look at this. I'll be doing a follow-up PR as well on some ssm/asm updates.

//
// Copyright 2025 Oxide Computer Company

// Port Bitmap Check Table

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding this.

zeeshanlakhaniand others added 2 commits January 13, 2026 22:21
This diffset handles our move toward ASM groups being able to have source
IPs.
Includes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source multicast filtering
- Add source filter normalization: when Any is present, collapse to single
/0 entry; empty sources treated as allow-any
- API versioning
- Add tag ownership validation for group updates and deletes (v4 API)
- Add v2/v3 API version adapters for backward compatibility
- Fix test_service_ipv4_unknown_address to set NAT-only on correct port
- #172
- I had to fix this here, as it was failing consistently locally.
Comment thread.cargo/config.toml

# Workaround for omicron's bootstore transitive dependency on pq-sys
[env]
DEP_PQ_LIBDIRS = "1"

@zeeshanlakhanizeeshanlakhaniJan 14, 2026

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sadly, this is now always necessary, having updated to a new Omicron commit. It's on maghemite too: https://github.com/oxidecomputer/maghemite/blob/main/.cargo/config.toml#L13.

Comment threaddpd-client/tests/integration_tests/service.rs Outdated
@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow admin-scoped to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycleJan 14, 2026
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@FelixMcFelix@rcgoodfellow I had to rework the API mgmt here, but this is now ready for another look.

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

PR description updated btw to capture everything here.

@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycleJan 15, 2026
zeeshanlakhaniand others added 2 commits January 15, 2026 01:04
…4::/16
As per Omicron, customers can use admin-local IPv6 multicast addresses
(ff04::/16) for external groups, except for the reserved underlay subnet
(ff04::/64) which is used for internal underlay multicast allocation.
Changes:
- switch external-group validation from validate_not_admin_local_ipv6()
to validate_not_underlay_subnet()
- validate_not_underlay_subnet() now only rejects ff04::/64
- validate_nat_target() now requires NAT IPs in UNDERLAY_MULTICAST_SUBNET
- VLAN tagging logic uses UNDERLAY_MULTICAST_SUBNET,
removed dead is_unique_local() check (multicast IPs can't be ULA)
- removed unused IPV6_SCOPE_MASK, IPV6_ULA_MASK/PATTERN from P4
- removed dead ULA entry from mcast_tag_check table (const size = 1)
- Updated integration test assertions, added unit tests
API v4 (MCAST_STRICT_UNDERLAY) changes:
- Renamed AdminScopedIpv6 to UnderlayMulticastIpv6 to better reflect its
purpose as the underlay multicast subnet type
- Tightened validation from ff04::/16 (admin-local scope) to ff04::/64
to match Omicron's UNDERLAY_MULTICAST_SUBNET allocation
- Tag validation now required for update/delete operations (as before)
API v3 backward compatibility:
- Added v3::AdminScopedIpv6 type that accepts the broader ff04::/16 range
- v3 endpoints use v3::MulticastUnderlayGroupIpParam and convert to the
v4 type with appropriate error handling for out-of-range addresses
@zeeshanlakhanizeeshanlakhani self-assigned this Jan 20, 2026
@zeeshanlakhani

zeeshanlakhani commented Jan 21, 2026

Copy link
Copy Markdown
ContributorAuthor

Same thing here. I'll get to the API updates when ready, but it'd be good to get re-review here @FelixMcFelix@rcgoodfellow.

@zeeshanlakhani
zeeshanlakhani changed the base branch from main to zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:25
@zeeshanlakhani
zeeshanlakhani deleted the branch zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:26
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Going to close and re-open, due to so many merge commits.

zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@zeeshanlakhani@rcgoodfellow@FelixMcFelix
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle - #162

Closed
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet
Closed

[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycle#162
zeeshanlakhani wants to merge 31 commits into
zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecyclefrom
zl/admin-scope-oxnet

Conversation

@zeeshanlakhani

@zeeshanlakhanizeeshanlakhani commented Dec 1, 2025

Copy link
Copy Markdown
Contributor

This PR aligns with the implicit lifecycle work that was recently merged into Omicron: oxidecomputer/omicron#9450.

Previously, internal/underlay multicast groups accepted admin-configured addresses, including admin-local (ff04), site-local (ff05), and org-local (ff08). This narrows the scope to only admin-local (ff04::/16), with ff04::/64 reserved for Omicron's internal underlay allocation.

The first set of key changes included:

  • Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
    • Update P4 table entries to only match admin-local (size 4→2) Omicron-focused underlay
  • Update to from oxnet v0.1.4
  • Bump to API versions from 2->3 and 3->4.
  • Only ff04::/64 is reserved for Omicron's internal underlay multicast allocation
    • Customers can use other admin-local /64s (e.g., ff04:0:0:1::/64) for external groups
  • validate_not_underlay_subnet() blocks ff04::/64 for external group creation
  • validate_nat_target() requires NAT IPs be within ff04::/64
  • P4 mcast_tag_check matches only ff04::/64 (removed dead ULA entry)
  • Update README with OpenAPI generation instructions
  • Use new multicast subnet constants from omicron-common for validation

After the Omicron work finally landed, which this PR relied on, we also addressed ASM groups with sources and explicit tagging:

  • ASM source filtering: Source filters are now allowed on ASM addresses (previously SSM-only). IpSrc::Subnet was replaced with IpSrc::Any for any-source matching.

  • P4 source filter changes: The source filter tables changed from exact to lpm matching on IPv6, and the multicast check was broadened from SSM-only ranges (232.0.0.0/8, ff3x::/16) to all multicast (224.0.0.0/4, ff00::/8).

  • Tag ownership: Multicast groups now require tag-based validation for mutations (delete/update) in API v4 (current). Tags are assigned at creation (user-provided or auto-generated as {uuid}:{group_ip}). Tags cannot be changed post-creation and must match for mutations; this is enforced by requiring the existing tag, not by rejecting tag-change requests. This prevents accidental modification or deletion of groups associated with other components, and better works with Omicron's retry model.

The API structure is now modeled as:

  • v4 = TAG_OWNERSHIP: required tags for delete/update as query params, IpSrc::Any,
    underlay subnet restricted to ff04::/64 (not all of ff04::/16)
  • v3 = SOURCE_FILTER_ANY: optional tags, IpSrc::Any
  • v2 = DUAL_STACK_NAT_WORKFLOW: optional tags, IpSrc::Subnet (from main)
  • v1 = INITIAL (from main)

This PR is a precursor to a follow-up PR that leverages
updated code in `omicron-common`. This gets dendrite
in line with Omicron `main`, capturing an upstream
type change that we needed to accomodate.
Comment threadCargo.toml Outdated
Previously, internal multicast groups accepted admin-scoped addresses
including admin-local (ff04), site-local (ff05), and org-local (ff08).
This narrows the scope to only admin-local (ff04::/16), which is what
Omicron *now* dictates.
- [ ] This should be merged after
oxidecomputer/omicron#9450 is reviewed
and merged into Omicron. We now make Dendrite/Dpd match Omicron
consistently for validation.
Key changes:
- Remove IPV6_SITE_LOCAL_PATTERN and IPV6_ORG_SCOPE_PATTERN from P4
- Update P4 table entries to only match admin-local (size 4→2)
- Add ADMIN_LOCAL_PREFIX const to dpd-types with RFC doc links
- Update validation to use `is_admin_local_multicast()` from oxnet v0.1.4
- Bump to API version 2 for doc changes (only)
- Update README with OpenAPI generation instructions
- Use new multicast subnet constants from `omicron-common` for validation
Base automatically changed from zl/omicron-changes-from-main to mainDecember 11, 2025 03:06
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow updated for your review.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Comment threaddpd/p4/port_bitmap_check.p4 Outdated
Comment threaddpd/p4/sidecar.p4 Outdated
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Thanks Zeeshan, the updates to the allowed IP families all make sense. Just some questions on the expanded comments on the decapsualtion bitmaps in the dataplane.

Yep. No questions, just my bad in context. Fixed.

@FelixMcFelixFelixMcFelix left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing up those comments!

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@rcgoodfellow, let me know if you'd like another look at this. I'll be doing a follow-up PR as well on some ssm/asm updates.

//
// Copyright 2025 Oxide Computer Company

// Port Bitmap Check Table

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding this.

zeeshanlakhaniand others added 2 commits January 13, 2026 22:21
This diffset handles our move toward ASM groups being able to have source
IPs.
Includes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source multicast filtering
- Add source filter normalization: when Any is present, collapse to single
/0 entry; empty sources treated as allow-any
- API versioning
- Add tag ownership validation for group updates and deletes (v4 API)
- Add v2/v3 API version adapters for backward compatibility
- Fix test_service_ipv4_unknown_address to set NAT-only on correct port
- #172
- I had to fix this here, as it was failing consistently locally.
Comment thread.cargo/config.toml

# Workaround for omicron's bootstore transitive dependency on pq-sys
[env]
DEP_PQ_LIBDIRS = "1"

@zeeshanlakhanizeeshanlakhaniJan 14, 2026

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sadly, this is now always necessary, having updated to a new Omicron commit. It's on maghemite too: https://github.com/oxidecomputer/maghemite/blob/main/.cargo/config.toml#L13.

Comment threaddpd-client/tests/integration_tests/service.rs Outdated
@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow admin-scoped to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycleJan 14, 2026
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

@FelixMcFelix@rcgoodfellow I had to rework the API mgmt here, but this is now ready for another look.

@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

PR description updated btw to capture everything here.

@zeeshanlakhanizeeshanlakhani changed the title [multicast] Narrow to admin-local only & match Omicron updates to mcast lifecycle[multicast] Narrow to admin-local Omicron underlay & match Omicron updates to mcast lifecycleJan 15, 2026
zeeshanlakhaniand others added 2 commits January 15, 2026 01:04
…4::/16
As per Omicron, customers can use admin-local IPv6 multicast addresses
(ff04::/16) for external groups, except for the reserved underlay subnet
(ff04::/64) which is used for internal underlay multicast allocation.
Changes:
- switch external-group validation from validate_not_admin_local_ipv6()
to validate_not_underlay_subnet()
- validate_not_underlay_subnet() now only rejects ff04::/64
- validate_nat_target() now requires NAT IPs in UNDERLAY_MULTICAST_SUBNET
- VLAN tagging logic uses UNDERLAY_MULTICAST_SUBNET,
removed dead is_unique_local() check (multicast IPs can't be ULA)
- removed unused IPV6_SCOPE_MASK, IPV6_ULA_MASK/PATTERN from P4
- removed dead ULA entry from mcast_tag_check table (const size = 1)
- Updated integration test assertions, added unit tests
API v4 (MCAST_STRICT_UNDERLAY) changes:
- Renamed AdminScopedIpv6 to UnderlayMulticastIpv6 to better reflect its
purpose as the underlay multicast subnet type
- Tightened validation from ff04::/16 (admin-local scope) to ff04::/64
to match Omicron's UNDERLAY_MULTICAST_SUBNET allocation
- Tag validation now required for update/delete operations (as before)
API v3 backward compatibility:
- Added v3::AdminScopedIpv6 type that accepts the broader ff04::/16 range
- v3 endpoints use v3::MulticastUnderlayGroupIpParam and convert to the
v4 type with appropriate error handling for out-of-range addresses
@zeeshanlakhanizeeshanlakhani self-assigned this Jan 20, 2026
@zeeshanlakhani

zeeshanlakhani commented Jan 21, 2026

Copy link
Copy Markdown
ContributorAuthor

Same thing here. I'll get to the API updates when ready, but it'd be good to get re-review here @FelixMcFelix@rcgoodfellow.

@zeeshanlakhani
zeeshanlakhani changed the base branch from main to zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:25
@zeeshanlakhani
zeeshanlakhani deleted the branch zl/main.multicast-narrow-to-admin-local-omicron-underlay-match-omicron-updates-to-mcast-lifecycleJanuary 22, 2026 07:26
@zeeshanlakhani

Copy link
Copy Markdown
ContributorAuthor

Going to close and re-open, due to so many merge commits.

zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
zeeshanlakhani added a commit that referenced this pull request Jan 22, 2026
…tering
Re-opening this from #162, as that PR was getting pretty gnarly with a saturation of merge commits. This one deserves a re-review after some added changes to match the Omicron mcast-lifecycle work in oxidecomputer/omicron#9450.
Underlay changes:
- Restrict internal multicast from admin/site/org scoped (ff04, ff05, ff08) to just Omicron's reserved subnet (ff04::/64). These underlay addresses are made unique in Omicron.
- Rename `AdminScopedIpv6` to `UnderlayMulticastIpv6`.
- Simplify P4 to only match ff04::/64.
- Use omicron-common multicast constants for validation.
Source filtering changes:
- Replace IpSrc::Subnet with IpSrc::Any for any-source matching.
- Change IPv6 source filter from exact to LPM match.
- Allow source filters on ASM groups (previously SSM-only).
API changes:
- API v5 adds IpSrc::Any for ASM source filtering.
- API v6 enforces strict underlay subnet validation.
Reviewers: FelixMcFelix, Nieuwejaar, rcgoodfellow
Pull Request: #189
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@zeeshanlakhani@rcgoodfellow@FelixMcFelix