[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission - #2

Draft
zhoubot wants to merge 315 commits into
mainfrom
codex/vpto-hivm-intrinsics
Draft

[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission#2
zhoubot wants to merge 315 commits into
mainfrom
codex/vpto-hivm-intrinsics

Conversation

@zhoubot

@zhoubotzhoubot commented Mar 30, 2026•
edited
Loading

Copy link
Copy Markdown

Summary

This PR lands the PTO Micro Instruction Set backend surface in PTOAS and wires the final HIVM/CCE intrinsic emission path through the LLVM text emitter.

It includes:

  • the PTO Micro Instruction Set dialect/lowering surface, text/LLVM emitters, and backend wiring
  • version selection, ptr-boundary, loop/fusion, and host validation plumbing
  • the PTO Micro Instruction Set spec/manifest/docs and phased regression suites
  • final direct HIVM emitter coverage for the remaining missing micro-instructions
  • a repo-wide terminology pass that replaces user-facing VPTO naming with PTO Micro Instruction Set

Why

The backend work was partially implemented but the final LLVM emitter still had gaps in the direct intrinsic path. In particular, get_buf, rls_buf, copy_ubuf_to_ubuf, ppack, and punpack were implemented elsewhere in the pipeline but were not emitted as HIVM intrinsics from VPTOLLVMEmitter.cpp, and vintlvv2/vdintlvv2 were decoding the wrong part-token enum.

This PR closes that gap, adds regression coverage so implemented micro-ops are checked against the final emitter, and aligns repo-facing terminology on PTO Micro Instruction Set while preserving stable technical identifiers such as the vpto backend flag and existing file/class names.

Impact

User-visible outcomes:

  • --pto-backend=vpto is wired through PTOAS with PTO Micro Instruction Set lowering and testing support.
  • --vpto-emit-hivm-llvm now emits the final HIVM intrinsics for the previously missing micro-op families.
  • the inventory script now fails if an implemented micro-op is missing from the direct HIVM emitter.
  • user-facing docs, diagnostics, and test/readme text now use PTO Micro Instruction Set instead of VPTO.

Validation

Ran locally:

  • ninja -C build-src312 ptoas
  • python3 test/vpto/scripts/check_vpto_coverage.py
  • ./build-src312/tools/ptoas/ptoas --pto-arch=a5 --pto-backend=vpto --vpto-emit-hivm-llvm test/phase2/vpto_emit_hivm_missing_intrinsics.mlir -o /tmp/vpto_emit_hivm_missing_intrinsics.ll

Environment note:

  • FileCheck is not installed in this environment, so I could not run the lit-style FileCheck assertions locally.
  • bisheng is not on PATH; the emitter falls back to the configured default target attributes, and the emission command still succeeds.

HecreReedand others added 30 commits March 10, 2026 20:57
@HecreReed
test: fix A5 MatMul tile layout in generator
71f176a
@HecreReed
Keep set_validshape PR focused
d1bd3f0
@zhangstevenunity
Merge pull requesthw-native-sys#237from HecreReed/codex/fix-a5-matm…
a40dea7
…ul-rowexpand-samples
test(samples): fix a5 matmul/rowexpand tile constraints
@zhangstevenunity
Merge pull requesthw-native-sys#236from HecreReed/codex/set-validsh…
c250b04
…ape-op
Add pto.set_validshape op
@zhangstevenunity
Merge pull requesthw-native-sys#229from HecreReed/codex/pypto-ir-pa…
4afe7f8
…rser-cases
Add fixed PyPTO ir_parser PTO snapshots
@HecreReed
ci: skip print in remote validation defaults
af7eb91
@HecreReed
fix(fillpad): split tfillpad and tfillpad_expand lowering
e2f7b92
@HecreReed
Fix tfillpad pad-null verifier and add invalid test
4a50813
@zhangstevenunity
Merge pull requesthw-native-sys#241from HecreReed/codex/fix-tfillpa…
8eb9e23
…d-expand-lowering
fix(fillpad): correct tfillpad/tfillpad_expand ISA mapping
@HecreReed
feat(ptoas): add release version to --version
20c4972
@zhangstevenunity
Merge pull requesthw-native-sys#239from HecreReed/codex/fix-issue-2…
09636d2
…07-origin-main
ci: skip print in remote validation defaults
Ruoyu Zhou
chore: prefer cann set_env for npu validation
4e9460e
@HecreReed
feat(release): auto-bump ptoas version for release builds
31b56b5
@HecreReed
fix(release): support multi-digit minor versions
d48af37
@HecreReed
fix(wheel): align package version with release version
028229f
@HecreReed
test(cli): assert exact release version when provided
f5bd104
@HecreReed
docs(readme): remove release version note
732ea42
@HecreReed
revert: remove pto.set_validshape support
f0aa51a
@zhangstevenunity
Merge pull requesthw-native-sys#247from HecreReed/codex/revert-setv…
d3e0aa8
…alidshape
revert: remove pto.set_validshape support
@zhangstevenunity
Merge pull requesthw-native-sys#246from zhoubot/codex/cann9-env-def…
8b8e911
…aults
chore: prefer cann set_env for npu validation
@TaoTao-real
Fix scf.if tile result lowering and add regression sample
5a5d952
@TaoTao-real
Skip ptobc roundtrip for if-else tile-result regression sample
ece6000
@zhangstevenunity
Merge pull requesthw-native-sys#242from HecreReed/codex/ptoas-versi…
80a5eeb
…on-flag
feat(ptoas): expose release version via --version
@zhangstevenunity
Merge pull requesthw-native-sys#244from TaoTao-real/codex/fix-if-el…
548e509
…se-tile-memref
Fix scf.if tile result lowering mismatch in ptoas
@HecreReed
fix: handle cfg-based emitc lowering in ptoas
07cffcf
@HecreReed
test: cover scf while cfg emission
ab2494f
@zhangstevenunity
Merge pull requesthw-native-sys#232from wangqilin18/codex/pto-arch-…
e76c96b
…mem-spec
Plan memory: use pto-arch for mem specs
@HecreReed
test: cover scf for break-like lowering
169eef1
@HecreReed
test: move scf control-flow cases under samples
720d219
@zhangstevenunity
Merge pull requesthw-native-sys#250from HecreReed/codex/scf-control…
c431087
…-flow
Fix EmitC CFG lowering for scf.while and add SCF control-flow tests
FangRui0and others added 29 commits March 27, 2026 10:10
@FangRui0
fix: restore single-entry sort32 sample for npu validation function n…
fc5ae3e
…ame parser
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge pull requesthw-native-sys#372from FangRui0/fix-remote-ci
2c40a5f
fix: restore single-entry sort32 sample for npu validation function n…
@zhangstevenunity
Merge pull requesthw-native-sys#342from HecreReed/fix-a5-gatherb-sc…
5adc661
…atter
fix: stabilize A5 scatter and gatherb validation
@FangRui0
Fix selected codecheck warnings
3165e07
qukelin
fix: use !pto.ptr for frontend gm_slot_buffer
41497dc
@zhangstevenunity
Merge pull requesthw-native-sys#376from KurrinQu/refactor-tile-emit…
70b4b4a
…c-gm-ptr-20260327
fix: use !pto.ptr for frontend gm_slot_buffer
@zhangstevenunity
Merge pull requesthw-native-sys#367from FangRui0/codecheck
b978d86
Fix codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#368from FangRui0/fix_verify
66cfa14
fix: Fix ptobc ctest failures by updating PTO samples
@HecreReed
[Feature] Support explicit FFTS modes for sync.set
d87678c
qukelin
test: add A3 TPushTPop sample cases
c57683a
@HecreReed
fix(release): preserve macos ptoas dist portability
6f7b3e2
@zhangstevenunity
Merge pull requesthw-native-sys#383from HecreReed/codex/issue380-ma…
d2fad66
…cos-release-dist
fix(release): preserve macOS ptoas binary portability
@zhangstevenunity
Merge pull requesthw-native-sys#382from KurrinQu/tpush-tpop-a3-samp…
3da2b88
…les-20260327
test: add A3 TPushTPop sample cases
@zhangstevenunity
Add manual event-id array support
ddfcc89
@FangRui0
fix: delete redundant code comments
30b3859
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge remote-tracking branch 'origin/main' into codex/eventid-array-m…
9db2d97
…anual-sync
# Conflicts:
#	include/PTO/IR/PTOOps.td
#	lib/PTO/Transforms/PTOToEmitC.cpp
@FangRui0
feat: add OAT.3 license header
cc18b84
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Prevent CSE from folding event-id array declarations
cf9c701
@zhangstevenunity
Prevent stale event-id array reads after CSE
ee79c5f
@zhangstevenunity
Merge pull requesthw-native-sys#385from zhangstevenunity/codex/even…
a57a0ae
…tid-array-manual
support eventid array manual
@zhangstevenunity
Merge pull requesthw-native-sys#386from FangRui0/codecheck
0c431a9
Fix Codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#377from HecreReed/codex/issue-369
bcdf492
[Feature] Support explicit getFFTSMsg modes in sync.set
@zhangstevenunity
emitc: render scalar constants as const locals
b16b816
mirkodevita
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
70cf07f
@zhangstevenunity
Merge pull requesthw-native-sys#391from zhangstevenunity/codex/arit…
ba4a1db
…h-constant-const
emitc: render scalar constants as const locals
@zhangstevenunity
Merge pull requesthw-native-sys#390from MirkoDeVita98/quant_op
b6a3c18
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
RuoyuZhou
Merge remote-tracking branch 'origin/main'
2775cfc
# Conflicts:
#	.github/workflows/ci.yml
#	docker/Dockerfile
RuoyuZhou
Add VPTO backend and HIVM intrinsic emission
e6da4f2
RuoyuZhou
Rename VPTO terminology to PTO Micro Instruction Set
9cb5d6f
@zhoubotzhoubot changed the title [codex] Add VPTO backend and HIVM intrinsic emission[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emissionMar 30, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@zhoubot@HecreReed@zhangstevenunity@TaoTao-real@FangRui0@learning-chip
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all 
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '

Skip to content
[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission - #2
Draft
zhoubot wants to merge 315 commits into
mainfrom 
codex/vpto-hivm-intrinsics
Draft
[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission#2
zhoubot wants to merge 315 commits into
mainfrom 
codex/vpto-hivm-intrinsics
Conversation
@zhoubot
@zhoubotzhoubot
commented
Mar 30, 2026•

edited

Loading

Copy link


Copy Markdown

Summary
This PR lands the PTO Micro Instruction Set backend surface in PTOAS and wires the final HIVM/CCE intrinsic emission path through the LLVM text emitter.
It includes:
  • the PTO Micro Instruction Set dialect/lowering surface, text/LLVM emitters, and backend wiring
  • version selection, ptr-boundary, loop/fusion, and host validation plumbing
  • the PTO Micro Instruction Set spec/manifest/docs and phased regression suites
  • final direct HIVM emitter coverage for the remaining missing micro-instructions
  • a repo-wide terminology pass that replaces user-facing VPTO naming with PTO Micro Instruction Set
Why
The backend work was partially implemented but the final LLVM emitter still had gaps in the direct intrinsic path. In particular, get_buf, rls_buf, copy_ubuf_to_ubuf, ppack, and punpack were implemented elsewhere in the pipeline but were not emitted as HIVM intrinsics from VPTOLLVMEmitter.cpp, and vintlvv2/vdintlvv2 were decoding the wrong part-token enum.
This PR closes that gap, adds regression coverage so implemented micro-ops are checked against the final emitter, and aligns repo-facing terminology on PTO Micro Instruction Set while preserving stable technical identifiers such as the vpto backend flag and existing file/class names.
Impact
User-visible outcomes:
  • --pto-backend=vpto is wired through PTOAS with PTO Micro Instruction Set lowering and testing support.
  • --vpto-emit-hivm-llvm now emits the final HIVM intrinsics for the previously missing micro-op families.
  • the inventory script now fails if an implemented micro-op is missing from the direct HIVM emitter.
  • user-facing docs, diagnostics, and test/readme text now use PTO Micro Instruction Set instead of VPTO.
Validation
Ran locally:
  • ninja -C build-src312 ptoas
  • python3 test/vpto/scripts/check_vpto_coverage.py
  • ./build-src312/tools/ptoas/ptoas --pto-arch=a5 --pto-backend=vpto --vpto-emit-hivm-llvm test/phase2/vpto_emit_hivm_missing_intrinsics.mlir -o /tmp/vpto_emit_hivm_missing_intrinsics.ll
Environment note:
  • FileCheck is not installed in this environment, so I could not run the lit-style FileCheck assertions locally.
  • bisheng is not on PATH; the emitter falls back to the configured default target attributes, and the emission command still succeeds.
HecreReedand others
added 30 commits
March 10, 2026 20:57
@HecreReed
test: fix A5 MatMul tile layout in generator
71f176a
@HecreReed
Keep set_validshape PR focused
d1bd3f0
@zhangstevenunity
Merge pull requesthw-native-sys#237from HecreReed/codex/fix-a5-matm…
a40dea7
…ul-rowexpand-samples
test(samples): fix a5 matmul/rowexpand tile constraints
@zhangstevenunity
Merge pull requesthw-native-sys#236from HecreReed/codex/set-validsh…
c250b04
…ape-op
Add pto.set_validshape op
@zhangstevenunity
Merge pull requesthw-native-sys#229from HecreReed/codex/pypto-ir-pa…
4afe7f8
…rser-cases
Add fixed PyPTO ir_parser PTO snapshots
@HecreReed
ci: skip print in remote validation defaults
af7eb91
@HecreReed
fix(fillpad): split tfillpad and tfillpad_expand lowering
e2f7b92
@HecreReed
Fix tfillpad pad-null verifier and add invalid test
4a50813
@zhangstevenunity
Merge pull requesthw-native-sys#241from HecreReed/codex/fix-tfillpa…
8eb9e23
…d-expand-lowering
fix(fillpad): correct tfillpad/tfillpad_expand ISA mapping
@HecreReed
feat(ptoas): add release version to --version
20c4972
@zhangstevenunity
Merge pull requesthw-native-sys#239from HecreReed/codex/fix-issue-2…
09636d2
…07-origin-main
ci: skip print in remote validation defaults
Ruoyu Zhou
chore: prefer cann set_env for npu validation
4e9460e
@HecreReed
feat(release): auto-bump ptoas version for release builds
31b56b5
@HecreReed
fix(release): support multi-digit minor versions
d48af37
@HecreReed
fix(wheel): align package version with release version
028229f
@HecreReed
test(cli): assert exact release version when provided
f5bd104
@HecreReed
docs(readme): remove release version note
732ea42
@HecreReed
revert: remove pto.set_validshape support
f0aa51a
@zhangstevenunity
Merge pull requesthw-native-sys#247from HecreReed/codex/revert-setv…
d3e0aa8
…alidshape
revert: remove pto.set_validshape support
@zhangstevenunity
Merge pull requesthw-native-sys#246from zhoubot/codex/cann9-env-def…
8b8e911
…aults
chore: prefer cann set_env for npu validation
@TaoTao-real
Fix scf.if tile result lowering and add regression sample
5a5d952
@TaoTao-real
Skip ptobc roundtrip for if-else tile-result regression sample
ece6000
@zhangstevenunity
Merge pull requesthw-native-sys#242from HecreReed/codex/ptoas-versi…
80a5eeb
…on-flag
feat(ptoas): expose release version via --version
@zhangstevenunity
Merge pull requesthw-native-sys#244from TaoTao-real/codex/fix-if-el…
548e509
…se-tile-memref
Fix scf.if tile result lowering mismatch in ptoas
@HecreReed
fix: handle cfg-based emitc lowering in ptoas
07cffcf
@HecreReed
test: cover scf while cfg emission
ab2494f
@zhangstevenunity
Merge pull requesthw-native-sys#232from wangqilin18/codex/pto-arch-…
e76c96b
…mem-spec
Plan memory: use pto-arch for mem specs
@HecreReed
test: cover scf for break-like lowering
169eef1
@HecreReed
test: move scf control-flow cases under samples
720d219
@zhangstevenunity
Merge pull requesthw-native-sys#250from HecreReed/codex/scf-control…
c431087
…-flow
Fix EmitC CFG lowering for scf.while and add SCF control-flow tests
FangRui0and others
added 29 commits
March 27, 2026 10:10
@FangRui0
fix: restore single-entry sort32 sample for npu validation function n…
fc5ae3e
…ame parser
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge pull requesthw-native-sys#372from FangRui0/fix-remote-ci
2c40a5f
fix: restore single-entry sort32 sample for npu validation function n…
@zhangstevenunity
Merge pull requesthw-native-sys#342from HecreReed/fix-a5-gatherb-sc…
5adc661
…atter
fix: stabilize A5 scatter and gatherb validation
@FangRui0
Fix selected codecheck warnings
3165e07
qukelin
fix: use !pto.ptr for frontend gm_slot_buffer
41497dc
@zhangstevenunity
Merge pull requesthw-native-sys#376from KurrinQu/refactor-tile-emit…
70b4b4a
…c-gm-ptr-20260327
fix: use !pto.ptr for frontend gm_slot_buffer
@zhangstevenunity
Merge pull requesthw-native-sys#367from FangRui0/codecheck
b978d86
Fix codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#368from FangRui0/fix_verify
66cfa14
fix: Fix ptobc ctest failures by updating PTO samples
@HecreReed
[Feature] Support explicit FFTS modes for sync.set
d87678c
qukelin
test: add A3 TPushTPop sample cases
c57683a
@HecreReed
fix(release): preserve macos ptoas dist portability
6f7b3e2
@zhangstevenunity
Merge pull requesthw-native-sys#383from HecreReed/codex/issue380-ma…
d2fad66
…cos-release-dist
fix(release): preserve macOS ptoas binary portability
@zhangstevenunity
Merge pull requesthw-native-sys#382from KurrinQu/tpush-tpop-a3-samp…
3da2b88
…les-20260327
test: add A3 TPushTPop sample cases
@zhangstevenunity
Add manual event-id array support
ddfcc89
@FangRui0
fix: delete redundant code comments
30b3859
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge remote-tracking branch 'origin/main' into codex/eventid-array-m…
9db2d97
…anual-sync
# Conflicts:
#	include/PTO/IR/PTOOps.td
#	lib/PTO/Transforms/PTOToEmitC.cpp
@FangRui0
feat: add OAT.3 license header
cc18b84
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Prevent CSE from folding event-id array declarations
cf9c701
@zhangstevenunity
Prevent stale event-id array reads after CSE
ee79c5f
@zhangstevenunity
Merge pull requesthw-native-sys#385from zhangstevenunity/codex/even…
a57a0ae
…tid-array-manual
support eventid array manual
@zhangstevenunity
Merge pull requesthw-native-sys#386from FangRui0/codecheck
0c431a9
Fix Codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#377from HecreReed/codex/issue-369
bcdf492
[Feature] Support explicit getFFTSMsg modes in sync.set
@zhangstevenunity
emitc: render scalar constants as const locals
b16b816
mirkodevita
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
70cf07f
@zhangstevenunity
Merge pull requesthw-native-sys#391from zhangstevenunity/codex/arit…
ba4a1db
…h-constant-const
emitc: render scalar constants as const locals
@zhangstevenunity
Merge pull requesthw-native-sys#390from MirkoDeVita98/quant_op
b6a3c18
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
RuoyuZhou
Merge remote-tracking branch 'origin/main'
2775cfc
# Conflicts:
#	.github/workflows/ci.yml
#	docker/Dockerfile
RuoyuZhou
Add VPTO backend and HIVM intrinsic emission
e6da4f2
RuoyuZhou
Rename VPTO terminology to PTO Micro Instruction Set
9cb5d6f
@zhoubotzhoubot
changed the title
[codex] Add VPTO backend and HIVM intrinsic emission[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emissionMar 30, 2026
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees


No one assigned


Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

6 participants

@zhoubot@HecreReed@zhangstevenunity@TaoTao-real@FangRui0@learning-chip

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix");
}
} catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission - #2
Draft
zhoubot wants to merge 315 commits into
mainfrom 
codex/vpto-hivm-intrinsics
Draft
[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission#2
zhoubot wants to merge 315 commits into
mainfrom 
codex/vpto-hivm-intrinsics
Conversation
@zhoubot
@zhoubotzhoubot
commented
Mar 30, 2026•

edited

Loading

Copy link


Copy Markdown

Summary
This PR lands the PTO Micro Instruction Set backend surface in PTOAS and wires the final HIVM/CCE intrinsic emission path through the LLVM text emitter.
It includes:
  • the PTO Micro Instruction Set dialect/lowering surface, text/LLVM emitters, and backend wiring
  • version selection, ptr-boundary, loop/fusion, and host validation plumbing
  • the PTO Micro Instruction Set spec/manifest/docs and phased regression suites
  • final direct HIVM emitter coverage for the remaining missing micro-instructions
  • a repo-wide terminology pass that replaces user-facing VPTO naming with PTO Micro Instruction Set
Why
The backend work was partially implemented but the final LLVM emitter still had gaps in the direct intrinsic path. In particular, get_buf, rls_buf, copy_ubuf_to_ubuf, ppack, and punpack were implemented elsewhere in the pipeline but were not emitted as HIVM intrinsics from VPTOLLVMEmitter.cpp, and vintlvv2/vdintlvv2 were decoding the wrong part-token enum.
This PR closes that gap, adds regression coverage so implemented micro-ops are checked against the final emitter, and aligns repo-facing terminology on PTO Micro Instruction Set while preserving stable technical identifiers such as the vpto backend flag and existing file/class names.
Impact
User-visible outcomes:
  • --pto-backend=vpto is wired through PTOAS with PTO Micro Instruction Set lowering and testing support.
  • --vpto-emit-hivm-llvm now emits the final HIVM intrinsics for the previously missing micro-op families.
  • the inventory script now fails if an implemented micro-op is missing from the direct HIVM emitter.
  • user-facing docs, diagnostics, and test/readme text now use PTO Micro Instruction Set instead of VPTO.
Validation
Ran locally:
  • ninja -C build-src312 ptoas
  • python3 test/vpto/scripts/check_vpto_coverage.py
  • ./build-src312/tools/ptoas/ptoas --pto-arch=a5 --pto-backend=vpto --vpto-emit-hivm-llvm test/phase2/vpto_emit_hivm_missing_intrinsics.mlir -o /tmp/vpto_emit_hivm_missing_intrinsics.ll
Environment note:
  • FileCheck is not installed in this environment, so I could not run the lit-style FileCheck assertions locally.
  • bisheng is not on PATH; the emitter falls back to the configured default target attributes, and the emission command still succeeds.
HecreReedand others
added 30 commits
March 10, 2026 20:57
@HecreReed
test: fix A5 MatMul tile layout in generator
71f176a
@HecreReed
Keep set_validshape PR focused
d1bd3f0
@zhangstevenunity
Merge pull requesthw-native-sys#237from HecreReed/codex/fix-a5-matm…
a40dea7
…ul-rowexpand-samples
test(samples): fix a5 matmul/rowexpand tile constraints
@zhangstevenunity
Merge pull requesthw-native-sys#236from HecreReed/codex/set-validsh…
c250b04
…ape-op
Add pto.set_validshape op
@zhangstevenunity
Merge pull requesthw-native-sys#229from HecreReed/codex/pypto-ir-pa…
4afe7f8
…rser-cases
Add fixed PyPTO ir_parser PTO snapshots
@HecreReed
ci: skip print in remote validation defaults
af7eb91
@HecreReed
fix(fillpad): split tfillpad and tfillpad_expand lowering
e2f7b92
@HecreReed
Fix tfillpad pad-null verifier and add invalid test
4a50813
@zhangstevenunity
Merge pull requesthw-native-sys#241from HecreReed/codex/fix-tfillpa…
8eb9e23
…d-expand-lowering
fix(fillpad): correct tfillpad/tfillpad_expand ISA mapping
@HecreReed
feat(ptoas): add release version to --version
20c4972
@zhangstevenunity
Merge pull requesthw-native-sys#239from HecreReed/codex/fix-issue-2…
09636d2
…07-origin-main
ci: skip print in remote validation defaults
Ruoyu Zhou
chore: prefer cann set_env for npu validation
4e9460e
@HecreReed
feat(release): auto-bump ptoas version for release builds
31b56b5
@HecreReed
fix(release): support multi-digit minor versions
d48af37
@HecreReed
fix(wheel): align package version with release version
028229f
@HecreReed
test(cli): assert exact release version when provided
f5bd104
@HecreReed
docs(readme): remove release version note
732ea42
@HecreReed
revert: remove pto.set_validshape support
f0aa51a
@zhangstevenunity
Merge pull requesthw-native-sys#247from HecreReed/codex/revert-setv…
d3e0aa8
…alidshape
revert: remove pto.set_validshape support
@zhangstevenunity
Merge pull requesthw-native-sys#246from zhoubot/codex/cann9-env-def…
8b8e911
…aults
chore: prefer cann set_env for npu validation
@TaoTao-real
Fix scf.if tile result lowering and add regression sample
5a5d952
@TaoTao-real
Skip ptobc roundtrip for if-else tile-result regression sample
ece6000
@zhangstevenunity
Merge pull requesthw-native-sys#242from HecreReed/codex/ptoas-versi…
80a5eeb
…on-flag
feat(ptoas): expose release version via --version
@zhangstevenunity
Merge pull requesthw-native-sys#244from TaoTao-real/codex/fix-if-el…
548e509
…se-tile-memref
Fix scf.if tile result lowering mismatch in ptoas
@HecreReed
fix: handle cfg-based emitc lowering in ptoas
07cffcf
@HecreReed
test: cover scf while cfg emission
ab2494f
@zhangstevenunity
Merge pull requesthw-native-sys#232from wangqilin18/codex/pto-arch-…
e76c96b
…mem-spec
Plan memory: use pto-arch for mem specs
@HecreReed
test: cover scf for break-like lowering
169eef1
@HecreReed
test: move scf control-flow cases under samples
720d219
@zhangstevenunity
Merge pull requesthw-native-sys#250from HecreReed/codex/scf-control…
c431087
…-flow
Fix EmitC CFG lowering for scf.while and add SCF control-flow tests
FangRui0and others
added 29 commits
March 27, 2026 10:10
@FangRui0
fix: restore single-entry sort32 sample for npu validation function n…
fc5ae3e
…ame parser
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge pull requesthw-native-sys#372from FangRui0/fix-remote-ci
2c40a5f
fix: restore single-entry sort32 sample for npu validation function n…
@zhangstevenunity
Merge pull requesthw-native-sys#342from HecreReed/fix-a5-gatherb-sc…
5adc661
…atter
fix: stabilize A5 scatter and gatherb validation
@FangRui0
Fix selected codecheck warnings
3165e07
qukelin
fix: use !pto.ptr for frontend gm_slot_buffer
41497dc
@zhangstevenunity
Merge pull requesthw-native-sys#376from KurrinQu/refactor-tile-emit…
70b4b4a
…c-gm-ptr-20260327
fix: use !pto.ptr for frontend gm_slot_buffer
@zhangstevenunity
Merge pull requesthw-native-sys#367from FangRui0/codecheck
b978d86
Fix codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#368from FangRui0/fix_verify
66cfa14
fix: Fix ptobc ctest failures by updating PTO samples
@HecreReed
[Feature] Support explicit FFTS modes for sync.set
d87678c
qukelin
test: add A3 TPushTPop sample cases
c57683a
@HecreReed
fix(release): preserve macos ptoas dist portability
6f7b3e2
@zhangstevenunity
Merge pull requesthw-native-sys#383from HecreReed/codex/issue380-ma…
d2fad66
…cos-release-dist
fix(release): preserve macOS ptoas binary portability
@zhangstevenunity
Merge pull requesthw-native-sys#382from KurrinQu/tpush-tpop-a3-samp…
3da2b88
…les-20260327
test: add A3 TPushTPop sample cases
@zhangstevenunity
Add manual event-id array support
ddfcc89
@FangRui0
fix: delete redundant code comments
30b3859
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge remote-tracking branch 'origin/main' into codex/eventid-array-m…
9db2d97
…anual-sync
# Conflicts:
#	include/PTO/IR/PTOOps.td
#	lib/PTO/Transforms/PTOToEmitC.cpp
@FangRui0
feat: add OAT.3 license header
cc18b84
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Prevent CSE from folding event-id array declarations
cf9c701
@zhangstevenunity
Prevent stale event-id array reads after CSE
ee79c5f
@zhangstevenunity
Merge pull requesthw-native-sys#385from zhangstevenunity/codex/even…
a57a0ae
…tid-array-manual
support eventid array manual
@zhangstevenunity
Merge pull requesthw-native-sys#386from FangRui0/codecheck
0c431a9
Fix Codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#377from HecreReed/codex/issue-369
bcdf492
[Feature] Support explicit getFFTSMsg modes in sync.set
@zhangstevenunity
emitc: render scalar constants as const locals
b16b816
mirkodevita
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
70cf07f
@zhangstevenunity
Merge pull requesthw-native-sys#391from zhangstevenunity/codex/arit…
ba4a1db
…h-constant-const
emitc: render scalar constants as const locals
@zhangstevenunity
Merge pull requesthw-native-sys#390from MirkoDeVita98/quant_op
b6a3c18
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
RuoyuZhou
Merge remote-tracking branch 'origin/main'
2775cfc
# Conflicts:
#	.github/workflows/ci.yml
#	docker/Dockerfile
RuoyuZhou
Add VPTO backend and HIVM intrinsic emission
e6da4f2
RuoyuZhou
Rename VPTO terminology to PTO Micro Instruction Set
9cb5d6f
@zhoubotzhoubot
changed the title
[codex] Add VPTO backend and HIVM intrinsic emission[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emissionMar 30, 2026
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees


No one assigned


Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

6 participants

@zhoubot@HecreReed@zhangstevenunity@TaoTao-real@FangRui0@learning-chip

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms");
}
} catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission - #2
Draft
zhoubot wants to merge 315 commits into
mainfrom 
codex/vpto-hivm-intrinsics
Draft
[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission#2
zhoubot wants to merge 315 commits into
mainfrom 
codex/vpto-hivm-intrinsics
Conversation
@zhoubot
@zhoubotzhoubot
commented
Mar 30, 2026•

edited

Loading

Copy link


Copy Markdown

Summary
This PR lands the PTO Micro Instruction Set backend surface in PTOAS and wires the final HIVM/CCE intrinsic emission path through the LLVM text emitter.
It includes:
  • the PTO Micro Instruction Set dialect/lowering surface, text/LLVM emitters, and backend wiring
  • version selection, ptr-boundary, loop/fusion, and host validation plumbing
  • the PTO Micro Instruction Set spec/manifest/docs and phased regression suites
  • final direct HIVM emitter coverage for the remaining missing micro-instructions
  • a repo-wide terminology pass that replaces user-facing VPTO naming with PTO Micro Instruction Set
Why
The backend work was partially implemented but the final LLVM emitter still had gaps in the direct intrinsic path. In particular, get_buf, rls_buf, copy_ubuf_to_ubuf, ppack, and punpack were implemented elsewhere in the pipeline but were not emitted as HIVM intrinsics from VPTOLLVMEmitter.cpp, and vintlvv2/vdintlvv2 were decoding the wrong part-token enum.
This PR closes that gap, adds regression coverage so implemented micro-ops are checked against the final emitter, and aligns repo-facing terminology on PTO Micro Instruction Set while preserving stable technical identifiers such as the vpto backend flag and existing file/class names.
Impact
User-visible outcomes:
  • --pto-backend=vpto is wired through PTOAS with PTO Micro Instruction Set lowering and testing support.
  • --vpto-emit-hivm-llvm now emits the final HIVM intrinsics for the previously missing micro-op families.
  • the inventory script now fails if an implemented micro-op is missing from the direct HIVM emitter.
  • user-facing docs, diagnostics, and test/readme text now use PTO Micro Instruction Set instead of VPTO.
Validation
Ran locally:
  • ninja -C build-src312 ptoas
  • python3 test/vpto/scripts/check_vpto_coverage.py
  • ./build-src312/tools/ptoas/ptoas --pto-arch=a5 --pto-backend=vpto --vpto-emit-hivm-llvm test/phase2/vpto_emit_hivm_missing_intrinsics.mlir -o /tmp/vpto_emit_hivm_missing_intrinsics.ll
Environment note:
  • FileCheck is not installed in this environment, so I could not run the lit-style FileCheck assertions locally.
  • bisheng is not on PATH; the emitter falls back to the configured default target attributes, and the emission command still succeeds.
HecreReedand others
added 30 commits
March 10, 2026 20:57
@HecreReed
test: fix A5 MatMul tile layout in generator
71f176a
@HecreReed
Keep set_validshape PR focused
d1bd3f0
@zhangstevenunity
Merge pull requesthw-native-sys#237from HecreReed/codex/fix-a5-matm…
a40dea7
…ul-rowexpand-samples
test(samples): fix a5 matmul/rowexpand tile constraints
@zhangstevenunity
Merge pull requesthw-native-sys#236from HecreReed/codex/set-validsh…
c250b04
…ape-op
Add pto.set_validshape op
@zhangstevenunity
Merge pull requesthw-native-sys#229from HecreReed/codex/pypto-ir-pa…
4afe7f8
…rser-cases
Add fixed PyPTO ir_parser PTO snapshots
@HecreReed
ci: skip print in remote validation defaults
af7eb91
@HecreReed
fix(fillpad): split tfillpad and tfillpad_expand lowering
e2f7b92
@HecreReed
Fix tfillpad pad-null verifier and add invalid test
4a50813
@zhangstevenunity
Merge pull requesthw-native-sys#241from HecreReed/codex/fix-tfillpa…
8eb9e23
…d-expand-lowering
fix(fillpad): correct tfillpad/tfillpad_expand ISA mapping
@HecreReed
feat(ptoas): add release version to --version
20c4972
@zhangstevenunity
Merge pull requesthw-native-sys#239from HecreReed/codex/fix-issue-2…
09636d2
…07-origin-main
ci: skip print in remote validation defaults
Ruoyu Zhou
chore: prefer cann set_env for npu validation
4e9460e
@HecreReed
feat(release): auto-bump ptoas version for release builds
31b56b5
@HecreReed
fix(release): support multi-digit minor versions
d48af37
@HecreReed
fix(wheel): align package version with release version
028229f
@HecreReed
test(cli): assert exact release version when provided
f5bd104
@HecreReed
docs(readme): remove release version note
732ea42
@HecreReed
revert: remove pto.set_validshape support
f0aa51a
@zhangstevenunity
Merge pull requesthw-native-sys#247from HecreReed/codex/revert-setv…
d3e0aa8
…alidshape
revert: remove pto.set_validshape support
@zhangstevenunity
Merge pull requesthw-native-sys#246from zhoubot/codex/cann9-env-def…
8b8e911
…aults
chore: prefer cann set_env for npu validation
@TaoTao-real
Fix scf.if tile result lowering and add regression sample
5a5d952
@TaoTao-real
Skip ptobc roundtrip for if-else tile-result regression sample
ece6000
@zhangstevenunity
Merge pull requesthw-native-sys#242from HecreReed/codex/ptoas-versi…
80a5eeb
…on-flag
feat(ptoas): expose release version via --version
@zhangstevenunity
Merge pull requesthw-native-sys#244from TaoTao-real/codex/fix-if-el…
548e509
…se-tile-memref
Fix scf.if tile result lowering mismatch in ptoas
@HecreReed
fix: handle cfg-based emitc lowering in ptoas
07cffcf
@HecreReed
test: cover scf while cfg emission
ab2494f
@zhangstevenunity
Merge pull requesthw-native-sys#232from wangqilin18/codex/pto-arch-…
e76c96b
…mem-spec
Plan memory: use pto-arch for mem specs
@HecreReed
test: cover scf for break-like lowering
169eef1
@HecreReed
test: move scf control-flow cases under samples
720d219
@zhangstevenunity
Merge pull requesthw-native-sys#250from HecreReed/codex/scf-control…
c431087
…-flow
Fix EmitC CFG lowering for scf.while and add SCF control-flow tests
FangRui0and others
added 29 commits
March 27, 2026 10:10
@FangRui0
fix: restore single-entry sort32 sample for npu validation function n…
fc5ae3e
…ame parser
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge pull requesthw-native-sys#372from FangRui0/fix-remote-ci
2c40a5f
fix: restore single-entry sort32 sample for npu validation function n…
@zhangstevenunity
Merge pull requesthw-native-sys#342from HecreReed/fix-a5-gatherb-sc…
5adc661
…atter
fix: stabilize A5 scatter and gatherb validation
@FangRui0
Fix selected codecheck warnings
3165e07
qukelin
fix: use !pto.ptr for frontend gm_slot_buffer
41497dc
@zhangstevenunity
Merge pull requesthw-native-sys#376from KurrinQu/refactor-tile-emit…
70b4b4a
…c-gm-ptr-20260327
fix: use !pto.ptr for frontend gm_slot_buffer
@zhangstevenunity
Merge pull requesthw-native-sys#367from FangRui0/codecheck
b978d86
Fix codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#368from FangRui0/fix_verify
66cfa14
fix: Fix ptobc ctest failures by updating PTO samples
@HecreReed
[Feature] Support explicit FFTS modes for sync.set
d87678c
qukelin
test: add A3 TPushTPop sample cases
c57683a
@HecreReed
fix(release): preserve macos ptoas dist portability
6f7b3e2
@zhangstevenunity
Merge pull requesthw-native-sys#383from HecreReed/codex/issue380-ma…
d2fad66
…cos-release-dist
fix(release): preserve macOS ptoas binary portability
@zhangstevenunity
Merge pull requesthw-native-sys#382from KurrinQu/tpush-tpop-a3-samp…
3da2b88
…les-20260327
test: add A3 TPushTPop sample cases
@zhangstevenunity
Add manual event-id array support
ddfcc89
@FangRui0
fix: delete redundant code comments
30b3859
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge remote-tracking branch 'origin/main' into codex/eventid-array-m…
9db2d97
…anual-sync
# Conflicts:
#	include/PTO/IR/PTOOps.td
#	lib/PTO/Transforms/PTOToEmitC.cpp
@FangRui0
feat: add OAT.3 license header
cc18b84
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Prevent CSE from folding event-id array declarations
cf9c701
@zhangstevenunity
Prevent stale event-id array reads after CSE
ee79c5f
@zhangstevenunity
Merge pull requesthw-native-sys#385from zhangstevenunity/codex/even…
a57a0ae
…tid-array-manual
support eventid array manual
@zhangstevenunity
Merge pull requesthw-native-sys#386from FangRui0/codecheck
0c431a9
Fix Codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#377from HecreReed/codex/issue-369
bcdf492
[Feature] Support explicit getFFTSMsg modes in sync.set
@zhangstevenunity
emitc: render scalar constants as const locals
b16b816
mirkodevita
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
70cf07f
@zhangstevenunity
Merge pull requesthw-native-sys#391from zhangstevenunity/codex/arit…
ba4a1db
…h-constant-const
emitc: render scalar constants as const locals
@zhangstevenunity
Merge pull requesthw-native-sys#390from MirkoDeVita98/quant_op
b6a3c18
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
RuoyuZhou
Merge remote-tracking branch 'origin/main'
2775cfc
# Conflicts:
#	.github/workflows/ci.yml
#	docker/Dockerfile
RuoyuZhou
Add VPTO backend and HIVM intrinsic emission
e6da4f2
RuoyuZhou
Rename VPTO terminology to PTO Micro Instruction Set
9cb5d6f
@zhoubotzhoubot
changed the title
[codex] Add VPTO backend and HIVM intrinsic emission[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emissionMar 30, 2026
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees


No one assigned


Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

6 participants

@zhoubot@HecreReed@zhangstevenunity@TaoTao-real@FangRui0@learning-chip

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links");
}
} catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); }
})();
(function(){
try {
var __m = "youtube.com";
var __re = new RegExp('^' + "youtube\\.com" + '

Skip to content
[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission - #2
Draft
zhoubot wants to merge 315 commits into
mainfrom 
codex/vpto-hivm-intrinsics
Draft
[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission#2
zhoubot wants to merge 315 commits into
mainfrom 
codex/vpto-hivm-intrinsics
Conversation
@zhoubot
@zhoubotzhoubot
commented
Mar 30, 2026•

edited

Loading

Copy link


Copy Markdown

Summary
This PR lands the PTO Micro Instruction Set backend surface in PTOAS and wires the final HIVM/CCE intrinsic emission path through the LLVM text emitter.
It includes:
  • the PTO Micro Instruction Set dialect/lowering surface, text/LLVM emitters, and backend wiring
  • version selection, ptr-boundary, loop/fusion, and host validation plumbing
  • the PTO Micro Instruction Set spec/manifest/docs and phased regression suites
  • final direct HIVM emitter coverage for the remaining missing micro-instructions
  • a repo-wide terminology pass that replaces user-facing VPTO naming with PTO Micro Instruction Set
Why
The backend work was partially implemented but the final LLVM emitter still had gaps in the direct intrinsic path. In particular, get_buf, rls_buf, copy_ubuf_to_ubuf, ppack, and punpack were implemented elsewhere in the pipeline but were not emitted as HIVM intrinsics from VPTOLLVMEmitter.cpp, and vintlvv2/vdintlvv2 were decoding the wrong part-token enum.
This PR closes that gap, adds regression coverage so implemented micro-ops are checked against the final emitter, and aligns repo-facing terminology on PTO Micro Instruction Set while preserving stable technical identifiers such as the vpto backend flag and existing file/class names.
Impact
User-visible outcomes:
  • --pto-backend=vpto is wired through PTOAS with PTO Micro Instruction Set lowering and testing support.
  • --vpto-emit-hivm-llvm now emits the final HIVM intrinsics for the previously missing micro-op families.
  • the inventory script now fails if an implemented micro-op is missing from the direct HIVM emitter.
  • user-facing docs, diagnostics, and test/readme text now use PTO Micro Instruction Set instead of VPTO.
Validation
Ran locally:
  • ninja -C build-src312 ptoas
  • python3 test/vpto/scripts/check_vpto_coverage.py
  • ./build-src312/tools/ptoas/ptoas --pto-arch=a5 --pto-backend=vpto --vpto-emit-hivm-llvm test/phase2/vpto_emit_hivm_missing_intrinsics.mlir -o /tmp/vpto_emit_hivm_missing_intrinsics.ll
Environment note:
  • FileCheck is not installed in this environment, so I could not run the lit-style FileCheck assertions locally.
  • bisheng is not on PATH; the emitter falls back to the configured default target attributes, and the emission command still succeeds.
HecreReedand others
added 30 commits
March 10, 2026 20:57
@HecreReed
test: fix A5 MatMul tile layout in generator
71f176a
@HecreReed
Keep set_validshape PR focused
d1bd3f0
@zhangstevenunity
Merge pull requesthw-native-sys#237from HecreReed/codex/fix-a5-matm…
a40dea7
…ul-rowexpand-samples
test(samples): fix a5 matmul/rowexpand tile constraints
@zhangstevenunity
Merge pull requesthw-native-sys#236from HecreReed/codex/set-validsh…
c250b04
…ape-op
Add pto.set_validshape op
@zhangstevenunity
Merge pull requesthw-native-sys#229from HecreReed/codex/pypto-ir-pa…
4afe7f8
…rser-cases
Add fixed PyPTO ir_parser PTO snapshots
@HecreReed
ci: skip print in remote validation defaults
af7eb91
@HecreReed
fix(fillpad): split tfillpad and tfillpad_expand lowering
e2f7b92
@HecreReed
Fix tfillpad pad-null verifier and add invalid test
4a50813
@zhangstevenunity
Merge pull requesthw-native-sys#241from HecreReed/codex/fix-tfillpa…
8eb9e23
…d-expand-lowering
fix(fillpad): correct tfillpad/tfillpad_expand ISA mapping
@HecreReed
feat(ptoas): add release version to --version
20c4972
@zhangstevenunity
Merge pull requesthw-native-sys#239from HecreReed/codex/fix-issue-2…
09636d2
…07-origin-main
ci: skip print in remote validation defaults
Ruoyu Zhou
chore: prefer cann set_env for npu validation
4e9460e
@HecreReed
feat(release): auto-bump ptoas version for release builds
31b56b5
@HecreReed
fix(release): support multi-digit minor versions
d48af37
@HecreReed
fix(wheel): align package version with release version
028229f
@HecreReed
test(cli): assert exact release version when provided
f5bd104
@HecreReed
docs(readme): remove release version note
732ea42
@HecreReed
revert: remove pto.set_validshape support
f0aa51a
@zhangstevenunity
Merge pull requesthw-native-sys#247from HecreReed/codex/revert-setv…
d3e0aa8
…alidshape
revert: remove pto.set_validshape support
@zhangstevenunity
Merge pull requesthw-native-sys#246from zhoubot/codex/cann9-env-def…
8b8e911
…aults
chore: prefer cann set_env for npu validation
@TaoTao-real
Fix scf.if tile result lowering and add regression sample
5a5d952
@TaoTao-real
Skip ptobc roundtrip for if-else tile-result regression sample
ece6000
@zhangstevenunity
Merge pull requesthw-native-sys#242from HecreReed/codex/ptoas-versi…
80a5eeb
…on-flag
feat(ptoas): expose release version via --version
@zhangstevenunity
Merge pull requesthw-native-sys#244from TaoTao-real/codex/fix-if-el…
548e509
…se-tile-memref
Fix scf.if tile result lowering mismatch in ptoas
@HecreReed
fix: handle cfg-based emitc lowering in ptoas
07cffcf
@HecreReed
test: cover scf while cfg emission
ab2494f
@zhangstevenunity
Merge pull requesthw-native-sys#232from wangqilin18/codex/pto-arch-…
e76c96b
…mem-spec
Plan memory: use pto-arch for mem specs
@HecreReed
test: cover scf for break-like lowering
169eef1
@HecreReed
test: move scf control-flow cases under samples
720d219
@zhangstevenunity
Merge pull requesthw-native-sys#250from HecreReed/codex/scf-control…
c431087
…-flow
Fix EmitC CFG lowering for scf.while and add SCF control-flow tests
FangRui0and others
added 29 commits
March 27, 2026 10:10
@FangRui0
fix: restore single-entry sort32 sample for npu validation function n…
fc5ae3e
…ame parser
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge pull requesthw-native-sys#372from FangRui0/fix-remote-ci
2c40a5f
fix: restore single-entry sort32 sample for npu validation function n…
@zhangstevenunity
Merge pull requesthw-native-sys#342from HecreReed/fix-a5-gatherb-sc…
5adc661
…atter
fix: stabilize A5 scatter and gatherb validation
@FangRui0
Fix selected codecheck warnings
3165e07
qukelin
fix: use !pto.ptr for frontend gm_slot_buffer
41497dc
@zhangstevenunity
Merge pull requesthw-native-sys#376from KurrinQu/refactor-tile-emit…
70b4b4a
…c-gm-ptr-20260327
fix: use !pto.ptr for frontend gm_slot_buffer
@zhangstevenunity
Merge pull requesthw-native-sys#367from FangRui0/codecheck
b978d86
Fix codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#368from FangRui0/fix_verify
66cfa14
fix: Fix ptobc ctest failures by updating PTO samples
@HecreReed
[Feature] Support explicit FFTS modes for sync.set
d87678c
qukelin
test: add A3 TPushTPop sample cases
c57683a
@HecreReed
fix(release): preserve macos ptoas dist portability
6f7b3e2
@zhangstevenunity
Merge pull requesthw-native-sys#383from HecreReed/codex/issue380-ma…
d2fad66
…cos-release-dist
fix(release): preserve macOS ptoas binary portability
@zhangstevenunity
Merge pull requesthw-native-sys#382from KurrinQu/tpush-tpop-a3-samp…
3da2b88
…les-20260327
test: add A3 TPushTPop sample cases
@zhangstevenunity
Add manual event-id array support
ddfcc89
@FangRui0
fix: delete redundant code comments
30b3859
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge remote-tracking branch 'origin/main' into codex/eventid-array-m…
9db2d97
…anual-sync
# Conflicts:
#	include/PTO/IR/PTOOps.td
#	lib/PTO/Transforms/PTOToEmitC.cpp
@FangRui0
feat: add OAT.3 license header
cc18b84
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Prevent CSE from folding event-id array declarations
cf9c701
@zhangstevenunity
Prevent stale event-id array reads after CSE
ee79c5f
@zhangstevenunity
Merge pull requesthw-native-sys#385from zhangstevenunity/codex/even…
a57a0ae
…tid-array-manual
support eventid array manual
@zhangstevenunity
Merge pull requesthw-native-sys#386from FangRui0/codecheck
0c431a9
Fix Codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#377from HecreReed/codex/issue-369
bcdf492
[Feature] Support explicit getFFTSMsg modes in sync.set
@zhangstevenunity
emitc: render scalar constants as const locals
b16b816
mirkodevita
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
70cf07f
@zhangstevenunity
Merge pull requesthw-native-sys#391from zhangstevenunity/codex/arit…
ba4a1db
…h-constant-const
emitc: render scalar constants as const locals
@zhangstevenunity
Merge pull requesthw-native-sys#390from MirkoDeVita98/quant_op
b6a3c18
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
RuoyuZhou
Merge remote-tracking branch 'origin/main'
2775cfc
# Conflicts:
#	.github/workflows/ci.yml
#	docker/Dockerfile
RuoyuZhou
Add VPTO backend and HIVM intrinsic emission
e6da4f2
RuoyuZhou
Rename VPTO terminology to PTO Micro Instruction Set
9cb5d6f
@zhoubotzhoubot
changed the title
[codex] Add VPTO backend and HIVM intrinsic emission[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emissionMar 30, 2026
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees


No one assigned


Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

6 participants

@zhoubot@HecreReed@zhangstevenunity@TaoTao-real@FangRui0@learning-chip

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default");
}
} catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission - #2
Draft
zhoubot wants to merge 315 commits into
mainfrom 
codex/vpto-hivm-intrinsics
Draft
[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission#2
zhoubot wants to merge 315 commits into
mainfrom 
codex/vpto-hivm-intrinsics
Conversation
@zhoubot
@zhoubotzhoubot
commented
Mar 30, 2026•

edited

Loading

Copy link


Copy Markdown

Summary
This PR lands the PTO Micro Instruction Set backend surface in PTOAS and wires the final HIVM/CCE intrinsic emission path through the LLVM text emitter.
It includes:
  • the PTO Micro Instruction Set dialect/lowering surface, text/LLVM emitters, and backend wiring
  • version selection, ptr-boundary, loop/fusion, and host validation plumbing
  • the PTO Micro Instruction Set spec/manifest/docs and phased regression suites
  • final direct HIVM emitter coverage for the remaining missing micro-instructions
  • a repo-wide terminology pass that replaces user-facing VPTO naming with PTO Micro Instruction Set
Why
The backend work was partially implemented but the final LLVM emitter still had gaps in the direct intrinsic path. In particular, get_buf, rls_buf, copy_ubuf_to_ubuf, ppack, and punpack were implemented elsewhere in the pipeline but were not emitted as HIVM intrinsics from VPTOLLVMEmitter.cpp, and vintlvv2/vdintlvv2 were decoding the wrong part-token enum.
This PR closes that gap, adds regression coverage so implemented micro-ops are checked against the final emitter, and aligns repo-facing terminology on PTO Micro Instruction Set while preserving stable technical identifiers such as the vpto backend flag and existing file/class names.
Impact
User-visible outcomes:
  • --pto-backend=vpto is wired through PTOAS with PTO Micro Instruction Set lowering and testing support.
  • --vpto-emit-hivm-llvm now emits the final HIVM intrinsics for the previously missing micro-op families.
  • the inventory script now fails if an implemented micro-op is missing from the direct HIVM emitter.
  • user-facing docs, diagnostics, and test/readme text now use PTO Micro Instruction Set instead of VPTO.
Validation
Ran locally:
  • ninja -C build-src312 ptoas
  • python3 test/vpto/scripts/check_vpto_coverage.py
  • ./build-src312/tools/ptoas/ptoas --pto-arch=a5 --pto-backend=vpto --vpto-emit-hivm-llvm test/phase2/vpto_emit_hivm_missing_intrinsics.mlir -o /tmp/vpto_emit_hivm_missing_intrinsics.ll
Environment note:
  • FileCheck is not installed in this environment, so I could not run the lit-style FileCheck assertions locally.
  • bisheng is not on PATH; the emitter falls back to the configured default target attributes, and the emission command still succeeds.
HecreReedand others
added 30 commits
March 10, 2026 20:57
@HecreReed
test: fix A5 MatMul tile layout in generator
71f176a
@HecreReed
Keep set_validshape PR focused
d1bd3f0
@zhangstevenunity
Merge pull requesthw-native-sys#237from HecreReed/codex/fix-a5-matm…
a40dea7
…ul-rowexpand-samples
test(samples): fix a5 matmul/rowexpand tile constraints
@zhangstevenunity
Merge pull requesthw-native-sys#236from HecreReed/codex/set-validsh…
c250b04
…ape-op
Add pto.set_validshape op
@zhangstevenunity
Merge pull requesthw-native-sys#229from HecreReed/codex/pypto-ir-pa…
4afe7f8
…rser-cases
Add fixed PyPTO ir_parser PTO snapshots
@HecreReed
ci: skip print in remote validation defaults
af7eb91
@HecreReed
fix(fillpad): split tfillpad and tfillpad_expand lowering
e2f7b92
@HecreReed
Fix tfillpad pad-null verifier and add invalid test
4a50813
@zhangstevenunity
Merge pull requesthw-native-sys#241from HecreReed/codex/fix-tfillpa…
8eb9e23
…d-expand-lowering
fix(fillpad): correct tfillpad/tfillpad_expand ISA mapping
@HecreReed
feat(ptoas): add release version to --version
20c4972
@zhangstevenunity
Merge pull requesthw-native-sys#239from HecreReed/codex/fix-issue-2…
09636d2
…07-origin-main
ci: skip print in remote validation defaults
Ruoyu Zhou
chore: prefer cann set_env for npu validation
4e9460e
@HecreReed
feat(release): auto-bump ptoas version for release builds
31b56b5
@HecreReed
fix(release): support multi-digit minor versions
d48af37
@HecreReed
fix(wheel): align package version with release version
028229f
@HecreReed
test(cli): assert exact release version when provided
f5bd104
@HecreReed
docs(readme): remove release version note
732ea42
@HecreReed
revert: remove pto.set_validshape support
f0aa51a
@zhangstevenunity
Merge pull requesthw-native-sys#247from HecreReed/codex/revert-setv…
d3e0aa8
…alidshape
revert: remove pto.set_validshape support
@zhangstevenunity
Merge pull requesthw-native-sys#246from zhoubot/codex/cann9-env-def…
8b8e911
…aults
chore: prefer cann set_env for npu validation
@TaoTao-real
Fix scf.if tile result lowering and add regression sample
5a5d952
@TaoTao-real
Skip ptobc roundtrip for if-else tile-result regression sample
ece6000
@zhangstevenunity
Merge pull requesthw-native-sys#242from HecreReed/codex/ptoas-versi…
80a5eeb
…on-flag
feat(ptoas): expose release version via --version
@zhangstevenunity
Merge pull requesthw-native-sys#244from TaoTao-real/codex/fix-if-el…
548e509
…se-tile-memref
Fix scf.if tile result lowering mismatch in ptoas
@HecreReed
fix: handle cfg-based emitc lowering in ptoas
07cffcf
@HecreReed
test: cover scf while cfg emission
ab2494f
@zhangstevenunity
Merge pull requesthw-native-sys#232from wangqilin18/codex/pto-arch-…
e76c96b
…mem-spec
Plan memory: use pto-arch for mem specs
@HecreReed
test: cover scf for break-like lowering
169eef1
@HecreReed
test: move scf control-flow cases under samples
720d219
@zhangstevenunity
Merge pull requesthw-native-sys#250from HecreReed/codex/scf-control…
c431087
…-flow
Fix EmitC CFG lowering for scf.while and add SCF control-flow tests
FangRui0and others
added 29 commits
March 27, 2026 10:10
@FangRui0
fix: restore single-entry sort32 sample for npu validation function n…
fc5ae3e
…ame parser
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge pull requesthw-native-sys#372from FangRui0/fix-remote-ci
2c40a5f
fix: restore single-entry sort32 sample for npu validation function n…
@zhangstevenunity
Merge pull requesthw-native-sys#342from HecreReed/fix-a5-gatherb-sc…
5adc661
…atter
fix: stabilize A5 scatter and gatherb validation
@FangRui0
Fix selected codecheck warnings
3165e07
qukelin
fix: use !pto.ptr for frontend gm_slot_buffer
41497dc
@zhangstevenunity
Merge pull requesthw-native-sys#376from KurrinQu/refactor-tile-emit…
70b4b4a
…c-gm-ptr-20260327
fix: use !pto.ptr for frontend gm_slot_buffer
@zhangstevenunity
Merge pull requesthw-native-sys#367from FangRui0/codecheck
b978d86
Fix codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#368from FangRui0/fix_verify
66cfa14
fix: Fix ptobc ctest failures by updating PTO samples
@HecreReed
[Feature] Support explicit FFTS modes for sync.set
d87678c
qukelin
test: add A3 TPushTPop sample cases
c57683a
@HecreReed
fix(release): preserve macos ptoas dist portability
6f7b3e2
@zhangstevenunity
Merge pull requesthw-native-sys#383from HecreReed/codex/issue380-ma…
d2fad66
…cos-release-dist
fix(release): preserve macOS ptoas binary portability
@zhangstevenunity
Merge pull requesthw-native-sys#382from KurrinQu/tpush-tpop-a3-samp…
3da2b88
…les-20260327
test: add A3 TPushTPop sample cases
@zhangstevenunity
Add manual event-id array support
ddfcc89
@FangRui0
fix: delete redundant code comments
30b3859
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge remote-tracking branch 'origin/main' into codex/eventid-array-m…
9db2d97
…anual-sync
# Conflicts:
#	include/PTO/IR/PTOOps.td
#	lib/PTO/Transforms/PTOToEmitC.cpp
@FangRui0
feat: add OAT.3 license header
cc18b84
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Prevent CSE from folding event-id array declarations
cf9c701
@zhangstevenunity
Prevent stale event-id array reads after CSE
ee79c5f
@zhangstevenunity
Merge pull requesthw-native-sys#385from zhangstevenunity/codex/even…
a57a0ae
…tid-array-manual
support eventid array manual
@zhangstevenunity
Merge pull requesthw-native-sys#386from FangRui0/codecheck
0c431a9
Fix Codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#377from HecreReed/codex/issue-369
bcdf492
[Feature] Support explicit getFFTSMsg modes in sync.set
@zhangstevenunity
emitc: render scalar constants as const locals
b16b816
mirkodevita
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
70cf07f
@zhangstevenunity
Merge pull requesthw-native-sys#391from zhangstevenunity/codex/arit…
ba4a1db
…h-constant-const
emitc: render scalar constants as const locals
@zhangstevenunity
Merge pull requesthw-native-sys#390from MirkoDeVita98/quant_op
b6a3c18
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
RuoyuZhou
Merge remote-tracking branch 'origin/main'
2775cfc
# Conflicts:
#	.github/workflows/ci.yml
#	docker/Dockerfile
RuoyuZhou
Add VPTO backend and HIVM intrinsic emission
e6da4f2
RuoyuZhou
Rename VPTO terminology to PTO Micro Instruction Set
9cb5d6f
@zhoubotzhoubot
changed the title
[codex] Add VPTO backend and HIVM intrinsic emission[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emissionMar 30, 2026
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees


No one assigned


Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

6 participants

@zhoubot@HecreReed@zhangstevenunity@TaoTao-real@FangRui0@learning-chip

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers");
}
} catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '

Skip to content
[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission - #2
Draft
zhoubot wants to merge 315 commits into
mainfrom 
codex/vpto-hivm-intrinsics
Draft
[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission#2
zhoubot wants to merge 315 commits into
mainfrom 
codex/vpto-hivm-intrinsics
Conversation
@zhoubot
@zhoubotzhoubot
commented
Mar 30, 2026•

edited

Loading

Copy link


Copy Markdown

Summary
This PR lands the PTO Micro Instruction Set backend surface in PTOAS and wires the final HIVM/CCE intrinsic emission path through the LLVM text emitter.
It includes:
  • the PTO Micro Instruction Set dialect/lowering surface, text/LLVM emitters, and backend wiring
  • version selection, ptr-boundary, loop/fusion, and host validation plumbing
  • the PTO Micro Instruction Set spec/manifest/docs and phased regression suites
  • final direct HIVM emitter coverage for the remaining missing micro-instructions
  • a repo-wide terminology pass that replaces user-facing VPTO naming with PTO Micro Instruction Set
Why
The backend work was partially implemented but the final LLVM emitter still had gaps in the direct intrinsic path. In particular, get_buf, rls_buf, copy_ubuf_to_ubuf, ppack, and punpack were implemented elsewhere in the pipeline but were not emitted as HIVM intrinsics from VPTOLLVMEmitter.cpp, and vintlvv2/vdintlvv2 were decoding the wrong part-token enum.
This PR closes that gap, adds regression coverage so implemented micro-ops are checked against the final emitter, and aligns repo-facing terminology on PTO Micro Instruction Set while preserving stable technical identifiers such as the vpto backend flag and existing file/class names.
Impact
User-visible outcomes:
  • --pto-backend=vpto is wired through PTOAS with PTO Micro Instruction Set lowering and testing support.
  • --vpto-emit-hivm-llvm now emits the final HIVM intrinsics for the previously missing micro-op families.
  • the inventory script now fails if an implemented micro-op is missing from the direct HIVM emitter.
  • user-facing docs, diagnostics, and test/readme text now use PTO Micro Instruction Set instead of VPTO.
Validation
Ran locally:
  • ninja -C build-src312 ptoas
  • python3 test/vpto/scripts/check_vpto_coverage.py
  • ./build-src312/tools/ptoas/ptoas --pto-arch=a5 --pto-backend=vpto --vpto-emit-hivm-llvm test/phase2/vpto_emit_hivm_missing_intrinsics.mlir -o /tmp/vpto_emit_hivm_missing_intrinsics.ll
Environment note:
  • FileCheck is not installed in this environment, so I could not run the lit-style FileCheck assertions locally.
  • bisheng is not on PATH; the emitter falls back to the configured default target attributes, and the emission command still succeeds.
HecreReedand others
added 30 commits
March 10, 2026 20:57
@HecreReed
test: fix A5 MatMul tile layout in generator
71f176a
@HecreReed
Keep set_validshape PR focused
d1bd3f0
@zhangstevenunity
Merge pull requesthw-native-sys#237from HecreReed/codex/fix-a5-matm…
a40dea7
…ul-rowexpand-samples
test(samples): fix a5 matmul/rowexpand tile constraints
@zhangstevenunity
Merge pull requesthw-native-sys#236from HecreReed/codex/set-validsh…
c250b04
…ape-op
Add pto.set_validshape op
@zhangstevenunity
Merge pull requesthw-native-sys#229from HecreReed/codex/pypto-ir-pa…
4afe7f8
…rser-cases
Add fixed PyPTO ir_parser PTO snapshots
@HecreReed
ci: skip print in remote validation defaults
af7eb91
@HecreReed
fix(fillpad): split tfillpad and tfillpad_expand lowering
e2f7b92
@HecreReed
Fix tfillpad pad-null verifier and add invalid test
4a50813
@zhangstevenunity
Merge pull requesthw-native-sys#241from HecreReed/codex/fix-tfillpa…
8eb9e23
…d-expand-lowering
fix(fillpad): correct tfillpad/tfillpad_expand ISA mapping
@HecreReed
feat(ptoas): add release version to --version
20c4972
@zhangstevenunity
Merge pull requesthw-native-sys#239from HecreReed/codex/fix-issue-2…
09636d2
…07-origin-main
ci: skip print in remote validation defaults
Ruoyu Zhou
chore: prefer cann set_env for npu validation
4e9460e
@HecreReed
feat(release): auto-bump ptoas version for release builds
31b56b5
@HecreReed
fix(release): support multi-digit minor versions
d48af37
@HecreReed
fix(wheel): align package version with release version
028229f
@HecreReed
test(cli): assert exact release version when provided
f5bd104
@HecreReed
docs(readme): remove release version note
732ea42
@HecreReed
revert: remove pto.set_validshape support
f0aa51a
@zhangstevenunity
Merge pull requesthw-native-sys#247from HecreReed/codex/revert-setv…
d3e0aa8
…alidshape
revert: remove pto.set_validshape support
@zhangstevenunity
Merge pull requesthw-native-sys#246from zhoubot/codex/cann9-env-def…
8b8e911
…aults
chore: prefer cann set_env for npu validation
@TaoTao-real
Fix scf.if tile result lowering and add regression sample
5a5d952
@TaoTao-real
Skip ptobc roundtrip for if-else tile-result regression sample
ece6000
@zhangstevenunity
Merge pull requesthw-native-sys#242from HecreReed/codex/ptoas-versi…
80a5eeb
…on-flag
feat(ptoas): expose release version via --version
@zhangstevenunity
Merge pull requesthw-native-sys#244from TaoTao-real/codex/fix-if-el…
548e509
…se-tile-memref
Fix scf.if tile result lowering mismatch in ptoas
@HecreReed
fix: handle cfg-based emitc lowering in ptoas
07cffcf
@HecreReed
test: cover scf while cfg emission
ab2494f
@zhangstevenunity
Merge pull requesthw-native-sys#232from wangqilin18/codex/pto-arch-…
e76c96b
…mem-spec
Plan memory: use pto-arch for mem specs
@HecreReed
test: cover scf for break-like lowering
169eef1
@HecreReed
test: move scf control-flow cases under samples
720d219
@zhangstevenunity
Merge pull requesthw-native-sys#250from HecreReed/codex/scf-control…
c431087
…-flow
Fix EmitC CFG lowering for scf.while and add SCF control-flow tests
FangRui0and others
added 29 commits
March 27, 2026 10:10
@FangRui0
fix: restore single-entry sort32 sample for npu validation function n…
fc5ae3e
…ame parser
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge pull requesthw-native-sys#372from FangRui0/fix-remote-ci
2c40a5f
fix: restore single-entry sort32 sample for npu validation function n…
@zhangstevenunity
Merge pull requesthw-native-sys#342from HecreReed/fix-a5-gatherb-sc…
5adc661
…atter
fix: stabilize A5 scatter and gatherb validation
@FangRui0
Fix selected codecheck warnings
3165e07
qukelin
fix: use !pto.ptr for frontend gm_slot_buffer
41497dc
@zhangstevenunity
Merge pull requesthw-native-sys#376from KurrinQu/refactor-tile-emit…
70b4b4a
…c-gm-ptr-20260327
fix: use !pto.ptr for frontend gm_slot_buffer
@zhangstevenunity
Merge pull requesthw-native-sys#367from FangRui0/codecheck
b978d86
Fix codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#368from FangRui0/fix_verify
66cfa14
fix: Fix ptobc ctest failures by updating PTO samples
@HecreReed
[Feature] Support explicit FFTS modes for sync.set
d87678c
qukelin
test: add A3 TPushTPop sample cases
c57683a
@HecreReed
fix(release): preserve macos ptoas dist portability
6f7b3e2
@zhangstevenunity
Merge pull requesthw-native-sys#383from HecreReed/codex/issue380-ma…
d2fad66
…cos-release-dist
fix(release): preserve macOS ptoas binary portability
@zhangstevenunity
Merge pull requesthw-native-sys#382from KurrinQu/tpush-tpop-a3-samp…
3da2b88
…les-20260327
test: add A3 TPushTPop sample cases
@zhangstevenunity
Add manual event-id array support
ddfcc89
@FangRui0
fix: delete redundant code comments
30b3859
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge remote-tracking branch 'origin/main' into codex/eventid-array-m…
9db2d97
…anual-sync
# Conflicts:
#	include/PTO/IR/PTOOps.td
#	lib/PTO/Transforms/PTOToEmitC.cpp
@FangRui0
feat: add OAT.3 license header
cc18b84
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Prevent CSE from folding event-id array declarations
cf9c701
@zhangstevenunity
Prevent stale event-id array reads after CSE
ee79c5f
@zhangstevenunity
Merge pull requesthw-native-sys#385from zhangstevenunity/codex/even…
a57a0ae
…tid-array-manual
support eventid array manual
@zhangstevenunity
Merge pull requesthw-native-sys#386from FangRui0/codecheck
0c431a9
Fix Codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#377from HecreReed/codex/issue-369
bcdf492
[Feature] Support explicit getFFTSMsg modes in sync.set
@zhangstevenunity
emitc: render scalar constants as const locals
b16b816
mirkodevita
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
70cf07f
@zhangstevenunity
Merge pull requesthw-native-sys#391from zhangstevenunity/codex/arit…
ba4a1db
…h-constant-const
emitc: render scalar constants as const locals
@zhangstevenunity
Merge pull requesthw-native-sys#390from MirkoDeVita98/quant_op
b6a3c18
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
RuoyuZhou
Merge remote-tracking branch 'origin/main'
2775cfc
# Conflicts:
#	.github/workflows/ci.yml
#	docker/Dockerfile
RuoyuZhou
Add VPTO backend and HIVM intrinsic emission
e6da4f2
RuoyuZhou
Rename VPTO terminology to PTO Micro Instruction Set
9cb5d6f
@zhoubotzhoubot
changed the title
[codex] Add VPTO backend and HIVM intrinsic emission[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emissionMar 30, 2026
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees


No one assigned


Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

6 participants

@zhoubot@HecreReed@zhangstevenunity@TaoTao-real@FangRui0@learning-chip

, 'i');
if (__m === '*' || __re.test(location.href)) {
injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode");
}
} catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); }
})();
})();

Skip to content
[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission - #2
Draft
zhoubot wants to merge 315 commits into
mainfrom 
codex/vpto-hivm-intrinsics
Draft
[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emission#2
zhoubot wants to merge 315 commits into
mainfrom 
codex/vpto-hivm-intrinsics
Conversation
@zhoubot
@zhoubotzhoubot
commented
Mar 30, 2026•

edited

Loading

Copy link


Copy Markdown

Summary
This PR lands the PTO Micro Instruction Set backend surface in PTOAS and wires the final HIVM/CCE intrinsic emission path through the LLVM text emitter.
It includes:
  • the PTO Micro Instruction Set dialect/lowering surface, text/LLVM emitters, and backend wiring
  • version selection, ptr-boundary, loop/fusion, and host validation plumbing
  • the PTO Micro Instruction Set spec/manifest/docs and phased regression suites
  • final direct HIVM emitter coverage for the remaining missing micro-instructions
  • a repo-wide terminology pass that replaces user-facing VPTO naming with PTO Micro Instruction Set
Why
The backend work was partially implemented but the final LLVM emitter still had gaps in the direct intrinsic path. In particular, get_buf, rls_buf, copy_ubuf_to_ubuf, ppack, and punpack were implemented elsewhere in the pipeline but were not emitted as HIVM intrinsics from VPTOLLVMEmitter.cpp, and vintlvv2/vdintlvv2 were decoding the wrong part-token enum.
This PR closes that gap, adds regression coverage so implemented micro-ops are checked against the final emitter, and aligns repo-facing terminology on PTO Micro Instruction Set while preserving stable technical identifiers such as the vpto backend flag and existing file/class names.
Impact
User-visible outcomes:
  • --pto-backend=vpto is wired through PTOAS with PTO Micro Instruction Set lowering and testing support.
  • --vpto-emit-hivm-llvm now emits the final HIVM intrinsics for the previously missing micro-op families.
  • the inventory script now fails if an implemented micro-op is missing from the direct HIVM emitter.
  • user-facing docs, diagnostics, and test/readme text now use PTO Micro Instruction Set instead of VPTO.
Validation
Ran locally:
  • ninja -C build-src312 ptoas
  • python3 test/vpto/scripts/check_vpto_coverage.py
  • ./build-src312/tools/ptoas/ptoas --pto-arch=a5 --pto-backend=vpto --vpto-emit-hivm-llvm test/phase2/vpto_emit_hivm_missing_intrinsics.mlir -o /tmp/vpto_emit_hivm_missing_intrinsics.ll
Environment note:
  • FileCheck is not installed in this environment, so I could not run the lit-style FileCheck assertions locally.
  • bisheng is not on PATH; the emitter falls back to the configured default target attributes, and the emission command still succeeds.
HecreReedand others
added 30 commits
March 10, 2026 20:57
@HecreReed
test: fix A5 MatMul tile layout in generator
71f176a
@HecreReed
Keep set_validshape PR focused
d1bd3f0
@zhangstevenunity
Merge pull requesthw-native-sys#237from HecreReed/codex/fix-a5-matm…
a40dea7
…ul-rowexpand-samples
test(samples): fix a5 matmul/rowexpand tile constraints
@zhangstevenunity
Merge pull requesthw-native-sys#236from HecreReed/codex/set-validsh…
c250b04
…ape-op
Add pto.set_validshape op
@zhangstevenunity
Merge pull requesthw-native-sys#229from HecreReed/codex/pypto-ir-pa…
4afe7f8
…rser-cases
Add fixed PyPTO ir_parser PTO snapshots
@HecreReed
ci: skip print in remote validation defaults
af7eb91
@HecreReed
fix(fillpad): split tfillpad and tfillpad_expand lowering
e2f7b92
@HecreReed
Fix tfillpad pad-null verifier and add invalid test
4a50813
@zhangstevenunity
Merge pull requesthw-native-sys#241from HecreReed/codex/fix-tfillpa…
8eb9e23
…d-expand-lowering
fix(fillpad): correct tfillpad/tfillpad_expand ISA mapping
@HecreReed
feat(ptoas): add release version to --version
20c4972
@zhangstevenunity
Merge pull requesthw-native-sys#239from HecreReed/codex/fix-issue-2…
09636d2
…07-origin-main
ci: skip print in remote validation defaults
Ruoyu Zhou
chore: prefer cann set_env for npu validation
4e9460e
@HecreReed
feat(release): auto-bump ptoas version for release builds
31b56b5
@HecreReed
fix(release): support multi-digit minor versions
d48af37
@HecreReed
fix(wheel): align package version with release version
028229f
@HecreReed
test(cli): assert exact release version when provided
f5bd104
@HecreReed
docs(readme): remove release version note
732ea42
@HecreReed
revert: remove pto.set_validshape support
f0aa51a
@zhangstevenunity
Merge pull requesthw-native-sys#247from HecreReed/codex/revert-setv…
d3e0aa8
…alidshape
revert: remove pto.set_validshape support
@zhangstevenunity
Merge pull requesthw-native-sys#246from zhoubot/codex/cann9-env-def…
8b8e911
…aults
chore: prefer cann set_env for npu validation
@TaoTao-real
Fix scf.if tile result lowering and add regression sample
5a5d952
@TaoTao-real
Skip ptobc roundtrip for if-else tile-result regression sample
ece6000
@zhangstevenunity
Merge pull requesthw-native-sys#242from HecreReed/codex/ptoas-versi…
80a5eeb
…on-flag
feat(ptoas): expose release version via --version
@zhangstevenunity
Merge pull requesthw-native-sys#244from TaoTao-real/codex/fix-if-el…
548e509
…se-tile-memref
Fix scf.if tile result lowering mismatch in ptoas
@HecreReed
fix: handle cfg-based emitc lowering in ptoas
07cffcf
@HecreReed
test: cover scf while cfg emission
ab2494f
@zhangstevenunity
Merge pull requesthw-native-sys#232from wangqilin18/codex/pto-arch-…
e76c96b
…mem-spec
Plan memory: use pto-arch for mem specs
@HecreReed
test: cover scf for break-like lowering
169eef1
@HecreReed
test: move scf control-flow cases under samples
720d219
@zhangstevenunity
Merge pull requesthw-native-sys#250from HecreReed/codex/scf-control…
c431087
…-flow
Fix EmitC CFG lowering for scf.while and add SCF control-flow tests
FangRui0and others
added 29 commits
March 27, 2026 10:10
@FangRui0
fix: restore single-entry sort32 sample for npu validation function n…
fc5ae3e
…ame parser
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge pull requesthw-native-sys#372from FangRui0/fix-remote-ci
2c40a5f
fix: restore single-entry sort32 sample for npu validation function n…
@zhangstevenunity
Merge pull requesthw-native-sys#342from HecreReed/fix-a5-gatherb-sc…
5adc661
…atter
fix: stabilize A5 scatter and gatherb validation
@FangRui0
Fix selected codecheck warnings
3165e07
qukelin
fix: use !pto.ptr for frontend gm_slot_buffer
41497dc
@zhangstevenunity
Merge pull requesthw-native-sys#376from KurrinQu/refactor-tile-emit…
70b4b4a
…c-gm-ptr-20260327
fix: use !pto.ptr for frontend gm_slot_buffer
@zhangstevenunity
Merge pull requesthw-native-sys#367from FangRui0/codecheck
b978d86
Fix codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#368from FangRui0/fix_verify
66cfa14
fix: Fix ptobc ctest failures by updating PTO samples
@HecreReed
[Feature] Support explicit FFTS modes for sync.set
d87678c
qukelin
test: add A3 TPushTPop sample cases
c57683a
@HecreReed
fix(release): preserve macos ptoas dist portability
6f7b3e2
@zhangstevenunity
Merge pull requesthw-native-sys#383from HecreReed/codex/issue380-ma…
d2fad66
…cos-release-dist
fix(release): preserve macOS ptoas binary portability
@zhangstevenunity
Merge pull requesthw-native-sys#382from KurrinQu/tpush-tpop-a3-samp…
3da2b88
…les-20260327
test: add A3 TPushTPop sample cases
@zhangstevenunity
Add manual event-id array support
ddfcc89
@FangRui0
fix: delete redundant code comments
30b3859
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Merge remote-tracking branch 'origin/main' into codex/eventid-array-m…
9db2d97
…anual-sync
# Conflicts:
#	include/PTO/IR/PTOOps.td
#	lib/PTO/Transforms/PTOToEmitC.cpp
@FangRui0
feat: add OAT.3 license header
cc18b84
Signed-off-by: FangRui <fangrui_95@163.com>
@zhangstevenunity
Prevent CSE from folding event-id array declarations
cf9c701
@zhangstevenunity
Prevent stale event-id array reads after CSE
ee79c5f
@zhangstevenunity
Merge pull requesthw-native-sys#385from zhangstevenunity/codex/even…
a57a0ae
…tid-array-manual
support eventid array manual
@zhangstevenunity
Merge pull requesthw-native-sys#386from FangRui0/codecheck
0c431a9
Fix Codecheck warnings
@zhangstevenunity
Merge pull requesthw-native-sys#377from HecreReed/codex/issue-369
bcdf492
[Feature] Support explicit getFFTSMsg modes in sync.set
@zhangstevenunity
emitc: render scalar constants as const locals
b16b816
mirkodevita
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
70cf07f
@zhangstevenunity
Merge pull requesthw-native-sys#391from zhangstevenunity/codex/arit…
ba4a1db
…h-constant-const
emitc: render scalar constants as const locals
@zhangstevenunity
Merge pull requesthw-native-sys#390from MirkoDeVita98/quant_op
b6a3c18
feat: add pto.tquant op with INT8_SYM/ASYM quantization support
RuoyuZhou
Merge remote-tracking branch 'origin/main'
2775cfc
# Conflicts:
#	.github/workflows/ci.yml
#	docker/Dockerfile
RuoyuZhou
Add VPTO backend and HIVM intrinsic emission
e6da4f2
RuoyuZhou
Rename VPTO terminology to PTO Micro Instruction Set
9cb5d6f
@zhoubotzhoubot
changed the title
[codex] Add VPTO backend and HIVM intrinsic emission[codex] Add PTO Micro Instruction Set backend and HIVM intrinsic emissionMar 30, 2026
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment

Reviewers


No reviews


Assignees


No one assigned


Labels


None yet


Projects


None yet


Milestone


No milestone


Development

Successfully merging this pull request may close these issues.

6 participants

@zhoubot@HecreReed@zhangstevenunity@TaoTao-real@FangRui0@learning-chip