NVFP4 per-token recipe - #2913

Draft

YigongQin wants to merge 10 commits into

NVIDIA:mainfrom

YigongQin:yigongq/pertoken-nvfp4-gemm

Commits on Apr 22, 2026

plumb through nvfp4 pertoken recipe
YigongQin
committed
a1f0dfe
interface checks
YigongQin
committed
6eb70d3
more unit test
YigongQin
committed
86694ff
pertoken quantization to match flashinfer
YigongQin
committed
cf367d8
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
authored and
YigongQin
committed
5433f99
fix building failures
YigongQin
committed
8b1c88f
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
authored and
YigongQin
committed
8a3a36d
pertoken nvfp4 tests
YigongQin
committed
1b1b9e6
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
committed
5191ec0

Commits on Apr 24, 2026

pytorch reference for quant
YigongQin
committed
cad6473