feat(moore): add Moore SwiGLU by gongchensu · Pull Request #24 · InfiniTensor/InfiniOps

gongchensu · 2026-03-16T03:12:36Z

A100编译及算子测试：

天数编译及算子测试：

寒武纪编译测试：

沐曦编译测试：

算子测试：

摩尔算子测试：

- add a Moore swiglu backend on top of the shared CUDA-style path - extract shared swiglu compute into a reusable op for backend override - keep Moore-specific half and bfloat162 handling in the Moore backend only

voltjia · 2026-03-19T13:48:24Z

NVIDIA

Looking in indexes: https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple
Processing /home/huangjiacheng/InfiniOps
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Installing backend dependencies: started
Installing backend dependencies: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Building wheels for collected packages: InfiniOps
Building wheel for InfiniOps (pyproject.toml): started
Building wheel for InfiniOps (pyproject.toml): finished with status 'done'
Created wheel for InfiniOps: filename=infiniops-0.1.0-cp310-cp310-linux_x86_64.whl size=391749 sha256=44d0484ba4ed586bd6ac6a1ebce0f33cf785055debd19d92d5ec0bfe68c15043
Stored in directory: /tmp/pip-ephem-wheel-cache-crzdieq5/wheels/b5/f3/6e/961028f73a2712eb7b753a23bdd1baaa714e27760fd92de56c
Successfully built InfiniOps
Installing collected packages: InfiniOps
Attempting uninstall: InfiniOps
Found existing installation: InfiniOps 0.1.0
Uninstalling InfiniOps-0.1.0:
Successfully uninstalled InfiniOps-0.1.0
Successfully installed InfiniOps-0.1.0
[notice] A new release of pip is available: 25.3 -> 26.0.1
[notice] To update, run: pip install --upgrade pip
============================= test session starts ==============================
platform linux -- Python 3.10.16, pytest-9.0.2, pluggy-1.6.0
rootdir: /home/huangjiacheng/InfiniOps
configfile: pyproject.toml
testpaths: tests
plugins: anyio-4.12.1, xdist-3.8.0, cov-7.0.0, typeguard-4.4.4
collected 3372 items
tests/test_add.py ...................................................... [ 1%]
........................................................................ [ 3%]
........................................................................ [ 5%]
.................. [ 6%]
tests/test_causal_softmax.py .................................... [ 7%]
tests/test_gemm.py ..................................................... [ 9%]
........................................................................ [ 11%]
........................................................................ [ 13%]
........................................................................ [ 15%]
........................................................................ [ 17%]
........................................................................ [ 19%]
........................................................................ [ 21%]
........................................................................ [ 23%]
........................................................................ [ 26%]
........................................................................ [ 28%]
........................................................................ [ 30%]
........................................................................ [ 32%]
........................................................................ [ 34%]
........................................................................ [ 36%]
........................................................................ [ 38%]
........................................................................ [ 41%]
........................................................................ [ 43%]
........................................................................ [ 45%]
........................................................................ [ 47%]
........................................................................ [ 49%]
........................................................................ [ 51%]
........................................................................ [ 53%]
........................................................................ [ 56%]
........................................................................ [ 58%]
........................................................................ [ 60%]
........................................................................ [ 62%]
........................................................................ [ 64%]
........................................................................ [ 66%]
........................................................................ [ 68%]
........................................................................ [ 70%]
........................................................................ [ 73%]
........................................................................ [ 75%]
........................................................................ [ 77%]
........................................................................ [ 79%]
........................................................................ [ 81%]
........................................................................ [ 83%]
........................................................................ [ 85%]
........................................................................ [ 88%]
........................................................................ [ 90%]
........................................................................ [ 92%]
........................................................................ [ 94%]
................................................................... [ 96%]
tests/test_rms_norm.py ................................................. [ 97%]
....................... [ 98%]
tests/test_swiglu.py ................................................ [100%]
======================= 3372 passed in 261.40s (0:04:21) =======================

MetaX

WARNING: The directory '/root/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag.
Looking in indexes: https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple
Processing ./.
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Installing backend dependencies: started
Installing backend dependencies: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Building wheels for collected packages: InfiniOps
Building wheel for InfiniOps (pyproject.toml): started
Building wheel for InfiniOps (pyproject.toml): finished with status 'done'
Created wheel for InfiniOps: filename=infiniops-0.1.0-cp310-cp310-linux_x86_64.whl size=541679 sha256=94339568f2e244056fe238fa3200f315da9ae150e0aaf4869c5bcde5f9756261
Stored in directory: /tmp/pip-ephem-wheel-cache-ysck2x6b/wheels/b5/f3/6e/961028f73a2712eb7b753a23bdd1baaa714e27760fd92de56c
Successfully built InfiniOps
Installing collected packages: InfiniOps
Attempting uninstall: InfiniOps
Found existing installation: InfiniOps 0.1.0
Uninstalling InfiniOps-0.1.0:
Successfully uninstalled InfiniOps-0.1.0
Successfully installed InfiniOps-0.1.0
============================= test session starts ==============================
platform linux -- Python 3.10.20, pytest-8.4.1, pluggy-1.6.0
rootdir: /home/huangjiacheng/InfiniOps
configfile: pyproject.toml
testpaths: tests
collected 3372 items
tests/test_add.py ...................................................... [ 1%]
........................................................................ [ 3%]
........................................................................ [ 5%]
.................. [ 6%]
tests/test_causal_softmax.py ..................Fatal Python error: Segmentation fault
Current thread 0x00007dd19b53a740 (most recent call first):
File "/home/huangjiacheng/InfiniOps/tests/test_causal_softmax.py", line 43 in _causal_softmax
File "/home/huangjiacheng/InfiniOps/tests/conftest.py", line 80 in pytest_pyfunc_call
File "/opt/conda/lib/python3.10/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/opt/conda/lib/python3.10/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/opt/conda/lib/python3.10/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/opt/conda/lib/python3.10/site-packages/_pytest/python.py", line 1671 in runtest
File "/opt/conda/lib/python3.10/site-packages/_pytest/runner.py", line 178 in pytest_runtest_call
File "/opt/conda/lib/python3.10/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/opt/conda/lib/python3.10/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/opt/conda/lib/python3.10/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/opt/conda/lib/python3.10/site-packages/_pytest/runner.py", line 246 in <lambda>
File "/opt/conda/lib/python3.10/site-packages/_pytest/runner.py", line 344 in from_call
File "/opt/conda/lib/python3.10/site-packages/_pytest/runner.py", line 245 in call_and_report
File "/opt/conda/lib/python3.10/site-packages/_pytest/runner.py", line 136 in runtestprotocol
File "/opt/conda/lib/python3.10/site-packages/_pytest/runner.py", line 117 in pytest_runtest_protocol
File "/opt/conda/lib/python3.10/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/opt/conda/lib/python3.10/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/opt/conda/lib/python3.10/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/opt/conda/lib/python3.10/site-packages/_pytest/main.py", line 367 in pytest_runtestloop
File "/opt/conda/lib/python3.10/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/opt/conda/lib/python3.10/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/opt/conda/lib/python3.10/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/opt/conda/lib/python3.10/site-packages/_pytest/main.py", line 343 in _main
File "/opt/conda/lib/python3.10/site-packages/_pytest/main.py", line 289 in wrap_session
File "/opt/conda/lib/python3.10/site-packages/_pytest/main.py", line 336 in pytest_cmdline_main
File "/opt/conda/lib/python3.10/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/opt/conda/lib/python3.10/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/opt/conda/lib/python3.10/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/opt/conda/lib/python3.10/site-packages/_pytest/config/__init__.py", line 175 in main
File "/opt/conda/lib/python3.10/site-packages/_pytest/config/__init__.py", line 201 in console_main
File "/opt/conda/lib/python3.10/site-packages/pytest/__main__.py", line 9 in <module>
File "/home/huangjiacheng/.local/share/uv/python/cpython-3.10-linux-x86_64-gnu/lib/python3.10/runpy.py", line 86 in _run_code
File "/home/huangjiacheng/.local/share/uv/python/cpython-3.10-linux-x86_64-gnu/lib/python3.10/runpy.py", line 196 in _run_module_as_main
Extension modules: numpy.core._multiarray_umath, numpy.core._multiarray_tests, numpy.linalg._umath_linalg, numpy.fft._pocketfft_internal, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, torch._C, torch._C._fft, torch._C._linalg, torch._C._nested, torch._C._nn, torch._C._sparse, torch._C._special (total: 20)

Iluvatar

WARNING: The directory '/root/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag.
Looking in indexes: https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple
Processing ./.
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Building wheels for collected packages: InfiniOps
Building wheel for InfiniOps (pyproject.toml): started
Building wheel for InfiniOps (pyproject.toml): finished with status 'done'
Created wheel for InfiniOps: filename=infiniops-0.1.0-cp310-cp310-linux_x86_64.whl size=342337 sha256=e16079bc05a63f635fc593b9479878457d1564bdd26a2ed6ac3493615609190b
Stored in directory: /tmp/pip-ephem-wheel-cache-jnbr7krw/wheels/b5/f3/6e/961028f73a2712eb7b753a23bdd1baaa714e27760fd92de56c
Successfully built InfiniOps
Installing collected packages: InfiniOps
Attempting uninstall: InfiniOps
Found existing installation: InfiniOps 0.1.0
Uninstalling InfiniOps-0.1.0:
Successfully uninstalled InfiniOps-0.1.0
Successfully installed InfiniOps-0.1.0
============================= test session starts ==============================
platform linux -- Python 3.10.19, pytest-9.0.2, pluggy-1.6.0
rootdir: /home/huangjiacheng/InfiniOps
configfile: pyproject.toml
testpaths: tests
plugins: anyio-4.9.0, cov-7.0.0, xdist-3.8.0
collected 3372 items
tests/test_add.py ...................................................... [ 1%]
........................................................................ [ 3%]
........................................................................ [ 5%]
.................. [ 6%]
tests/test_causal_softmax.py .................................... [ 7%]
tests/test_gemm.py ..................................................... [ 9%]
........................................................................ [ 11%]
........................................................................ [ 13%]
........................................................................ [ 15%]
........................................................................ [ 17%]
........................................................................ [ 19%]
........................................................................ [ 21%]
........................................................................ [ 23%]
........................................................................ [ 26%]
........................................................................ [ 28%]
........................................................................ [ 30%]
........................................................................ [ 32%]
........................................................................ [ 34%]
........................................................................ [ 36%]
........................................................................ [ 38%]
........................................................................ [ 41%]
........................................................................ [ 43%]
........................................................................ [ 45%]
........................................................................ [ 47%]
........................................................................ [ 49%]
........................................................................ [ 51%]
........................................................................ [ 53%]
........................................................................ [ 56%]
........................................................................ [ 58%]
........................................................................ [ 60%]
........................................................................ [ 62%]
........................................................................ [ 64%]
........................................................................ [ 66%]
........................................................................ [ 68%]
........................................................................ [ 70%]
........................................................................ [ 73%]
........................................................................ [ 75%]
........................................................................ [ 77%]
........................................................................ [ 79%]
........................................................................ [ 81%]
........................................................................ [ 83%]
........................................................................ [ 85%]
........................................................................ [ 88%]
........................................................................ [ 90%]
........................................................................ [ 92%]
........................................................................ [ 94%]
................................................................... [ 96%]
tests/test_rms_norm.py ................................................. [ 97%]
....................... [ 98%]
tests/test_swiglu.py ................................................ [100%]
======================= 3372 passed in 243.81s (0:04:03) =======================

Moore

WARNING: The directory '/root/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag.
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Processing ./.
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Installing backend dependencies: started
Installing backend dependencies: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Building wheels for collected packages: InfiniOps
Building wheel for InfiniOps (pyproject.toml): started
Building wheel for InfiniOps (pyproject.toml): finished with status 'done'
Created wheel for InfiniOps: filename=infiniops-0.1.0-cp310-cp310-linux_x86_64.whl size=344534 sha256=a597d39aca6ac2fb3744c392358d6c9dd46d19d448e937c66f1f6b7cf90ba4c0
Stored in directory: /tmp/pip-ephem-wheel-cache-fhcd7kz8/wheels/b5/f3/6e/961028f73a2712eb7b753a23bdd1baaa714e27760fd92de56c
Successfully built InfiniOps
Installing collected packages: InfiniOps
Attempting uninstall: InfiniOps
Found existing installation: InfiniOps 0.1.0
Uninstalling InfiniOps-0.1.0:
Successfully uninstalled InfiniOps-0.1.0
Successfully installed InfiniOps-0.1.0
============================= test session starts ==============================
platform linux -- Python 3.10.20, pytest-7.2.2, pluggy-1.6.0
rootdir: /home/huangjiacheng/InfiniOps, configfile: pyproject.toml, testpaths: tests
plugins: cov-7.0.0, xdist-3.8.0, hypothesis-6.145.0, anyio-4.10.0
collected 3372 items
tests/test_add.py ...................................................... [ 1%]
........................................................................ [ 3%]
......................................................ssssssssssssssssss [ 5%]
ssssssssssssssssss [ 6%]
tests/test_causal_softmax.py ..................Fatal Python error: Segmentation fault
Current thread 0x00007f63ca2e0740 (most recent call first):
File "/home/huangjiacheng/InfiniOps/tests/test_causal_softmax.py", line 43 in _causal_softmax
File "/home/huangjiacheng/InfiniOps/tests/conftest.py", line 80 in pytest_pyfunc_call
File "/usr/local/lib/python3.10/dist-packages/pluggy/_callers.py", line 121 in _multicall
File "/usr/local/lib/python3.10/dist-packages/pluggy/_manager.py", line 120 in _hookexec
File "/usr/local/lib/python3.10/dist-packages/pluggy/_hooks.py", line 512 in __call__
File "/usr/local/lib/python3.10/dist-packages/_pytest/python.py", line 1789 in runtest
File "/usr/local/lib/python3.10/dist-packages/_pytest/runner.py", line 167 in pytest_runtest_call
File "/usr/local/lib/python3.10/dist-packages/pluggy/_callers.py", line 121 in _multicall
File "/usr/local/lib/python3.10/dist-packages/pluggy/_manager.py", line 120 in _hookexec
File "/usr/local/lib/python3.10/dist-packages/pluggy/_hooks.py", line 512 in __call__
File "/usr/local/lib/python3.10/dist-packages/_pytest/runner.py", line 260 in <lambda>
File "/usr/local/lib/python3.10/dist-packages/_pytest/runner.py", line 339 in from_call
File "/usr/local/lib/python3.10/dist-packages/_pytest/runner.py", line 259 in call_runtest_hook
File "/usr/local/lib/python3.10/dist-packages/_pytest/runner.py", line 220 in call_and_report
File "/usr/local/lib/python3.10/dist-packages/_pytest/runner.py", line 131 in runtestprotocol
File "/usr/local/lib/python3.10/dist-packages/_pytest/runner.py", line 112 in pytest_runtest_protocol
File "/usr/local/lib/python3.10/dist-packages/pluggy/_callers.py", line 121 in _multicall
File "/usr/local/lib/python3.10/dist-packages/pluggy/_manager.py", line 120 in _hookexec
File "/usr/local/lib/python3.10/dist-packages/pluggy/_hooks.py", line 512 in __call__
File "/usr/local/lib/python3.10/dist-packages/_pytest/main.py", line 349 in pytest_runtestloop
File "/usr/local/lib/python3.10/dist-packages/pluggy/_callers.py", line 121 in _multicall
File "/usr/local/lib/python3.10/dist-packages/pluggy/_manager.py", line 120 in _hookexec
File "/usr/local/lib/python3.10/dist-packages/pluggy/_hooks.py", line 512 in __call__
File "/usr/local/lib/python3.10/dist-packages/_pytest/main.py", line 324 in _main
File "/usr/local/lib/python3.10/dist-packages/_pytest/main.py", line 270 in wrap_session
File "/usr/local/lib/python3.10/dist-packages/_pytest/main.py", line 317 in pytest_cmdline_main
File "/usr/local/lib/python3.10/dist-packages/pluggy/_callers.py", line 121 in _multicall
File "/usr/local/lib/python3.10/dist-packages/pluggy/_manager.py", line 120 in _hookexec
File "/usr/local/lib/python3.10/dist-packages/pluggy/_hooks.py", line 512 in __call__
File "/usr/local/lib/python3.10/dist-packages/_pytest/config/__init__.py", line 167 in main
File "/usr/local/lib/python3.10/dist-packages/_pytest/config/__init__.py", line 190 in console_main
File "/usr/local/lib/python3.10/dist-packages/pytest/__main__.py", line 5 in <module>
File "/home/huangjiacheng/.local/share/uv/python/cpython-3.10-linux-x86_64-gnu/lib/python3.10/runpy.py", line 86 in _run_code
File "/home/huangjiacheng/.local/share/uv/python/cpython-3.10-linux-x86_64-gnu/lib/python3.10/runpy.py", line 196 in _run_module_as_main
Extension modules: numpy.core._multiarray_umath, numpy.core._multiarray_tests, numpy.linalg._umath_linalg, numpy.fft._pocketfft_internal, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, torch._C, torch._C._dynamo.autograd_compiler, torch._C._dynamo.eval_frame, torch._C._dynamo.guards, torch._C._dynamo.utils, torch._C._fft, torch._C._linalg, torch._C._nested, torch._C._nn, torch._C._sparse, torch._C._special, torch_musa._MUSAC, markupsafe._speedups (total: 26)

Cambricon

WARNING: The directory '/root/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag.
WARNING: Ignoring invalid distribution -orch (/home/huangjiacheng/.venv/lib/python3.10/site-packages)
Looking in indexes: https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple
Processing ./.
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Installing backend dependencies: started
Installing backend dependencies: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Building wheels for collected packages: InfiniOps
Building wheel for InfiniOps (pyproject.toml): started
Building wheel for InfiniOps (pyproject.toml): finished with status 'done'
Created wheel for InfiniOps: filename=infiniops-0.1.0-cp310-cp310-linux_aarch64.whl size=155485 sha256=be1a8d954049decd8424ab44d02b3cd21abe28e2c72f5f350ff4887bacda8bfd
Stored in directory: /tmp/pip-ephem-wheel-cache-jeg6yhow/wheels/b5/f3/6e/961028f73a2712eb7b753a23bdd1baaa714e27760fd92de56c
Successfully built InfiniOps
WARNING: Ignoring invalid distribution -orch (/home/huangjiacheng/.venv/lib/python3.10/site-packages)
Installing collected packages: InfiniOps
Attempting uninstall: InfiniOps
Found existing installation: InfiniOps 0.1.0
Uninstalling InfiniOps-0.1.0:
Successfully uninstalled InfiniOps-0.1.0
WARNING: Ignoring invalid distribution -orch (/home/huangjiacheng/.venv/lib/python3.10/site-packages)
Successfully installed InfiniOps-0.1.0
============================= test session starts ==============================
platform linux -- Python 3.10.20, pytest-9.0.2, pluggy-1.6.0
rootdir: /home/huangjiacheng/InfiniOps
configfile: pyproject.toml
testpaths: tests
plugins: xdist-3.8.0, cov-7.0.0, hypothesis-6.135.14
collected 3300 items
tests/test_add.py ...................................................... [ 1%]
..................Fatal Python error: Segmentation fault
Current thread 0x0000ffffbb315090 (most recent call first):
File "/home/huangjiacheng/InfiniOps/tests/test_add.py", line 66 in _add
File "/home/huangjiacheng/InfiniOps/tests/conftest.py", line 80 in pytest_pyfunc_call
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/_pytest/python.py", line 1720 in runtest
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/_pytest/runner.py", line 179 in pytest_runtest_call
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/_pytest/runner.py", line 245 in <lambda>
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/_pytest/runner.py", line 353 in from_call
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/_pytest/runner.py", line 244 in call_and_report
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/_pytest/runner.py", line 137 in runtestprotocol
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/_pytest/runner.py", line 118 in pytest_runtest_protocol
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/_pytest/main.py", line 396 in pytest_runtestloop
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/_pytest/main.py", line 372 in _main
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/_pytest/main.py", line 318 in wrap_session
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/_pytest/main.py", line 365 in pytest_cmdline_main
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/_pytest/config/__init__.py", line 199 in main
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/_pytest/config/__init__.py", line 223 in console_main
File "/home/huangjiacheng/.venv/lib/python3.10/site-packages/pytest/__main__.py", line 9 in <module>
File "/home/huangjiacheng/.local/share/uv/python/cpython-3.10-linux-aarch64-gnu/lib/python3.10/runpy.py", line 86 in _run_code
File "/home/huangjiacheng/.local/share/uv/python/cpython-3.10-linux-aarch64-gnu/lib/python3.10/runpy.py", line 196 in _run_module_as_main
Extension modules: numpy.core._multiarray_umath, numpy.core._multiarray_tests, numpy.linalg._umath_linalg, numpy.fft._pocketfft_internal, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, torch._C, torch._C._fft, torch._C._linalg, torch._C._nested, torch._C._nn, torch._C._sparse, torch._C._special, torch_mlu._MLUC, pandas._libs.tslibs.ccalendar, pandas._libs.tslibs.np_datetime, pandas._libs.tslibs.dtypes, pandas._libs.tslibs.base, pandas._libs.tslibs.nattype, pandas._libs.tslibs.timezones, pandas._libs.tslibs.fields, pandas._libs.tslibs.timedeltas, pandas._libs.tslibs.tzconversion, pandas._libs.tslibs.timestamps, pandas._libs.properties, pandas._libs.tslibs.offsets, pandas._libs.tslibs.strptime, pandas._libs.tslibs.parsing, pandas._libs.tslibs.conversion, pandas._libs.tslibs.period, pandas._libs.tslibs.vectorized, pandas._libs.ops_dispatch, pandas._libs.missing, pandas._libs.hashtable, pandas._libs.algos, pandas._libs.interval, pandas._libs.lib, pandas._libs.ops, pandas._libs.hashing, pandas._libs.arrays, pandas._libs.tslib, pandas._libs.sparse, pandas._libs.internals, pandas._libs.indexing, pandas._libs.index, pandas._libs.writers, pandas._libs.join, pandas._libs.window.aggregations, pandas._libs.window.indexers, pandas._libs.reshape, pandas._libs.groupby, pandas._libs.json, pandas._libs.parsers, pandas._libs.testing (total: 61)

gongchensu self-assigned this Mar 16, 2026

gongchensu requested a review from voltjia March 16, 2026 07:37

Ziminli requested changes Mar 17, 2026
View reviewed changes

gongchensu force-pushed the feat/moore-swiglu branch from 0056c17 to 921aedeCompare March 18, 2026 08:59

gongchensu requested a review from Ziminli March 18, 2026 09:11

gongchensu force-pushed the feat/moore-swiglu branch from 921aede to 253462eCompare March 19, 2026 03:23

gongchensu changed the title ~~Feat/moore swiglu~~feat(moore): add swiglu-op support with musa integration.Mar 19, 2026

gongchensu force-pushed the feat/moore-swiglu branch from 253462e to 53f8f77Compare March 19, 2026 08:47

feat(moore): add swiglu-op support with musa integration
239baf5
- add a Moore swiglu backend on top of the shared CUDA-style path - extract shared swiglu compute into a reusable op for backend override - keep Moore-specific half and bfloat162 handling in the Moore backend only

voltjia force-pushed the feat/moore-swiglu branch from 53f8f77 to 239baf5Compare March 19, 2026 11:57

voltjia added 2 commits March 19, 2026 20:58

refactor: introduce src/moore/polyfills.cuh
bdd45c9

refactor: use polyfills for Moore SwiGLU
92e6ce9

voltjia approved these changes Mar 19, 2026
View reviewed changes

voltjia changed the title ~~feat(moore): add swiglu-op support with musa integration.~~feat(moore): add Moore SwiGLUMar 19, 2026

voltjia merged commit f0fccb1 into InfiniTensor:feat/dev-infraMar 19, 2026

voltjia mentioned this pull request Jul 9, 2026
fix: remove unused device placeholders #790
Merged
19 tasks

Navigation Menu

Uh oh!

feat(moore): add Moore SwiGLU - #24

feat(moore): add Moore SwiGLU#24
voltjia merged 3 commits into
InfiniTensor:feat/dev-infrafrom
gongchensu:feat/moore-swiglu

gongchensu commented Mar 16, 2026•
edited
Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

voltjia commented Mar 19, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

gongchensu commented Mar 16, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

voltjia commented Mar 19, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

gongchensu commented Mar 16, 2026•
edited
Loading