Skip to content

feat(thead): add linked vLLM rms_norm and silu_and_mul - #955

Open
spike-zhu wants to merge 1 commit into
masterfrom
feat/thead-vllm-linked-rmsnorm-and-silu_and_mul
Open

feat(thead): add linked vLLM rms_norm and silu_and_mul#955
spike-zhu wants to merge 1 commit into
masterfrom
feat/thead-vllm-linked-rmsnorm-and-silu_and_mul

Conversation

@spike-zhu

@spike-zhuspike-zhu commented Aug 26, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Add the T-Head C10 stream adapter for linked Torch operators.
  • Add linked vLLM providers for rms_norm and silu_and_mul.

Motivation

Closes #

Type of Change

  • feat — new feature / new operator / new platform
  • fix — bug fix
  • perf — performance improvement (no behavioral change)
  • refactor — code restructuring without behavior change
  • test — adding or fixing tests only
  • docs — documentation only
  • build / ci — build system or CI configuration
  • chore — tooling, formatting, or other non-code changes
  • Breaking change (requires a ! in the Conventional Commits prefix or a BREAKING CHANGE: footer)

Platforms Affected

  • CPU (WITH_CPU)
  • NVIDIA (WITH_NVIDIA)
  • Iluvatar (WITH_ILUVATAR)
  • MetaX (WITH_METAX)
  • Cambricon (WITH_CAMBRICON)
  • Moore (WITH_MOORE)
  • Ascend (WITH_ASCEND)
  • T-Head (WITH_THEAD)
  • PyTorch C++ bindings (WITH_TORCH)
  • Build system / CMake / CI
  • Python bindings / user-facing API

Smoke Test Result

paste smoke test output here

Test Results on Supported Platforms

PlatformAffectedBuild / Smoke ResultFull Result / Notes
NVIDIA
Iluvatar
MetaX
Cambricon
Moore
Ascend
Full `pytest` output (optional)
paste here

Benchmark / Performance Impact

Notes for Reviewers

@spike-zhu
spike-zhu requested review from a team and voltjiaAugust 26, 2026 13:13
@spike-zhuspike-zhu self-assigned this Aug 26, 2026
@spike-zhu
spike-zhuforce-pushed the feat/thead-vllm-linked-rmsnorm-and-silu_and_mul branch 2 times, most recently from ef5e172 to 507da79CompareAugust 26, 2026 13:29
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@spike-zhu