Skip to content

build: declare fla-core (flash-linear-attention) as the Kimi-K3 KDA dependency - #321

Merged
Andrewxu313 merged 1 commit into
mainfrom
infra/kimi-k3-fla-dep
Sep 11, 2026
Merged

build: declare fla-core (flash-linear-attention) as the Kimi-K3 KDA dependency#321
Andrewxu313 merged 1 commit into
mainfrom
infra/kimi-k3-fla-dep

Conversation

@Andrewxu313

Copy link
Copy Markdown
Contributor

Description

Declare fla-core (flash-linear-attention) as a dependency and document it:

  • requirements.txt: add fla-core>=0.5.0 (feeds install_requires, so pip install ., pip install -r requirements.txt, and install_deps.sh all pull it).
  • docs/INSTALL.md + docs/deploy-kimi-k3-h200.md: note it as the Kimi-K3 / Kimi-linear KDA dependency.

Motivation

Kimi-K3 / Kimi-linear do a bare top-level import of fla in batchgen/models/moonshotai/kimi_linear/model.py (from fla.modules import FusedRMSNormGated, ShortConvolution; from fla.ops.kda import chunk_kda, fused_recurrent_kda) for Kimi Delta Attention. It was not declared in requirements.txt, install_deps.sh, or the docs — so a clean install can import-error on K3. The >=0.5.0 floor matches the requirement asserted by the K3 KDA test-script (chunk_kda must accept use_beta_sigmoid_in_kernel; the model fail-fasts on older fla). NOTE: pinned as a floor rather than == because it is a feature floor; set an exact == to the validated version if a reproducible lock is preferred.

Type of Change

  • model — add/extend model support (models/** + registration seam + model kernels only)
  • kernel — add/optimize a compute kernel (batchgen_kernels/** + in-tree kernel dirs)
  • core — change scheduling/serving/runtime scaffolding (the only type that may)
  • fix — narrow bug fix (+ a regression test)
  • infra — build / CI / packaging / scripts / Docker
  • docs — documentation only

File changes

File Δ Note
requirements.txt mod add fla-core>=0.5.0 (Kimi-K3 KDA dependency)
docs/INSTALL.md mod prerequisite note for the K3 KDA fla-core dependency
docs/deploy-kimi-k3-h200.md mod §3 install note for fla-core

Checklist

…ependency

Kimi-linear/K3 hard-import fla (fla.modules, fla.ops.kda) for Kimi Delta Attention
but it was undeclared. Add fla-core>=0.5.0 to requirements.txt (feeds install_requires)
and document it in INSTALL.md and the K3 deploy guide.
@Andrewxu313
Andrewxu313 marked this pull request as ready for review September 11, 2026 15:03
@Andrewxu313
Andrewxu313 merged commit c1207e9 into main Sep 11, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant