#

fast-weight-programmers

Here are 9 public repositories matching this topic...

IDSIA / modern-srwm

Official repository for the paper "A Modern Self-Referential Weight Matrix That Learns to Modify Itself" (ICML 2022 & NeurIPS 2021 Deep RL Workshop) and "Accelerating Neural Self-Improvement via Bootstrapping" (ICLR 2023 Workshop)

reinforcement-learning transformers pytorch fast-weights torchbeast fast-weight-programmers self-referential-weight-matrix rnn-based-few-shot-learning self-referential-learning

Updated Jun 11, 2025
Python

IDSIA / recurrent-fwp

Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)

reinforcement-learning transformers language-modeling pytorch recurrent-neural-networks fast-weights torchbeast fast-weight-programmers

Updated Jun 11, 2025
Python

IDSIA / neuraldiffeq-fwp

Official repository for the paper "Neural Differential Equations for Learning to Program Neural Nets Through Continuous Learning Rules" (NeurIPS 2022)

fast-weights neural-differential-equations neural-odes controlled-differential-equations fast-weight-programmers continuous-time-sequence-processing

Updated Jun 11, 2025
Python

IDSIA / lmtool-fwp

PyTorch Language Modeling Toolkit for Fast Weight Programmers

transformers pytorch language-model fast-weights fast-weight-programmers

Updated Jun 11, 2025
Python

IDSIA / automated-cl

Official repository for the paper "Automating Continual Learning"

cuda transformers pytorch fast-weights meta-learning continual-learning few-shot-learning fast-weight-programmers self-referential-weight-matrix self-referential-learning linear-transformers

Updated Jun 11, 2025
Python

kazuki-irie / hybrid-memory

Official repository for the paper "Blending Complementary Memory Systems in Hybrid Quadratic-Linear Transformers"

reinforcement-learning transformers pytorch attention language-model flame fast-weight-programmers key-value-memory flash-linear-attention

Updated Jun 3, 2025
Python

IDSIA / fpainter

Official repository for the paper "Images as Weight Matrices: Sequential Image Generation Through Synaptic Learning Rules" (ICLR 2023)

transformers generative-adversarial-network image-generation fast-weights fast-weight-programmers neural-learning-rules

Updated Jun 11, 2025
Python

kazuki-irie / dct-fast-weights

PyTorch implementation of DCT fast weight RNNs

language-modeling pytorch recurrent-neural-networks dct fast-weights fast-weight-programmers

Updated Jun 11, 2025
Python

mcarbonell / delta-phase

DeltaPhase: High-Expressivity O(N) Complex Phase Matrix Delta-Rule Memory & Lerp Spectral Transformer for Subquadratic LLMs.

deep-learning pytorch associative-memory state-space-models delta-rule linear-attention fast-weight-programmers llm-architecture subquadratic-attention complex-phase

Updated Aug 22, 2026
Python

Add this topic to your repo

To associate your repository with the fast-weight-programmers topic, visit your repo's landing page and select "manage topics."