#

linformer

Here are 8 public repositories matching this topic...

awesome-fast-attention

Separius / awesome-fast-attention

list of efficient attention modules

awesome transformer attention attention-is-all-you-need multihead-attention reformer self-attention transformer-network longformer linformer

Updated Aug 23, 2021
Python

tatp22 / linformer-pytorch

My take on a practical implementation of Linformer for Pytorch.

machine-learning deep-learning paper pytorch artificial-intelligence attention-mechanism linformer

Updated Jul 27, 2022
Python

kuixu / Linear-Multihead-Attention

Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)

transformer attention-mechanism detr linformer linear-multihead-attention

Updated Jun 23, 2020
Python

pranavphoenix / VisionXformer

Vision Xformers

image deep-learning efficient transformer vision classification gpu-computing attention-mechanism nystrom performer linformer

Updated May 11, 2023
Python

zadid6pretam / iStructTab

iStructTab: Structured Feature Sequencing for Multimodal Image-Tabular Learning with GEDS and OEMT.

multimodal-learning linformer image-table feature-ordering column-permutation-problem feature-sequencing

Updated Aug 21, 2026
Jupyter Notebook

MaxLSB / linformer

linformer implementation and comparison with vanilla transformers

python nlp machine-learning pytorch attention-mechanism linformer

Updated Jan 23, 2025
Jupyter Notebook

zadid6pretam / iSyncTab

iSyncTab learns synchronized cross-modal feature sequences for image-tabular and audio-video multimodal learning using neural synchrony, NS-PFS, and an order-aware Transformer.

cross-modal audio-video multimodal-learning cross-modal-learning linformer image-table neuroai feature-ordering neural-synchrony

Updated Aug 21, 2026
Jupyter Notebook

anto18671 / lumenspark

Lumenspark is a lightweight Linformer-based Language Model Trained from Scratch

training text-classification text-generation transformer low-rank-approximation pretraining linformer llm runpod prenormalization layer-scale

Updated Oct 24, 2024
Python

Improve this page

Add a description, image, and links to the linformer topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the linformer topic, visit your repo's landing page and select "manage topics."