Skip to content
View gmongaras's full-sized avatar
😼
When softmax attention is sus
😼
When softmax attention is sus

Highlights

  • Pro

Block or report gmongaras

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Pinned Loading

  1. Stable-Diffusion-3-From-ScratchStable-Diffusion-3-From-ScratchPublic

    A repo that attempts to train stable diffusion 3 from scratch

    Python 42 5

  2. 2Mamba2Furious2Mamba2FuriousPublic

    Code for the paper "2Mamba2Furious: Linear in complexity, competitive in accuracy"

    Jupyter Notebook 3

  3. On-the-Expressiveness-of-Softmax-Attention-A-Recurrent-Neural-Network-PerspectiveOn-the-Expressiveness-of-Softmax-Attention-A-Recurrent-Neural-Network-PerspectivePublic

    Jupyter Notebook 4

  4. Cottention_TransformerCottention_TransformerPublic

    Code for the paper "Cottention: Linear Transformers With Cosine Attention"

    Cuda 21

  5. AI_GirlfriendAI_GirlfriendPublic archive

    Creating a waifu

    Jupyter Notebook 132 43

  6. Protogen_Code_PublicProtogen_Code_PublicPublic

    Public code for my protogen

    C 1