Fast and memory-efficient exact attention

🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐

A PyTorch implementation of the Transformer model in "Attention is All You Need".

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

🚀 Efficient implementations for emerging model architectures

Attendize is an open-source ticket selling and event management platform built on Laravel.

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

No description available

Summary of related papers on visual attention. Related code will be released based on Jittor gradually.

Keras Attention Layer (Luong and Bahdanau scores).

Pytorch implementation of Self-Attention Generative Adversarial Networks (SAGAN)

Official PyTorch code for "BAM: Bottleneck Attention Module (BMVC2018)" and "CBAM: Convolutional Block Attention Module (ECCV2018)"

Use of Attention Gates in a Convolutional Neural Network / Medical Image Classification and Segmentation

Open Event Attendee Android General App https://github.com/fossasia/open-event-android/blob/apk/open-event-dev-app-playStore-debug.apk

Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"

iOS app for open event

Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome

Improving Convolutional Networks via Attention Transfer (ICLR 2017)

some attention implements

Attention based model for learning to solve different routing problems

Unofficial implementation of "Prompt-to-Prompt Image Editing with Cross Attention Control" with Stable Diffusion

Awesome List of Attention Modules and Plug&Play Modules in Computer Vision

Provide with pre-build flash-attention package wheels on Linux and Windows platforms using GitHub Actions

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

Neighborhood Attention Transformer, arxiv 2022 / CVPR 2023. Dilated Neighborhood Attention Transformer, arxiv 2022

Helpful tools and examples for working with flex-attention

KGAT: Knowledge Graph Attention Network for Recommendation, KDD2019

Code for our CVPR2021 paper coordinate attention

Source code for "On the Relationship between Self-Attention and Convolutional Layers"

Visual Attention based OCR