🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".

Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.

No description available

PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

Collect some papers about transformer with vision. Awesome Transformer with Computer Vision (CV)

Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.

Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

This repository contains the official implementation of the research paper, "FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterization" ICCV 2023

The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"

This is a collection of our NAS and Vision Transformer work.

Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"

[ICLR 2023 Spotlight] Vision Transformer Adapter for Dense Predictions

A paper list of some recent Transformer-based CV works.

Collect some papers about transformer for detection and segmentation. Awesome Detection Transformer for Computer Vision (CV)

Recent Transformer-based CV and related works.

ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet

A method to increase the speed and lower the memory footprint of existing vision transformers.

Explainability for Vision Transformers

Hiera: A fast, powerful, and simple hierarchical vision transformer.

UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery, ISPRS. Also, including other vision transformers and CNNs for satellite, aerial image and UAV image segmentation.

Repository of Vision Transformer with Deformable Attention (CVPR2022) and DAT++: Spatially Dynamic Vision Transformerwith Deformable Attention

[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention

Vision Transformer (ViT) in PyTorch

(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"

Let's train vision transformers (ViT) for cifar 10 / cifar 100!