Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

PyTorch code and models for the DINOv2 self-supervised learning method.

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models

PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO

A curated list of awesome self-supervised methods

SimCLRv2 - Big Self-Supervised Models are Strong Semi-Supervised Learners

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

A python library for self-supervised learning on images.

PyTorch code and models for V-JEPA self-supervised learning from video.

PyTorch code and models for VJEPA2 self-supervised learning from video.

Official codebase for I-JEPA, the Image-based Joint-Embedding Predictive Architecture. First outlined in the CVPR paper, "Self-supervised learning from images with a joint-embedding predictive architecture."

OpenMMLab Self-Supervised Learning Toolbox and Benchmark

VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

Face Depixelizer based on "PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models" repository.

Self-Supervised Speech Pre-training and Representation Learning Toolkit

Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch

Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).

[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training

solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning

A Semantic Controllable Self-Supervised Learning Framework to learn general human representations from massive unlabeled human images, which can benefit downstream human-centric tasks to the maximum extent

Code for TKDE paper "Self-supervised learning on graphs: Contrastive, generative, or predictive"

Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decomposition (CVPR2023)

A comprehensive list of awesome contrastive self-supervised learning papers.

[ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation

A self-supervised learning framework for audio-visual speech

A Lite Bert For Self-Supervised Learning Language Representations

[CVPR'25 Highlight] Official repository of Sonata: Self-Supervised Learning of Reliable Point Representations

[CVPR2023] Lite-Mono: A Lightweight CNN and Transformer Architecture for Self-Supervised Monocular Depth Estimation