GitHub Explorer

by Alexey Ratnikov

GitHub Explorer

GitHub Explorer|TRENDING COMPARE|FEEDBACK

Back to search

Copyright (c) 2026 Alexey Ratnikov

xxxnell/how-do-vits-work - GitHub Explorer | GitHub Explorer | Trending | Compare

how-do-vits-work

xxxnell•PUBLIC

(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"

loss-landscapepytorchself-attentiontransformervision-transformer

Apache License 2.0

Created on Mar 9, 2021

Updated on Mar 5, 2026

Stars

821

Forks

77

Watchers

821

Open Issues

6

Repository Health Score

❤️

47/100

Poor

Overall repository health assessment

Score Breakdown

Activity

Slow updates - updated within 3 months

10/30

33%

Community

821 stars, 77 forks

2/30

7%

Documentation

Has description, license

15/20

75%

Maintenance

0.7% issue ratio

20/20

100%

Health score is calculated based on activity, community engagement, documentation quality, and maintenance practices

Languages

Python

80.9%

Jupyter Notebook

19.1%

Issues Analytics

44

Total Issues

All time

6

Open

14% of total

38

Closed

86% of total

4d

Avg Close Time

Fast response ✅

Issues Activity: Last 6 months

Hottest Issues

1

#9 In convit.py file, where does ConVit come from, really?

15

open

2

#26 What exactly makes MSAs data specificity?

7

closed

3

#12 How to plot the Hessian max eigenvalue spectra?

7

open

4

#36 Question about Figure 2(a)

6

closed

5

#30 Conclusion about long-range dependency seems not true

6

closed

Dependencies

No package.json found

This might not be a Node.js project

Top Contributors

1

xxxnell

User

129

commits

Recent Commits

Add "Blurs Behave Like Ensembles" poster

XXXNELL•3 years ago

9571ff1View on GitHub

Fix typo

XXXNELL•3 years ago

c029746View on GitHub

Fix typo and add a detailed description of "Blurs Behave Like Ensembles"

XXXNELL•3 years ago

24aa230View on GitHub

Add detailed description to `loss-landscape` figure

XXXNELL•3 years ago

8968269View on GitHub

Simplify description

XXXNELL•3 years ago

1268df6View on GitHub

Update the description for "blurs behave like ensemble"

XXXNELL•3 years ago

4362479View on GitHub

Improve readability

XXXNELL•3 years ago

12b720cView on GitHub

Update resources

XXXNELL•3 years ago

cea0635View on GitHub

Add uids for pretrained models

XXXNELL•3 years ago

05a4347View on GitHub

Add codes for Colab

XXXNELL•3 years ago

210c9b1View on GitHub

Add resources to README

XXXNELL•3 years ago

207495bView on GitHub

Add comments

XXXNELL•3 years ago

d2979f2View on GitHub

Add code and experiment description to README

XXXNELL•4 years ago

8752f4eView on GitHub

Add code for plotting loss landscapes

XXXNELL•4 years ago

a4f5a34View on GitHub

No gpu required

XXXNELL•4 years ago

ce3cd1eView on GitHub

View all commits