Vision Transformer
AI's Eyes Evolve: Vision transformer research exploded in 2022.
Work on vision transformers exploded in 2022. Researchers published well over 17,000 ViT papers during the year. A major theme: combining self-attention and convolution.