BEiT
Who Was That Masked Input? Pretraining Method Improves Computer Vision Performance
Researchers have shown that it’s possible to train a computer vision model effectively on around 66 percent of the pixels in each training image. New work used 25 percent, saving computation and boosting performance to boot.