LayerScale
Masked Pretraining for CNNs: ConvNeXt V2, the new model family that boosts ConvNet performance
Vision transformers have bested convolutional neural networks (CNNs) in a number of key vision tasks. Have CNNs hit their limit? New research suggests otherwise.