Image Generative Pre-Training (iGPT)
Transforming Pixels: An image generation model using the GPT architecture
Language models like Bert, Ernie, and Elmo have achieved spectacular results based on clever pre-training approaches. New research applies some of those Sesame Street lessons into image processing.