Retrieval Enhanced Transformer (RETRO)

1 Post

Two images showing RETRO Architecture and Gopher (280B) vs State of the Art
Retrieval Enhanced Transformer (RETRO)

Large Language Models Shrink: Gopher and RETRO Prove Lean Language Models Can Push Boundaries

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.
2 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox