MILA

1 Post

Data related to experience replay
MILA

Experience Counts: Research proposes an upgrade to experience replay.

If the world changes every second and you take a picture every 10 seconds, you won’t have enough pictures to observe the changes clearly, and storing a series of pictures won’t help. On the other hand, if you take a picture every tenth of a second, then storing a history will help model the world.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox