Forget More To Learn More

Author: David Perell URL: https://www.perell.com/blog/compression One-line: Forgetting is a feature, not a bug — the brain (like a deep-learning algorithm) learns by compressing information through bottlenecks, discarding the inessential to lift signal over noise.

Key claims

• The most important part of learning is forgetting, not remembering. The brain prizes efficiency, trying to retain only the most important things rather than everything.
• Memory is a teacher, not a recorder. It isn’t designed to help us remember the past; it helps us navigate the future — remembering why something bad happened lets us avoid repeating it.
• The steeper the learning curve, the more interesting the data (Tiago Forte) — learning helps us focus on what’s important and ignore what’s irrelevant.
• Compression is why teaching forces learning. To communicate anything you must compress it; distilling what you know forces you to grapple with ideas, absorbing the good and forgetting the bad. Jeff Bezos compressed his philosophy to two rules: “It’s always Day 1” and “Be obsessed with the customer.”
• The information bottleneck is a universal learning principle. Deep-learning algorithms squeeze data through bottlenecks, managing the tradeoff between compression and context — too much compression loses context, too much context loses compression.
• Dreams help us forget. During sleep we discard much of what we learned, keeping the most important things — lifting signal over noise. “Forget more to learn more.”

Notable quotes

“The most important part of learning is not remembering things. It’s forgetting them.”

“Forgetting is a feature, not a bug.”

“The steeper the learning curve — the greater the improvement from the old rule to the new one — the more interesting you find a piece of data.” — Tiago Forte

How it connects

• Learning / Teaching — compression as the mechanism that makes teaching the best way to learn.
• Jeff Bezos — two-rule compression of a whole business philosophy as the exemplar.
• David Perell — recurring distillation/simplicity theme across his writing.

Verbatim source notes — restored from Roam, 2026-09-21

• Since deep learning algorithms sort through giant data sets, there is a lot of irrelevant information. The algorithms strive to wipe out bad data, while retaining good data. This presents a tradeoff — the same kind that we face every day. It is impossible to compress something without losing some of the context. Thus, the algorithms manage tradeoffs between compression and context. While compression is efficient, information is always lost in the process.Too much compression and they lose context; but too much context and they lose compression.
• The brain doesn’t try to remember everything. Instead, it prizes efficiently. It tries to remember only the most important things. Subconsciously we know that its better to remember a few, vital pieces of information instead of a bunch of inconsequential details.
• Whether you’re an algorithm or a conscious being, the information bottleneck is a fundamental learning principle. In their discovery, these researchers discovered a fascinating paradox: the most important part of learning is actually forgetting. Ideally, in its final state, the algorithm achieves the optimal tradeoff of accuracy and compression.
• Jeff Bezos compressed his business philosophy into two simple rules:
• To distill the data and expose the signal, algorithms squeeze large amounts of information through bottlenecks. In the process, only the most relevant features are retained.
• Compression is why teaching forces learning. To communicate anything you have to compress it. Teaching forces us to distill what we know and focus on the most important things. In the process of compressing ideas, you grapple with the ideas, which forces you to absorb the good ones and forget the bad ones. In theory, the best ideas and patterns of behavior should rise to the top over time.
• Dreams help us forge memories. While we sleep, we forget many of the things we learn each day. This helps us remember the most important things — to lift the signal over the noise.
• Contrary to popular belief, memory isn’t designed to help us remember the past. But it has tremendous value. Memory is a teacher. Memories help us navigate the future. If you remember that something bad happened, and you can figure out why, then you can try to avoid that bad thing happening again.
• As Tiago Forte once wrote: “The steeper the learning curve — the greater the improvement from the old rule to the new one — the more interesting you find a piece of data.” Learning new things helps us focus more on what’s important and less on what’s irrelevant.