New Book Summary: Inadequate Equilibria by Eliezer Yudkowsky


My latest summary is for Inadequate Equilibria: Where and How Civilizations Get Stuck, in which Eliezer Yudkowsky pushes back against what he calls "modest epistemology".

As usual, the key takeaways are below, and you can find the full summary by clicking the link above.

KEY TAKEAWAYS

  • Two competing views on when you should think you may be able to do something unusually well:
    • Inadequacy. We should understand how different systems work and the incentives within them to determine whether we’ll be able to outperform them.
    • Modesty. We should always defer to “experts” or “the crowd” because the average person will not be able to outperform them.
  • Inadequate systems are surprisingly common because of misaligned incentives and coordination problems. Even if someone spots an inadequacy, it’s usually inexploitable in terms of money or prestige, so the inadequacy does not get fixed.
  • Modest epistemology seems primarily motivated by social considerations:
    • It’s not necessarily arrogant to think you can outperform a system of experts on some dimensions. Systems can easily end up ‘dumber’ than the people within them. Rather than worrying about whether you are smarter or dumber in general, treat adequacy as a technical question where the answer shifts depending on the situation.
    • While correcting for overconfidence is good, underconfidence is just as big an epistemological error as overconfidence—just less of a social one.
    • People act to protect status hierarchies when they slap down those who try to “steal” status by attempting to do much better than normal.
  • But sometimes modesty seems to be based on misunderstandings of the following:
    • Applying base rates or the “outside view”. While Yudkowsky agrees this is a good idea, you can get reference class tennis when two sides disagree on which reference class to use.
    • Distrust of theories and models. The concern seems to be that people get too wedded to their theories and apply motivated reasoning to explain away all evidence that conflicts with it. But the answer there is to avoid motivated reasoning, not avoid theories and models.
  • It’s much easier to identify the correct contrarian experts in an existing field than to become one yourself.
  • Don’t overcorrect by falling into sloppy cynicism. The amount of failure to be explained is bounded.

You can find the full detailed summary on the website. If you found this summary useful, consider forwarding to a friend you think might enjoy it.

Thanks for subscribing! Until next time,

To Summarise

ToSummarise.com

I summarise non-fiction books with more detail and critical analysis than you'll find elsewhere. Join my newsletter to get new summaries delivered straight to your inbox!

Read more from ToSummarise.com

March was a quieter month with only 2 book summaries: Why We’re Polarized by Ezra Klein (25 mins) — published in 2020, Ezra Klein looks at how US politics got to be so polarized. A Hacker’s Mind by Bruce Schneier (25 mins) — Schneier applies his background in computer security to looking at how market, legal, political, and cognitive systems can also be "hacked". I'm also planning to take some time off next month, so I'll see you in May! Thanks for subscribing and until next time, To Summarise

My latest summary is for A Hacker’s Mind: How the Powerful Bend Society’s Rules, and How to Bend them Back by security expert Bruce Schneier. It's an interesting look at the systems around us through the lens of hacking. As usual, the key takeaways are below, and you can find the full summary by clicking the link above. KEY TAKEAWAYS A hack is an activity allowed by the system that subverts the goal or intent of the system. Hacks exploit a vulnerability in the system to advance the hacker’s...

If, like me, you’ve been watching US politics recently and wondering how it got to be the way it is, you might find my latest summary for Why We’re Polarized by Ezra Klein to be an enlightening read. As usual, the key takeaways are below, and you can find the full summary by clicking the link above. KEY TAKEAWAYS America has polarized significantly over the past few decades: Political polarization has increased. Swing voters who are genuinely persuadable are going extinct. Polarization by...