The Calibration Gap: Why Smart People Still Make Terrible Decisions

Judgment isn't an IQ test. It's an engineering problem, and most people never build the system.

David H. Friedel Jr./ 2026-03-12
Subscribe
Cognition
Listen to this post

There’s a persistent myth in professional circles that good judgment is a personality trait, something you either have or you don’t, like height or charisma. People say things like “she just has great instincts” as if instinct were some genetic gift rather than the output of a system that someone deliberately built and refined over thousands of reps.

It’s not. Judgment is a calibration problem.

In cognitive science, judgment improves when three systems evolve together: information quality, feedback loops, and decision frameworks. Not one. Not two. All three, working in concert. Miss any leg of that stool and you get the executive who reads everything, learns nothing, and keeps making the same mistake with increasingly expensive consequences.

What follows is a structured approach borrowed from fields where bad judgment has immediate, quantifiable costs: investing, intelligence analysis, and executive leadership. These aren’t domains that tolerate “trust your gut” as a strategy for very long.

Build a Mental Model Library

Judgment improves when you can recognize patterns quickly. Not data, patterns. The distinction matters. Data is noise until it’s organized by a framework that tells you what to pay attention to and what to ignore.

This is why experts don’t actually process more information than novices. They process less. They just process the right information, because they have mental models that act as filters.

Charlie Munger called this a “latticework of models,” and it’s one of the few pieces of investing wisdom that translates perfectly into every other domain. The models that pay the highest dividends across decision-making contexts are remarkably consistent… second-order thinking (what happens after the thing happens), inversion (how could this fail?), opportunity cost (what am I sacrificing?), base rates (what usually happens in situations like this?), and incentive analysis (who benefits, and how does that shape behavior?).

Without a latticework of mental models, decisions default to emotion or narrative. And narratives are just stories we tell ourselves to avoid doing the math.

Close the Feedback Loop

Here’s the uncomfortable truth about most decision-making… people never go back and check.

They make a call, move on, and then retroactively construct a story about why things worked out the way they did, whether they actually made a good decision or just got lucky. This is how overconfidence compounds. You never calibrate because you never measure.

Professionals in high-stakes fields don’t operate this way. They run post-mortems. The process is almost embarrassingly simple… write down the decision, record your reasoning and key assumptions, assign a probability to the outcome, and then, this is the part nobody does, go back and review it later.

What you discover when you actually do this is humbling. You find overconfidence everywhere. You find assumptions you didn’t even know you were making.

As a professional trader, this separates the good from the great and after a decade of futures trading, humbling is an understatement.

You find narrative bias dressing up gut reactions as analysis. Superforecasters, the people who consistently outperform intelligence analysts at predicting geopolitical events, use exactly this process. It’s not magic. It’s bookkeeping.

Filter the Signal from the Noise

Information overload isn’t a quantity problem. It’s a filtering problem.

Most people consume information the way they eat at a buffet, indiscriminately, driven by what looks interesting rather than what’s actually nutritious. The result is a brain stuffed with takes, opinions, and context-free data points that feel like knowledge but don’t actually improve decision quality.

Three questions cut through this…

  1. Is the source credible?
  2. Is the information predictive or just interesting?
  3. Does it change the probability of a decision I’m actually making?

That last question is the killer. 90% of what passes for “staying informed” fails it completely. You can read every article about a sector and still not have a single piece of information that changes the probability on a specific bet. That’s entertainment, not analysis.

This is essentially Bayesian thinking applied to everyday life. Every piece of information either updates your probability estimate or it doesn’t. If it doesn’t, it’s noise. Treat it accordingly.

Separate Emotion from Evaluation

Emotion is fuel. It’s useful for motivation, for conviction, for getting out of bed and grinding on something nobody else believes in. But emotion is catastrophic for evaluation. The moment you fall in love with an idea, you stop being able to assess it honestly.

The simplest hack I’ve found for this… delay commitment.

Instead of saying “this is a good idea,” say “my current probability that this succeeds is 60%.” It sounds robotic, but that’s the point. The shift from binary (good/bad) to probabilistic (percentage) changes the entire psychology of the decision. You stop defending a position and start updating an estimate.

Probabilistic thinking isn’t about hedging. It’s about killing your ego before your ego kills your portfolio, or your product roadmap, or your career bet, or whatever you’re staking resources on.

Hunt for Disconfirming Evidence

Poor judgment seeks confirmation. This is one of the best-documented findings in behavioral science and one of the hardest to actually override, because confirmation bias doesn’t feel like bias. It feels like research.

Good judgment actively hunts for contradiction. The questions are simple…

  • What would prove this wrong?
  • What would my smartest critic say?
  • Under what conditions does this completely fail?

If you can’t answer those questions, you don’t understand the decision you’re making.

A surprising number of you literally do not understand and hence why you can not extract orders of magnitude of value from AI.

You understand the version of it that makes you feel comfortable, which is a very different thing. This is the foundation of scientific reasoning, and it works just as well for product strategy, investment theses, and career decisions as it does for hypothesis testing.

Stretch the Time Horizon

Bad judgment optimizes for immediate outcomes. Good judgment evaluates across time.

This shows up everywhere once you see it. In investing, weak judgment asks “will this go up?” while strong judgment asks “what does this look like in five to ten years?” In career decisions, weak judgment chases the higher salary while strong judgment asks whether the role compounds skills. In technology bets, weak judgment follows what’s trending while strong judgment asks what’s durable.

Time arbitrage, the willingness to accept short-term discomfort for long-term advantage, is one of the most reliable sources of edge in any domain. It works precisely because most people can’t do it. The time horizon mismatch between you and the crowd is where the value lives.

Study the System Builders

Judgment compounds when you study people who have demonstrated strong track records over decades, not months. Munger, Dalio, Kahneman, the names aren’t important. What matters is the common trait… none of them rely on instinct. They all built explicit systems for thinking.

Munger built his latticework. Dalio built Principles. Kahneman spent a career documenting exactly how human judgment fails and engineering around those failures.

The lesson isn’t “be like them.” The lesson is that judgment is engineered, not inherited. And the engineering is available to anyone willing to do the work.

Earn Your Reps

Everything above is infrastructure. But infrastructure without traffic is just an empty highway.

Judgment ultimately develops through exposure to consequences. The cycle is simple and unforgiving: decision, outcome, reflection, adjustment. Then repeat. Hundreds of times. There’s no shortcut through the repetitions. You can accelerate the cycle by improving your reflection process, but you can’t skip the reps themselves.

This is why people who’ve operated in consequential domains, where wrong answers cost real money, real time, or real opportunity, tend to develop sharper judgment than people who’ve spent careers in environments where bad decisions are absorbed by bureaucracy. The feedback signal matters. Without it, you’re just practicing your swing without ever seeing where the ball lands.

The Meta-Framework

If you compress all of this down, good judgment comes from five things: better models for pattern recognition, better feedback loops for calibration, better probability thinking for assessment, better emotional discipline for objectivity, and longer time horizons for strategic advantage.

None of these are about intelligence. All of them are about systems. And systems can be built.

Back to the Journal