The Concept
Evaluation is where thinking becomes rigorous. You have defined the problem and generated a range of potential solutions. Now you need to determine which option gives you the best chance of a good outcome. This requires clear criteria, honest assessment of trade-offs, and the willingness to think beyond first-order effects.
The most common failure in evaluation is focusing only on what happens immediately. Every decision has second-order and third-order consequences -- effects that ripple outward over time. Cutting costs by laying off experienced staff saves money this quarter but may cost you expertise, morale, and institutional knowledge for years. Good evaluation means tracing the chain of consequences further than feels comfortable.
Another critical element is establishing your criteria before you evaluate. If you decide what matters after seeing the options, you are far more likely to unconsciously rig the criteria to favor whichever option you already prefer. Setting the rules of the game before you play keeps the process honest.
Recognition Patterns
- You changed your evaluation criteria after seeing which option they favored, a classic sign of motivated reasoning.
- You are only thinking about the immediate effects of each option, ignoring what happens six months or two years down the road.
- You are evaluating based on how each option feels rather than how it performs against specific, measurable criteria.
- You have not seriously considered the worst-case scenario for your preferred option, only its best case.
- The evaluation conversation keeps circling back to the same points without making progress, suggesting the criteria are unclear or conflicting.
Actionable Takeaways
- Write down your evaluation criteria before you look at the options. What matters most? What are your non-negotiables? Rank them.
- For each option, ask: "And then what?" at least three times. This surfaces second- and third-order consequences you would otherwise miss.
- Apply the "newspaper test" -- would you be comfortable if your decision and its reasoning were published? This catches ethical blind spots.
- Use a simple scoring matrix: list your criteria on one axis and your options on the other. Rate each option against each criterion. The structure forces completeness.
- Seek out the strongest argument against your leading option. If you cannot articulate it, you have not evaluated thoroughly enough.
Connect the Dots
Evaluation only works if you have done the earlier steps well. A poorly defined problem means your criteria are off. A shallow exploration of options means you might be choosing the best of a bad set.
Once you have identified the strongest option, the next challenge is to execute with commitment. Lingering doubt from an incomplete evaluation often leads to half-hearted execution, so doing this step thoroughly pays dividends later.
This is also where safeguards become critical. Pre-mortems, red teams, and other structured challenges help you stress-test your evaluation before you commit real resources to the decision.