6
The Art of Evaluative Comparison 15:53 Lena: So, we’ve generated options, we’ve stress-tested them, and we’ve managed our biases. Now we’re at the point where we have to actually pick one. The guidebook talks about "Evaluative Comparison." Is this more than just a pro-and-con list? Because I’ve found those can be pretty subjective.
16:10 Miles: You’re right, a simple pro-and-con list is often just a way to justify what we already want to do. The guidebook suggests a more rigorous "Weighted Scoring Model." It sounds technical, but the "Playbook" version is actually quite intuitive once you break it down.
16:24 Lena: Okay, walk me through it. How do we make it less "gut feeling" and more "analytical"?
16:29 Miles: First, you go back to those "Success Criteria" we established in the Framing phase. Let’s say you have four criteria: Cost, Speed, Scalability, and Brand Alignment. But you realize that for this specific problem, Scalability is twice as important as Cost.
16:43 Lena: So you assign "weights" to each criterion?
6:05 Miles: Exactly. You give them a numerical value—say, Scalability is a 10, while Cost is a 5. Then, you score each of your options against those criteria on a scale of one to ten. When you multiply the score by the weight, you get a much more nuanced picture of which option actually delivers the most value.
17:07 Lena: That’s fascinating. It prevents one single factor—like a low price—from overshadowing everything else if it’s not actually your top priority. But does the guidebook warn about over-relying on the numbers?
17:20 Miles: Definitely. This is where the "Sanity Check" comes in. The guide says that if the scoring model tells you to pick Option B, but your entire team feels a sense of dread about it, don't just ignore that feeling. Use it as a signal to re-examine your weights or your scores. Did you miss a hidden criterion? Is there a risk you didn't account for?
17:40 Lena: So the model is a tool for conversation, not just a final answer.
4:08 Miles: Precisely. It’s a way to surface disagreements. If you score Brand Alignment as a 9 and I score it as a 3, we don't just average them. We talk about *why* we see it so differently. That conversation is often more valuable than the final score itself.
0:40 Lena: I love that. It’s about using the numbers to find the "blind spots." What other tools does the guidebook offer for this final comparison?
18:10 Miles: It introduces the concept of "Trade-off Analysis." Every choice involves a sacrifice. If you choose Speed, you might sacrifice Quality. The guidebook suggests being brutally honest about what you are *giving up*. A great "Playbook" move is to write a "Sacrifice Statement" for each option: "By choosing Option A, we are intentionally deciding to accept a higher cost in exchange for a faster launch."
18:32 Lena: That’s so powerful. It makes the "hidden costs" visible. It prevents that feeling of regret later because you’ve already acknowledged the downside upfront.
15:12 Miles: Right. And for those really tough, "close-call" decisions, the guide suggests "Paired Comparison." You take your options and compare them two at a time. Between A and B, which is better? Between B and C? Between A and C? It’s a way to simplify a complex choice into a series of simple binary ones.
19:01 Lena: It’s like a tournament bracket for ideas!
19:03 Miles: (laughs) Exactly! And the "winner" of the bracket is usually the most robust choice. But the guidebook adds one final layer: the "Implementation Ease" check. Sometimes the "best" theoretical option is so hard to execute that it’s actually the worst choice for your specific team.
19:21 Lena: That’s a really grounded point. A "B-plus" strategy that your team can execute perfectly is better than an "A-plus" strategy that will fall apart in a month.
3:32 Miles: You’ve hit the nail on the head. Evaluative comparison isn't about finding the "perfect" solution—it’s about finding the "best fit" solution for your goals, your constraints, and your people. It’s about moving from "I think" to "We’ve compared the alternatives, weighed the trade-offs, and this is the most logical path forward."