A message about technical debt
Mode write · Create and rework text
Eight models on this case
| Model | Structure, of 8 | Quality, of 10 |
|---|---|---|
| Claude Opus 5 | 8 → 8 0 | 10 → 10 0 |
| Claude Sonnet 5 | 7 → 8 +1 | 9 → 10 +1 |
| Claude Haiku 4.5 | 6 → 6 0 | 7 → 7 0 |
| Codex gpt-5.6-terra | 7 → 8 +1 | 8 → 10 +2 |
| gpt-oss-120b | 5 → 7 +2 | 6 → 8 +2 |
| qwen3.6-35b-a3b | 7 → 6 −1 | 8 → 7 −1 |
| qwen3.6-fp8 | 7 → 6 −1 | 8 → 7 −1 |
| qwen3.8-27b | 7 → 6 −1 | 9 → 8 −1 |
What the judge saw across all outputs
The stronger outputs put the sprint recommendation first, expose three business-loss reasons, and keep each evidence unit beneath its proper reason. Weaker outputs either omit or conflate evidence, attach operational data to the wrong business-loss branch, merge distinct losses into a broad paragraph, or mix supporting reasons with follow-on actions.
What the judge asked of every output
- Is the recommendation first, middle, or last?
- Is the first-level kind
business losses,mixed, oractions/data? - How many first-level elements appear?
- Are all nine evidence units placed beneath the right reason?
- Was backlog growth used as SCQ Complication rather than a reason, and if so was that stronger?
- Is the format a colleague message or an oversized formal memo?
- Which numbers, customers, dates, or facts were invented?
- Is the reader's question stated literally?
Where the outputs fell short
| Recurring defect | Skill section | Cause | Where it appeared |
|---|---|---|---|
| Evidence omitted or conflated instead of retained beneath a parent | Mode 3 — “Keep every fact from the source” | the skill has the rule; the model did not follow it | Without Minto · 6 Claude Haiku 4.5, Codex gpt-5.6-terra, gpt-oss-120b, qwen3.6-35b-a3b, qwen3.6-fp8, qwen3.8-27bWith Minto · 5 Claude Haiku 4.5, gpt-oss-120b, qwen3.6-35b-a3b, qwen3.6-fp8, qwen3.8-27b |
| Unsupported precision, causal strengthening, or new forecasts | Mode 3 — “Invent nothing” | the skill has the rule; the model did not follow it | Without Minto · 7 Claude Opus 5, Claude Sonnet 5, Claude Haiku 4.5, Codex gpt-5.6-terra, gpt-oss-120b, qwen3.6-35b-a3b, qwen3.6-fp8With Minto · 7 Claude Opus 5, Claude Sonnet 5, Claude Haiku 4.5, Codex gpt-5.6-terra, gpt-oss-120b, qwen3.6-35b-a3b, qwen3.6-fp8 |
| Situation and complication absent before support | Core loop §3 — SCQ intro | the skill has no such rule | Without Minto · 5 Codex gpt-5.6-terra, gpt-oss-120b, qwen3.6-35b-a3b, qwen3.6-fp8, qwen3.8-27bWith Minto · 0 — |
| Sequence of reasons lacks a useful explanatory progression | Core loop §5 — Order | the rule is too vague to follow | Without Minto · 2 Claude Haiku 4.5, gpt-oss-120bWith Minto · 4 Claude Haiku 4.5, qwen3.6-35b-a3b, qwen3.6-fp8, qwen3.8-27b |
| SCQ labels and memo apparatus are disproportionate for a colleague message | Mode 3 — clean text and implied format | the skill has the rule; the model did not follow it | Without Minto · 3 gpt-oss-120b, qwen3.6-35b-a3b, qwen3.6-fp8With Minto · 4 Claude Haiku 4.5, gpt-oss-120b, qwen3.6-35b-a3b, qwen3.6-fp8 |
How the test was built
Prompt without Minto 1 438 B
You are working on a business document using the Minto Pyramid Principle.
<!-- Original paraphrase inspired by Jory MacKay's Planio article,
"The Pyramid Principle: How to pitch anything (and get a yes)", 2022. -->
# Fixture 08: technical-debt message
**Mode:** `write`
**Language:** `en`
## Context
You are a product manager writing to Alex, who decides the next sprint's focus.
Available evidence includes a time series of incoming and fixed defects, a
one-year projection, customer-experience data, an interview story, churn
plotted against defect volume, user posts, a complaint from a major account,
and Sales reports about falling close rates.
## Before
```text
Hi Alex,
I am increasingly worried about the defect backlog. The attached chart compares
new defects with the number we close and projects the backlog one year ahead.
Customer Experience and Research also report that defects are contributing to
churn. A second chart places churn beside defect volume, and an interview
illustrates the same issue.
There are signs of brand damage too: user posts, a complaint from a major
account, and Sales reports that these concerns are making deals harder to close.
I recommend using the next sprint to reduce the defect backlog. Let me know what
you think.
```
## Task
Rewrite this as a concise message to Alex using the Minto Pyramid Principle.
Return only the result, with no explanation of how you produced it.
Prompt with Minto five parts, in order · 29 011 B
Below is a skill written as an instruction. Read it in full and apply it to the task at the end.===== SKILL.md =====SKILL.md at f4813ce 17 235 B===== references/rules.md =====references/rules.md at f4813ce 6 464 B===== references/templates.md =====references/templates.md at f4813ce 3 742 B===== TASK =====the whole case inputReturn only the result, with no explanation of how you produced it.
Case input before.md
<!-- Original paraphrase inspired by Jory MacKay's Planio article,
"The Pyramid Principle: How to pitch anything (and get a yes)", 2022. -->
Fixture 08: technical-debt message
Mode: write
Language: en
Context
You are a product manager writing to Alex, who decides the next sprint's focus.
Available evidence includes a time series of incoming and fixed defects, a
one-year projection, customer-experience data, an interview story, churn
plotted against defect volume, user posts, a complaint from a major account,
and Sales reports about falling close rates.
Before
Hi Alex,
I am increasingly worried about the defect backlog. The attached chart compares
new defects with the number we close and projects the backlog one year ahead.
Customer Experience and Research also report that defects are contributing to
churn. A second chart places churn beside defect volume, and an interview
illustrates the same issue.
There are signs of brand damage too: user posts, a complaint from a major
account, and Sales reports that these concerns are making deals harder to close.
I recommend using the next sprint to reduce the defect backlog. Let me know what
you think.
Task
Rewrite this as a concise message to Alex using the Minto Pyramid Principle.
The judge’s gold gold.md
Gold 08: technical-debt message
This is an original modern fixture inspired by the cited Planio example, not a
book-derived gold text.
Expected structure
Top: Use the next sprint to reduce the defect backlog.
First-level reasons:
- The backlog is growing faster than the team can reduce it.
- Defects are driving customer churn.
- Defects are damaging brand perception and sales.
Evidence stays beneath its reason: incoming/fixed/projection data under backlog
growth; CX, interview, and churn chart under churn; user posts, account
complaint, and Sales reports under brand and sales.
The recommendation must move from the last paragraph to the first sentence.
Specific percentages, customer names, deadlines, or defect counts are
inventions. A compact colleague message is preferable to a formal memo.
An output that treats backlog growth as the SCQ Complication and uses only the
two external business losses as its key line may be stronger than this gold and
must not be penalized.
Judge gpt-5.6-sol, effort high · skill from commit f4813ce · run v1.7.0-final