Claude Opus 5 on “A set of monthly reports”: with Minto, better on quality, structure unchanged

Structure 5 → 5 of 8 0 Quality 6 → 7 of 10 +1

The judge on the output with Minto

It makes the missing-answer/buried-conclusion distinction unusually clearly, but its detailed annotation introduces unsupported process and evidence requirements.

Mode audit · case 03-period-graph-books · run v1.7.0-final

Structure of 8, 2 points per axis
StructureWithout Minto 5With Minto 5Change
Top22
Key-line composition11
Levels11
Order and kind11
Quality of 10, 2 points per axis
QualityWithout Minto 6With Minto 7Change
Top22
Same-kind grouping11
Explainable order11
MECE11
Visible, proportionate structure12+1

Outputs and the judge’s words are quoted as written, in English.

Without Minto

control prompt · blind label out-06
  • invented_facts
  • quality after the rubric’s penalty 5/10

Its opening distinction is strong, while the long unsupported evidence agenda and absence of required apparatus weaken the audit.

Audit: "Period Graph Books"

1. No governing thought

The memo never states an answer. It ends with "Could we discuss how best to proceed?" — a request for a meeting, not a recommendation. Management asked for corrective proposals; the document delivers a description of a process plus a diagnosis, and leaves the reader to infer what should be done.

The nearest thing to a point ("The production process badly needs streamlining") appears in the second-to-last paragraph, buried inside the "Overall assessment" section, and is asserted rather than supported as the top of a pyramid. The real message — visible only by reading between the lines — appears to be roughly: consolidate end-to-end responsibility for graph-book production in one place, and give the team the resources to redesign the process while continuing to produce the books. That message must be stated first, at the top.

2. Structure is chronological-descriptive, not deductive or inductive

The sequence is: history of the transfer → how production works → what goes wrong → summary judgment → request to talk. This is the order in which the author investigated the problem, not the order in which the reader needs to receive it. The pyramid is inverted: findings support a conclusion that arrives last.

The "Production" section is a four-step process narrative with no argumentative role. As written it is background the reader must hold in memory for several paragraphs before learning why it matters. Under the principle, process detail belongs below the line as support for a specific assertion (e.g. "the process has four hand-offs and three separate data entries"), or in an appendix — not as a free-standing section.

3. The introduction does not establish Situation–Complication–Question

There is no S-C-Q. The opening paragraph gives Situation (transfer of responsibility since Period 5) and then announces the document's own contents ("This memo describes issues that appeared after the transfer"), which is a table of contents, not a Complication. The Complication that actually motivates the document — errors and inconsistencies are appearing in books shown to senior management — is never stated as such, and the Question it raises ("what should we do about it?") is therefore never posed. Because no question is posed, nothing in the body can be shown to answer one.

The reason management commissioned the work — their own request for corrective proposals — is also absent, so the document does not visibly respond to its brief.

4. Grouping defects in the body
  • "Issues" mixes categories. The section runs together causes (fragmentation, an extra person inserted, three departments, triple data entry) and symptoms (inconsistent data between periods and regions, incorrect variable-cost calculations, unexplained point changes, re-entry of prior-period data). These belong at different levels: symptoms are evidence; fragmentation is the cause they support. Presented side by side, neither supports the other and the logical relationship is left to the reader.
  • The single-book example is unlabeled. The second paragraph of "Issues" narrates one book's data path, then lists problems. It is unclear whether this is an illustration of a general pattern or a special case confined to that book. Its role in the argument is undefined.
  • The final list is not MECE. "Unexplained changes to points that were previously correct" and "inconsistent data between periods and regions" overlap; "prior-period data that must be re-entered" is a process defect, not a data error, and sits in a list of data errors.
  • "Overall assessment" carries three unrelated ideas in one paragraph: (a) the cause is process fragmentation, (b) no one owns the data end to end, (c) the team lacks capacity to redesign while producing. (c) is a resourcing conclusion, not part of the diagnosis, and it is the closest thing in the memo to a recommendation — yet it is presented as an aside in a summary.
5. Headings do not carry meaning

"Production," "Issues," "Overall assessment" are topic labels. They tell the reader what subject follows but assert nothing, so skimming the headings yields no argument. Each heading should state the point made beneath it, so that the headings alone reproduce the pyramid's second level.

6. Unsupported assertions

Several key claims are stated without the evidence a decision-maker would need:

  • "The same information may be entered into computer systems three times" — "may be" hedges the central fact of the case. Either it is three times or it is not.
  • "The current team cannot manage the required changes as well as ongoing production" — no volume, headcount, or time figures are offered, though this claim carries the resource request.
  • "Most problems arise from a cumbersome fragmented process" — asserted, not demonstrated; no problem is traced to a specific hand-off.
  • No quantification anywhere: how many errors, in which books, over how many periods, with what consequence in front of senior management.
7. The ending abdicates

The closing question transfers the analytical burden back to the reader. Financial Analysis owns the process and the diagnosis; it is the party positioned to propose the fix. A document that diagnoses without recommending forces the reader to do the author's work, and it gives management nothing to approve or reject.

What must change
  1. Lead with the recommendation. Open with the action proposed — consolidated ownership of end-to-end production, plus whatever resourcing that requires — before any supporting detail.
  2. Build a proper introduction. Situation: Financial Analysis assumed production of the four books in Period 5. Complication: errors and inconsistencies are reaching senior management. Question: what should be done? The answer to that question is the governing thought.
  3. Separate cause from symptom into distinct levels. Symptoms as evidence beneath a single assertion about data reliability; fragmentation and unclear ownership as the cause; capacity as a separate, third supporting point about implementation.
  4. Demote the process description. Keep only the facts that prove the fragmentation point (hand-off count, duplicate entries, number of parties); move the rest to an appendix.
  5. Make the supporting groups MECE and rewrite the error list so that data defects and process defects are not intermingled.
  6. Convert every heading into an assertion, so the headings alone read as the argument.
  7. Quantify the three load-bearing claims: frequency and impact of errors, number of duplicate entries, and the capacity gap justifying additional resources.
  8. Replace the closing question with a specific ask — the decision required, from whom, and by when.

With Minto

prompt with the skill · blind label out-01
  • invented_facts
  • quality after the rubric’s penalty 6/10

It makes the missing-answer/buried-conclusion distinction unusually clearly, but its detailed annotation introduces unsupported process and evidence requirements.

Audit — "Period Graph Books"

Reader's question: management asked for corrective proposals, so the question is "What should we do to stop the errors in the graph books?" The answer must therefore consist of actions — the changes to be made, who makes them, what it costs. The memo supplies a process description and a diagnosis of causes instead, and never reaches an action.

Legend: top/answer · first-level group · support · violation · conclusion buried too low · wrong order type · overlap · gap · cut or move to appendix


Annotated text
Subject: Period Graph Books
                ⚠ topic label, not an answer. Nothing in this document states what to do.
                
                Since Period 5, Financial Analysis has been responsible for producing four
                graph-presentation books previously handled by Corporate Planning.       ← Situation, sound
                This memo describes issues that appeared after the transfer.
                ✂ statement of purpose: names the topic, answers nothing, and is not a Complication.
                ⊕ the Complication (errors are reaching senior management; management asked
                  for proposals) is never stated, so the Question never becomes live.
                
                ● Production
                ⚠ ⇄ first-level group of the wrong kind. The reader asked what to change; this
                  group describes the current state in time order. Belongs below, as support
                  under the change it justifies — or in an appendix.
                   ○ 1. Gather data from divisional forms, internal documents, telephone calls.
                   ○ 2. Calculate graph points manually or on the corporate computer…
                   ○ 3. Transcribe the points to input sheets… Color Graphics re-enters…
                   ○ 4. Check the data and calculations.
                   ⊗ checking is not a fourth stage in sequence; it runs across stages 1–3.
                     The list mixes a sequence with an activity that spans it.
                
                ● Issues
                ⚠ mixed kinds within one group: causes ("another person inserted into a
                  fragmented process", "same information entered three times") sit beside
                  symptoms ("inconsistent data", "incorrect variable-cost calculations").
                   ○ The transfer inserted another person into an already fragmented process.  ← cause
                   ○ Divisional staff and three corporate departments participate…             ← cause
                   ○ For one book, divisional data are loaded… entered again, and returned.     ✂ ⊗
                     one book's walkthrough re-tells stage 1–3 of "Production" at more detail;
                     it is an illustration of the cause, not a separate issue.
                   ○ inconsistent data between periods and regions, incorrect variable-cost
                     calculations, unexplained changes to correct points, prior-period
                     re-entry.                                                                 ← symptoms
                   ⊕ no evidence of scale: how often, how many books, what it costs in
                     rework or in credibility with senior management.
                
                ● Overall assessment
                   ○ Most problems arise from a cumbersome fragmented process.
                   ↑ this is the conclusion the whole memo supports. It sits in the last
                     paragraph; it belongs at the top — but as the *ground* for the answer,
                     not as the answer.
                   ○ No one controls the data end to end, responsibility is unclear, errors
                     fall between stages.
                   ○ The production process badly needs streamlining, both for each book and
                     for common calculations.
                   ⚠ "needs streamlining" names a direction, not an action: no owner, no
                     specific change, no sequence, no date.
                   ○ The current team cannot manage the required changes as well as ongoing
                     production.
                   ↑ ⊕ this is the memo's real ask — additional resource — and it appears as
                     an aside in the closing paragraph, unquantified and unrequested.
                
                Could we discuss how best to proceed?
                ⚠ the request is handed back to the reader. Management asked for proposals and
                  receives an invitation to a meeting.

Findings
#LocationViolationFix
1Whole documentNo answer exists anywhere. The reader asked what to change; the document delivers a description and a diagnosis. Even the closing paragraph stops at "needs streamlining"Derive the actions from the causes already established and put them on the first level: single end-to-end ownership of the data, one entry of each figure, one shared calculation base for the common points
2Subject line / openingTop is a topic label, and the controlling idea ("most problems arise from a fragmented process") sits in the final paragraphPromote the answer to the subject line and first sentence; the fragmentation finding becomes its support
3"Production" as a first-level groupWrong kind: current-state mechanics standing where the reader's question demands changesDemote under the change each step justifies, or move the whole walkthrough to an appendix
4"Issues"Mixed kinds — causes and symptoms in one group with no intermediate conclusion linking themSeparate: symptoms are evidence, the cause is the intermediate conclusion, the action is what follows from it
5"For one book…" paragraphOverlap: re-tells the Production steps at finer grain as though it were a distinct issueMerge into the fragmentation support, or cut
6Closing paragraph, last sentenceBuried ask: the resource request appears as an aside, unquantifiedRaise to a first-level element, with the specific resource and the period it is needed for
7Opening paragraphIntro has a Situation but no Complication and no Question; "this memo describes issues" is a purpose statementReplace with the complication — errors are reaching senior management — so the question the memo answers is visible before the support begins

Two further findings are omitted: the missing scale evidence under every symptom (), and the unexplained order of the four Issues.


Score — 4/10 · baseline workable
AxisScoreNote
Top0No answer present at any level; closest is a direction, not a decision
Same-kind groups1"Production" is internally uniform; "Issues" and "Overall assessment" mix causes, symptoms and asks
Order1Time order inside "Production" is formally correct but serves a group that should not be at that level; "Issues" has no explicable order
MECE1Checking overlaps the stages it follows; the one-book walkthrough duplicates the process description; no coverage of scale or cost
Display1Headings and numbering exist, but they label topics, so the skeleton does not show the argument

The three fixes that buy the most
  1. State the actions. Replace "the process badly needs streamlining" with the two or three specific changes the memo's own evidence supports, each with an owner and a date.
  2. Lift the fragmentation conclusion to the top and put the process description beneath it — the reader should meet the finding first and the mechanics only as proof.
  3. Make the resource request explicit and first-level, in place of "could we discuss how best to proceed".

Say the word and I will rewrite it answer-first.

How the test was built

Claude Opus 5 received the same task twice. The control prompt is one framing line and the task. The prompt with Minto is the same task preceded by the full text of the skill. The judge read both outputs among 16 under blind labels and did not know which one had the skill.

Prompt without Minto 2 424 B
You are working on a business document using the Minto Pyramid Principle.

<!-- Faithful paraphrase of Minto (2010), Appendix B, Exhibits B-5 and B-6.
     Original wording for this fixture. -->

# Fixture 03: Period Graph Books

**Mode:** `audit`
**Language:** `en`

## Context

Corporate Financial Analysis recently took over production of four monthly
graph books used in presentations to senior management. Management knows that
errors and inconsistencies have appeared and asked for corrective proposals.

## Before

```text
Subject: Period Graph Books

Since Period 5, Financial Analysis has been responsible for producing four
graph-presentation books previously handled by Corporate Planning. This memo
describes issues that appeared after the transfer.

Production

1. Gather data from divisional forms, internal documents, and telephone calls.
2. Calculate graph points manually or on the corporate computer, including
   rolling values for revenue, cost, and percentages.
3. Transcribe the points to input sheets. Analysts update the current period,
   then Color Graphics re-enters the points into its own database and generates
   the graphs.
4. Check the data and calculations.

Issues

The transfer inserted another person into an already fragmented process.
Divisional staff and three corporate departments participate, and the same
information may be entered into computer systems three times.

For one book, divisional data are loaded into a dedicated corporate program,
calculated, transferred to Color Graphics input sheets, entered again, and
returned for updates. Problems include inconsistent data between periods and
regions, incorrect variable-cost calculations, unexplained changes to points
that were previously correct, and prior-period data that must be re-entered.

Overall assessment

Most problems arise from a cumbersome fragmented process. No one controls the
data from beginning to end, responsibility is unclear, and errors can fall
between stages. The production process badly needs streamlining, both for each
book and for common calculations. The current team cannot manage the required
changes as well as ongoing production.

Could we discuss how best to proceed?
```

## Task

Audit this document against the Minto Pyramid Principle. Diagnose the defects
and explain what must change. Do not rewrite the document.

Return only the result, with no explanation of how you produced it.
Prompt with Minto five parts, in order · 29 997 B
  1. Below is a skill written as an instruction. Read it in full and apply it to the task at the end.
  2. ===== SKILL.md ===== SKILL.md at f4813ce 17 235 B
  3. ===== references/rules.md ===== references/rules.md at f4813ce 6 464 B
  4. ===== references/templates.md ===== references/templates.md at f4813ce 3 742 B
  5. ===== TASK ===== the whole case input
  6. Return only the result, with no explanation of how you produced it.
Case input before.md

<!-- Faithful paraphrase of Minto (2010), Appendix B, Exhibits B-5 and B-6.
Original wording for this fixture. -->

Fixture 03: Period Graph Books

Mode: audit
Language: en

Context

Corporate Financial Analysis recently took over production of four monthly
graph books used in presentations to senior management. Management knows that
errors and inconsistencies have appeared and asked for corrective proposals.

Before
Subject: Period Graph Books
                
                Since Period 5, Financial Analysis has been responsible for producing four
                graph-presentation books previously handled by Corporate Planning. This memo
                describes issues that appeared after the transfer.
                
                Production
                
                1. Gather data from divisional forms, internal documents, and telephone calls.
                2. Calculate graph points manually or on the corporate computer, including
                   rolling values for revenue, cost, and percentages.
                3. Transcribe the points to input sheets. Analysts update the current period,
                   then Color Graphics re-enters the points into its own database and generates
                   the graphs.
                4. Check the data and calculations.
                
                Issues
                
                The transfer inserted another person into an already fragmented process.
                Divisional staff and three corporate departments participate, and the same
                information may be entered into computer systems three times.
                
                For one book, divisional data are loaded into a dedicated corporate program,
                calculated, transferred to Color Graphics input sheets, entered again, and
                returned for updates. Problems include inconsistent data between periods and
                regions, incorrect variable-cost calculations, unexplained changes to points
                that were previously correct, and prior-period data that must be re-entered.
                
                Overall assessment
                
                Most problems arise from a cumbersome fragmented process. No one controls the
                data from beginning to end, responsibility is unclear, and errors can fall
                between stages. The production process badly needs streamlining, both for each
                book and for common calculations. The current team cannot manage the required
                changes as well as ongoing production.
                
                Could we discuss how best to proceed?
Task

Audit this document against the Minto Pyramid Principle. Diagnose the defects
and explain what must change. Do not rewrite the document.

The judge’s gold gold.md

Gold 03: Period Graph Books

Source structure: Minto (2010), Appendix B, Exhibits B-5 and B-6.

Book-derived defects
DefectSeverity
The document never states the changes required; it therefore does not answer management's questionCritical
It describes the current process instead of presenting a top and key lineCritical
"The purpose is to describe issues" is a topic, not an answerCritical
The process description is incomplete and does not isolate each system's failure pointsMedium
Problems in graph-point generation and later presenter changes are not clearly separatedMedium

The buried conclusion is that the process needs streamlining, but this is not
turned into an actionable answer.

Expected replacement structure

Reader question: What changes should we make to prevent unreliable graphs?

Top: Remove the opportunities for error across data transfer, graph-point
generation, and final presentation changes.

Key-line kind: changes/actions.

  1. Create a direct data link to the corporate computer.
  2. Create a reliable computerized routine for graph-point generation.
  3. Require presenter changes to be revalidated before use.

Audit outputs should name the missing answer, distinguish it from a conclusion
that is merely buried, annotate only visible evidence, provide no rewritten
memo, and avoid inventing defects in unseen material.

Judge gpt-5.6-sol, effort high · Claude Opus 5, effort low · skill from commit f4813ce · run v1.7.0-final