Claude Opus 5 на кейсе «Набор заголовков»: с Minto лучше по качеству, структура та же

Структура 6 → 6 из 8 0 Качество 7 → 9 из 10 +2

Судья об ответе с Minto

Exceptionally visible and answer-focused, but it turns an unknown reader decision and tentative section relationships into definite claims.

Режим audit · кейс 07-headings-audit · прогон v1.7.0-final

Структура из 8, по 2 балла на ось
СтруктураБез Minto 6С Minto 6Изменение
Вершина22
Состав ключевой линии11
Уровни21−1
Порядок и род12+1
Качество из 10, по 2 балла на ось
КачествоБез Minto 7С Minto 9Изменение
Вершина22
Однородные группы22
Объяснимый порядок12+1
MECE11
Видимая соразмерная структура12+1

Ответы моделей и слова судьи приведены в оригинале, по-английски.

Без Minto

контрольный промпт · слепая метка out-02
  • invented_facts
  • качество со штрафом рубрики 6/10

Covers most visible defects and explicitly limits some body judgments, yet contradicts that restraint when describing unseen Background material and later-section behavior.

Headings audit — Fixture 07

1. No governing thought

The opening tells the reader what the document describes ("how project teams identify and deliver significant profit improvements") instead of stating the answer. A pyramid's apex must be an idea that the reader can agree or disagree with — a point, not a subject label. As written, nothing at the top holds the six sections together, so nothing below can support it.

2. "Background" is not a section

Background belongs in the introduction, where it establishes the Situation and Complication that raise the reader's question. Promoting it to a body heading means the document begins without a question in play, and the reader must carry unattached facts forward until some later section gives them a purpose.

3. The headings are sterile category labels, not ideas

"Definition of project work," "Organization of the program," and "Conditions required for success" name topics; they assert nothing. Read on their own, the list tells the reader nothing about what the memorandum concludes. Minto's test — that the headings alone should convey the argument — fails here.

4. The six items are not a single logical grouping

They are of mixed kinds and cannot be the answer to one question:

  • Principles and Definition describe what the approach is
  • Organization describes how it is run
  • Benefits and results describe what it produces
  • Conditions for success describe what it requires

Four different questions are being answered at one level. The set is therefore neither mutually exclusive (principles and definition overlap; conditions and organization overlap) nor collectively driven by a common inductive plural or deductive chain.

5. Six items at one level exceeds working-memory limits

With no intermediate grouping, the reader has no structure to hold. The mixed kinds identified above indicate the natural remedy is grouping into fewer, higher-level ideas — but which grouping is correct cannot be determined without the body.

6. The order is unexplained

Nothing in the setout signals whether the sequence is chronological, structural, or by degree of importance. Minto requires that each grouping have a discernible logical order; the reader here cannot tell why Benefits precedes Conditions rather than following from them.

7. The setout invites serial reading

"It is organized in six sections" prepares the reader to work through the document linearly to find out what it thinks. A pyramid should let the reader stop at any level and still have the message.


Not assessed: whether the body's content supports these headings, whether the summary statements within each section are valid, and the correct regrouping of the six items — all require the body, which is unavailable.

С Minto

промпт с навыком · слепая метка out-01
  • invented_facts
  • качество со штрафом рубрики 8/10

Exceptionally visible and answer-focused, but it turns an unknown reader decision and tentative section relationships into definite claims.

Legend: top/answer · first-level group · violation · overlap · gap · cut

▲⚠ This memorandum describes how project teams identify and deliver significant
                   profit improvements. [topic label — states the subject, answers nothing]
                ✂ It is organized in six sections: [statement of purpose / table of contents,
                   not a Situation and not an Answer]
                
                    ● Background                                  ⚠ context, not a claim
                    ● Principles of the project-team approach     ⚠ concepts  ⊗ with Definition
                    ● Definition of project work                  ⚠ concepts  ⊗ with Principles
                    ● Organization of the program                 ⚠ mechanics ⊗ with Principles
                    ● Distinctive benefits and results            ⚠ payoffs — the only branch of
                                                                     the kind the reader needs
                    ● Conditions required for success             ⚠ prerequisites
                    ⊕ [no reader question stated anywhere; no SCQ; six groups, no order]
LocationViolationFix
Opening sentenceNo answer anywhere in the visible text — the document has a subject, not a controlling idea. Reader deciding whether to adopt project teams needs what it is worth, not what the memo coversReplace with one sentence asserting the answer, e.g. the reader's payoff from adopting the approach
Whole setoutSix headings of six different kinds (context, concepts, definition, mechanics, payoffs, prerequisites) — no plural noun fits themRe-derive the kind from the reader's question, refill the groups with one kind
Six sectionsCount exceeds working memory; nothing signals which matter mostCollapse to 3–4 first-level groups
Sections 2, 3, 4Overlap: principles, definition and organization all describe what the approach is and how it runsMerge into supports under the payoff they produce
Section 5 vs 1–4Wrong level: "Benefits and results" is the answer to the reader's question, buried as the fifth of six itemsPromote the benefits to the first level; demote mechanics beneath them
Entire openingNo SCQ: no Situation the reader accepts, no Complication forcing a choice, no Question — so no way to tell what the memo closesOpen with the situation and what changed, then the question, then the answer
All six headingsTopic words, not claims — the skeleton cannot be read at a glanceRestate every heading as an assertion

Score: 2/10 — Top 0 · Same-kind groups 0 · Order 0 · MECE 1 · Display 1. Band: not structured yet.

Three fixes that buy the most

  1. State the answer in the first sentence — what the reader gains from project teams.
  2. Promote "benefits and results" to the first level and hang principles, definition and organization under it as support.
  3. Rewrite the six topic labels as three or four same-kind assertions, ordered by ranking.

Say the word and I'll run write on it once the body is available.

Как устроен тест

Claude Opus 5 получила одну и ту же задачу дважды. Контрольный промпт — одна вводная строка и задача. Промпт с Minto — та же задача, перед которой стоит полный текст навыка. Судья читал оба ответа среди 16 ответов под слепыми метками и не знал, в каком из них был навык.

Промпт без Minto 998 Б
You are working on a business document using the Minto Pyramid Principle.

<!-- Faithful paraphrase of Minto (2010), Chapter 4, the six-heading
     project-team example. Original wording for this fixture. -->

# Fixture 07: headings audit

**Mode:** `audit`
**Language:** `en`

## Context

Only the opening and setout below are available. The body of the memorandum is
not available and must not be inferred.

## Before

```text
This memorandum describes how project teams identify and deliver significant
profit improvements. It is organized in six sections:

    Background
    Principles of the project-team approach
    Definition of project work
    Organization of the program
    Distinctive benefits and results
    Conditions required for success
```

## Task

Audit the visible opening against the Minto Pyramid Principle. Report what is
wrong without rewriting the document or inventing facts about the missing body.

Return only the result, with no explanation of how you produced it.
Промпт с Minto пять частей по порядку · 28 571 Б
  1. Below is a skill written as an instruction. Read it in full and apply it to the task at the end.
  2. ===== SKILL.md ===== SKILL.md на f4813ce 17 235 Б
  3. ===== references/rules.md ===== references/rules.md на f4813ce 6 464 Б
  4. ===== references/templates.md ===== references/templates.md на f4813ce 3 742 Б
  5. ===== TASK ===== вход кейса целиком
  6. Return only the result, with no explanation of how you produced it.
Вход кейса before.md

<!-- Faithful paraphrase of Minto (2010), Chapter 4, the six-heading
project-team example. Original wording for this fixture. -->

Fixture 07: headings audit

Mode: audit
Language: en

Context

Only the opening and setout below are available. The body of the memorandum is
not available and must not be inferred.

Before
This memorandum describes how project teams identify and deliver significant
                profit improvements. It is organized in six sections:
                
                    Background
                    Principles of the project-team approach
                    Definition of project work
                    Organization of the program
                    Distinctive benefits and results
                    Conditions required for success
Task

Audit the visible opening against the Minto Pyramid Principle. Report what is
wrong without rewriting the document or inventing facts about the missing body.

Эталон судьи gold.md

Gold 07: headings audit

Source structure: Minto (2010), Chapter 4.

Visible defects
DefectSeverity
The setout contains topics, not ideas, so it conveys no message or key lineCritical
The first sentence describes a subject instead of answering a reader questionCritical
Background cannot sit at the same abstraction level as the other pointsMedium
Benefits/results likely belong under principles; success conditions likely belong under program organizationMedium
Six first-level topics exceed the skill's normal display limitMedium
The topics do not form a visible inductive or deductive argumentMedium

The output must stay within the visible evidence. Claims about missing data,
metrics, proof, vertical support inside sections, or exact content of the body
are false positives. Invented page numbers, line numbers, or quotations are
hard failures.

Судья gpt-5.6-sol, effort high · Claude Opus 5, effort low · навык с коммита f4813ce · прогон v1.7.0-final