Codex gpt-5.6-terra на кейсе «Набор заголовков»: с Minto лучше по обеим мерам

Структура 3 → 6 из 8 +3 Качество 4 → 8 из 10 +4

Судья об ответе с Minto

Is appropriately cautious about the unavailable body and visibly structured, though it substitutes speculative benefits/results and completeness concerns for the missing nesting analysis.

Режим audit · кейс 07-headings-audit · прогон v1.7.0-final

Структура из 8, по 2 балла на ось
СтруктураБез Minto 3С Minto 6Изменение
Вершина12+1
Состав ключевой линии11
Уровни11
Порядок и род02+2
Качество из 10, по 2 балла на ось
КачествоБез Minto 4С Minto 8Изменение
Вершина12+1
Однородные группы11
Объяснимый порядок02+2
MECE11
Видимая соразмерная структура12+1

Ответы моделей и слова судьи приведены в оригинале, по-английски.

Без Minto

контрольный промпт · слепая метка out-15

Жёстких провалов нет

Correctly calls the headings topic labels and mixed, but is too abbreviated to diagnose the opening, six-item limit, Background level, or order with the required apparatus.

  • The six headings are topic labels, not message headings; they do not state the points the memorandum will prove.
  • They are not parallel: they mix background, definitions, principles, organization, benefits/results, and success conditions.
  • “Distinctive benefits and results” combines two potentially different ideas in one heading.
  • The opening promises how teams identify and deliver profit improvements, but the setout does not make the supporting logic or sequence visible.

С Minto

промпт с навыком · слепая метка out-12

Жёстких провалов нет

Is appropriately cautious about the unavailable body and visibly structured, though it substitutes speculative benefits/results and completeness concerns for the missing nesting analysis.

Legend: ▲ top/answer · ⚠ structural violation · ⊕ gap · ⇄ unexplained order

⚠ This memorandum describes how project teams identify and deliver significant
                profit improvements. ⊕ No reader question or answer is stated. It is organized in six sections:
                
                    ⚠ Background
                    ⚠ Principles of the project-team approach
                    ⚠ Definition of project work
                    ⚠ Organization of the program
                    ⚠ Distinctive benefits and results
                    ⚠ Conditions required for success
                    ⇄ No ordering principle is visible.
LocationViolationFix
Opening sentenceIt is a topic statement, not an answer to a reader’s question.State the conclusion the memorandum supports; the visible material does not establish one.
Opening and headingsNo reader question is made explicit.Define the decision or question the memorandum is intended to close.
Six-heading setoutThe headings mix kinds: background, principles, definition, organization, benefits/results, and conditions.Rebuild first-level headings as one same-kind set after the reader question is known.
“Distinctive benefits and results”Benefits and results are potentially separate categories; the visible setout does not establish their boundary.Separate them or define their relationship in the hierarchy.
Full setoutNo order is apparent: it is neither clearly chronological, structural, nor ranked.Apply and signal an order that serves the reader’s question.
Full setoutCompleteness and non-overlap cannot be verified from the heading labels alone; the missing body must not be inferred.Test the final hierarchy against the body when available.

Score: 1/10 — not structured yet

AxisScore
Top0
Same-kind groups0
Order0
MECE0
Display1

Three highest-value fixes:

  1. Establish the reader’s question and a one-sentence answer before naming sections.
  2. Replace the mixed six-heading list with three or four same-kind first-level groups.
  3. Order those groups by a visible, reader-relevant principle.

Как устроен тест

Codex gpt-5.6-terra получила одну и ту же задачу дважды. Контрольный промпт — одна вводная строка и задача. Промпт с Minto — та же задача, перед которой стоит полный текст навыка. Судья читал оба ответа среди 16 ответов под слепыми метками и не знал, в каком из них был навык.

Промпт без Minto 998 Б
You are working on a business document using the Minto Pyramid Principle.

<!-- Faithful paraphrase of Minto (2010), Chapter 4, the six-heading
     project-team example. Original wording for this fixture. -->

# Fixture 07: headings audit

**Mode:** `audit`
**Language:** `en`

## Context

Only the opening and setout below are available. The body of the memorandum is
not available and must not be inferred.

## Before

```text
This memorandum describes how project teams identify and deliver significant
profit improvements. It is organized in six sections:

    Background
    Principles of the project-team approach
    Definition of project work
    Organization of the program
    Distinctive benefits and results
    Conditions required for success
```

## Task

Audit the visible opening against the Minto Pyramid Principle. Report what is
wrong without rewriting the document or inventing facts about the missing body.

Return only the result, with no explanation of how you produced it.
Промпт с Minto пять частей по порядку · 28 571 Б
  1. Below is a skill written as an instruction. Read it in full and apply it to the task at the end.
  2. ===== SKILL.md ===== SKILL.md на f4813ce 17 235 Б
  3. ===== references/rules.md ===== references/rules.md на f4813ce 6 464 Б
  4. ===== references/templates.md ===== references/templates.md на f4813ce 3 742 Б
  5. ===== TASK ===== вход кейса целиком
  6. Return only the result, with no explanation of how you produced it.
Вход кейса before.md

<!-- Faithful paraphrase of Minto (2010), Chapter 4, the six-heading
project-team example. Original wording for this fixture. -->

Fixture 07: headings audit

Mode: audit
Language: en

Context

Only the opening and setout below are available. The body of the memorandum is
not available and must not be inferred.

Before
This memorandum describes how project teams identify and deliver significant
                profit improvements. It is organized in six sections:
                
                    Background
                    Principles of the project-team approach
                    Definition of project work
                    Organization of the program
                    Distinctive benefits and results
                    Conditions required for success
Task

Audit the visible opening against the Minto Pyramid Principle. Report what is
wrong without rewriting the document or inventing facts about the missing body.

Эталон судьи gold.md

Gold 07: headings audit

Source structure: Minto (2010), Chapter 4.

Visible defects
DefectSeverity
The setout contains topics, not ideas, so it conveys no message or key lineCritical
The first sentence describes a subject instead of answering a reader questionCritical
Background cannot sit at the same abstraction level as the other pointsMedium
Benefits/results likely belong under principles; success conditions likely belong under program organizationMedium
Six first-level topics exceed the skill's normal display limitMedium
The topics do not form a visible inductive or deductive argumentMedium

The output must stay within the visible evidence. Claims about missing data,
metrics, proof, vertical support inside sections, or exact content of the body
are false positives. Invented page numbers, line numbers, or quotations are
hard failures.

Судья gpt-5.6-sol, effort high · Codex gpt-5.6-terra, effort low · навык с коммита f4813ce · прогон v1.7.0-final