Claude Sonnet 5 на кейсе «Пирамида готовой записки»: с Minto хуже по обеим мерам
Структура 8 → 6 из 8 −2 Качество 10 → 8 из 10 −2
Судья об ответе с Minto
The two branches remain actions, but both are materially recast and the union-pressure evidence is lost.
| Структура | Без Minto 8 | С Minto 6 | Изменение |
|---|---|---|---|
| Вершина | 2 | 2 | |
| Состав ключевой линии | 2 | 1 | −1 |
| Уровни | 2 | 1 | −1 |
| Порядок и род | 2 | 2 |
| Качество | Без Minto 10 | С Minto 8 | Изменение |
|---|---|---|---|
| Вершина | 2 | 2 | |
| Однородные группы | 2 | 2 | |
| Объяснимый порядок | 2 | 2 | |
| MECE | 2 | 1 | −1 |
| Видимая соразмерная структура | 2 | 1 | −1 |
Ответы моделей и слова судьи приведены в оригинале, по-английски.
Без Minto
контрольный промпт · слепая меткаout-07invented_facts- качество со штрафом рубрики 8/10
The hierarchy and evidence are complete, with only the recruitment effect stated too categorically.
TTW can substantially cut composing
cost by removing unnecessary process
stages and raising wages to local
market level
|
------------------------------------
| |
Remove unnecessary Raise wages
process stages to market level
| |
- Productivity trails - TTW pays below
benchmark by 20-50% nearby printers,
- Every title gets same cannot hire/retain
checks regardless of compositors
complexity - Two compositors just
- Test fewer/different left; dept understaffed
checks on simple jobs - Most work late,
next week, monitor overtime >50% over
quality/customer reaction budget
- Possible saving: up to - New union claim may
10% of composing cost force higher pay anyway
- Methods study to cover - Competitive pay enables
remaining gap recruitment, removes
overtime premium
С Minto
промпт с навыком · слепая меткаout-08invented_factsunacknowledged_source_loss- качество со штрафом рубрики 7/10
The two branches remain actions, but both are materially recast and the union-pressure evidence is lost.
flowchart TD
A["TTW can cut composing cost substantially by removing unnecessary process stages and raising wages to market level"] --> B1["We will eliminate wasted process capacity"]
A --> B2["We will fix the compositor shortage driving cost up"]
B1 --> C11["TTW trails the productivity benchmark by 20-50%"]
B1 --> C12["Every title gets the same checks regardless of complexity"]
B1 --> C13["Test fewer/differently-timed checks on simple jobs next week, monitoring quality and customer reaction"]
B1 --> C14["Possible saving: up to 10% of composing cost"]
B1 --> C15["Methods study will address the remaining benchmark gap"]
B2 --> C21["TTW pays less than nearby printers"]
B2 --> C22["Department cannot hire or retain enough compositors — two just left"]
B2 --> C23["Understaffing causes late work and overtime over 50% of budget"]
B2 --> C24["Competitive pay enables recruitment and removes the overtime premium"]
Как устроен тест
Claude Sonnet 5 получила одну и ту же задачу дважды. Контрольный промпт — одна вводная строка и задача. Промпт с Minto — та же задача, перед которой стоит полный текст навыка. Судья читал оба ответа среди 16 ответов под слепыми метками и не знал, в каком из них был навык.
Промпт без Minto 1 688 Б
You are working on a business document using the Minto Pyramid Principle.
<!-- Faithful paraphrase of Minto (2010), Chapter 3, the rewritten TTW memo.
Original wording for this fixture. -->
# Fixture 06: TTW pyramid
**Mode:** `viz`
**Language:** `en`
## Context
The TTW memo has already been rewritten. Show its existing structure; do not
rewrite it.
## Before
```text
Subject: TTW composing cost
During the past two weeks I reviewed the Aylesbury composing room. Composition
represents about 40% of hardback cost and 50-55% of paperback cost. TTW does not
know whether the cost is excessive, but customers regard it as uncompetitive on
simple jobs.
Our preliminary work indicates that TTW can cut composing cost substantially
by:
- removing unnecessary process stages;
- raising wages to the local market level.
REMOVE UNNECESSARY STAGES
TTW trails the productivity benchmark by 20-50%. Every title passes through
essentially the same checks regardless of complexity. Next week, selected
simple jobs will be tested with fewer or differently timed checks, while
quality and customer reaction are monitored. The possible saving is up to 10%
of composing cost. A methods study will examine the remaining benchmark gap.
RAISE WAGES
TTW pays less than nearby printers and cannot hire or retain enough
compositors. Two have just left. The department is understaffed, most work is
late, and overtime exceeds budget by more than 50%. A new union claim may force
higher pay; competitive pay should make recruitment possible and remove the
overtime premium.
```
## Task
Draw the pyramid of this memorandum.
Return only the result, with no explanation of how you produced it.
Промпт с Minto пять частей по порядку · 29 261 Б
Below is a skill written as an instruction. Read it in full and apply it to the task at the end.===== SKILL.md =====SKILL.md на f4813ce 17 235 Б===== references/rules.md =====references/rules.md на f4813ce 6 464 Б===== references/templates.md =====references/templates.md на f4813ce 3 742 Б===== TASK =====вход кейса целикомReturn only the result, with no explanation of how you produced it.
Вход кейса before.md
<!-- Faithful paraphrase of Minto (2010), Chapter 3, the rewritten TTW memo.
Original wording for this fixture. -->
Fixture 06: TTW pyramid
Mode: viz
Language: en
Context
The TTW memo has already been rewritten. Show its existing structure; do not
rewrite it.
Before
Subject: TTW composing cost
During the past two weeks I reviewed the Aylesbury composing room. Composition
represents about 40% of hardback cost and 50-55% of paperback cost. TTW does not
know whether the cost is excessive, but customers regard it as uncompetitive on
simple jobs.
Our preliminary work indicates that TTW can cut composing cost substantially
by:
- removing unnecessary process stages;
- raising wages to the local market level.
REMOVE UNNECESSARY STAGES
TTW trails the productivity benchmark by 20-50%. Every title passes through
essentially the same checks regardless of complexity. Next week, selected
simple jobs will be tested with fewer or differently timed checks, while
quality and customer reaction are monitored. The possible saving is up to 10%
of composing cost. A methods study will examine the remaining benchmark gap.
RAISE WAGES
TTW pays less than nearby printers and cannot hire or retain enough
compositors. Two have just left. The department is understaffed, most work is
late, and overtime exceeds budget by more than 50%. A new union claim may force
higher pay; competitive pay should make recruitment possible and remove the
overtime premium.
Task
Draw the pyramid of this memorandum.
Эталон судьи gold.md
Gold 06: TTW pyramid
Source structure: Minto (2010), Chapter 3, TTW analysis and rewritten memo.
Expected diagram
Top: TTW can cut composing cost substantially.
Exactly two first-level actions:
- Remove unnecessary composing stages.
- Raise wages to competitive levels.
Under the first: benchmark gap, identical stages for different work, controlled
test, potential 10% saving, methods study.
Under the second: below-market pay, recruitment and retention failure, two
departures, understaffing, delays, overtime more than 50% over budget, union
pressure.
A valid output contains a Mermaid flowchart TD or an equivalent visible text
diagram. It does not create an HTML page or local file because none was
requested. Repeating section labels without turning them into claims, adding a
third first-level branch, or promoting observations to the first level reduces
the structural score. No prose rewrite is required.
Судья gpt-5.6-sol, effort high · Claude Sonnet 5, effort low · навык с коммита f4813ce · прогон v1.7.0-final