Записка перед встречей

Режим write · Создать и переработать текст

Восемь моделей на этом кейсе

МодельСтруктура, из 8Качество, из 10
Claude Opus 54 → 6 +26 → 8 +2
Claude Sonnet 54 → 6 +26 → 8 +2
Claude Haiku 4.54 → 4 06 → 7 +1
Codex gpt-5.6-terra4 → 5 +17 → 7 0
gpt-oss-120b4 → 3 −15 → 3 −2
qwen3.6-35b-a3b5 → 6 +17 → 9 +2
qwen3.6-fp85 → 5 07 → 7 0
qwen3.8-27b4 → 4 07 → 6 −1

Что судья увидел во всех ответах

Stronger outputs put the reschedule proposal first, remain close to the source’s length, and subordinate scheduling facts to a compact rationale. Weaker outputs leave constraints flat, promote room availability beside attendee benefits, force extra branches, or turn the source’s tentative possibility into certainty.

О чём судья спрашивал каждый ответ

  1. How many first-level benefits appear? The gold has two.
  2. Is room availability incorrectly used as a third benefit?
  3. Is the reschedule request the first sentence?
  4. Is the output no longer than the source?
  5. Which excessive devices appear: headings, SCQ labels, table, separate key line, Mermaid, or change log?
  6. Were attendee constraints omitted, demoted, or promoted?
  7. Were any time, day, attendee, or fact invented?

Где ответы не дотянули

Повторяющийся дефектРаздел навыкаПричинаУ кого
Constraints or time slots replace the two benefit-level reasonsCore loop §4, “Groups”правило в навыке есть, модель его не выполнилаБез Minto · 5 Claude Opus 5, Claude Sonnet 5, Codex gpt-5.6-terra, gpt-oss-120b, qwen3.8-27bС Minto · 3 Claude Haiku 4.5, qwen3.6-35b-a3b, qwen3.8-27b
Room availability is promoted to a peer branch instead of remaining supportCore loop §4 and §6, “Groups” and “MECE”правило в навыке есть, модель его не выполнилаБез Minto · 8 Claude Opus 5, Claude Sonnet 5, Claude Haiku 4.5, Codex gpt-5.6-terra, gpt-oss-120b, qwen3.6-35b-a3b, qwen3.6-fp8, qwen3.8-27bС Minto · 7 Claude Opus 5, Claude Sonnet 5, Claude Haiku 4.5, Codex gpt-5.6-terra, gpt-oss-120b, qwen3.6-fp8, qwen3.8-27b
A numerical grouping norm encourages unnecessary extra branchesMode 3 “3–4 first-level groups” versus Limits “four honest groups beat three forced ones”правило есть, но спрятано глубокоБез Minto · 5 Claude Opus 5, Claude Sonnet 5, Codex gpt-5.6-terra, gpt-oss-120b, qwen3.8-27bС Minto · 3 Claude Haiku 4.5, gpt-oss-120b, qwen3.8-27b
Tentative or bounded evidence becomes certain availability, feasibility, or priorityMode 3, “Invent nothing”правило в навыке есть, модель его не выполнилаБез Minto · 5 Claude Opus 5, Claude Haiku 4.5, gpt-oss-120b, qwen3.6-35b-a3b, qwen3.6-fp8С Minto · 7 Claude Opus 5, Claude Sonnet 5, Claude Haiku 4.5, Codex gpt-5.6-terra, gpt-oss-120b, qwen3.6-35b-a3b, qwen3.6-fp8
Structural apparatus is disproportionate to a short meeting noteMode 3, “clean text” and plain-format rulesправило в навыке есть, модель его не выполнилаБез Minto · 1 gpt-oss-120bС Minto · 2 gpt-oss-120b, qwen3.6-fp8
Collins and the reason the original slot fails disappearMode 3, “Keep every fact from the source”правило в навыке есть, модель его не выполнилаБез Minto · 1 Claude Haiku 4.5С Minto · 0

Как устроен тест

Промпт без Minto 868 Б
You are working on a business document using the Minto Pyramid Principle.

<!-- Faithful paraphrase of the short meeting example in the preface of
     Minto (2010). Original wording for this fixture. -->

# Fixture 04: meeting note

**Mode:** `write`
**Language:** `en`

## Context

A meeting is booked for 3:00 today. You checked the attendees and the conference
room, and now need one colleague to approve a change.

## Before

```text
Collins cannot attend at 3:00. Johnson can meet later today or tomorrow, but
not before 10:30. Clifford will not return from Frankfurt until late tomorrow.
The conference room is occupied tomorrow but available on Thursday. Thursday
at 11:00 appears possible. Is that acceptable?
```

## Task

Rewrite this as one short note using the Minto Pyramid Principle.

Return only the result, with no explanation of how you produced it.
Промпт с Minto пять частей по порядку · 28 441 Б
  1. Below is a skill written as an instruction. Read it in full and apply it to the task at the end.
  2. ===== SKILL.md ===== SKILL.md на f4813ce 17 235 Б
  3. ===== references/rules.md ===== references/rules.md на f4813ce 6 464 Б
  4. ===== references/templates.md ===== references/templates.md на f4813ce 3 742 Б
  5. ===== TASK ===== вход кейса целиком
  6. Return only the result, with no explanation of how you produced it.
Вход кейса before.md

<!-- Faithful paraphrase of the short meeting example in the preface of
Minto (2010). Original wording for this fixture. -->

Fixture 04: meeting note

Mode: write
Language: en

Context

A meeting is booked for 3:00 today. You checked the attendees and the conference
room, and now need one colleague to approve a change.

Before
Collins cannot attend at 3:00. Johnson can meet later today or tomorrow, but
                not before 10:30. Clifford will not return from Frankfurt until late tomorrow.
                The conference room is occupied tomorrow but available on Thursday. Thursday
                at 11:00 appears possible. Is that acceptable?
Task

Rewrite this as one short note using the Minto Pyramid Principle.

Эталон судьи gold.md

Gold 04: meeting note

Source structure: Minto (2010), Preface.

Expected structure

Top: Request approval to move today's meeting to Thursday at 11:00.

Key line has exactly two reader benefits:

  1. The time is more convenient for Collins and Johnson.
  2. Clifford can attend.

The room's availability is a constraint, not a third reader benefit. Do not add
a third branch just to satisfy a numerical norm.

Proportionality

The result should remain a two-sentence note, no longer than the source. Section
headings, an SCQ template, tables, a separate key-line block, or a Mermaid
diagram are excessive. Omitting the detailed scheduling constraints is
acceptable when the answer and both benefits remain clear.

Судья gpt-5.6-sol, effort high · навык с коммита f4813ce · прогон v1.7.0-final

Вернуться к карте