qwen3.8-27b на кейсе «Записка перед встречей»: с Minto хуже по качеству, структура та же
Структура 4 → 4 из 8 0 Качество 7 → 6 из 10 −1
Судья об ответе с Minto
It is factually faithful but turns a two-sentence note into a four-item evidence list.
| Структура | Без Minto 4 | С Minto 4 | Изменение |
|---|---|---|---|
| Вершина | 2 | 2 | |
| Состав ключевой линии | 1 | 1 | |
| Уровни | 0 | 0 | |
| Порядок и род | 1 | 1 |
| Качество | Без Minto 7 | С Minto 6 | Изменение |
|---|---|---|---|
| Вершина | 2 | 2 | |
| Однородные группы | 1 | 1 | |
| Объяснимый порядок | 1 | 1 | |
| MECE | 1 | 1 | |
| Видимая соразмерная структура | 2 | 1 | −1 |
Ответы моделей и слова судьи приведены в оригинале, по-английски.
Без Minto
контрольный промпт · слепая меткаout-02Жёстких провалов нет
This is the most faithful compact constraint summary, though it still promotes evidence rather than synthesizing the benefits.
Please approve rescheduling the meeting to Thursday at 11:00. Collins cannot attend at 3:00, Johnson is unavailable before 10:30, Clifford returns late tomorrow, and the conference room is occupied tomorrow but available Thursday.
С Minto
промпт с навыком · слепая меткаout-06Жёстких провалов нет
It is factually faithful but turns a two-sentence note into a four-item evidence list.
Please approve moving the 3:00 meeting to Thursday at 11:00.
Thursday at 11:00 appears possible:
- Collins cannot attend at 3:00.
- Johnson can meet later today or tomorrow, but not before 10:30.
- Clifford will not return from Frankfurt until late tomorrow.
- The conference room is occupied tomorrow but available on Thursday.
Как устроен тест
qwen3.8-27b получила одну и ту же задачу дважды. Контрольный промпт — одна вводная строка и задача. Промпт с Minto — та же задача, перед которой стоит полный текст навыка. Судья читал оба ответа среди 16 ответов под слепыми метками и не знал, в каком из них был навык.
Промпт без Minto 868 Б
You are working on a business document using the Minto Pyramid Principle.
<!-- Faithful paraphrase of the short meeting example in the preface of
Minto (2010). Original wording for this fixture. -->
# Fixture 04: meeting note
**Mode:** `write`
**Language:** `en`
## Context
A meeting is booked for 3:00 today. You checked the attendees and the conference
room, and now need one colleague to approve a change.
## Before
```text
Collins cannot attend at 3:00. Johnson can meet later today or tomorrow, but
not before 10:30. Clifford will not return from Frankfurt until late tomorrow.
The conference room is occupied tomorrow but available on Thursday. Thursday
at 11:00 appears possible. Is that acceptable?
```
## Task
Rewrite this as one short note using the Minto Pyramid Principle.
Return only the result, with no explanation of how you produced it.
Промпт с Minto пять частей по порядку · 28 441 Б
Below is a skill written as an instruction. Read it in full and apply it to the task at the end.===== SKILL.md =====SKILL.md на f4813ce 17 235 Б===== references/rules.md =====references/rules.md на f4813ce 6 464 Б===== references/templates.md =====references/templates.md на f4813ce 3 742 Б===== TASK =====вход кейса целикомReturn only the result, with no explanation of how you produced it.
Вход кейса before.md
<!-- Faithful paraphrase of the short meeting example in the preface of
Minto (2010). Original wording for this fixture. -->
Fixture 04: meeting note
Mode: write
Language: en
Context
A meeting is booked for 3:00 today. You checked the attendees and the conference
room, and now need one colleague to approve a change.
Before
Collins cannot attend at 3:00. Johnson can meet later today or tomorrow, but
not before 10:30. Clifford will not return from Frankfurt until late tomorrow.
The conference room is occupied tomorrow but available on Thursday. Thursday
at 11:00 appears possible. Is that acceptable?
Task
Rewrite this as one short note using the Minto Pyramid Principle.
Эталон судьи gold.md
Gold 04: meeting note
Source structure: Minto (2010), Preface.
Expected structure
Top: Request approval to move today's meeting to Thursday at 11:00.
Key line has exactly two reader benefits:
- The time is more convenient for Collins and Johnson.
- Clifford can attend.
The room's availability is a constraint, not a third reader benefit. Do not add
a third branch just to satisfy a numerical norm.
Proportionality
The result should remain a two-sentence note, no longer than the source. Section
headings, an SCQ template, tables, a separate key-line block, or a Mermaid
diagram are excessive. Omitting the detailed scheduling constraints is
acceptable when the answer and both benefits remain clear.
Судья gpt-5.6-sol, effort high · навык с коммита f4813ce · прогон v1.7.0-final