gpt-oss-120b на кейсе «Записка перед встречей»: с Minto хуже по обеим мерам
Структура 4 → 3 из 8 −1 Качество 5 → 3 из 10 −2
Судья об ответе с Minto
It forces three labeled branches, promotes the room, and invents “minimal disruption.”
| Структура | Без Minto 4 | С Minto 3 | Изменение |
|---|---|---|---|
| Вершина | 2 | 1 | −1 |
| Состав ключевой линии | 1 | 0 | −1 |
| Уровни | 0 | 1 | +1 |
| Порядок и род | 1 | 1 |
| Качество | Без Minto 5 | С Minto 3 | Изменение |
|---|---|---|---|
| Вершина | 2 | 1 | −1 |
| Однородные группы | 1 | 0 | −1 |
| Объяснимый порядок | 1 | 1 | |
| MECE | 1 | 0 | −1 |
| Видимая соразмерная структура | 0 | 1 | +1 |
Ответы моделей и слова судьи приведены в оригинале, по-английски.
Без Minto
контрольный промпт · слепая меткаout-08invented_facts- качество со штрафом рубрики 4/10
Heavy recommendation/rationale/conclusion apparatus culminates in the unsupported claim that this is the earliest feasible time.
Recommendation: Approve moving the 3 pm meeting to Thursday 11:00 am.
Rationale
- Collins cannot attend at 3 pm.
- Johnson is only available after 10:30 today or tomorrow.
- Clifford returns from Frankfurt late tomorrow.
- The conference room is occupied tomorrow.
Conclusion
Thursday at 11 am is the earliest time that satisfies all attendees and room availability.
С Minto
промпт с навыком · слепая меткаout-05invented_facts
It forces three labeled branches, promotes the room, and invents “minimal disruption.”
Thursday at 11:00 is acceptable for the meeting.
1. Attendee availability
- Collins cannot attend today.
- Johnson is free only after 10:30 today or tomorrow.
- Clifford returns late tomorrow.
2. Room availability
- The conference room is occupied tomorrow but free on Thursday.
3. Minimal disruption
- A single change lets all key participants attend.
Как устроен тест
gpt-oss-120b получила одну и ту же задачу дважды. Контрольный промпт — одна вводная строка и задача. Промпт с Minto — та же задача, перед которой стоит полный текст навыка. Судья читал оба ответа среди 16 ответов под слепыми метками и не знал, в каком из них был навык.
Промпт без Minto 868 Б
You are working on a business document using the Minto Pyramid Principle.
<!-- Faithful paraphrase of the short meeting example in the preface of
Minto (2010). Original wording for this fixture. -->
# Fixture 04: meeting note
**Mode:** `write`
**Language:** `en`
## Context
A meeting is booked for 3:00 today. You checked the attendees and the conference
room, and now need one colleague to approve a change.
## Before
```text
Collins cannot attend at 3:00. Johnson can meet later today or tomorrow, but
not before 10:30. Clifford will not return from Frankfurt until late tomorrow.
The conference room is occupied tomorrow but available on Thursday. Thursday
at 11:00 appears possible. Is that acceptable?
```
## Task
Rewrite this as one short note using the Minto Pyramid Principle.
Return only the result, with no explanation of how you produced it.
Промпт с Minto пять частей по порядку · 28 441 Б
Below is a skill written as an instruction. Read it in full and apply it to the task at the end.===== SKILL.md =====SKILL.md на f4813ce 17 235 Б===== references/rules.md =====references/rules.md на f4813ce 6 464 Б===== references/templates.md =====references/templates.md на f4813ce 3 742 Б===== TASK =====вход кейса целикомReturn only the result, with no explanation of how you produced it.
Вход кейса before.md
<!-- Faithful paraphrase of the short meeting example in the preface of
Minto (2010). Original wording for this fixture. -->
Fixture 04: meeting note
Mode: write
Language: en
Context
A meeting is booked for 3:00 today. You checked the attendees and the conference
room, and now need one colleague to approve a change.
Before
Collins cannot attend at 3:00. Johnson can meet later today or tomorrow, but
not before 10:30. Clifford will not return from Frankfurt until late tomorrow.
The conference room is occupied tomorrow but available on Thursday. Thursday
at 11:00 appears possible. Is that acceptable?
Task
Rewrite this as one short note using the Minto Pyramid Principle.
Эталон судьи gold.md
Gold 04: meeting note
Source structure: Minto (2010), Preface.
Expected structure
Top: Request approval to move today's meeting to Thursday at 11:00.
Key line has exactly two reader benefits:
- The time is more convenient for Collins and Johnson.
- Clifford can attend.
The room's availability is a constraint, not a third reader benefit. Do not add
a third branch just to satisfy a numerical norm.
Proportionality
The result should remain a two-sentence note, no longer than the source. Section
headings, an SCQ template, tables, a separate key-line block, or a Mermaid
diagram are excessive. Omitting the detailed scheduling constraints is
acceptable when the answer and both benefits remain clear.
Судья gpt-5.6-sol, effort high · навык с коммита f4813ce · прогон v1.7.0-final