gpt-oss-120b на кейсе «Записка перед встречей»: с Minto хуже по обеим мерам

Структура 4 → 3 из 8 −1 Качество 5 → 3 из 10 −2

Судья об ответе с Minto

It forces three labeled branches, promotes the room, and invents “minimal disruption.”

Режим write · кейс 04-meeting-note · прогон v1.7.0-final

Структура из 8, по 2 балла на ось
СтруктураБез Minto 4С Minto 3Изменение
Вершина21−1
Состав ключевой линии10−1
Уровни01+1
Порядок и род11
Качество из 10, по 2 балла на ось
КачествоБез Minto 5С Minto 3Изменение
Вершина21−1
Однородные группы10−1
Объяснимый порядок11
MECE10−1
Видимая соразмерная структура01+1

Ответы моделей и слова судьи приведены в оригинале, по-английски.

Без Minto

контрольный промпт · слепая метка out-08
  • invented_facts
  • качество со штрафом рубрики 4/10

Heavy recommendation/rationale/conclusion apparatus culminates in the unsupported claim that this is the earliest feasible time.

Recommendation: Approve moving the 3 pm meeting to Thursday 11:00 am.

Rationale

  • Collins cannot attend at 3 pm.
  • Johnson is only available after 10:30 today or tomorrow.
  • Clifford returns from Frankfurt late tomorrow.
  • The conference room is occupied tomorrow.

Conclusion
Thursday at 11 am is the earliest time that satisfies all attendees and room availability.

С Minto

промпт с навыком · слепая метка out-05
  • invented_facts

It forces three labeled branches, promotes the room, and invents “minimal disruption.”

Thursday at 11:00 is acceptable for the meeting.

1. Attendee availability

  • Collins cannot attend today.
  • Johnson is free only after 10:30 today or tomorrow.
  • Clifford returns late tomorrow.

2. Room availability

  • The conference room is occupied tomorrow but free on Thursday.

3. Minimal disruption

  • A single change lets all key participants attend.

Как устроен тест

gpt-oss-120b получила одну и ту же задачу дважды. Контрольный промпт — одна вводная строка и задача. Промпт с Minto — та же задача, перед которой стоит полный текст навыка. Судья читал оба ответа среди 16 ответов под слепыми метками и не знал, в каком из них был навык.

Промпт без Minto 868 Б
You are working on a business document using the Minto Pyramid Principle.

<!-- Faithful paraphrase of the short meeting example in the preface of
     Minto (2010). Original wording for this fixture. -->

# Fixture 04: meeting note

**Mode:** `write`
**Language:** `en`

## Context

A meeting is booked for 3:00 today. You checked the attendees and the conference
room, and now need one colleague to approve a change.

## Before

```text
Collins cannot attend at 3:00. Johnson can meet later today or tomorrow, but
not before 10:30. Clifford will not return from Frankfurt until late tomorrow.
The conference room is occupied tomorrow but available on Thursday. Thursday
at 11:00 appears possible. Is that acceptable?
```

## Task

Rewrite this as one short note using the Minto Pyramid Principle.

Return only the result, with no explanation of how you produced it.
Промпт с Minto пять частей по порядку · 28 441 Б
  1. Below is a skill written as an instruction. Read it in full and apply it to the task at the end.
  2. ===== SKILL.md ===== SKILL.md на f4813ce 17 235 Б
  3. ===== references/rules.md ===== references/rules.md на f4813ce 6 464 Б
  4. ===== references/templates.md ===== references/templates.md на f4813ce 3 742 Б
  5. ===== TASK ===== вход кейса целиком
  6. Return only the result, with no explanation of how you produced it.
Вход кейса before.md

<!-- Faithful paraphrase of the short meeting example in the preface of
Minto (2010). Original wording for this fixture. -->

Fixture 04: meeting note

Mode: write
Language: en

Context

A meeting is booked for 3:00 today. You checked the attendees and the conference
room, and now need one colleague to approve a change.

Before
Collins cannot attend at 3:00. Johnson can meet later today or tomorrow, but
                not before 10:30. Clifford will not return from Frankfurt until late tomorrow.
                The conference room is occupied tomorrow but available on Thursday. Thursday
                at 11:00 appears possible. Is that acceptable?
Task

Rewrite this as one short note using the Minto Pyramid Principle.

Эталон судьи gold.md

Gold 04: meeting note

Source structure: Minto (2010), Preface.

Expected structure

Top: Request approval to move today's meeting to Thursday at 11:00.

Key line has exactly two reader benefits:

  1. The time is more convenient for Collins and Johnson.
  2. Clifford can attend.

The room's availability is a constraint, not a third reader benefit. Do not add
a third branch just to satisfy a numerical norm.

Proportionality

The result should remain a two-sentence note, no longer than the source. Section
headings, an SCQ template, tables, a separate key-line block, or a Mermaid
diagram are excessive. Omitting the detailed scheduling constraints is
acceptable when the answer and both benefits remain clear.

Судья gpt-5.6-sol, effort high · навык с коммита f4813ce · прогон v1.7.0-final