qwen3.8-27b на кейсе «Записка перед встречей»: с Minto хуже по качеству, структура та же

Структура 4 → 4 из 8 0 Качество 7 → 6 из 10 −1

Судья об ответе с Minto

It is factually faithful but turns a two-sentence note into a four-item evidence list.

Режим write · кейс 04-meeting-note · прогон v1.7.0-final

Структура из 8, по 2 балла на ось
СтруктураБез Minto 4С Minto 4Изменение
Вершина22
Состав ключевой линии11
Уровни00
Порядок и род11
Качество из 10, по 2 балла на ось
КачествоБез Minto 7С Minto 6Изменение
Вершина22
Однородные группы11
Объяснимый порядок11
MECE11
Видимая соразмерная структура21−1

Ответы моделей и слова судьи приведены в оригинале, по-английски.

Без Minto

контрольный промпт · слепая метка out-02

Жёстких провалов нет

This is the most faithful compact constraint summary, though it still promotes evidence rather than synthesizing the benefits.

Please approve rescheduling the meeting to Thursday at 11:00. Collins cannot attend at 3:00, Johnson is unavailable before 10:30, Clifford returns late tomorrow, and the conference room is occupied tomorrow but available Thursday.

С Minto

промпт с навыком · слепая метка out-06

Жёстких провалов нет

It is factually faithful but turns a two-sentence note into a four-item evidence list.

Please approve moving the 3:00 meeting to Thursday at 11:00.

Thursday at 11:00 appears possible:

  • Collins cannot attend at 3:00.
  • Johnson can meet later today or tomorrow, but not before 10:30.
  • Clifford will not return from Frankfurt until late tomorrow.
  • The conference room is occupied tomorrow but available on Thursday.

Как устроен тест

qwen3.8-27b получила одну и ту же задачу дважды. Контрольный промпт — одна вводная строка и задача. Промпт с Minto — та же задача, перед которой стоит полный текст навыка. Судья читал оба ответа среди 16 ответов под слепыми метками и не знал, в каком из них был навык.

Промпт без Minto 868 Б
You are working on a business document using the Minto Pyramid Principle.

<!-- Faithful paraphrase of the short meeting example in the preface of
     Minto (2010). Original wording for this fixture. -->

# Fixture 04: meeting note

**Mode:** `write`
**Language:** `en`

## Context

A meeting is booked for 3:00 today. You checked the attendees and the conference
room, and now need one colleague to approve a change.

## Before

```text
Collins cannot attend at 3:00. Johnson can meet later today or tomorrow, but
not before 10:30. Clifford will not return from Frankfurt until late tomorrow.
The conference room is occupied tomorrow but available on Thursday. Thursday
at 11:00 appears possible. Is that acceptable?
```

## Task

Rewrite this as one short note using the Minto Pyramid Principle.

Return only the result, with no explanation of how you produced it.
Промпт с Minto пять частей по порядку · 28 441 Б
  1. Below is a skill written as an instruction. Read it in full and apply it to the task at the end.
  2. ===== SKILL.md ===== SKILL.md на f4813ce 17 235 Б
  3. ===== references/rules.md ===== references/rules.md на f4813ce 6 464 Б
  4. ===== references/templates.md ===== references/templates.md на f4813ce 3 742 Б
  5. ===== TASK ===== вход кейса целиком
  6. Return only the result, with no explanation of how you produced it.
Вход кейса before.md

<!-- Faithful paraphrase of the short meeting example in the preface of
Minto (2010). Original wording for this fixture. -->

Fixture 04: meeting note

Mode: write
Language: en

Context

A meeting is booked for 3:00 today. You checked the attendees and the conference
room, and now need one colleague to approve a change.

Before
Collins cannot attend at 3:00. Johnson can meet later today or tomorrow, but
                not before 10:30. Clifford will not return from Frankfurt until late tomorrow.
                The conference room is occupied tomorrow but available on Thursday. Thursday
                at 11:00 appears possible. Is that acceptable?
Task

Rewrite this as one short note using the Minto Pyramid Principle.

Эталон судьи gold.md

Gold 04: meeting note

Source structure: Minto (2010), Preface.

Expected structure

Top: Request approval to move today's meeting to Thursday at 11:00.

Key line has exactly two reader benefits:

  1. The time is more convenient for Collins and Johnson.
  2. Clifford can attend.

The room's availability is a constraint, not a third reader benefit. Do not add
a third branch just to satisfy a numerical norm.

Proportionality

The result should remain a two-sentence note, no longer than the source. Section
headings, an SCQ template, tables, a separate key-line block, or a Mermaid
diagram are excessive. Omitting the detailed scheduling constraints is
acceptable when the answer and both benefits remain clear.

Судья gpt-5.6-sol, effort high · навык с коммита f4813ce · прогон v1.7.0-final