qwen3.8-27b на кейсе «Роль совета директоров»: с Minto хуже по обеим мерам

Структура 1 → 0 из 8 −1 Качество 7 → 6 из 10 −1

Судья об ответе с Minto

Its explicit reader question and full context are strengths, but the answer is only a list of design topics.

Режим write · кейс 05-role-of-board · прогон v1.7.0-final

Структура из 8, по 2 балла на ось
СтруктураБез Minto 1С Minto 0Изменение
Вершина10−1
Состав ключевой линии00
Уровни00
Порядок и род00
Качество из 10, по 2 балла на ось
КачествоБез Minto 7С Minto 6Изменение
Вершина10−1
Однородные группы22
Объяснимый порядок11
MECE11
Видимая соразмерная структура22

Ответы моделей и слова судьи приведены в оригинале, по-английски.

Без Minto

контрольный промпт · слепая метка out-16
  • unacknowledged_source_loss
  • качество со штрафом рубрики 6/10

It groups the source material cleanly beneath three headings, but those headings remain topics, transition stays a branch, and the historical complication is weakened.

Following the October reorganization, which gave divisional managers full authority over day-to-day operations, the Board should concentrate on policy and planning rather than short-term operational problems. To define that role, this memorandum sets out three areas for discussion:

  1. Mandate and division of work
    • The Board’s core responsibilities for policy and planning.
    • The Executive Committee’s responsibilities and the relationship between the two bodies.
  2. Composition and membership
    • The Board’s optimum size and membership.
    • Principles for selecting directors and setting their tenure.
    • How outside directors can participate effectively.
  3. Transition
    • Options for moving from the present Board and Executive Committee arrangements to the desired model.

С Minto

промпт с навыком · слепая метка out-09

Жёстких провалов нет

Its explicit reader question and full context are strengths, but the answer is only a list of design topics.

In October, a reorganization gave divisional managers full authority for day-to-day operations, leaving policy and planning with the Board. The Board has nevertheless spent years dealing with short-term operational problems. The question is how the Board should be constituted and operated so that it can discharge its remaining policy and planning role. The discussion should therefore address four design decisions:

  1. The Board’s composition and optimum size.
  2. The division of work between the Board and the Executive Committee, including the responsibilities of each and their relationship.
  3. The conditions for making an outside director an effective participant.
  4. The principles for selecting directors, setting their tenure, and choosing a route from the present Board and Executive Committee arrangement to the desired one.

Как устроен тест

qwen3.8-27b получила одну и ту же задачу дважды. Контрольный промпт — одна вводная строка и задача. Промпт с Minto — та же задача, перед которой стоит полный текст навыка. Судья читал оба ответа среди 16 ответов под слепыми метками и не знал, в каком из них был навык.

Промпт без Minto 1 403 Б
You are working on a business document using the Minto Pyramid Principle.

<!-- Faithful paraphrase of Minto (2010), Chapter 2, the board-role
     introduction. Original wording for this fixture. -->

# Fixture 05: role of the board

**Mode:** `write`
**Language:** `en`

## Context

In October, a reorganization gave divisional managers full authority for
day-to-day operations. Policy and planning remain the Board's responsibility.
The Board has nevertheless spent years dealing with short-term operational
problems.

Open questions include Board size and membership, the division of work between
the Board and Executive Committee, effective participation by outside members,
and selection and tenure.

## Before

```text
The purpose of this memorandum is to collect ideas for discussion about:

1. Board composition and optimum size.
2. The broad roles of the Board and Executive Committee, the responsibilities
   of each, and their relationship.
3. How to make an outside director an effective participant.
4. Principles for selecting directors and setting their tenure.
5. Alternative ways to move from the present Board and Executive Committee
   arrangement to the desired one.
```

## Task

Rewrite the opening using the Minto Pyramid Principle. Return the introduction
and the points it sets out, not the full memorandum.

Return only the result, with no explanation of how you produced it.
Промпт с Minto пять частей по порядку · 28 976 Б
  1. Below is a skill written as an instruction. Read it in full and apply it to the task at the end.
  2. ===== SKILL.md ===== SKILL.md на f4813ce 17 235 Б
  3. ===== references/rules.md ===== references/rules.md на f4813ce 6 464 Б
  4. ===== references/templates.md ===== references/templates.md на f4813ce 3 742 Б
  5. ===== TASK ===== вход кейса целиком
  6. Return only the result, with no explanation of how you produced it.
Вход кейса before.md

<!-- Faithful paraphrase of Minto (2010), Chapter 2, the board-role
introduction. Original wording for this fixture. -->

Fixture 05: role of the board

Mode: write
Language: en

Context

In October, a reorganization gave divisional managers full authority for
day-to-day operations. Policy and planning remain the Board's responsibility.
The Board has nevertheless spent years dealing with short-term operational
problems.

Open questions include Board size and membership, the division of work between
the Board and Executive Committee, effective participation by outside members,
and selection and tenure.

Before
The purpose of this memorandum is to collect ideas for discussion about:
                
                1. Board composition and optimum size.
                2. The broad roles of the Board and Executive Committee, the responsibilities
                   of each, and their relationship.
                3. How to make an outside director an effective participant.
                4. Principles for selecting directors and setting their tenure.
                5. Alternative ways to move from the present Board and Executive Committee
                   arrangement to the desired one.
Task

Rewrite the opening using the Minto Pyramid Principle. Return the introduction
and the points it sets out, not the full memorandum.

Эталон судьи gold.md

Gold 05: role of the board

Source structure: Minto (2010), Chapter 2.

Expected structure
ElementExpected value
Reader questionWhat must the Board change to focus on long-range strategy?
TopThe Board should make the changes that let it concentrate on strategy
Key-line kindActions

Key line:

  1. Hand day-to-day operating responsibility to the Executive Committee.
  2. Broaden the Board to include outside directors.
  3. Formalize internal operation through policies and procedures.

The October reorganization is the Situation. The Board's long habit of handling
short-term issues is the Complication.

None of the five source topics should survive unchanged as a first-level point.
Composition, roles, outside participation, and tenure become evidence beneath
the three actions. "Alternative ways to get there" describes the entire
document and is not a branch. The purpose statement disappears because it is
neither Situation nor answer.

Судья gpt-5.6-sol, effort high · навык с коммита f4813ce · прогон v1.7.0-final