qwen3.8-27b на кейсе «Роль совета директоров»: с Minto хуже по обеим мерам
Структура 1 → 0 из 8 −1 Качество 7 → 6 из 10 −1
Судья об ответе с Minto
Its explicit reader question and full context are strengths, but the answer is only a list of design topics.
| Структура | Без Minto 1 | С Minto 0 | Изменение |
|---|---|---|---|
| Вершина | 1 | 0 | −1 |
| Состав ключевой линии | 0 | 0 | |
| Уровни | 0 | 0 | |
| Порядок и род | 0 | 0 |
| Качество | Без Minto 7 | С Minto 6 | Изменение |
|---|---|---|---|
| Вершина | 1 | 0 | −1 |
| Однородные группы | 2 | 2 | |
| Объяснимый порядок | 1 | 1 | |
| MECE | 1 | 1 | |
| Видимая соразмерная структура | 2 | 2 |
Ответы моделей и слова судьи приведены в оригинале, по-английски.
Без Minto
контрольный промпт · слепая меткаout-16unacknowledged_source_loss- качество со штрафом рубрики 6/10
It groups the source material cleanly beneath three headings, but those headings remain topics, transition stays a branch, and the historical complication is weakened.
Following the October reorganization, which gave divisional managers full authority over day-to-day operations, the Board should concentrate on policy and planning rather than short-term operational problems. To define that role, this memorandum sets out three areas for discussion:
- Mandate and division of work
- The Board’s core responsibilities for policy and planning.
- The Executive Committee’s responsibilities and the relationship between the two bodies.
- Composition and membership
- The Board’s optimum size and membership.
- Principles for selecting directors and setting their tenure.
- How outside directors can participate effectively.
- Transition
- Options for moving from the present Board and Executive Committee arrangements to the desired model.
С Minto
промпт с навыком · слепая меткаout-09Жёстких провалов нет
Its explicit reader question and full context are strengths, but the answer is only a list of design topics.
In October, a reorganization gave divisional managers full authority for day-to-day operations, leaving policy and planning with the Board. The Board has nevertheless spent years dealing with short-term operational problems. The question is how the Board should be constituted and operated so that it can discharge its remaining policy and planning role. The discussion should therefore address four design decisions:
- The Board’s composition and optimum size.
- The division of work between the Board and the Executive Committee, including the responsibilities of each and their relationship.
- The conditions for making an outside director an effective participant.
- The principles for selecting directors, setting their tenure, and choosing a route from the present Board and Executive Committee arrangement to the desired one.
Как устроен тест
qwen3.8-27b получила одну и ту же задачу дважды. Контрольный промпт — одна вводная строка и задача. Промпт с Minto — та же задача, перед которой стоит полный текст навыка. Судья читал оба ответа среди 16 ответов под слепыми метками и не знал, в каком из них был навык.
Промпт без Minto 1 403 Б
You are working on a business document using the Minto Pyramid Principle.
<!-- Faithful paraphrase of Minto (2010), Chapter 2, the board-role
introduction. Original wording for this fixture. -->
# Fixture 05: role of the board
**Mode:** `write`
**Language:** `en`
## Context
In October, a reorganization gave divisional managers full authority for
day-to-day operations. Policy and planning remain the Board's responsibility.
The Board has nevertheless spent years dealing with short-term operational
problems.
Open questions include Board size and membership, the division of work between
the Board and Executive Committee, effective participation by outside members,
and selection and tenure.
## Before
```text
The purpose of this memorandum is to collect ideas for discussion about:
1. Board composition and optimum size.
2. The broad roles of the Board and Executive Committee, the responsibilities
of each, and their relationship.
3. How to make an outside director an effective participant.
4. Principles for selecting directors and setting their tenure.
5. Alternative ways to move from the present Board and Executive Committee
arrangement to the desired one.
```
## Task
Rewrite the opening using the Minto Pyramid Principle. Return the introduction
and the points it sets out, not the full memorandum.
Return only the result, with no explanation of how you produced it.
Промпт с Minto пять частей по порядку · 28 976 Б
Below is a skill written as an instruction. Read it in full and apply it to the task at the end.===== SKILL.md =====SKILL.md на f4813ce 17 235 Б===== references/rules.md =====references/rules.md на f4813ce 6 464 Б===== references/templates.md =====references/templates.md на f4813ce 3 742 Б===== TASK =====вход кейса целикомReturn only the result, with no explanation of how you produced it.
Вход кейса before.md
<!-- Faithful paraphrase of Minto (2010), Chapter 2, the board-role
introduction. Original wording for this fixture. -->
Fixture 05: role of the board
Mode: write
Language: en
Context
In October, a reorganization gave divisional managers full authority for
day-to-day operations. Policy and planning remain the Board's responsibility.
The Board has nevertheless spent years dealing with short-term operational
problems.
Open questions include Board size and membership, the division of work between
the Board and Executive Committee, effective participation by outside members,
and selection and tenure.
Before
The purpose of this memorandum is to collect ideas for discussion about:
1. Board composition and optimum size.
2. The broad roles of the Board and Executive Committee, the responsibilities
of each, and their relationship.
3. How to make an outside director an effective participant.
4. Principles for selecting directors and setting their tenure.
5. Alternative ways to move from the present Board and Executive Committee
arrangement to the desired one.
Task
Rewrite the opening using the Minto Pyramid Principle. Return the introduction
and the points it sets out, not the full memorandum.
Эталон судьи gold.md
Gold 05: role of the board
Source structure: Minto (2010), Chapter 2.
Expected structure
| Element | Expected value |
|---|---|
| Reader question | What must the Board change to focus on long-range strategy? |
| Top | The Board should make the changes that let it concentrate on strategy |
| Key-line kind | Actions |
Key line:
- Hand day-to-day operating responsibility to the Executive Committee.
- Broaden the Board to include outside directors.
- Formalize internal operation through policies and procedures.
The October reorganization is the Situation. The Board's long habit of handling
short-term issues is the Complication.
None of the five source topics should survive unchanged as a first-level point.
Composition, roles, outside participation, and tenure become evidence beneath
the three actions. "Alternative ways to get there" describes the entire
document and is not a branch. The purpose statement disappears because it is
neither Situation nor answer.
Судья gpt-5.6-sol, effort high · навык с коммита f4813ce · прогон v1.7.0-final