Claude Sonnet 5 на кейсе «Роль совета директоров»: с Minto хуже по обеим мерам
Структура 1 → 0 из 8 −1 Качество 7 → 6 из 10 −1
Судья об ответе с Minto
It offers a sound SCQ frame, yet stops at four questions and retains a purpose-style closing sentence.
| Структура | Без Minto 1 | С Minto 0 | Изменение |
|---|---|---|---|
| Вершина | 1 | 0 | −1 |
| Состав ключевой линии | 0 | 0 | |
| Уровни | 0 | 0 | |
| Порядок и род | 0 | 0 |
| Качество | Без Minto 7 | С Minto 6 | Изменение |
|---|---|---|---|
| Вершина | 1 | 0 | −1 |
| Однородные группы | 2 | 2 | |
| Объяснимый порядок | 1 | 1 | |
| MECE | 1 | 1 | |
| Видимая соразмерная структура | 2 | 2 |
Ответы моделей и слова судьи приведены в оригинале, по-английски.
Без Minto
контрольный промпт · слепая меткаout-10unacknowledged_source_lossmore_than_four_first_level- качество со штрафом рубрики 4/10
It states the desired shift promptly, then reproduces the five-question agenda without the reorganization context.
The Board should shift its focus from operational matters to policy and planning, but doing so raises five questions that need to be resolved first:
- What size and composition will let the Board carry out its planning and policy role effectively?
- How should responsibilities be divided between the Board and the Executive Committee, and how should the two bodies relate to one another?
- How can outside directors be made effective participants?
- What principles should govern the selection and tenure of directors?
- How should the Board move from its present arrangement with the Executive Committee to the arrangement it wants?
С Minto
промпт с навыком · слепая меткаout-14invented_facts- качество со штрафом рубрики 5/10
It offers a sound SCQ frame, yet stops at four questions and retains a purpose-style closing sentence.
Since October's reorganization gave divisional managers full authority for day-to-day operations, the Board is now expected to concentrate on policy and planning. Yet the Board has continued to spend much of its time on short-term operational matters. To redefine its role, the Board needs to resolve four questions:
- What size and composition will let the Board do this work effectively?
- How should responsibilities be divided between the Board and the Executive Committee?
- How can outside directors be made effective participants?
- What principles should govern the selection and tenure of directors?
This memorandum sets out ideas on each, together with alternative ways to move from the present arrangement to the one the Board decides on.
Как устроен тест
Claude Sonnet 5 получила одну и ту же задачу дважды. Контрольный промпт — одна вводная строка и задача. Промпт с Minto — та же задача, перед которой стоит полный текст навыка. Судья читал оба ответа среди 16 ответов под слепыми метками и не знал, в каком из них был навык.
Промпт без Minto 1 403 Б
You are working on a business document using the Minto Pyramid Principle.
<!-- Faithful paraphrase of Minto (2010), Chapter 2, the board-role
introduction. Original wording for this fixture. -->
# Fixture 05: role of the board
**Mode:** `write`
**Language:** `en`
## Context
In October, a reorganization gave divisional managers full authority for
day-to-day operations. Policy and planning remain the Board's responsibility.
The Board has nevertheless spent years dealing with short-term operational
problems.
Open questions include Board size and membership, the division of work between
the Board and Executive Committee, effective participation by outside members,
and selection and tenure.
## Before
```text
The purpose of this memorandum is to collect ideas for discussion about:
1. Board composition and optimum size.
2. The broad roles of the Board and Executive Committee, the responsibilities
of each, and their relationship.
3. How to make an outside director an effective participant.
4. Principles for selecting directors and setting their tenure.
5. Alternative ways to move from the present Board and Executive Committee
arrangement to the desired one.
```
## Task
Rewrite the opening using the Minto Pyramid Principle. Return the introduction
and the points it sets out, not the full memorandum.
Return only the result, with no explanation of how you produced it.
Промпт с Minto пять частей по порядку · 28 976 Б
Below is a skill written as an instruction. Read it in full and apply it to the task at the end.===== SKILL.md =====SKILL.md на f4813ce 17 235 Б===== references/rules.md =====references/rules.md на f4813ce 6 464 Б===== references/templates.md =====references/templates.md на f4813ce 3 742 Б===== TASK =====вход кейса целикомReturn only the result, with no explanation of how you produced it.
Вход кейса before.md
<!-- Faithful paraphrase of Minto (2010), Chapter 2, the board-role
introduction. Original wording for this fixture. -->
Fixture 05: role of the board
Mode: write
Language: en
Context
In October, a reorganization gave divisional managers full authority for
day-to-day operations. Policy and planning remain the Board's responsibility.
The Board has nevertheless spent years dealing with short-term operational
problems.
Open questions include Board size and membership, the division of work between
the Board and Executive Committee, effective participation by outside members,
and selection and tenure.
Before
The purpose of this memorandum is to collect ideas for discussion about:
1. Board composition and optimum size.
2. The broad roles of the Board and Executive Committee, the responsibilities
of each, and their relationship.
3. How to make an outside director an effective participant.
4. Principles for selecting directors and setting their tenure.
5. Alternative ways to move from the present Board and Executive Committee
arrangement to the desired one.
Task
Rewrite the opening using the Minto Pyramid Principle. Return the introduction
and the points it sets out, not the full memorandum.
Эталон судьи gold.md
Gold 05: role of the board
Source structure: Minto (2010), Chapter 2.
Expected structure
| Element | Expected value |
|---|---|
| Reader question | What must the Board change to focus on long-range strategy? |
| Top | The Board should make the changes that let it concentrate on strategy |
| Key-line kind | Actions |
Key line:
- Hand day-to-day operating responsibility to the Executive Committee.
- Broaden the Board to include outside directors.
- Formalize internal operation through policies and procedures.
The October reorganization is the Situation. The Board's long habit of handling
short-term issues is the Complication.
None of the five source topics should survive unchanged as a first-level point.
Composition, roles, outside participation, and tenure become evidence beneath
the three actions. "Alternative ways to get there" describes the entire
document and is not a branch. The purpose statement disappears because it is
neither Situation nor answer.
Судья gpt-5.6-sol, effort high · Claude Sonnet 5, effort low · навык с коммита f4813ce · прогон v1.7.0-final