qwen3.6-35b-a3b на кейсе «Записка о наборных издержках»: с Minto лучше по структуре и хуже по качеству
Структура 5 → 6 из 8 +1 Качество 8 → 7 из 10 −1
Судья об ответе с Minto
Staffing evidence is buried under the methods study, while identical checks are asserted to waste capacity without source support.
| Структура | Без Minto 5 | С Minto 6 | Изменение |
|---|---|---|---|
| Вершина | 2 | 2 | |
| Состав ключевой линии | 1 | 1 | |
| Уровни | 0 | 1 | +1 |
| Порядок и род | 2 | 2 |
| Качество | Без Minto 8 | С Minto 7 | Изменение |
|---|---|---|---|
| Вершина | 2 | 2 | |
| Однородные группы | 2 | 2 | |
| Объяснимый порядок | 2 | 1 | −1 |
| MECE | 0 | 0 | |
| Видимая соразмерная структура | 2 | 2 |
Ответы моделей и слова судьи приведены в оригинале, по-английски.
Без Minto
контрольный промпт · слепая меткаout-09invented_facts
A third validation branch duplicates the pilot and promotes weak peer comparison, alongside an invented outdated-workflow diagnosis.
To: Engagement Manager
From: Junior Consultant
Subject: Recommendations to Reduce TTW Composing Costs
Recommendation
TTW should immediately implement a two-part initiative to reduce composing costs: streamline quality-control procedures for standard titles and conduct a focused methods study to eliminate productivity inefficiencies.
Key Actions & Rationale
- Simplify QC for low-complexity titles. Every title currently passes through identical quality-control stages regardless of complexity. Testing reduced or delayed checks on selected standard jobs will isolate the impact on quality and customer satisfaction while capturing potential savings of up to 10% of total composing costs.
- Close the productivity gap through a methods study. TTW’s manual composition output trails industry benchmarks by 20–50%. This gap is driven by outdated workflows compounded by critical capacity constraints, below-market compensation, recent staff attrition, and overtime running 50% over budget. A dedicated methods review will identify actionable workflow improvements.
- Validate changes through controlled pilots and peer benchmarking. George Kennedy will oversee initial stage-removal tests. Results should be cross-referenced with data from three comparable printers to establish context, though external comparisons alone cannot resolve internal efficiency issues.
Management Alignment
While departmental managers remain divided on whether current costs are excessive, all have committed to investigating these recommendations.
Omissions & Demotions
- Removed: Detailed narrative regarding the two-week engagement timeline, specific interviewee names (Roy Walter, Brian Thompson), and speculative remarks about union claims. These do not directly support the cost-reduction recommendation.
- Demoted: General statements that composition is the “largest production cost,” along with exact percentage breakdowns (40% of hardback, 50–55% of paperback), were moved to background context. They establish scale but do not drive the recommended actions.
- Condensed: Hiring difficulties and overtime overruns were retained only insofar as they explain the 20–50% productivity gap and capacity constraints, removing redundant operational complaints.
С Minto
промпт с навыком · слепая меткаout-05invented_facts
Staffing evidence is buried under the methods study, while identical checks are asserted to waste capacity without source support.
Subject: Recommendation to reduce composing costs and restore competitiveness
Composition accounts for 40–55% of production costs, and TTW is currently uncompetitive on simple titles. Productivity trails industry benchmarks by 20–50%, manual capacity is critically constrained with overtime exceeding budget by 50%, and the union is pressing new claims, yet management lacks clarity on whether costs are excessive or how to resolve them.
TTW should simplify the workflow for inexpensive titles and upgrade the composing method to reduce costs and restore competitiveness.
- Simplify the quality-control process for inexpensive titles.
- Applying identical quality checks to all titles wastes capacity; streamlining checks for simple work can yield savings of up to 10% of total composing costs.
- George Kennedy is prepared to test selected jobs and measure the effect of reduced checks on quality and customer response.
- Conduct a methods study to upgrade the composing method and close the productivity gap.
- TTW's productivity lags benchmarks by 20–50%, necessitating a structural change to the composing method rather than incremental adjustments.
- Current operations are overwhelmed: overtime is 50% over budget, jobs are running late, and recruitment is failing due to below-market pay and recent staff losses, indicating a systemic capacity deficit.
Next step: Authorise George Kennedy to proceed with the job tests and commission the methods study.
Dropped facts: comparative analysis with three peer printers (low diagnostic value), names of interviewees Roy Walter and Brian Thompson (not decision-critical), internal disagreement among managers regarding cost severity, and general assertions superseded by precise data.
Как устроен тест
qwen3.6-35b-a3b получила одну и ту же задачу дважды. Контрольный промпт — одна вводная строка и задача. Промпт с Minto — та же задача, перед которой стоит полный текст навыка. Судья читал оба ответа среди 14 ответов под слепыми метками и не знал, в каком из них был навык.
Промпт без Minto 2 516 Б
You are working on a business document using the Minto Pyramid Principle.
<!-- Faithful paraphrase of Minto (2010), Chapter 3, the TTW composing-room
memorandum before restructuring. Original wording for this fixture. -->
# Fixture 02: TTW composing costs
**Mode:** `write`
**Language:** `en`
## Context
TTW is a printing company in Aylesbury. A junior consultant spent two weeks
examining composing-room costs. The engagement manager already knows that
composition accounts for roughly 40% of hardback cost and 50-55% of paperback
cost, that TTW is uncompetitive on simple work, and that TTW does not know
whether its composing costs are actually excessive.
## Before
```text
To:
From:
Subject: TTW
This note records the information gathered during the past two weeks.
Composition is the largest production cost. Industry comparisons suggest weak
productivity and high cost at TTW. Every title, whether a complex reference
book or a simple novel, passes through essentially the same quality-control
stages.
People in Aylesbury want to understand the causes. I spoke with Roy Walter,
Brian Thompson, and George Kennedy. Kennedy is willing to test whether some
stages can be removed and why measured productivity trails the benchmark.
The department is overloaded. Manual composition is especially short of
capacity. TTW pays below local market rates, struggles to hire and retain
compositors, has just lost two employees, and now runs most jobs late.
Overtime is more than 50% over budget, while the union is pressing a new claim.
Conclusions
1. Costs may be reduced by:
a. simplifying the process for inexpensive titles;
b. increasing productivity by changing the composing method.
2. To simplify the process, TTW should test selected jobs and measure the
effect of fewer or differently timed checks on quality and customers. The
saving might reach 10% of total composing cost. A separate methods study
could identify further productivity improvements because TTW trails the
benchmark by 20-50%.
3. Comparisons with three other printers might provide useful context, although
I doubt a simple comparison will settle the issue.
4. Managers disagree about whether costs are high, but all are willing to
investigate.
```
## Task
Rewrite the report using the Minto Pyramid Principle. Keep the useful facts,
remove or demote material that does not support the recommendation, and state
what was omitted.
Return only the result, with no explanation of how you produced it.
Промпт с Minto пять частей по порядку · 30 089 Б
Below is a skill written as an instruction. Read it in full and apply it to the task at the end.===== SKILL.md =====SKILL.md на f4813ce 17 235 Б===== references/rules.md =====references/rules.md на f4813ce 6 464 Б===== references/templates.md =====references/templates.md на f4813ce 3 742 Б===== TASK =====вход кейса целикомReturn only the result, with no explanation of how you produced it.
Вход кейса before.md
<!-- Faithful paraphrase of Minto (2010), Chapter 3, the TTW composing-room
memorandum before restructuring. Original wording for this fixture. -->
Fixture 02: TTW composing costs
Mode: write
Language: en
Context
TTW is a printing company in Aylesbury. A junior consultant spent two weeks
examining composing-room costs. The engagement manager already knows that
composition accounts for roughly 40% of hardback cost and 50-55% of paperback
cost, that TTW is uncompetitive on simple work, and that TTW does not know
whether its composing costs are actually excessive.
Before
To:
From:
Subject: TTW
This note records the information gathered during the past two weeks.
Composition is the largest production cost. Industry comparisons suggest weak
productivity and high cost at TTW. Every title, whether a complex reference
book or a simple novel, passes through essentially the same quality-control
stages.
People in Aylesbury want to understand the causes. I spoke with Roy Walter,
Brian Thompson, and George Kennedy. Kennedy is willing to test whether some
stages can be removed and why measured productivity trails the benchmark.
The department is overloaded. Manual composition is especially short of
capacity. TTW pays below local market rates, struggles to hire and retain
compositors, has just lost two employees, and now runs most jobs late.
Overtime is more than 50% over budget, while the union is pressing a new claim.
Conclusions
1. Costs may be reduced by:
a. simplifying the process for inexpensive titles;
b. increasing productivity by changing the composing method.
2. To simplify the process, TTW should test selected jobs and measure the
effect of fewer or differently timed checks on quality and customers. The
saving might reach 10% of total composing cost. A separate methods study
could identify further productivity improvements because TTW trails the
benchmark by 20-50%.
3. Comparisons with three other printers might provide useful context, although
I doubt a simple comparison will settle the issue.
4. Managers disagree about whether costs are high, but all are willing to
investigate.
Task
Rewrite the report using the Minto Pyramid Principle. Keep the useful facts,
remove or demote material that does not support the recommendation, and state
what was omitted.
Эталон судьи gold.md
Gold 02: TTW composing costs
Source structure: Minto (2010), Chapter 3, TTW analysis and rewritten memo.
Expected structure
| Element | Expected value |
|---|---|
| Reader question | How can TTW reduce composing cost? |
| Top | TTW can reduce composing cost substantially |
| Key-line kind | Actions |
| Order | Two independent changes, each followed by its causal support |
Key line
- Eliminate unnecessary stages from the composing process for simple work.
- Raise wages to competitive levels.
The source's "simplify the process" and "increase productivity by changing the
method" are overlapping descriptions of the same process intervention. They
must not survive as two separate first-level branches. The missing second
branch is embedded in the observations: low wages cause vacancies, delays, and
overtime cost.
Levels
Under eliminating stages: every job follows the same process; TTW trails the
benchmark by 20-50%; run a controlled experiment; potential saving up to 10%.
Under raising wages: below-market pay; hiring and retention difficulty; two
departures; understaffing; late work; overtime more than 50% over budget; union
pressure.
Names, conflicting opinions, and generic competitor comparisons do not answer
the reader's question. They may be omitted with one explicit note.
Судья gpt-5.6-sol, effort high · навык с коммита f4813ce · прогон v1.7.0-final