qwen3.6-fp8 на кейсе «Предложение генеральному директору»: с Minto лучше по обеим мерам
Структура 1 → 3 из 8 +2 Качество 8 → 10 из 10 +2
Судья об ответе с Minto
It opens with approval and presents a strong sequence, but the sequence remains mechanical and adds unsupported accuracy benefits.
| Структура | Без Minto 1 | С Minto 3 | Изменение |
|---|---|---|---|
| Вершина | 0 | 2 | +2 |
| Состав ключевой линии | 0 | 0 | |
| Уровни | 0 | 0 | |
| Порядок и род | 1 | 1 |
| Качество | Без Minto 8 | С Minto 10 | Изменение |
|---|---|---|---|
| Вершина | 0 | 2 | +2 |
| Однородные группы | 2 | 2 | |
| Объяснимый порядок | 2 | 2 | |
| MECE | 2 | 2 | |
| Видимая соразмерная структура | 2 | 2 |
Ответы моделей и слова судьи приведены в оригинале, по-английски.
Без Minto
контрольный промпт · слепая меткаout-05Жёстких провалов нет
The memo has visible grouping and complete mechanics but never supplies a management conclusion.
To: Robert Salton
From: John Jackson
Subject: Big Chief electronic settlement proposal
Big Chief's request for monthly electronic settlement requires adherence to three key operational requirements: data identification standards, file and cheque reconciliation, and system-based billing generation.
Data Identification Standards
- The external account file must contain the parent number, outlet number, ticket number, ticket amount, and delivery date.
- If Big Chief cannot provide the parent and outlet numbers, the company will supply these identifiers from the customer master file for inclusion in future submissions.
File and Cheque Reconciliation
- Big Chief will build an extraction program to generate a file using the format accepted by the national-accounts cash-receipt system.
- Big Chief will send the file to Data Processing and deliver the cheque with a detailed listing to the lockbox.
- Finance will balance the file under the prescribed procedure, ensuring the cheque total and file detail net to zero.
System-Based Billing Generation
- Once balanced, the monthly file will run through the national-accounts system.
- The system will match ticket numbers against statement history and produce the relevant billing records.
С Minto
промпт с навыком · слепая меткаout-15invented_facts- качество со штрафом рубрики 8/10
It opens with approval and presents a strong sequence, but the sequence remains mechanical and adds unsupported accuracy benefits.
We can approve Big Chief’s monthly electronic settlement request provided they supply the required data, generate and deliver the file and payment, and allow our system to reconcile and bill.
Big Chief, a major multi-outlet customer, has requested to replace individual ticket settlements with a monthly electronic file and a single prepaid payment. Because our national-accounts cash-receipt system requires specific data identifiers and a zero-net balance between the electronic file and the physical cheque to process payments accurately, we must define the implementation steps before proceeding. To ensure accurate reconciliation and billing, the process must follow this sequence:
- Data Preparation
- The external account file must contain the parent number, outlet number, ticket number, ticket amount, and delivery date.
- If Big Chief cannot provide the parent and outlet identifiers, we will supply them from the customer master file for inclusion in later submissions.
- File Generation and Payment Delivery
- Big Chief will build an extraction program for its accounts-payable file, formatted to match our national-accounts cash-receipt system.
- Big Chief will send the resulting file to Data Processing and deliver the cheque, along with a detailed listing, to the lockbox.
- We will balance the file under the prescribed procedure, ensuring the cheque total and file detail net to zero.
- System Reconciliation and Billing
- Once balanced, the monthly file will run through the national-accounts system.
- The system will match ticket numbers against statement history and produce the relevant billing records.
Как устроен тест
qwen3.6-fp8 получила одну и ту же задачу дважды. Контрольный промпт — одна вводная строка и задача. Промпт с Minto — та же задача, перед которой стоит полный текст навыка. Судья читал оба ответа среди 16 ответов под слепыми метками и не знал, в каком из них был навык.
Промпт без Minto 2 147 Б
You are working on a business document using the Minto Pyramid Principle.
<!-- Faithful paraphrase of Barbara Minto, The Minto Pyramid Principle
(2010), Chapter 3, Exhibit 5 and the surrounding top-down analysis.
The wording is original to this evaluation fixture. -->
# Fixture 01: Big Chief proposal
**Mode:** `write`
**Language:** `en`
## Context
The company supplies beverages. Drivers send delivery tickets to Finance; each
ticket identifies the customer, outlet, delivery, amount, and date. The tickets
feed the national-accounts settlement process.
Big Chief, a major multi-outlet customer, wants to replace individual ticket
settlement with a monthly computer file and one payment. Finance reviewed how
the proposed process would work and sent management the memo below.
## Before
```text
To: Robert Salton
From: John Jackson
Subject: Big Chief request
We reviewed Big Chief account 8306's request to submit delivery-ticket data
electronically and settle it through one prepaid monthly payment. Our findings
follow.
1. Any external account file must contain the parent number, outlet number,
ticket number, ticket amount, and delivery date. If Big Chief cannot provide
the first two identifiers, we can supply them from the customer master file
for inclusion in later submissions.
2. Big Chief will build an extraction program for its accounts-payable file.
The resulting file will use the format accepted by our national-accounts
cash-receipt system. Big Chief will send the file to Data Processing and
send its cheque, with a detailed listing, to the lockbox. We will balance
the file under the prescribed procedure. The cheque total and file detail
must net to zero.
3. Once balanced, the monthly file will run through the national-accounts
system, match ticket numbers against statement history, and produce the
relevant billing records.
```
## Task
Rewrite this as a short management memo using the Minto Pyramid Principle.
Do not invent benefits, savings, or operational facts that are absent from the
source.
Return only the result, with no explanation of how you produced it.
Промпт с Minto пять частей по порядку · 29 720 Б
Below is a skill written as an instruction. Read it in full and apply it to the task at the end.===== SKILL.md =====SKILL.md на f4813ce 17 235 Б===== references/rules.md =====references/rules.md на f4813ce 6 464 Б===== references/templates.md =====references/templates.md на f4813ce 3 742 Б===== TASK =====вход кейса целикомReturn only the result, with no explanation of how you produced it.
Вход кейса before.md
<!-- Faithful paraphrase of Barbara Minto, The Minto Pyramid Principle
(2010), Chapter 3, Exhibit 5 and the surrounding top-down analysis.
The wording is original to this evaluation fixture. -->
Fixture 01: Big Chief proposal
Mode: write
Language: en
Context
The company supplies beverages. Drivers send delivery tickets to Finance; each
ticket identifies the customer, outlet, delivery, amount, and date. The tickets
feed the national-accounts settlement process.
Big Chief, a major multi-outlet customer, wants to replace individual ticket
settlement with a monthly computer file and one payment. Finance reviewed how
the proposed process would work and sent management the memo below.
Before
To: Robert Salton
From: John Jackson
Subject: Big Chief request
We reviewed Big Chief account 8306's request to submit delivery-ticket data
electronically and settle it through one prepaid monthly payment. Our findings
follow.
1. Any external account file must contain the parent number, outlet number,
ticket number, ticket amount, and delivery date. If Big Chief cannot provide
the first two identifiers, we can supply them from the customer master file
for inclusion in later submissions.
2. Big Chief will build an extraction program for its accounts-payable file.
The resulting file will use the format accepted by our national-accounts
cash-receipt system. Big Chief will send the file to Data Processing and
send its cheque, with a detailed listing, to the lockbox. We will balance
the file under the prescribed procedure. The cheque total and file detail
must net to zero.
3. Once balanced, the monthly file will run through the national-accounts
system, match ticket numbers against statement history, and produce the
relevant billing records.
Task
Rewrite this as a short management memo using the Minto Pyramid Principle.
Do not invent benefits, savings, or operational facts that are absent from the
source.
Эталон судьи gold.md
Gold 01: Big Chief proposal
Source structure: Minto (2010), Chapter 3, Exhibits 4-6.
Expected structure
| Element | Expected value |
|---|---|
| Reader question | Is Big Chief's proposal a good idea? |
| Top | Yes, the proposed process is workable and worth accepting, within the evidence available |
| Key-line kind | Reasons or reader benefits, not system mechanics |
| Order | Inductive reasons supporting one conclusion |
The book illustrates three possible benefits: obtaining the required
information, increasing cash flow, and reducing clerical work. Only the first
is directly supported by this fixture. Literal reproduction of all three is
therefore not required and unsupported benefits count as inventions.
Strong outputs:
- answer the management question before explaining the file mechanics;
- use two to four same-kind reasons grounded in the supplied facts;
- place field lists, file format, routing, balancing, and matching below those
reasons as evidence or implementation detail; - retain the literal reader question in the delivered memo.
Main defect in the source
The source explains how the proposed system would operate but never answers
whether management should accept it. A technically tidy list is still the wrong
key line if the reader is deciding whether to act.
Scoring notes
2for key-line composition: every first-level point is a grounded benefit,
loss avoided, or reason for acceptance.1: benefits and mechanics are mixed.0: the first level is entirely fields, file handling, or balancing steps.
Do not reward unsupported claims about savings, speed, or cash flow.
Судья gpt-5.6-sol, effort high · навык с коммита f4813ce · прогон v1.7.0-final