gpt-oss-120b on “A proposal to the chief executive”: with Minto, better on quality, structure unchanged

Structure 3 → 3 of 8 0 Quality 5 → 8 of 10 +3

The judge on the output with Minto

It states the approval question and answer explicitly, but SCQ labels are disproportionate and the file-format requirement disappears.

Mode write · case 01-big-chief · run v1.7.0-final

Structure of 8, 2 points per axis
Structure	Without Minto 3	With Minto 3
Top	2	2
Key-line composition	0	0
Levels	0	0
Order and kind	1	1

Quality of 10, 2 points per axis
Quality	Without Minto 5	With Minto 8	Change
Top	2	2
Same-kind grouping	1	1
Explainable order	1	2	+1
MECE	0	2	+2
Visible, proportionate structure	1	1

Outputs and the judge’s words are quoted as written, in English.

Without Minto With Minto

Without Minto

control prompt · blind label out-14

invented_facts

It gives the correct recommendation but duplicates the same mechanics as both conditions and implementation steps.

To: Robert Salton
From: John Jackson
Subject: Recommendation on Big Chief electronic settlement request

Recommendation
Approve Big Chief’s proposal to submit a monthly electronic delivery‑ticket file and settle with a single prepaid cheque, provided the conditions below are satisfied.

Key Conditions

File content – Each external file must include the parent number, outlet number, ticket number, ticket amount, and delivery date. If Big Chief cannot supply the parent or outlet numbers, we will add them from the customer master file.
Submission process – Big Chief will develop an extraction program that produces a file in the format accepted by our national‑accounts cash‑receipt system. The file will be sent to Data Processing, and the accompanying cheque (with a detailed listing) will be mailed to the lockbox. Finance will balance the file; the cheque total and file detail must net to zero.
Billing generation – Once balanced, the monthly file will run through the national‑accounts system, where ticket numbers are matched against statement history to create the appropriate billing records.

Implementation steps

Verify that all required identifiers are present or can be supplemented from the master file.
Confirm Big Chief’s file format complies with our cash‑receipt system specifications.
Execute the balancing procedure and ensure the cheque total equals the file detail.
Process the balanced file through the national‑accounts system to generate billing.

Please confirm approval of these conditions so we can proceed with the arrangement.

With Minto

prompt with the skill · blind label out-07

unacknowledged_source_loss
quality after the rubric’s penalty 6/10

It states the approval question and answer explicitly, but SCQ labels are disproportionate and the file-format requirement disappears.

Subject: Approval of Big Chief’s monthly electronic settlement request

Situation: Finance currently settles each Big Chief delivery ticket individually.

Complication: Big Chief wants to replace individual ticket settlement with a single monthly electronic file and one prepaid payment, altering our standard workflow.

Question: Should we accept this new settlement method?

Answer: Yes – we can support the monthly electronic settlement provided the file meets our data requirements and the balancing steps are followed.

Key requirements and process

File content – The external file must contain the parent number, outlet number, ticket number, ticket amount, and delivery date. If Big Chief cannot supply the parent or outlet numbers, Finance will add them from the customer master file.
Responsibilities – Big Chief will build an extraction program to generate the accounts‑payable file, send the file to Data Processing, and forward the prepaid cheque (with a detailed listing) to the lockbox. Finance will balance the file, ensuring the cheque total and file detail net to zero.
Settlement execution – After balancing, the monthly file will run through the national‑accounts system, match ticket numbers against statement history, and produce the appropriate billing records.

Next step: Proceed with implementation under the conditions above.

The judge

Recurring defect	without	with Minto
Mechanics occupy the first level instead of grounded reasonsthe skill has the rule; the model did not follow it · Core loop §4, Groups	present	present
Literal reader question is absentthe skill has the rule; the model did not follow it · Core loop §1 and §3	present	absent
Situation and complication are not both visible before supportthe skill has no such rule · Core loop §3, SCQ intro	present	absent
Unsupported operational assurances or benefits are assertedthe skill has the rule; the model did not follow it · Mode 3, “Invent nothing”	present	absent
Operational source material disappears without acknowledgementthe skill has the rule; the model did not follow it · Mode 3, “Keep every fact”	absent	present

Decisive questions

without Kind: mechanics; grounded elements: 3; top clearly recommends approval; invention: the cheque is said to be mailed; conditions remain the key line and are then redundantly restated as steps; reader question absent.
with Minto Kind: mechanics; grounded elements: 3; top explicitly supports acceptance; no inventions; mechanics form the key line and the accepted file-format fact is lost; reader question is literal.

Judge’s check	without	with Minto
Answer first	yes	no
First-level elements	3	3
First-level kind matches the gold	no	no
Invented facts	yes	no
Source lost without a note	no	yes
Mode respected	yes	yes
Reader’s question stated literally	no	yes
Order type named	no	no
SCQ introduction present	no	yes

How the test was built

gpt-oss-120b received the same task twice. The control prompt is one framing line and the task. The prompt with Minto is the same task preceded by the full text of the skill. The judge read both outputs among 16 under blind labels and did not know which one had the skill.

Prompt without Minto 2 147 B

You are working on a business document using the Minto Pyramid Principle.

<!-- Faithful paraphrase of Barbara Minto, The Minto Pyramid Principle
     (2010), Chapter 3, Exhibit 5 and the surrounding top-down analysis.
     The wording is original to this evaluation fixture. -->

# Fixture 01: Big Chief proposal

**Mode:** `write`
**Language:** `en`

## Context

The company supplies beverages. Drivers send delivery tickets to Finance; each
ticket identifies the customer, outlet, delivery, amount, and date. The tickets
feed the national-accounts settlement process.

Big Chief, a major multi-outlet customer, wants to replace individual ticket
settlement with a monthly computer file and one payment. Finance reviewed how
the proposed process would work and sent management the memo below.

## Before

```text
To: Robert Salton
From: John Jackson
Subject: Big Chief request

We reviewed Big Chief account 8306's request to submit delivery-ticket data
electronically and settle it through one prepaid monthly payment. Our findings
follow.

1. Any external account file must contain the parent number, outlet number,
   ticket number, ticket amount, and delivery date. If Big Chief cannot provide
   the first two identifiers, we can supply them from the customer master file
   for inclusion in later submissions.

2. Big Chief will build an extraction program for its accounts-payable file.
   The resulting file will use the format accepted by our national-accounts
   cash-receipt system. Big Chief will send the file to Data Processing and
   send its cheque, with a detailed listing, to the lockbox. We will balance
   the file under the prescribed procedure. The cheque total and file detail
   must net to zero.

3. Once balanced, the monthly file will run through the national-accounts
   system, match ticket numbers against statement history, and produce the
   relevant billing records.
```

## Task

Rewrite this as a short management memo using the Minto Pyramid Principle.
Do not invent benefits, savings, or operational facts that are absent from the
source.

Return only the result, with no explanation of how you produced it.

Prompt with Minto five parts, in order · 29 720 B

Below is a skill written as an instruction. Read it in full and apply it to the task at the end.
===== SKILL.md ===== SKILL.md at f4813ce 17 235 B
===== references/rules.md ===== references/rules.md at f4813ce 6 464 B
===== references/templates.md ===== references/templates.md at f4813ce 3 742 B
===== TASK ===== the whole case input
Return only the result, with no explanation of how you produced it.

Case input before.md

Fixture 01: Big Chief proposal

Mode: write
Language: en

Context

The company supplies beverages. Drivers send delivery tickets to Finance; each
ticket identifies the customer, outlet, delivery, amount, and date. The tickets
feed the national-accounts settlement process.

Big Chief, a major multi-outlet customer, wants to replace individual ticket
settlement with a monthly computer file and one payment. Finance reviewed how
the proposed process would work and sent management the memo below.

Before

To: Robert Salton
                From: John Jackson
                Subject: Big Chief request
                
                We reviewed Big Chief account 8306's request to submit delivery-ticket data
                electronically and settle it through one prepaid monthly payment. Our findings
                follow.
                
                1. Any external account file must contain the parent number, outlet number,
                   ticket number, ticket amount, and delivery date. If Big Chief cannot provide
                   the first two identifiers, we can supply them from the customer master file
                   for inclusion in later submissions.
                
                2. Big Chief will build an extraction program for its accounts-payable file.
                   The resulting file will use the format accepted by our national-accounts
                   cash-receipt system. Big Chief will send the file to Data Processing and
                   send its cheque, with a detailed listing, to the lockbox. We will balance
                   the file under the prescribed procedure. The cheque total and file detail
                   must net to zero.
                
                3. Once balanced, the monthly file will run through the national-accounts
                   system, match ticket numbers against statement history, and produce the
                   relevant billing records.

Task

Rewrite this as a short management memo using the Minto Pyramid Principle.
Do not invent benefits, savings, or operational facts that are absent from the
source.

The judge’s gold gold.md

Gold 01: Big Chief proposal

Source structure: Minto (2010), Chapter 3, Exhibits 4-6.

Expected structure

Element	Expected value
Reader question	Is Big Chief's proposal a good idea?
Top	Yes, the proposed process is workable and worth accepting, within the evidence available
Key-line kind	Reasons or reader benefits, not system mechanics
Order	Inductive reasons supporting one conclusion

The book illustrates three possible benefits: obtaining the required
information, increasing cash flow, and reducing clerical work. Only the first
is directly supported by this fixture. Literal reproduction of all three is
therefore not required and unsupported benefits count as inventions.

Strong outputs:

answer the management question before explaining the file mechanics;
use two to four same-kind reasons grounded in the supplied facts;
place field lists, file format, routing, balancing, and matching below those
reasons as evidence or implementation detail;
retain the literal reader question in the delivered memo.

Main defect in the source

The source explains how the proposed system would operate but never answers
whether management should accept it. A technically tidy list is still the wrong
key line if the reader is deciding whether to act.

Scoring notes

2 for key-line composition: every first-level point is a grounded benefit,
loss avoided, or reason for acceptance.
1: benefits and mechanics are mixed.
0: the first level is entirely fields, file handling, or balancing steps.

Do not reward unsupported claims about savings, speed, or cash flow.

Judge gpt-5.6-sol, effort high · skill from commit f4813ce · run v1.7.0-final