11 · Capital E/E Publisher (diagnostic procedures)

Fault diagnosis

Given symptoms and a few voltmeter readings, can it find the one open circuit?

Each case is a fused feed tree, several loads, ground wires to shared ground splices and a strap to chassis. One element is open: a wire, the fuse, or a load. From which loads work and a handful of readings, name it. Every case is constructed to have exactly one consistent answer.

Capital reference. Creating Diagnostic Procedures (ee-publisher/creating-diagnostic-procedures). This domain stands for the capability that article describes; the task gives the model the rules in full rather than testing whether it remembers Capital’s.

Not tested here. Shorts, intermittent faults, and authoring the published procedure itself.

Scale ladder. S: 3 cases · M: 6 cases · L: 10 cases.

Results

ModelVerdictS passedM passedL passedMean score
Claude Opus 5.5Ready3 / 33 / 33 / 3100
Claude Fable 5.1Ready3 / 33 / 33 / 3100
Claude Sonnet 5.5Ready3 / 33 / 33 / 3100

Every trial

ModelSizeSeedScoreChecksTime
Claude Fable 5.1L#0325172963100faults found: 10 of 10 faults identified14 s
Claude Fable 5.1L#1308395344100faults found: 10 of 10 faults identified16 s
Claude Fable 5.1L#2358728201100faults found: 10 of 10 faults identified15 s
Claude Fable 5.1M#0885637528100faults found: 6 of 6 faults identified12 s
Claude Fable 5.1M#1902415147100faults found: 6 of 6 faults identified12 s
Claude Fable 5.1M#2919192766100faults found: 6 of 6 faults identified10 s
Claude Fable 5.1S#0822899002100faults found: 3 of 3 faults identified8 s
Claude Fable 5.1S#1839676621100faults found: 3 of 3 faults identified9 s
Claude Fable 5.1S#2789343764100faults found: 3 of 3 faults identified7 s
Claude Opus 5.5L#0325172963100faults found: 10 of 10 faults identified14 s
Claude Opus 5.5L#1308395344100faults found: 10 of 10 faults identified22 s
Claude Opus 5.5L#2358728201100faults found: 10 of 10 faults identified18 s
Claude Opus 5.5M#0885637528100faults found: 6 of 6 faults identified12 s
Claude Opus 5.5M#1902415147100faults found: 6 of 6 faults identified14 s
Claude Opus 5.5M#2919192766100faults found: 6 of 6 faults identified12 s
Claude Opus 5.5S#0822899002100faults found: 3 of 3 faults identified9 s
Claude Opus 5.5S#1839676621100faults found: 3 of 3 faults identified10 s
Claude Opus 5.5S#2789343764100faults found: 3 of 3 faults identified7 s
Claude Sonnet 5.5L#0325172963100faults found: 10 of 10 faults identified10 s
Claude Sonnet 5.5L#1308395344100faults found: 10 of 10 faults identified11 s
Claude Sonnet 5.5L#2358728201100faults found: 10 of 10 faults identified10 s
Claude Sonnet 5.5M#0885637528100faults found: 6 of 6 faults identified8 s
Claude Sonnet 5.5M#1902415147100faults found: 6 of 6 faults identified7 s
Claude Sonnet 5.5M#2919192766100faults found: 6 of 6 faults identified7 s
Claude Sonnet 5.5S#0822899002100faults found: 3 of 3 faults identified7 s
Claude Sonnet 5.5S#1839676621100faults found: 3 of 3 faults identified6 s
Claude Sonnet 5.5S#2789343764100faults found: 3 of 3 faults identified6 s

What the model is asked

The small instance at seed 822899002, exactly as sent. Regenerate any instance with npm run sample -- diagnostics M 2.

Show the prompt (2,732 characters)
TASK: Fault diagnosis.

Each case is a separate 12 V circuit. BAT is the battery positive (12 V); CH is chassis ground (0 V).
Segments are wires (F1 is the fuse, treated as a segment). Loads are resistive devices between two nodes.
Wires have negligible resistance; every switch is closed. In each case EXACTLY ONE element is open circuit:
one segment (including the fuse) or one load. Symptoms say which loads operate. Readings are DC voltage at a node, measured to chassis.
Identify the open element in each case.

CASE1:
segments: [
  {"id":"F1","a":"BAT","b":"P0"},
  {"id":"S1","a":"P0","b":"P1"},
  {"id":"S2","a":"P1","b":"P2"},
  {"id":"S3","a":"P0","b":"P3"},
  {"id":"S4","a":"G1","b":"GS1"},
  {"id":"S5","a":"G2","b":"GS1"},
  {"id":"S6","a":"G3","b":"GS1"},
  {"id":"S7","a":"GS1","b":"CH"}
]
loads: [
  {"id":"L1","a":"P2","b":"G1"},
  {"id":"L2","a":"P1","b":"G2"},
  {"id":"L3","a":"P3","b":"G3"}
]
symptoms: [{"load":"L1","state":"OFF"},{"load":"L2","state":"ON"},{"load":"L3","state":"ON"}]
readings: [{"node":"P2","reading":"12V"},{"node":"P3","reading":"12V"},{"node":"GS1","reading":"0V"},{"node":"G1","reading":"0V"}]

CASE2:
segments: [
  {"id":"F1","a":"BAT","b":"P0"},
  {"id":"S1","a":"P0","b":"P1"},
  {"id":"S2","a":"P1","b":"P2"},
  {"id":"S3","a":"P2","b":"P3"},
  {"id":"S4","a":"P2","b":"P4"},
  {"id":"S5","a":"P4","b":"P5"},
  {"id":"S6","a":"G1","b":"GS1"},
  {"id":"S7","a":"G2","b":"GS1"},
  {"id":"S8","a":"G3","b":"GS1"},
  {"id":"S9","a":"G4","b":"GS1"},
  {"id":"S10","a":"GS1","b":"CH"}
]
loads: [
  {"id":"L1","a":"P4","b":"G1"},
  {"id":"L2","a":"P5","b":"G2"},
  {"id":"L3","a":"P2","b":"G3"},
  {"id":"L4","a":"P3","b":"G4"}
]
symptoms: [{"load":"L1","state":"ON"},{"load":"L2","state":"OFF"},{"load":"L3","state":"ON"},{"load":"L4","state":"ON"}]
readings: [{"node":"P5","reading":"12V"},{"node":"G3","reading":"0V"},{"node":"G2","reading":"0V"}]

CASE3:
segments: [
  {"id":"F1","a":"BAT","b":"P0"},
  {"id":"S1","a":"P0","b":"P1"},
  {"id":"S2","a":"P0","b":"P2"},
  {"id":"S3","a":"P1","b":"P3"},
  {"id":"S4","a":"P1","b":"P4"},
  {"id":"S5","a":"G1","b":"GS1"},
  {"id":"S6","a":"G2","b":"GS1"},
  {"id":"S7","a":"G3","b":"GS1"},
  {"id":"S8","a":"G4","b":"GS1"},
  {"id":"S9","a":"GS1","b":"CH"}
]
loads: [
  {"id":"L1","a":"P2","b":"G1"},
  {"id":"L2","a":"P4","b":"G2"},
  {"id":"L3","a":"P1","b":"G3"},
  {"id":"L4","a":"P3","b":"G4"}
]
symptoms: [{"load":"L1","state":"ON"},{"load":"L2","state":"ON"},{"load":"L3","state":"OFF"},{"load":"L4","state":"ON"}]
readings: [{"node":"P3","reading":"12V"},{"node":"G2","reading":"0V"},{"node":"G3","reading":"0V"}]

Output format (JSON, exactly these keys):
```json
{
 "cases": [
  {
   "case": "CASE1",
   "fault": "S4"
  }
 ]
}
```

All results · Capital knowledge base article