10 · Capital Harness Designer (harness synchronization) · Capital Systems Integrator (change history)

Change impact

Can it work out exactly what an engineering change touches?

Compare two revisions of a wire list, in different orders, and report what was added, removed and modified (and which attributes), then every harness and connector the change reaches. This is the input to an ECO and to harness synchronization.

Capital reference. Simulate Harness Synchronization (harness-designer/simulate-harness-synchronization). This domain stands for the capability that article describes; the task gives the model the rules in full rather than testing whether it remembers Capital’s.

Not tested here. Change policies, build lists and Teamcenter change objects.

Scale ladder. S: 15 wires per revision · M: 60 wires per revision · L: 180 wires per revision.

Results

ModelVerdictS passedM passedL passedMean score
Claude Opus 5.5Ready3 / 33 / 33 / 3100
Claude Fable 5.1Ready3 / 33 / 33 / 3100
Claude Sonnet 5.5Ready3 / 33 / 33 / 3100

Every trial

ModelSizeSeedScoreChecksTime
Claude Fable 5.1L#03722818793100added: 14 of 14 · removed: 14 of 14 · modified: 14 of 14 · changed fields: 14 of 14 field lists exact · harnesses: 6 of 6 · connectors: 40 of 4065 s
Claude Fable 5.1L#13706041174100added: 14 of 14 · removed: 14 of 14 · modified: 14 of 14 · changed fields: 14 of 14 field lists exact · harnesses: 6 of 6 · connectors: 36 of 3668 s
Claude Fable 5.1L#23689263555100added: 14 of 14 · removed: 14 of 14 · modified: 14 of 14 · changed fields: 14 of 14 field lists exact · harnesses: 6 of 6 · connectors: 38 of 3863 s
Claude Fable 5.1M#01868689318100added: 5 of 5 · removed: 5 of 5 · modified: 5 of 5 · changed fields: 5 of 5 field lists exact · harnesses: 2 of 2 · connectors: 14 of 1425 s
Claude Fable 5.1M#11885466937100added: 5 of 5 · removed: 5 of 5 · modified: 5 of 5 · changed fields: 5 of 5 field lists exact · harnesses: 2 of 2 · connectors: 13 of 1318 s
Claude Fable 5.1M#21835134080100added: 5 of 5 · removed: 5 of 5 · modified: 5 of 5 · changed fields: 5 of 5 field lists exact · harnesses: 2 of 2 · connectors: 11 of 1120 s
Claude Fable 5.1S#02976807628100added: 2 of 2 · removed: 2 of 2 · modified: 2 of 2 · changed fields: 2 of 2 field lists exact · harnesses: 2 of 2 · connectors: 4 of 48 s
Claude Fable 5.1S#12993585247100added: 2 of 2 · removed: 2 of 2 · modified: 2 of 2 · changed fields: 2 of 2 field lists exact · harnesses: 2 of 2 · connectors: 4 of 49 s
Claude Fable 5.1S#23010362866100added: 2 of 2 · removed: 2 of 2 · modified: 2 of 2 · changed fields: 2 of 2 field lists exact · harnesses: 2 of 2 · connectors: 4 of 49 s
Claude Opus 5.5L#03722818793100added: 14 of 14 · removed: 14 of 14 · modified: 14 of 14 · changed fields: 14 of 14 field lists exact · harnesses: 6 of 6 · connectors: 40 of 4039 s
Claude Opus 5.5L#13706041174100added: 14 of 14 · removed: 14 of 14 · modified: 14 of 14 · changed fields: 14 of 14 field lists exact · harnesses: 6 of 6 · connectors: 36 of 3636 s
Claude Opus 5.5L#23689263555100added: 14 of 14 · removed: 14 of 14 · modified: 14 of 14 · changed fields: 14 of 14 field lists exact · harnesses: 6 of 6 · connectors: 38 of 3841 s
Claude Opus 5.5M#01868689318100added: 5 of 5 · removed: 5 of 5 · modified: 5 of 5 · changed fields: 5 of 5 field lists exact · harnesses: 2 of 2 · connectors: 14 of 1417 s
Claude Opus 5.5M#11885466937100added: 5 of 5 · removed: 5 of 5 · modified: 5 of 5 · changed fields: 5 of 5 field lists exact · harnesses: 2 of 2 · connectors: 13 of 1320 s
Claude Opus 5.5M#21835134080100added: 5 of 5 · removed: 5 of 5 · modified: 5 of 5 · changed fields: 5 of 5 field lists exact · harnesses: 2 of 2 · connectors: 11 of 1119 s
Claude Opus 5.5S#02976807628100added: 2 of 2 · removed: 2 of 2 · modified: 2 of 2 · changed fields: 2 of 2 field lists exact · harnesses: 2 of 2 · connectors: 4 of 410 s
Claude Opus 5.5S#12993585247100added: 2 of 2 · removed: 2 of 2 · modified: 2 of 2 · changed fields: 2 of 2 field lists exact · harnesses: 2 of 2 · connectors: 4 of 411 s
Claude Opus 5.5S#23010362866100added: 2 of 2 · removed: 2 of 2 · modified: 2 of 2 · changed fields: 2 of 2 field lists exact · harnesses: 2 of 2 · connectors: 4 of 411 s
Claude Sonnet 5.5L#03722818793100added: 14 of 14 · removed: 14 of 14 · modified: 14 of 14 · changed fields: 14 of 14 field lists exact · harnesses: 6 of 6 · connectors: 40 of 4025 s
Claude Sonnet 5.5L#13706041174100added: 14 of 14 · removed: 14 of 14 · modified: 14 of 14 · changed fields: 14 of 14 field lists exact · harnesses: 6 of 6 · connectors: 36 of 3625 s
Claude Sonnet 5.5L#23689263555100added: 14 of 14 · removed: 14 of 14 · modified: 14 of 14 · changed fields: 14 of 14 field lists exact · harnesses: 6 of 6 · connectors: 38 of 3826 s
Claude Sonnet 5.5M#01868689318100added: 5 of 5 · removed: 5 of 5 · modified: 5 of 5 · changed fields: 5 of 5 field lists exact · harnesses: 2 of 2 · connectors: 14 of 1410 s
Claude Sonnet 5.5M#11885466937100added: 5 of 5 · removed: 5 of 5 · modified: 5 of 5 · changed fields: 5 of 5 field lists exact · harnesses: 2 of 2 · connectors: 13 of 1312 s
Claude Sonnet 5.5M#21835134080100added: 5 of 5 · removed: 5 of 5 · modified: 5 of 5 · changed fields: 5 of 5 field lists exact · harnesses: 2 of 2 · connectors: 11 of 1111 s
Claude Sonnet 5.5S#02976807628100added: 2 of 2 · removed: 2 of 2 · modified: 2 of 2 · changed fields: 2 of 2 field lists exact · harnesses: 2 of 2 · connectors: 4 of 47 s
Claude Sonnet 5.5S#12993585247100added: 2 of 2 · removed: 2 of 2 · modified: 2 of 2 · changed fields: 2 of 2 field lists exact · harnesses: 2 of 2 · connectors: 4 of 48 s
Claude Sonnet 5.5S#23010362866100added: 2 of 2 · removed: 2 of 2 · modified: 2 of 2 · changed fields: 2 of 2 field lists exact · harnesses: 2 of 2 · connectors: 4 of 47 s

What the model is asked

The small instance at seed 2976807628, exactly as sent. Regenerate any instance with npm run sample -- change M 2.

Show the prompt (3,523 characters)
TASK: Change impact analysis.

Compare revision A and revision B of a wire list. Wires are matched by id. Report:
- added: ids in B but not A; removed: ids in A but not B;
- modified: ids in both whose attributes differ, with the list of fields that changed (fields are from, to, gauge, color, harness);
- impactedHarnesses: every harness that any added, removed or modified wire belongs to, in EITHER revision;
- impactedConnectors: every connector (the part of an end before the "-") at either end of any added, removed or modified wire, in EITHER revision.

Revision A:
[
  {"id":"W1001","from":"C1-5","to":"C4-4","gauge":18,"color":"VT","harness":"HN-101"},
  {"id":"W1002","from":"C3-1","to":"C3-15","gauge":22,"color":"GY","harness":"HN-101"},
  {"id":"W1003","from":"C1-1","to":"C3-19","gauge":16,"color":"BK","harness":"HN-100"},
  {"id":"W1004","from":"C3-10","to":"C3-18","gauge":18,"color":"BU","harness":"HN-100"},
  {"id":"W1005","from":"C3-20","to":"C3-7","gauge":22,"color":"OG","harness":"HN-100"},
  {"id":"W1006","from":"C1-11","to":"C2-6","gauge":16,"color":"GY","harness":"HN-101"},
  {"id":"W1007","from":"C1-12","to":"C2-10","gauge":20,"color":"RD","harness":"HN-101"},
  {"id":"W1008","from":"C2-13","to":"C3-12","gauge":22,"color":"YE","harness":"HN-101"},
  {"id":"W1009","from":"C1-11","to":"C3-7","gauge":22,"color":"RD","harness":"HN-100"},
  {"id":"W1010","from":"C2-20","to":"C1-10","gauge":20,"color":"RD","harness":"HN-101"},
  {"id":"W1011","from":"C2-16","to":"C1-1","gauge":16,"color":"VT","harness":"HN-101"},
  {"id":"W1012","from":"C1-15","to":"C2-1","gauge":22,"color":"GY","harness":"HN-101"},
  {"id":"W1013","from":"C3-12","to":"C2-4","gauge":16,"color":"YE","harness":"HN-101"},
  {"id":"W1014","from":"C1-3","to":"C2-13","gauge":18,"color":"YE","harness":"HN-100"},
  {"id":"W1015","from":"C2-10","to":"C3-13","gauge":20,"color":"OG","harness":"HN-100"}
]

Revision B:
[
  {"id":"W1002","from":"C3-1","to":"C3-15","gauge":22,"color":"GY","harness":"HN-101"},
  {"id":"W1006","from":"C1-11","to":"C2-6","gauge":16,"color":"BN","harness":"HN-101"},
  {"id":"W1001","from":"C1-5","to":"C4-4","gauge":18,"color":"VT","harness":"HN-101"},
  {"id":"W1009","from":"C1-11","to":"C3-7","gauge":22,"color":"RD","harness":"HN-100"},
  {"id":"W1005","from":"C3-20","to":"C3-7","gauge":22,"color":"OG","harness":"HN-100"},
  {"id":"W1004","from":"C3-10","to":"C3-18","gauge":18,"color":"BU","harness":"HN-100"},
  {"id":"W1008","from":"C2-13","to":"C3-12","gauge":20,"color":"OG","harness":"HN-101"},
  {"id":"W1015","from":"C2-10","to":"C3-13","gauge":20,"color":"OG","harness":"HN-100"},
  {"id":"W2002","from":"C1-4","to":"C2-17","gauge":20,"color":"BU","harness":"HN-100"},
  {"id":"W2001","from":"C4-9","to":"C1-17","gauge":16,"color":"BU","harness":"HN-100"},
  {"id":"W1003","from":"C1-1","to":"C3-19","gauge":16,"color":"BK","harness":"HN-100"},
  {"id":"W1007","from":"C1-12","to":"C2-10","gauge":20,"color":"RD","harness":"HN-101"},
  {"id":"W1012","from":"C1-15","to":"C2-1","gauge":22,"color":"GY","harness":"HN-101"},
  {"id":"W1013","from":"C3-12","to":"C2-4","gauge":16,"color":"YE","harness":"HN-101"},
  {"id":"W1014","from":"C1-3","to":"C2-13","gauge":18,"color":"YE","harness":"HN-100"}
]

Output format (JSON, exactly these keys):
```json
{
 "added": [
  "W2001"
 ],
 "removed": [
  "W1004"
 ],
 "modified": [
  {
   "id": "W1010",
   "fields": [
    "gauge",
    "color"
   ]
  }
 ],
 "impactedHarnesses": [
  "HN-100"
 ],
 "impactedConnectors": [
  "C3",
  "C7"
 ]
}
```

All results · Capital knowledge base article