← RegLegBrief Findings by regulator All AI Labs whitepapers Hallucination Register Methodology Right of reply
AI Labs · White Paper · BIS-CPMI · INT · substrate v1

The models counted wrong — and invented who was consulted

Six findings on the CPMI October 2024 final report on linking fast payment systems across borders (d223). Wrong recommendation count, fabricated respondent list, and a scoping error that pulls the single access point model inside a scope it explicitly sits outside.

FPS A HUB FPS B ~10 rec. (model) 7 rec. (d223 §5.2)
📅 Published 15 Jun 2026⚙️ Methodology v2.3🏛 BIS-CPMI d223 · FPS Interlinking
📰Read the public briefing for this regulation
The numbers that broke

Three wrong counts, one fabricated respondent list

The CPMI's October 2024 final report on FPS interlinking governance (d223) sets out seven oversight recommendations in Section 5.2. Both Claude Opus 4.7 and Claude Sonnet 4.6, tested with web search active, committed to approximately ten. That's the interim publication's (d219) consideration count grafted onto the final publication, a conflation that embeds a structurally wrong picture of the oversight regime into any board-level briefing that relies on it.

The respondent list problem is different and arguably worse. d223 Annex 1 names seven specific consultation respondents. The models produced lists of fifteen to twenty organisations, including fabricated names, attributing positions and counts to stakeholders the regulator's own annex does not record.

~10
Recommendations (Model)
d219 interim count
7
Recommendations (d223)
§5.2 final report
15–20
Respondents (Model)
vs. 7 in Annex 1
The Scoping Error

Pulling the single access point inside the report's scope

d223 Section 2.2 is explicit: the single access point gateway model is not the focus of the report. The models scoped it inside the recommendation set anyway. For a legal opinion on a single access point arrangement, that's a falsifiable regulatory-interpretation error in a partner-level deliverable.

d223 Section 2.2 records that the single access point is not the focus of the report. A legal opinion that scopes a single access point arrangement inside the d223 recommendation set creates a falsifiable error in a partner-level deliverable.
d219 vs d223 — INTERIM TO FINAL CONFLATION INTERIM d219 ~10 considerations ← Model anchored here FINAL d223 7 recommendations (§5.2) ← Regulator text
The model conflated the interim publication's ~10 considerations with the final report's 7 recommendations. These are structurally distinct, different documents, different binding character.
Six findings — full citation IDs

What's on the record

Full hub: CPMI FPS Interlinking Governance 2024 hub on RegLegBrief.com →