← RegLegBrief Findings by regulator All AI Labs whitepapers Hallucination Register Methodology Right of reply
CPMI-API-HARMONISATION-2024 · ai-labs · evaluation-report
1// CPMI API Harmonisation for Cross-Border Payments (Oct 2024)
2// RLB Evaluation: 6 AI runs · Opus 4.7 + Sonnet 4.6 · web search enabled
3
4const evaluation = {
5 regulation: "CPMI October 2024 API Harmonisation Recommendations",
6 models_tested: ["claude-opus-4.7", "claude-sonnet-4.6"],
7 runs: 6, search: true,
8 failure_pattern: "structurally similar across both models",
9 failure_types: ["scope_conflation", "attribution_drift", "impl_detail_error"]
10};

// Six AI runs on the CPMI October 2024 API harmonisation framework produced structurally similar failures across both model families, the same scope conflations, the same attribution errors, the same wrong implementation details.

DATE: 2026-06-07 METHODOLOGY: v2.3 SUBSTRATE: CPMI-API-OCT-2024
Read the public briefing for this regulation
The regulation

CPMI's October 2024 API harmonisation recommendations

The CPMI's October 2024 recommendations on API harmonisation for cross-border payments address a specific and technically precise problem: the fragmentation of application programming interface standards across payment systems in different jurisdictions that creates friction in cross-border payment flows. The recommendations cover API design principles, data standards alignment with ISO 20022, and governance frameworks for cross-jurisdictional API interoperability.

The document sits within the G20's cross-border payments roadmap, the FSB/CPMI workstream on harmonised API standards. Its recommendations are addressed to payment system operators, financial institutions, and standard-setting bodies implementing cross-border payment API frameworks. Practitioners asking AI tools about this document are typically payment product architects, fintech builders, or regulatory policy teams.

6
AI runs conducted
2
Models tested
3
Failure types documented
Failure type 1: scope conflation

Models expanded the recommendation scope beyond its actual coverage

The CPMI October 2024 recommendations address API harmonisation for cross-border retail payment systems within the G20 roadmap context. Both models expanded the scope in their outputs, describing the recommendations as covering wholesale payment APIs, central bank digital currency APIs, and domestic payment API standards that the CPMI document does not address. The scope expansion is directionally consistent: both models inflated coverage rather than narrowing it.

scope-comparison.diff
+++ CPMI Oct 2024 (actual scope)
+ Cross-border retail payment APIs
+ G20 roadmap context
+ ISO 20022 data standards alignment
 
--- Model output (both models, expanded)
- Wholesale payment APIs // not in scope ✗
- CBDC API standards // not in scope ✗
- Domestic payment API frameworks // not in scope ✗
Failure type 2: attribution drift

Provisions attributed to the wrong workstream or document

The October 2024 CPMI recommendations exist within a broader family of FSB and CPMI cross-border payment documents. Both models, when citing specific recommendations, attributed some provisions to the wrong document within this family, crediting CPMI October 2024 with recommendations that appear in earlier FSB documents, and attributing FSB positions to the CPMI October 2024 report. The failure is attribution drift within a document family: the model knows the space, but conflates which specific document contains which specific provision.

Attribution in model outputs
Specific API design principles attributed to CPMI Oct 2024 that appear in earlier FSB documents, and FSB positions attributed to CPMI Oct 2024.
Correct attribution
Each recommendation traces to a specific document in the FSB/CPMI cross-border payment workstream. Attribution between documents in the family requires document-level verification.
DOCUMENT FAMILY — ATTRIBUTION DRIFT MAP FSB Roadmap Cross-border payments priority areas CPMI API Oct 2024 (target doc) ← correct source Model attribution Blends provisions from both → attributes to CPMI Oct 2024 only ✗ Both models blended FSB roadmap provisions into CPMI Oct 2024 citations
Attribution drift within the cross-border payment document family: model blended FSB roadmap provisions into citations attributed to CPMI October 2024 only.
Operational signal

What builders and policy teams need to know

Payment product teams and API architects embedding CPMI October 2024 compliance requirements into cross-border payment infrastructure should expect scope expansion and attribution drift when using frontier AI tools to research the recommendations. Specific recommendation citations require document-level verification against the CPMI October 2024 text. The FSB/CPMI document family context means the model's blending risk is structurally higher than for standalone regulatory documents.

Full hub: CPMI-API-HARMONISATION-CROSS-BORDER-2024 →

Hallucination Register: reglegbrief.com/hallucination-register/