AI Hallucination Research › Briefings

Briefings Blog

The running blog from the RLB Specialist Panel delves into real-world scenarios where the compliance, legal, or AI lab team interacts with frontier AI models under specific regulations. The blogs are anonymised to remove client-specific details and include insights from the RLB team analysing the hallucinations experienced in AI models while working on these cases. For example, when a model returns a confident answer that contradicts the regulator's primary text, such as a fabricated staff letter, a wrong appendix, or an inverted scope, these issues are discussed here. Each blog explains one set of findings and what it would have meant for the team that would have acted on it, sans this research initiative. This blog is frequently updated, a few times a day.

263 briefings in the archive · Subscribe via Atom: /briefings/feed.xml (this blog) · /feed.xml (all RegLegBrief publications)
Audience colours: AI Labs Practitioner (profession) Sector × Department
Audience
Jur.
Regulator
Profession
Sector
Dept
Range
Sort
Per page
Showing 5 of 263 · page 14 of 53
Friday, 17 July 2026
Sector: Payment Institutions and Dept: Product & Business Development INT BIS-CPMI

Payment Institutions Product & Business Development teams: documentation and reporting gaps possible from AI reading of CPMI Cross-Border API Harmonisation 2024

For Payment Institutions Product & Business Development teams working with Promoting the Harmonisation of Application Programming Interfaces to Enhance Cross-Border Payments: Recommendations and Toolkit:...

Product and business-development teams at payment institutions building cross-border products against the CPMI API harmonisation programme are increasingly using AI to draft market-sizing memos using FPS connectivity figures, generate investor-pitch decks on Africa-corridor opportunity, prepare strategy papers on the SARB pre-validation workstream, build competitor-landscape annexes citing central-bank-versus-private operator splits, and validate go-to-market commitments against published CPMI data. The RLB Specialist Panel tested how that AI usage performs against the regulator's own primary text on CPMI's October 2024 d224 report and the related CPMI Brief and speech series.

The audit surfaced four substantive failure modes that the AI subjects delivered with regulator-fluent confidence.

Numeric Drift and False-Negative Availability Claim on CPMI API Harmonisation for Cross-Border Payments. Two frontier AI models tested by the RLB Specialist Panel returned confident, citable answers across the panel's CPMI substrate-bound question set on the October 2024 d224 report and the related CPMI Brief and speech series. The panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Across the 2 findings in this Product & Business Development teams at Payment Institutions briefing, the AI subjects returned a global fast payment system count of 57 sourced to the 2025 monitoring survey sample, when the authoritative CPMI figure is 70+; stated that the central-bank versus private operator split of global fast payment systems is not enumerated in public CPMI sources, when the November 2023 CPMI speech gives exact percentages.

A market-sizing memo that quotes 57 as the global FPS count rather than 70+ understates the addressable opportunity. A pitch deck that records the central-bank-versus-private operator split as 'not enumerated by CPMI' leaves a known data point off the competitor landscape. A strategy paper that frames SARB pre-validation as 'no named jurisdictional partner' positions the firm one step behind a published regulator-bilateral programme.

The findings are published with immutable RLB Citation IDs: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q010-Opus47, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q010-Sonnet46. The full audit is published at the CPMI API Harmonisation for Cross-Border Payments hub on RegLegBrief.com.

Sector: Payment Institutions and Dept: Operations INT BIS-CPMI

Payment Institutions Operations teams: documentation and reporting gaps possible from AI reading of CPMI Cross-Border API Harmonisation 2024

For Payment Institutions Operations teams working with Promoting the Harmonisation of Application Programming Interfaces to Enhance Cross-Border Payments: Recommendations and Toolkit: Specialist-Panel-verified...

Operations leads at payment institutions running cross-border rails under the CPMI API harmonisation programme are increasingly using AI to draft ISO 20022 message-format runbook updates, prepare operational readiness papers on the SARB pre-validation workstream, update capacity-planning briefings against published FPS connectivity figures, generate vendor-management packs against CPMI implementation milestones, and verify dated CPMI commitments against regulator publications. The RLB Specialist Panel tested how that AI usage performs against the regulator's own primary text on CPMI's October 2024 d224 report and the related CPMI Brief and speech series.

The audit surfaced four substantive failure modes that the AI subjects delivered with regulator-fluent confidence.

Fabricated Date-and-Format Commitment and Numeric Drift on CPMI API Harmonisation for Cross-Border Payments. Two frontier AI models tested by the RLB Specialist Panel returned confident, citable answers across the panel's CPMI substrate-bound question set on the October 2024 d224 report and the related CPMI Brief and speech series. The panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Across the 2 findings in this Operations teams at Payment Institutions briefing, the AI subjects introduced a specific November 2026 cutover commitment for structured ISO 20022 addresses that does not appear in the regulator's text; returned a global fast payment system count of 57 sourced to the 2025 monitoring survey sample, when the authoritative CPMI figure is 70+.

An operational readiness paper that records a November 2026 structured-ISO-20022 cutover as a CPMI mandate triggers a remediation programme against a regulator commitment the regulator never made. A capacity-planning briefing that uses 57 as the global FPS count under-sizes corridor expansion against a regulator-stated 70+ universe. A vendor-management pack built on AI-asserted CPMI mandates accepts vendor commitments against an imaginary regulator baseline.

The findings are published with immutable RLB Citation IDs: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q009-Sonnet46, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q010-Opus47. The full audit is published at the CPMI API Harmonisation for Cross-Border Payments hub on RegLegBrief.com.

Thursday, 16 July 2026
Sector: Payment Institutions and Dept: Legal INT BIS-CPMI

Payment Institutions Legal teams: documentation and reporting gaps possible from AI reading of CPMI Cross-Border API Harmonisation 2024

For Payment Institutions Legal teams working with Promoting the Harmonisation of Application Programming Interfaces to Enhance Cross-Border Payments: Recommendations and Toolkit: Specialist-Panel-verified findings on...

In-house legal counsel at payment institutions operating cross-border rails on the CPMI API harmonisation programme are increasingly using AI to draft legal memos on stakeholder obligations per recommendation, prepare board-paper legal annexes on the SARB pre-validation workstream, generate scoping documents for new correspondent counterparties, validate ISO 20022 structured-address commitments against regulator text, and produce regulatory horizon-scan summaries for the legal function. The RLB Specialist Panel tested how that AI usage performs against the regulator's own primary text on CPMI's October 2024 d224 report and the related CPMI Brief and speech series.

The audit surfaced four substantive failure modes that the AI subjects delivered with regulator-fluent confidence.

Confident Denial and Stakeholder Taxonomy Fabrication on CPMI API Harmonisation for Cross-Border Payments. Two frontier AI models tested by the RLB Specialist Panel returned confident, citable answers across the panel's CPMI substrate-bound question set on the October 2024 d224 report and the related CPMI Brief and speech series. The panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Across the 2 findings in this Legal teams at Payment Institutions briefing, the AI subjects denied that any pilot partner has been named for the CPMI pre-validation API recommendation; built a recommendation-by-recommendation stakeholder breakdown from category names rather than the regulator's actual recommendation text.

A legal opinion that hedges the SARB pre-validation partnership as 'plausible but unverified' or denies it outright embeds a verifiable factual error in a partner-signed deliverable. A scoping document built on an AI per-recommendation stakeholder taxonomy carries fabricated assignments into the firm's contract pipeline. A regulatory horizon-scan annex that misses the SARB-CPMI workstream positions the firm behind a published regulator-bilateral programme.

The findings are published with immutable RLB Citation IDs: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q007-Sonnet46, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q008-Opus47. The full audit is published at the CPMI API Harmonisation for Cross-Border Payments hub on RegLegBrief.com.

Sector: Corporate Banking and Dept: Technology & Data INT BIS-CPMI

Corporate Banking Technology & Data teams: documentation and reporting gaps possible from AI reading of CPMI Cross-Border API Harmonisation 2024

For Corporate Banking Technology & Data teams working with Promoting the Harmonisation of Application Programming Interfaces to Enhance Cross-Border Payments: Recommendations and Toolkit: Specialist-Panel-verified...

Technology and data teams at corporate banks implementing ISO 20022 message changes under the CPMI API harmonisation programme are increasingly using AI to draft message-schema change notes, generate API specification documents against CPMI recommendations, prepare data-model impact assessments on structured-address formats, populate engineering change-control tickets with regulator-stated cutover dates, and validate vendor-supplied implementation roadmaps against CPMI source. The RLB Specialist Panel tested how that AI usage performs against the regulator's own primary text on CPMI's October 2024 d224 report and the related CPMI Brief and speech series.

The audit surfaced four substantive failure modes that the AI subjects delivered with regulator-fluent confidence.

Stakeholder Taxonomy Fabrication and Fabricated Date-and-Format Commitment on CPMI API Harmonisation for Cross-Border Payments. Two frontier AI models tested by the RLB Specialist Panel returned confident, citable answers across the panel's CPMI substrate-bound question set on the October 2024 d224 report and the related CPMI Brief and speech series. The panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Across the 2 findings in this Technology & Data teams at Corporate Banking firms briefing, the AI subjects built a recommendation-by-recommendation stakeholder breakdown from category names rather than the regulator's actual recommendation text; introduced a specific November 2026 cutover commitment for structured ISO 20022 addresses that does not appear in the regulator's text.

An engineering change-control ticket that records a November 2026 CPMI structured-address cutover triggers a real implementation programme against a regulator commitment the regulator never issued. An API specification document that adopts an AI-fabricated per-recommendation stakeholder taxonomy mis-routes integration ownership against the 10 CPMI recommendations. A vendor-roadmap validation built on AI-asserted CPMI mandates accepts vendor commitments against an imaginary regulator baseline.

The findings are published with immutable RLB Citation IDs: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q008-Opus47, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q009-Sonnet46. The full audit is published at the CPMI API Harmonisation for Cross-Border Payments hub on RegLegBrief.com.

Sector: Corporate Banking and Dept: Risk INT BIS-CPMI

Corporate Banking Risk teams: documentation and reporting gaps possible from AI reading of CPMI Cross-Border API Harmonisation 2024

For Corporate Banking Risk teams working with Promoting the Harmonisation of Application Programming Interfaces to Enhance Cross-Border Payments: Recommendations and Toolkit: Specialist-Panel-verified findings on...

Risk leads at corporate banks running cross-border payments rails on the CPMI API harmonisation programme are increasingly using AI to update payment-risk dashboards with CPMI connectivity figures, draft enterprise-risk-assessment annexes on the SARB pre-validation workstream, prepare board-risk-appetite papers on Africa-corridor exposure, generate operational-risk metrics using fast payment system operator splits, and verify dated CPMI commitments against primary publications. The RLB Specialist Panel tested how that AI usage performs against the regulator's own primary text on CPMI's October 2024 d224 report and the related CPMI Brief and speech series.

The audit surfaced four substantive failure modes that the AI subjects delivered with regulator-fluent confidence.

Numeric Drift and False-Negative Availability Claim on CPMI API Harmonisation for Cross-Border Payments. Two frontier AI models tested by the RLB Specialist Panel returned confident, citable answers across the panel's CPMI substrate-bound question set on the October 2024 d224 report and the related CPMI Brief and speech series. The panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Across the 2 findings in this Risk teams at Corporate Banking firms briefing, the AI subjects returned a global fast payment system count of 57 sourced to the 2025 monitoring survey sample, when the authoritative CPMI figure is 70+; stated that the central-bank versus private operator split of global fast payment systems is not enumerated in public CPMI sources, when the November 2023 CPMI speech gives exact percentages.

A board-risk paper that records a CPMI cutover date the regulator never set is a factual error in a board-approved risk-appetite document. A risk dashboard that uses 57 rather than 70+ as the FPS connectivity baseline mis-sizes corridor exposure. An enterprise risk register entry recording 'no SARB pre-validation workstream identified' carries a verifiable error into a supervisory deliverable. The next supervisory testing on AI use in risk reporting will find these gaps.

The findings are published with immutable RLB Citation IDs: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q010-Opus47, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q010-Sonnet46. The full audit is published at the CPMI API Harmonisation for Cross-Border Payments hub on RegLegBrief.com.

↑ Back to top