AI Hallucination Research › Briefings

Briefings Blog

The running blog from the RLB Specialist Panel delves into real-world scenarios where the compliance, legal, or AI lab team interacts with frontier AI models under specific regulations. The blogs are anonymised to remove client-specific details and include insights from the RLB team analysing the hallucinations experienced in AI models while working on these cases. For example, when a model returns a confident answer that contradicts the regulator's primary text, such as a fabricated staff letter, a wrong appendix, or an inverted scope, these issues are discussed here. Each blog explains one set of findings and what it would have meant for the team that would have acted on it, sans this research initiative. This blog is frequently updated, a few times a day.

263 briefings in the archive · Subscribe via Atom: /briefings/feed.xml (this blog) · /feed.xml (all RegLegBrief publications)
Audience colours: AI Labs Practitioner (profession) Sector × Department
Audience
Jur.
Regulator
Profession
Sector
Dept
Range
Sort
Per page
Showing 5 of 263 · page 16 of 53
Wednesday, 15 July 2026
Sector: Payment Institutions and Dept: Compliance INT BIS-CPMI

Payment Institutions Compliance teams: documentation and reporting gaps possible from AI reading of CPMI Cross-Border API Harmonisation 2024

For Payment Institutions Compliance teams working with Promoting the Harmonisation of Application Programming Interfaces to Enhance Cross-Border Payments: Recommendations and Toolkit: Specialist-Panel-verified...

Compliance teams at payment institutions operating cross-border rails on the CPMI API harmonisation programme are increasingly relying on AI to update onboarding checklists for correspondent partners, generate sanctions and AML programme appendices on the 10 CPMI recommendations, prepare regulatory horizon scans on the SARB pre-validation workstream, validate ISO 20022 address-format commitments against regulator-issued source text, and draft board-level compliance papers on cross-border programme exposures. The RLB Specialist Panel tested how that AI usage performs against the regulator's own primary text on CPMI's October 2024 d224 report and the related CPMI Brief and speech series.

The audit surfaced four substantive failure modes that the AI subjects delivered with regulator-fluent confidence.

Confident Denial, Stakeholder Taxonomy Fabrication and Fabricated Date-and-Format Commitment on CPMI API Harmonisation for Cross-Border Payments. Two frontier AI models tested by the RLB Specialist Panel returned confident, citable answers across the panel's CPMI substrate-bound question set on the October 2024 d224 report and the related CPMI Brief and speech series. The panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Across the 3 findings in this Compliance teams at Payment Institutions briefing, the AI subjects denied that any pilot partner has been named for the CPMI pre-validation API recommendation; built a recommendation-by-recommendation stakeholder breakdown from category names rather than the regulator's actual recommendation text; introduced a specific November 2026 cutover commitment for structured ISO 20022 addresses that does not appear in the regulator's text.

A regulatory horizon scan that records 'no jurisdictional partner identified' on the CPMI pre-validation workstream when SARB is in fact named is a verifiable factual error in a supervisory deliverable. A board paper that quotes a November 2026 structured-ISO-20022 cutover as a CPMI mandate cites a regulator commitment that does not exist. A correspondent-onboarding stakeholder mapping built on AI taxonomy outputs carries fabricated assignments forward into compliance scoping. Supervisory testing on AI use in compliance is now active across major regulators.

The findings are published with immutable RLB Citation IDs: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q007-Sonnet46, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q008-Opus47, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q009-Sonnet46. The full audit is published at the CPMI API Harmonisation for Cross-Border Payments hub on RegLegBrief.com.

Sector: Corporate Banking and Dept: Compliance INT BIS-CPMI

Corporate Banking Compliance teams: documentation and reporting gaps possible from AI reading of CPMI Cross-Border API Harmonisation 2024

For Corporate Banking Compliance teams working with Promoting the Harmonisation of Application Programming Interfaces to Enhance Cross-Border Payments: Recommendations and Toolkit: Specialist-Panel-verified findings...

Compliance officers at corporate banks operating cross-border payments rails on the CPMI API harmonisation programme are increasingly relying on AI to update onboarding checklists for new correspondent counterparties, generate trade-monitoring rule bulletins on the SARB pre-validation workstream, update sanctions and AML programme appendices on the 10 CPMI recommendations, draft board-level horizon-scan papers, and verify ISO 20022 address-format commitments against regulator-issued source text. The RLB Specialist Panel tested how that AI usage performs against the regulator's own primary text on CPMI's October 2024 d224 report and the related CPMI Brief and speech series.

The audit surfaced four substantive failure modes that the AI subjects delivered with regulator-fluent confidence.

Confident Denial, Stakeholder Taxonomy Fabrication and Fabricated Date-and-Format Commitment on CPMI API Harmonisation for Cross-Border Payments. Two frontier AI models tested by the RLB Specialist Panel returned confident, citable answers across the panel's CPMI substrate-bound question set on the October 2024 d224 report and the related CPMI Brief and speech series. The panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Across the 3 findings in this Compliance teams at Corporate Banking firms briefing, the AI subjects denied that any pilot partner has been named for the CPMI pre-validation API recommendation; built a recommendation-by-recommendation stakeholder breakdown from category names rather than the regulator's actual recommendation text; introduced a specific November 2026 cutover commitment for structured ISO 20022 addresses that does not appear in the regulator's text.

A regulatory horizon scan that records 'no jurisdictional partner identified' on the CPMI pre-validation workstream when SARB is in fact the named partner is now a verifiable factual error on a supervisory deliverable. A November 2026 structured-ISO-20022-address cutover commitment that appears in a board paper as a CPMI mandate is a fabricated mandate quoted as if regulator-issued. A correspondent-banking stakeholder taxonomy lifted from AI output and pasted into the firm's scoping document carries fabricated assignments forward.

The next FCA, OCC or MAS examiner spot-check on AI use in compliance reads the memo, runs the same query, and the factual gap becomes a documented control finding.

The findings are published with immutable RLB Citation IDs: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q007-Sonnet46, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q008-Opus47, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q009-Sonnet46. The full audit is published at the CPMI API Harmonisation for Cross-Border Payments hub on RegLegBrief.com.

Practitioner: Financial Advisers INT BIS-CPMI

Financial Advisers: AI summaries of CPMI Cross-Border API Harmonisation 2024 may understate professional obligations

For Financial Advisers working with Promoting the Harmonisation of Application Programming Interfaces to Enhance Cross-Border Payments: Recommendations and Toolkit: where Specialist-Panel-verified divergences between...

Financial advisers tracking CPMI's API harmonisation programme for cross-border payments are increasingly using AI to compile fast payment system landscape data for client market briefings, prepare central-bank-versus-private operator splits for institutional investor decks, draft horizon-scan summaries on the SARB pre-validation workstream, generate strategy memos on the 10 CPMI recommendations, and verify topline FPS counts and connectivity figures against the regulator's published statements. The RLB Specialist Panel tested how that AI usage performs against the regulator's own primary text on CPMI's October 2024 d224 report and the related CPMI Brief and speech series.

The audit surfaced four substantive failure modes that the AI subjects delivered with regulator-fluent confidence.

Numeric Drift and False-Negative Availability Claim on CPMI API Harmonisation for Cross-Border Payments. Two frontier AI models tested by the RLB Specialist Panel returned confident, citable answers across the panel's CPMI substrate-bound question set on the October 2024 d224 report and the related CPMI Brief and speech series. The panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Across the 2 findings in this Financial Advisers briefing, the AI subjects returned a global fast payment system count of 57 sourced to the 2025 monitoring survey sample, when the authoritative CPMI figure is 70+; stated that the central-bank versus private operator split of global fast payment systems is not enumerated in public CPMI sources, when the November 2023 CPMI speech gives exact percentages.

A market briefing that quotes a global fast payment system count of 57, sourced to the 2025 CPMI monitoring survey sample, understates global connectivity by roughly 20 percent against the regulator's stated 70+ figure. A research memo that records the central-bank versus private operator split as 'not available in public CPMI sources' misses an explicit 40 percent / 35 percent split that the November 2023 CPMI speech records.

A client-facing strategy note that frames the SARB pre-validation workstream as 'no jurisdictional partner identified' positions the firm as one step behind a published regulator-bilateral workstream the next time the client researches the same question.

The findings are published with immutable RLB Citation IDs: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q010-Opus47, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q010-Sonnet46. The full audit is published at the CPMI API Harmonisation for Cross-Border Payments hub on RegLegBrief.com.

Practitioner: Lawyers INT BIS-CPMI

Lawyers: AI summaries of CPMI Cross-Border API Harmonisation 2024 may understate professional obligations

For Lawyers working with Promoting the Harmonisation of Application Programming Interfaces to Enhance Cross-Border Payments: Recommendations and Toolkit: where Specialist-Panel-verified divergences between frontier...

Lawyers advising on the CPMI API harmonisation recommendations for cross-border payments are increasingly using AI to draft client memos on each of the 10 recommendations, map recommendation-by-recommendation stakeholder obligations onto their client books, prepare partner-level briefings on the South African Reserve Bank pre-validation workstream, validate ISO 20022 address-format commitments against the regulator-issued source text, and generate horizon-scan summaries for client risk committees. The RLB Specialist Panel tested how that AI usage performs against the regulator's own primary text on CPMI's October 2024 d224 report and the related CPMI Brief and speech series.

The audit surfaced four substantive failure modes that the AI subjects delivered with regulator-fluent confidence.

Source-Credit Fabrication, Confident Denial, Stakeholder Taxonomy Fabrication and Fabricated Date-and-Format Commitment on CPMI API Harmonisation for Cross-Border Payments. Two frontier AI models tested by the RLB Specialist Panel returned confident, citable answers across the panel's CPMI substrate-bound question set on the October 2024 d224 report and the related CPMI Brief and speech series. The panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Across the 4 findings in this Lawyers briefing, the AI subjects downgraded a regulator-stated named partnership to a speculative hedge; denied that any pilot partner has been named for the CPMI pre-validation API recommendation; built a recommendation-by-recommendation stakeholder breakdown from category names rather than the regulator's actual recommendation text; introduced a specific November 2026 cutover commitment for structured ISO 20022 addresses that does not appear in the regulator's text.

A partner-level memo that says SARB is not a named CPMI pre-validation partner embeds a verifiable factual error into an opinion deliverable. A scoping document that adopts a fabricated stakeholder taxonomy assigns the wrong recommendation owners to client product workstreams. A client briefing that quotes a November 2026 structured-address cutover as if it were regulator language commits the firm to a mandate the regulator never issued. Each error is durable: it travels into client files, engagement letters, internal know-how and partner-level deliverables, and is hard to walk back without quietly issuing a correction.

The findings are published with immutable RLB Citation IDs: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q007-Opus47, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q007-Sonnet46, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q008-Opus47, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q009-Sonnet46. The full audit is published at the CPMI API Harmonisation for Cross-Border Payments hub on RegLegBrief.com.

Tuesday, 14 July 2026
Sector: Payment Institutions and Dept: Legal INT BIS-CPMI

Payment Institutions Legal teams: documentation and reporting gaps possible from AI reading of PFMI Level 3 General Business Risk (2025)

For Payment Institutions Legal teams working with Implementation Monitoring of the PFMI: Level 3 Assessment on General Business Risks: Specialist-Panel-verified findings on where AI summaries diverge from the...

Legal teams at payment institutions are increasingly using AI to draft methodology notes on CPMI-IOSCO oversight cycles, validate procedural-fact statements in regulatory submissions, prepare counterparty disclosure summaries on supervisory engagement, and produce internal advisory notes on the November 2025 CPMI-IOSCO Level 3 cycle. The November 2025 CPMI-IOSCO Level 3 assessment of general business risk, recorded under PFMI Principle 15, is the supervisory exercise most directly bearing on this practice area in the current cycle.

As AI tooling enters the drafting layer, the question is no longer whether AI-assisted work product reaches client-facing deliverables; it is whether the work product reaches them with the regulator-text fidelity that PI Legal teams need.

The RLB Specialist Panel tested two frontier AI models on a question set covering the LNAFE quantitative floor, the Basel/CRD equity carve-out condition, and the November 2025 assessment lifecycle. The Panel records 1 finding on this audience-specific cell. The failure pattern in scope: Supervisory-timeline truncation, dropping the validation phase. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

For PI Legal teams the operational consequence is direct. An internal advisory note that records the CPMI-IOSCO Level 3 assessment as a 2023-2024 exercise misstates the supervisory lifecycle, and any regulatory submission, board pack, or counterparty memorandum built on the note inherits the same factual inaccuracy.

PFMI Principle 15 is one of the cleanest primary-source surfaces in the cross-border CCP and CSD universe: a Key Consideration cited in a deliverable is either the right KC or it is not; a quantitative floor is either the regulator's text or it is not; an assessment-period date range is either accurate or it is not. Each is recoverable on a routine line-by-line read.

The audit's 1 finding for this cell carry immutable RLB Citation IDs and are bound to verbatim regulator-issued source text held by the RLB Specialist Panel: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q005-Sonnet46. The full audit on the November 2025 CPMI-IOSCO Level 3 assessment is published at the PFMI Level 3 General Business Risk hub on RegLegBrief.com.

↑ Back to top