AI Hallucination Research › Briefings

Briefings Blog

The running blog from the RLB Specialist Panel delves into real-world scenarios where the compliance, legal, or AI lab team interacts with frontier AI models under specific regulations. The blogs are anonymised to remove client-specific details and include insights from the RLB team analysing the hallucinations experienced in AI models while working on these cases. For example, when a model returns a confident answer that contradicts the regulator's primary text, such as a fabricated staff letter, a wrong appendix, or an inverted scope, these issues are discussed here. Each blog explains one set of findings and what it would have meant for the team that would have acted on it, sans this research initiative. This blog is frequently updated, a few times a day.

263 briefings in the archive · Subscribe via Atom: /briefings/feed.xml (this blog) · /feed.xml (all RegLegBrief publications)
Audience colours: AI Labs Practitioner (profession) Sector × Department
Audience
Jur.
Regulator
Profession
Sector
Dept
Range
Sort
Per page
Showing 5 of 263 · page 12 of 53
Saturday, 18 July 2026
Sector: Statutory Boards & Agencies and Dept: Legal INT BIS-CPMI

Statutory Boards & Agencies Legal teams: documentation and reporting gaps possible from AI reading of CPMI Cross-Border API Harmonisation 2024

For Statutory Boards & Agencies Legal teams working with Promoting the Harmonisation of Application Programming Interfaces to Enhance Cross-Border Payments: Recommendations and Toolkit: Specialist-Panel-verified...

Legal teams at statutory boards and public agencies engaging with the CPMI API harmonisation programme are increasingly using AI to draft legal memos on the agency's CPMI engagement position, prepare board-paper legal annexes on the SARB pre-validation workstream, generate scoping documents for inter-agency cooperation on the 10 CPMI recommendations, validate ISO 20022 structured-address commitments against regulator text, and produce horizon-scan summaries for senior officials. The RLB Specialist Panel tested how that AI usage performs against the regulator's own primary text on CPMI's October 2024 d224 report and the related CPMI Brief and speech series.

The audit surfaced four substantive failure modes that the AI subjects delivered with regulator-fluent confidence.

Source-Credit Fabrication and Stakeholder Taxonomy Fabrication on CPMI API Harmonisation for Cross-Border Payments. Two frontier AI models tested by the RLB Specialist Panel returned confident, citable answers across the panel's CPMI substrate-bound question set on the October 2024 d224 report and the related CPMI Brief and speech series. The panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Across the 2 findings in this Legal teams at Statutory Boards & Agencies briefing, the AI subjects downgraded a regulator-stated named partnership to a speculative hedge; built a recommendation-by-recommendation stakeholder breakdown from category names rather than the regulator's actual recommendation text.

A legal opinion that hedges the SARB pre-validation partnership as 'plausible but unverified' or that adopts an AI per-recommendation stakeholder taxonomy carries fabricated assignments into the agency's official record. A horizon-scan annex that misses the SARB-CPMI workstream positions the agency one step behind a published regulator-bilateral programme.

The findings are published with immutable RLB Citation IDs: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q007-Opus47, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q008-Opus47. The full audit is published at the CPMI API Harmonisation for Cross-Border Payments hub on RegLegBrief.com.

Sector: Statutory Boards & Agencies and Dept: Compliance INT BIS-CPMI

Statutory Boards & Agencies Compliance teams: documentation and reporting gaps possible from AI reading of CPMI Cross-Border API Harmonisation 2024

For Statutory Boards & Agencies Compliance teams working with Promoting the Harmonisation of Application Programming Interfaces to Enhance Cross-Border Payments: Recommendations and Toolkit: Specialist-Panel-verified...

Compliance teams at statutory boards and public agencies engaging with the CPMI API harmonisation programme for cross-border payments oversight are increasingly using AI to draft inter-agency briefing notes, prepare board-paper annexes on the SARB pre-validation workstream, generate regulatory horizon-scan summaries on the 10 CPMI recommendations for senior officials, update programme-level CPMI mapping documents, and verify ISO 20022 commitments against regulator-issued source text. The RLB Specialist Panel tested how that AI usage performs against the regulator's own primary text on CPMI's October 2024 d224 report and the related CPMI Brief and speech series.

The audit surfaced four substantive failure modes that the AI subjects delivered with regulator-fluent confidence.

Confident Denial and Stakeholder Taxonomy Fabrication on CPMI API Harmonisation for Cross-Border Payments. Two frontier AI models tested by the RLB Specialist Panel returned confident, citable answers across the panel's CPMI substrate-bound question set on the October 2024 d224 report and the related CPMI Brief and speech series. The panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Across the 2 findings in this Compliance teams at Statutory Boards & Agencies briefing, the AI subjects denied that any pilot partner has been named for the CPMI pre-validation API recommendation; built a recommendation-by-recommendation stakeholder breakdown from category names rather than the regulator's actual recommendation text.

An inter-agency briefing note that records 'no jurisdictional partner identified' on the CPMI pre-validation workstream embeds a verifiable factual error into official correspondence. A senior-official horizon scan that quotes a fabricated November 2026 structured-ISO-20022 cutover commits the agency's position to a regulator commitment the regulator never made.

The findings are published with immutable RLB Citation IDs: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q007-Sonnet46, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q008-Opus47. The full audit is published at the CPMI API Harmonisation for Cross-Border Payments hub on RegLegBrief.com.

Sector: Software & SaaS and Dept: Technology & Data INT BIS-CPMI

Software & SaaS Technology & Data teams: documentation and reporting gaps possible from AI reading of CPMI Cross-Border API Harmonisation 2024

For Software & SaaS Technology & Data teams working with Promoting the Harmonisation of Application Programming Interfaces to Enhance Cross-Border Payments: Recommendations and Toolkit: Specialist-Panel-verified...

Technology and data teams at software and SaaS firms implementing ISO 20022 message-handling for cross-border payments platforms aligned to the CPMI API harmonisation programme are increasingly using AI to draft message-schema change notes, generate API specification documents against CPMI recommendations, prepare data-model impact assessments on structured-address formats, populate engineering change-control tickets with regulator-stated cutover dates, and validate vendor-supplied implementation roadmaps against CPMI source. The RLB Specialist Panel tested how that AI usage performs against the regulator's own primary text on CPMI's October 2024 d224 report and the related CPMI Brief and speech series.

The audit surfaced four substantive failure modes that the AI subjects delivered with regulator-fluent confidence.

Stakeholder Taxonomy Fabrication and Fabricated Date-and-Format Commitment on CPMI API Harmonisation for Cross-Border Payments. Two frontier AI models tested by the RLB Specialist Panel returned confident, citable answers across the panel's CPMI substrate-bound question set on the October 2024 d224 report and the related CPMI Brief and speech series. The panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Across the 2 findings in this Technology & Data teams at Software & SaaS firms briefing, the AI subjects built a recommendation-by-recommendation stakeholder breakdown from category names rather than the regulator's actual recommendation text; introduced a specific November 2026 cutover commitment for structured ISO 20022 addresses that does not appear in the regulator's text.

An engineering change-control ticket that records a November 2026 CPMI structured-address cutover triggers a real implementation programme against a regulator commitment the regulator never issued. An API specification document built on an AI-fabricated per-recommendation stakeholder taxonomy mis-routes integration ownership across the platform engineering team.

The findings are published with immutable RLB Citation IDs: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q008-Opus47, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q009-Sonnet46. The full audit is published at the CPMI API Harmonisation for Cross-Border Payments hub on RegLegBrief.com.

Sector: Software & SaaS and Dept: Compliance INT BIS-CPMI

Software & SaaS Compliance teams: documentation and reporting gaps possible from AI reading of CPMI Cross-Border API Harmonisation 2024

For Software & SaaS Compliance teams working with Promoting the Harmonisation of Application Programming Interfaces to Enhance Cross-Border Payments: Recommendations and Toolkit: Specialist-Panel-verified findings on...

Compliance officers at software and SaaS firms building cross-border payments platforms aligned to the CPMI API harmonisation programme are increasingly using AI to draft customer-facing CPMI alignment statements, generate regulatory-horizon-scan summaries for client compliance teams, prepare board-paper compliance annexes on the SARB pre-validation workstream, update product-level CPMI mapping documents against the 10 recommendations, and validate ISO 20022 address-format commitments against regulator-issued source text. The RLB Specialist Panel tested how that AI usage performs against the regulator's own primary text on CPMI's October 2024 d224 report and the related CPMI Brief and speech series.

The audit surfaced four substantive failure modes that the AI subjects delivered with regulator-fluent confidence.

Stakeholder Taxonomy Fabrication and Fabricated Date-and-Format Commitment on CPMI API Harmonisation for Cross-Border Payments. Two frontier AI models tested by the RLB Specialist Panel returned confident, citable answers across the panel's CPMI substrate-bound question set on the October 2024 d224 report and the related CPMI Brief and speech series. The panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Across the 2 findings in this Compliance teams at Software & SaaS firms briefing, the AI subjects built a recommendation-by-recommendation stakeholder breakdown from category names rather than the regulator's actual recommendation text; introduced a specific November 2026 cutover commitment for structured ISO 20022 addresses that does not appear in the regulator's text.

A customer-facing CPMI alignment statement that records a November 2026 structured-ISO-20022 cutover as a CPMI mandate gives the customer's procurement and compliance team a regulator commitment that does not exist. A product-level CPMI mapping document built on AI per-recommendation stakeholder taxonomy carries fabricated assignments into the platform's roadmap and into customer-facing collateral.

The findings are published with immutable RLB Citation IDs: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q008-Opus47, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q009-Sonnet46. The full audit is published at the CPMI API Harmonisation for Cross-Border Payments hub on RegLegBrief.com.

Sector: Retail Banking and Dept: Technology & Data INT BIS-CPMI

Retail Banking Technology & Data teams: documentation and reporting gaps possible from AI reading of CPMI Cross-Border API Harmonisation 2024

For Retail Banking Technology & Data teams working with Promoting the Harmonisation of Application Programming Interfaces to Enhance Cross-Border Payments: Recommendations and Toolkit: Specialist-Panel-verified...

Technology and data teams at retail banks implementing ISO 20022 message changes for cross-border consumer payments under the CPMI API harmonisation programme are increasingly using AI to draft message-schema change notes, generate API specification documents against CPMI recommendations, prepare data-model impact assessments on structured-address formats, populate engineering change-control tickets with regulator-stated cutover dates, and validate vendor-supplied implementation roadmaps against CPMI source. The RLB Specialist Panel tested how that AI usage performs against the regulator's own primary text on CPMI's October 2024 d224 report and the related CPMI Brief and speech series.

The audit surfaced four substantive failure modes that the AI subjects delivered with regulator-fluent confidence.

Stakeholder Taxonomy Fabrication and Fabricated Date-and-Format Commitment on CPMI API Harmonisation for Cross-Border Payments. Two frontier AI models tested by the RLB Specialist Panel returned confident, citable answers across the panel's CPMI substrate-bound question set on the October 2024 d224 report and the related CPMI Brief and speech series. The panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Across the 2 findings in this Technology & Data teams at Retail Banking firms briefing, the AI subjects built a recommendation-by-recommendation stakeholder breakdown from category names rather than the regulator's actual recommendation text; introduced a specific November 2026 cutover commitment for structured ISO 20022 addresses that does not appear in the regulator's text.

An engineering change-control ticket that records a November 2026 CPMI structured-address cutover triggers a real implementation programme against a regulator commitment the regulator never issued. An API specification document built on an AI-fabricated per-recommendation stakeholder taxonomy mis-routes integration ownership.

The findings are published with immutable RLB Citation IDs: RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q008-Opus47, RLB-H-INT-BIS-CPMI-API-HARMONISATION-CROSS-BORDER-2024-Q009-Sonnet46. The full audit is published at the CPMI API Harmonisation for Cross-Border Payments hub on RegLegBrief.com.

↑ Back to top