AI Hallucination Research › Briefings

Briefings Blog

The running blog from the RLB Specialist Panel delves into real-world scenarios where the compliance, legal, or AI lab team interacts with frontier AI models under specific regulations. The blogs are anonymised to remove client-specific details and include insights from the RLB team analysing the hallucinations experienced in AI models while working on these cases. For example, when a model returns a confident answer that contradicts the regulator's primary text, such as a fabricated staff letter, a wrong appendix, or an inverted scope, these issues are discussed here. Each blog explains one set of findings and what it would have meant for the team that would have acted on it, sans this research initiative. This blog is frequently updated, a few times a day.

263 briefings in the archive · Subscribe via Atom: /briefings/feed.xml (this blog) · /feed.xml (all RegLegBrief publications)
Audience colours: AI Labs Practitioner (profession) Sector × Department
Audience
Jur.
Regulator
Profession
Sector
Dept
Range
Sort
Per page
Showing 5 of 263 · page 4 of 53
Monday, 19 October 2026
Sector: Corporate Banking and Dept: Operations INT BIS-CPMI

Corporate Banking Operations teams: documentation and reporting gaps possible from AI reading of CPMI ISO 20022 Harmonisation (2026 update)

For Corporate Banking Operations teams working with Harmonised ISO 20022 Data Requirements for Enhancing Cross-Border Payments - Updated Report: Specialist-Panel-verified findings on where AI summaries diverge from...

Operations teams at Corporate Banking firms implementing the CPMI Harmonised ISO 20022 Data Requirements (Updated Report) are increasingly using AI to configure Fedwire payment-message templates, generate operational specifications for correspondent-bank onboarding, and document address-field handling logic. The same tools draft implementation guidance for cross-border payment migration projects.

Two frontier AI models tested by the RLB Specialist Panel on the workflows corporate-banking operations teams use to support advice on the CPMI Harmonised ISO 20022 Data Requirements (Updated Report) produced one discrete hallucination bound to regulator-issued source text. The Panel records a single recurring failure class: Schema Over-Specification across the set. Questions were prepared by the Specialist Panel based on real practical AI usage in the workflows corporate-banking operations teams use AI for, and each finding is bound to verbatim regulator-issued source text held as primary substrate.

For Operations teams at Corporate Banking firms, each hallucination has a direct operational consequence in the message template, correspondent-onboarding spec, or implementation guidance. The Panel's testing surfaces Fedwire hybrid postal address schema over-specification. Where these errors flow into a deliverable, the exposure is address-field rejects on Fedwire at go-live, remediation across origination systems, and re-run of bilateral UAT cycles. The pattern is uniform across the set: the AI returns a confident, sourced-looking answer that conflicts in a load-bearing specific with the regulator's verbatim text, and the error survives a first-pass review precisely because the surface form is plausible.

The Panel records each hallucination with the regulator's primary substrate held as the anchor, so the corrective text is available alongside the failure.

The Specialist Panel records the citation IDs as follows: RLB-H-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q010-Opus47 (Claude Opus 4.7 (web search on), Schema Over-Specification). Each citation links to the verbatim regulator-issued source text, the tested AI question, and the recorded AI response, so the Panel's assessment is traceable end to end. For operations teams at corporate banking firms, the citation IDs operate as a reference index: when an AI answer in the working draft matches a known Panel finding, the cited regulator text is already available as the corrective anchor.

The full per-finding analysis cards, including the audience-specific impact statement, sit on the cell's detail surface for sign-off use.

Sector: Retail Banking and Dept: Technology & Data INT BIS-CPMI

Retail Banking Technology & Data teams: documentation and reporting gaps possible from AI reading of CPMI ISO 20022 Harmonisation (2026 update)

For Retail Banking Technology & Data teams working with Harmonised ISO 20022 Data Requirements for Enhancing Cross-Border Payments - Updated Report: Specialist-Panel-verified findings on where AI summaries diverge...

Technology & Data teams at Retail Banking firms implementing the CPMI Harmonised ISO 20022 Data Requirements (Updated Report) are increasingly using AI to design message-schema validators, generate field-mapping logic for Fedwire and CHAPS rails, and draft API documentation for connected clients. The same tools build address-field parsing components for payment engines.

Two frontier AI models tested by the RLB Specialist Panel on the workflows retail-banking technology and data teams use to support advice on the CPMI Harmonised ISO 20022 Data Requirements (Updated Report) produced one discrete hallucination bound to regulator-issued source text. The Panel records a single recurring failure class: Schema Over-Specification across the set. Questions were prepared by the Specialist Panel based on real practical AI usage in the workflows retail-banking technology and data teams use AI for, and each finding is bound to verbatim regulator-issued source text held as primary substrate.

For Technology & Data teams at Retail Banking firms, each hallucination has a direct operational consequence in the message-schema validator, field-mapping component, or API specification. The Panel's testing surfaces Fedwire hybrid postal address schema over-specification. Where these errors flow into a deliverable, the exposure is non-compliant Fedwire messages, rejected transactions at clearing, and a rework cycle spanning data-mapping and payment-engine logic. The pattern is uniform across the set: the AI returns a confident, sourced-looking answer that conflicts in a load-bearing specific with the regulator's verbatim text, and the error survives a first-pass review precisely because the surface form is plausible.

The Panel records each hallucination with the regulator's primary substrate held as the anchor, so the corrective text is available alongside the failure.

The Specialist Panel records the citation IDs as follows: RLB-H-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q010-Opus47 (Claude Opus 4.7 (web search on), Schema Over-Specification). Each citation links to the verbatim regulator-issued source text, the tested AI question, and the recorded AI response, so the Panel's assessment is traceable end to end. For technology & data teams at retail banking firms, the citation IDs operate as a reference index: when an AI answer in the working draft matches a known Panel finding, the cited regulator text is already available as the corrective anchor.

The full per-finding analysis cards, including the audience-specific impact statement, sit on the cell's detail surface for sign-off use.

Sector: Payment Institutions and Dept: Technology & Data INT BIS-CPMI

Payment Institutions Technology & Data teams: documentation and reporting gaps possible from AI reading of CPMI ISO 20022 Harmonisation (2026 update)

For Payment Institutions Technology & Data teams working with Harmonised ISO 20022 Data Requirements for Enhancing Cross-Border Payments - Updated Report: Specialist-Panel-verified findings on where AI summaries...

Technology & Data teams at Payment Institutions building cross-border payment infrastructure under the CPMI Harmonised ISO 20022 Data Requirements (Updated Report) are increasingly using AI to design address parsers, build message-schema components for Fedwire-connected rails, and generate API documentation for connected clients. The same tools draft technical specifications for white-label cross-border payment products.

Two frontier AI models tested by the RLB Specialist Panel on the workflows payment-institution technology and data teams use to support advice on the CPMI Harmonised ISO 20022 Data Requirements (Updated Report) produced one discrete hallucination bound to regulator-issued source text. The Panel records a single recurring failure class: Schema Over-Specification across the set. Questions were prepared by the Specialist Panel based on real practical AI usage in the workflows payment-institution technology and data teams use AI for, and each finding is bound to verbatim regulator-issued source text held as primary substrate.

For Technology & Data teams at Payment Institutions, each hallucination has a direct operational consequence in the address parser, message-schema component, or API specification. The Panel's testing surfaces Fedwire hybrid postal address schema over-specification. Where these errors flow into a deliverable, the exposure is non-compliant Fedwire messages flowing through sponsor-bank governance, multi-team remediation across release cycles, and a contractual breach finding with the sponsor bank.

The pattern is uniform across the set: the AI returns a confident, sourced-looking answer that conflicts in a load-bearing specific with the regulator's verbatim text, and the error survives a first-pass review precisely because the surface form is plausible. The Panel records each hallucination with the regulator's primary substrate held as the anchor, so the corrective text is available alongside the failure.

The Specialist Panel records the citation IDs as follows: RLB-H-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q010-Opus47 (Claude Opus 4.7 (web search on), Schema Over-Specification). Each citation links to the verbatim regulator-issued source text, the tested AI question, and the recorded AI response, so the Panel's assessment is traceable end to end. For technology & data teams at payment institutions, the citation IDs operate as a reference index: when an AI answer in the working draft matches a known Panel finding, the cited regulator text is already available as the corrective anchor.

The full per-finding analysis cards, including the audience-specific impact statement, sit on the cell's detail surface for sign-off use.

Sector: Statutory Boards & Agencies and Dept: Compliance INT BIS-CPMI

Statutory Boards & Agencies Compliance teams: documentation and reporting gaps possible from AI reading of CPMI ISO 20022 Harmonisation (2026 update)

For Statutory Boards & Agencies Compliance teams working with Harmonised ISO 20022 Data Requirements for Enhancing Cross-Border Payments - Updated Report: Specialist-Panel-verified findings on where AI summaries...

Compliance teams at Statutory Boards & Agencies responsible for payments infrastructure exposure to the CPMI Harmonised ISO 20022 Data Requirements (Updated Report) are increasingly using AI to draft formal regulatory submissions to central banks or supranational bodies, generate board papers on payments infrastructure benchmarks, and prepare gap-analysis documents against peer adoption rates. The same tools validate citation accuracy in finance-ministry-facing briefings.

Two frontier AI models tested by the RLB Specialist Panel on the workflows statutory-agency compliance officers use to support advice on the CPMI Harmonised ISO 20022 Data Requirements (Updated Report) produced two discrete hallucinations bound to regulator-issued source text. The Panel records a single recurring failure class: Numeric Drift across the set. Questions were prepared by the Specialist Panel based on real practical AI usage in the workflows statutory-agency compliance officers use AI for, and each finding is bound to verbatim regulator-issued source text held as primary substrate.

For Compliance teams at Statutory Boards & Agencies, each hallucination has a direct operational consequence in the regulatory submission, gap-analysis document, or finance-ministry briefing. The Panel's testing surfaces ISO 20022 adoption rate conflation (RTGS vs faster payments), and ISO 20022 adoption rate conflation (RTGS vs faster payments). Where these errors flow into a deliverable, the exposure is a credibility-damaging factual discrepancy in a formal submission, a forced retraction or amended filing, and a misstated baseline for gap analysis presented to the governing board.

The pattern is uniform across the set: the AI returns a confident, sourced-looking answer that conflicts in a load-bearing specific with the regulator's verbatim text, and the error survives a first-pass review precisely because the surface form is plausible. The Panel records each hallucination with the regulator's primary substrate held as the anchor, so the corrective text is available alongside the failure.

The Specialist Panel records the citation IDs as follows: RLB-H-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006-Opus47 (Claude Opus 4.7 (web search on), Numeric Drift); RLB-H-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006-Sonnet46 (Claude Sonnet 4.6 (web search on), Numeric Drift). Each citation links to the verbatim regulator-issued source text, the tested AI question, and the recorded AI response, so the Panel's assessment is traceable end to end. For compliance teams at statutory boards & agencies, the citation IDs operate as a reference index: when an AI answer in the working draft matches a known Panel finding, the cited regulator text is already available as the corrective anchor.

The full per-finding analysis cards, including the audience-specific impact statement, sit on the cell's detail surface for sign-off use.

Sector: Retail Banking and Dept: Product & Business Development INT BIS-CPMI

Retail Banking Product & Business Development teams: documentation and reporting gaps possible from AI reading of CPMI ISO 20022 Harmonisation (2026 update)

For Retail Banking Product & Business Development teams working with Harmonised ISO 20022 Data Requirements for Enhancing Cross-Border Payments - Updated Report: Specialist-Panel-verified findings on where AI...

Product & Business Development teams at Retail Banking firms shaping cross-border payment propositions under the CPMI Harmonised ISO 20022 Data Requirements (Updated Report) are increasingly using AI to build corridor strategy and partner-pitch decks, draft investor briefings on payments infrastructure positioning, and prepare product approval papers that cite peer-system adoption data. The same tools generate competitive-positioning claims in regulator-facing product narratives.

Two frontier AI models tested by the RLB Specialist Panel on the workflows retail-banking product and business-development teams use to support advice on the CPMI Harmonised ISO 20022 Data Requirements (Updated Report) produced two discrete hallucinations bound to regulator-issued source text. The Panel records a single recurring failure class: Numeric Drift across the set. Questions were prepared by the Specialist Panel based on real practical AI usage in the workflows retail-banking product and business-development teams use AI for, and each finding is bound to verbatim regulator-issued source text held as primary substrate.

For Product & Business Development teams at Retail Banking firms, each hallucination has a direct operational consequence in the product approval paper, investor briefing, or competitive-positioning narrative. The Panel's testing surfaces ISO 20022 adoption rate conflation (RTGS vs faster payments), and ISO 20022 adoption rate conflation (RTGS vs faster payments). Where these errors flow into a deliverable, the exposure is investor-facing misstatement, product strategy built on a false market assumption, and credibility damage in partner conversations.

The pattern is uniform across the set: the AI returns a confident, sourced-looking answer that conflicts in a load-bearing specific with the regulator's verbatim text, and the error survives a first-pass review precisely because the surface form is plausible. The Panel records each hallucination with the regulator's primary substrate held as the anchor, so the corrective text is available alongside the failure.

The Specialist Panel records the citation IDs as follows: RLB-H-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006-Opus47 (Claude Opus 4.7 (web search on), Numeric Drift); RLB-H-INT-BIS-CPMI-ISO-20022-HARMONISATION-UPDATED-2026-Q006-Sonnet46 (Claude Sonnet 4.6 (web search on), Numeric Drift). Each citation links to the verbatim regulator-issued source text, the tested AI question, and the recorded AI response, so the Panel's assessment is traceable end to end. For product & business development teams at retail banking firms, the citation IDs operate as a reference index: when an AI answer in the working draft matches a known Panel finding, the cited regulator text is already available as the corrective anchor.

The full per-finding analysis cards, including the audience-specific impact statement, sit on the cell's detail surface for sign-off use.

↑ Back to top