AI Hallucination Research › Briefings

Briefings Blog

The running blog from the RLB Specialist Panel delves into real-world scenarios where the compliance, legal, or AI lab team interacts with frontier AI models under specific regulations. The blogs are anonymised to remove client-specific details and include insights from the RLB team analysing the hallucinations experienced in AI models while working on these cases. For example, when a model returns a confident answer that contradicts the regulator's primary text, such as a fabricated staff letter, a wrong appendix, or an inverted scope, these issues are discussed here. Each blog explains one set of findings and what it would have meant for the team that would have acted on it, sans this research initiative. This blog is frequently updated, a few times a day.

263 briefings in the archive · Subscribe via Atom: /briefings/feed.xml (this blog) · /feed.xml (all RegLegBrief publications)
Audience colours: AI Labs Practitioner (profession) Sector × Department
Audience
Jur.
Regulator
Profession
Sector
Dept
Range
Sort
Per page
Showing 5 of 263 · page 1 of 53
Thursday, 22 October 2026
Sector: Investment Banking and Dept: Compliance INT BIS-CPMI

Investment Banking Compliance teams: documentation and reporting gaps possible from AI reading of CPMI-IOSCO Cyber Resilience for FMIs (2016)

For Investment Banking Compliance teams working with Guidance on Cyber Resilience for Financial Market Infrastructures (CPMI-IOSCO 2016): Specialist-Panel-verified findings on where AI summaries diverge from the...

Compliance teams at investment banks operating as participants in CCPs and CSDs, and as direct counterparties to systemically important FMIs, are increasingly relying on AI to update FMI-participant onboarding records, generate cyber-incident notification briefings, and verify cyber-supervisory expectations against the CPMI-IOSCO 2016 source text. In practice, AI is used to update FMI participation onboarding records for clearing and settlement counterparties, generate cyber-incident notification briefings for trading-desk and prime-brokerage units, validate cyber-supervisory expectations against CPMI-IOSCO 2016 source text, and prepare compliance reports on cyber exposure through CCPs and CSDs.

That workflow places the regulator-issued text of the 2016 guidance, its 2018-2020 derivative standards, and its current operative status at the centre of every AI-generated deliverable for investment banking compliance teams.

Two frontier AI models tested by the RegLeg Brief Specialist Panel produced confident, citable reconstructions of the CPMI-IOSCO 2016 Cyber Guidance (June 2016) that the regulator-issued primary text directly contradicts across nine findings spanning four failure classes: Source-Credit Fabrication (an asserted NIST Cybersecurity Framework citation that the 2016 guidance does not contain), Misattribution (the slogan 'secure the periphery, protect the core' located inside CPMI-IOSCO 2016 guidance or its 2018 wholesale-payments paper rather than the actual 2018 speech source), Anachronistic Cross-Reference (the 2016 guidance asserted as definitionally aligned with the November 2018 FSB Cyber Lexicon and the October 2020 FSB Effective Practices that postdate it), and Outdated Standing Claim (the 2016 guidance presented as the unchanged operative standard when CPMI-IOSCO has issued a May 2026 consultative document under active revision).

Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows investment banking compliance teams use AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

For investment-banking compliance teams, the failure pattern is operationally consequential. A counterparty-onboarding record that records the 2016 guidance as containing an explicit NIST CSF citation imports a regulatory-criterion reference the source does not contain. A cyber-exposure briefing that records the 2016 guidance and the FSB Cyber Lexicon as definitionally aligned collapses a two-year vocabulary gap. A compliance report that records the 2016 guidance as the unchanged operative standard at the reporting date misstates the regulatory horizon at a moment when CPMI-IOSCO has issued a May 2026 consultative document.

The audit's nine findings are documented with immutable RLB Citation IDs. Representative entries include RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q008-Opus47, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q008-Sonnet46, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q014-Opus47, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q014-Sonnet46, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q019-Sonnet46, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q020-Opus47, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q020-Sonnet46, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q022-Opus47, and RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q022-Sonnet46. The full audit is documented at the CPMI-IOSCO 2016 Cyber Resilience Guidance hub on RegLegBrief.com.

Sector: Corporate Banking and Dept: Compliance INT BIS-CPMI

Corporate Banking Compliance teams: documentation and reporting gaps possible from AI reading of CPMI-IOSCO Cyber Resilience for FMIs (2016)

For Corporate Banking Compliance teams working with Guidance on Cyber Resilience for Financial Market Infrastructures (CPMI-IOSCO 2016): Specialist-Panel-verified findings on where AI summaries diverge from the...

Compliance teams at corporate banks operating as FMI participants and intermediaries to systemically important payment systems are increasingly relying on AI to update FMI-participant onboarding checklists, generate cyber-incident notification protocols, and verify cyber-supervisory expectations against the CPMI-IOSCO 2016 source text. In practice, AI is used to update FMI participation onboarding checklists, generate cyber-incident notification protocols for corporate-banking participants in payment systems, validate cyber-supervisory expectations citations against CPMI-IOSCO 2016 source text, and prepare compliance reports on FMI cyber-resilience standards exposure.

That workflow places the regulator-issued text of the 2016 guidance, its 2018-2020 derivative standards, and its current operative status at the centre of every AI-generated deliverable for corporate banking compliance teams.

Two frontier AI models tested by the RegLeg Brief Specialist Panel produced confident, citable reconstructions of the CPMI-IOSCO 2016 Cyber Guidance (June 2016) that the regulator-issued primary text directly contradicts across nine findings spanning four failure classes: Source-Credit Fabrication (an asserted NIST Cybersecurity Framework citation that the 2016 guidance does not contain), Misattribution (the slogan 'secure the periphery, protect the core' located inside CPMI-IOSCO 2016 guidance or its 2018 wholesale-payments paper rather than the actual 2018 speech source), Anachronistic Cross-Reference (the 2016 guidance asserted as definitionally aligned with the November 2018 FSB Cyber Lexicon and the October 2020 FSB Effective Practices that postdate it), and Outdated Standing Claim (the 2016 guidance presented as the unchanged operative standard when CPMI-IOSCO has issued a May 2026 consultative document under active revision).

Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows corporate banking compliance teams use AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

For corporate-banking compliance teams, the failure pattern is operationally consequential. A compliance checklist that records the 2016 guidance as containing an explicit NIST CSF citation imports a regulatory-criterion reference the source does not contain. A cyber-supervisor briefing that records the 2016 guidance and the FSB Cyber Lexicon as definitionally aligned papers over the two-year gap between them. A compliance report that records the 2016 guidance as the unchanged operative standard at the reporting date misstates the regulatory horizon.

The audit's nine findings are documented with immutable RLB Citation IDs. Representative entries include RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q008-Opus47, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q008-Sonnet46, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q014-Opus47, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q014-Sonnet46, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q019-Sonnet46, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q020-Opus47, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q020-Sonnet46, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q022-Opus47, and RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q022-Sonnet46. The full audit is documented at the CPMI-IOSCO 2016 Cyber Resilience Guidance hub on RegLegBrief.com.

Wednesday, 21 October 2026
Sector: Investment Banking and Dept: Compliance SG MAS

Investment Banking Compliance teams: documentation and reporting gaps possible from AI reading of MAS Notice 637 (2025 Amendment)

For Investment Banking Compliance teams working with MAS Notice 637 (Amendment) 2025 - Risk Based Capital Adequacy Requirements for Banks Incorporated in Singapore: Specialist-Panel-verified findings on where AI...

Compliance teams at Singapore investment-banking divisions are increasingly using AI to update the investment-banking regulatory-perimeter map for MAS Notice 637, draft deal-clearance regulatory-impact memoranda referencing the FHC framework, generate compliance-training summaries on the 31 December 2025 amendment, and prepare supervisor-facing position papers on group-capital obligations. In Singapore-incorporated banks and financial holding companies the workflow shape is now consistent: a frontier AI assistant produces a clean first draft on MAS Notice 637 risk-based capital adequacy for Reporting Banks, and the reviewer is asked to spot-check the cited MAS instruments and drafting-convention claims against the regulator-issued source before the deliverable goes out.

The two AI failures recorded by the RLB Specialist Panel sit precisely at that spot-check boundary.

Two frontier AI models tested by the RLB Specialist Panel on MAS Notice 637 (Amendment) 2025 produced FABRICATED_FACT errors against the regulator-issued source held as primary substrate. The first invented a sibling "Notice FHC-N637" for financial holding companies that does not appear on the MAS Notices and Directives register; the actual FHC capital framework is a separate MAS notice issued under the Financial Holding Companies Act.

The second misread the yellow-highlight convention in the MAS Notice 637 amendment PDF as visual emphasis, when the regulator's cover note states the yellow is annotation describing the change and will not appear in the published untracked Notice. Both findings sit in the same failure class: Source-Credit Fabrication, where the AI produces a confident, lawyer-shaped citation that does not exist or contradicts a regulator-stated convention. Neither AI subject hedged, flagged low confidence, or refused.

Both produced clean, deployable prose with the wrong substantive content, which is the version of AI failure that is hardest for a reviewer to catch on a fast-moving deliverable. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate, and records the AI subject, the question class, and the operational consequence for each affected audience.

For Compliance teams at Singapore investment-banking divisions the operational consequence is concrete. An IB deal-clearance memo that cites a fabricated MAS instrument would enter transaction documentation and surface on external diligence. A regulator-facing position paper that treats amendment annotation as substantive Notice text would mischaracterise the rule estate to MAS. Both errors are direct enforcement-risk events tied to AI output that was not bound to the regulator's source.

The RLB Specialist Panel records each error against the underlying regulator-issued text and names the AI subject for audit transparency. The two findings carry Citation IDs RLB-H-SG-MAS-NOTICE-637-CAPITAL-ADEQUACY-BANKS-2025-Q010-Opus47 and RLB-H-SG-MAS-NOTICE-637-CAPITAL-ADEQUACY-BANKS-2025-Q012-Opus47; Claude Opus 4.7 is the AI subject in both events and the source-text excerpts are quoted verbatim in the briefing body that follows.

Sector: Retail Banking and Dept: Risk SG MAS

Retail Banking Risk teams: documentation and reporting gaps possible from AI reading of MAS Notice 637 (2025 Amendment)

For Retail Banking Risk teams working with MAS Notice 637 (Amendment) 2025 - Risk Based Capital Adequacy Requirements for Banks Incorporated in Singapore: Specialist-Panel-verified findings on where AI summaries...

Risk functions at Singapore retail-banking divisions are increasingly using AI to update the retail-banking regulatory-capital framework map, draft RWA classification notes for the 31 December 2025 amendment, generate stress-test documentation for consumer portfolios under MAS Notice 637, and prepare board-level dashboards on FHC-level capital obligations. In Singapore-incorporated banks and financial holding companies the workflow shape is now consistent: a frontier AI assistant produces a clean first draft on MAS Notice 637 risk-based capital adequacy for Reporting Banks, and the reviewer is asked to spot-check the cited MAS instruments and drafting-convention claims against the regulator-issued source before the deliverable goes out.

The two AI failures recorded by the RLB Specialist Panel sit precisely at that spot-check boundary.

Two frontier AI models tested by the RLB Specialist Panel on MAS Notice 637 (Amendment) 2025 produced FABRICATED_FACT errors against the regulator-issued source held as primary substrate. The first invented a sibling "Notice FHC-N637" for financial holding companies that does not appear on the MAS Notices and Directives register; the actual FHC capital framework is a separate MAS notice issued under the Financial Holding Companies Act.

The second misread the yellow-highlight convention in the MAS Notice 637 amendment PDF as visual emphasis, when the regulator's cover note states the yellow is annotation describing the change and will not appear in the published untracked Notice. Both findings sit in the same failure class: Source-Credit Fabrication, where the AI produces a confident, lawyer-shaped citation that does not exist or contradicts a regulator-stated convention. Neither AI subject hedged, flagged low confidence, or refused.

Both produced clean, deployable prose with the wrong substantive content, which is the version of AI failure that is hardest for a reviewer to catch on a fast-moving deliverable. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate, and records the AI subject, the question class, and the operational consequence for each affected audience.

For Risk functions at Singapore retail-banking divisions the operational consequence is concrete. A retail-banking regulatory-framework map that names a fabricated MAS notice would drive RWA classification and capital-buffer calibration through an instrument that does not exist. Risk-model documentation that captures amendment annotation as substantive Notice text would generate a versioning artefact that fails reconciliation against the published Notice. Both errors are direct model-governance issues.

The RLB Specialist Panel records each error against the underlying regulator-issued text and names the AI subject for audit transparency. The two findings carry Citation IDs RLB-H-SG-MAS-NOTICE-637-CAPITAL-ADEQUACY-BANKS-2025-Q010-Opus47 and RLB-H-SG-MAS-NOTICE-637-CAPITAL-ADEQUACY-BANKS-2025-Q012-Opus47; Claude Opus 4.7 is the AI subject in both events and the source-text excerpts are quoted verbatim in the briefing body that follows.

Sector: Retail Banking and Dept: Legal SG MAS

Retail Banking Legal teams: documentation and reporting gaps possible from AI reading of MAS Notice 637 (2025 Amendment)

For Retail Banking Legal teams working with MAS Notice 637 (Amendment) 2025 - Risk Based Capital Adequacy Requirements for Banks Incorporated in Singapore: Specialist-Panel-verified findings on where AI summaries...

Legal teams at Singapore retail-banking divisions are increasingly using AI to draft legal opinions on MAS Notice 637 amendment effects for product counsel, prepare consumer-disclosure language tied to capital-adequacy positioning, generate first-pass risk-of-non-compliance memoranda, and validate group-structure references in product documentation. In Singapore-incorporated banks and financial holding companies the workflow shape is now consistent: a frontier AI assistant produces a clean first draft on MAS Notice 637 risk-based capital adequacy for Reporting Banks, and the reviewer is asked to spot-check the cited MAS instruments and drafting-convention claims against the regulator-issued source before the deliverable goes out.

The two AI failures recorded by the RLB Specialist Panel sit precisely at that spot-check boundary.

Two frontier AI models tested by the RLB Specialist Panel on MAS Notice 637 (Amendment) 2025 produced FABRICATED_FACT errors against the regulator-issued source held as primary substrate. The first invented a sibling "Notice FHC-N637" for financial holding companies that does not appear on the MAS Notices and Directives register; the actual FHC capital framework is a separate MAS notice issued under the Financial Holding Companies Act.

The second misread the yellow-highlight convention in the MAS Notice 637 amendment PDF as visual emphasis, when the regulator's cover note states the yellow is annotation describing the change and will not appear in the published untracked Notice. Both findings sit in the same failure class: Source-Credit Fabrication, where the AI produces a confident, lawyer-shaped citation that does not exist or contradicts a regulator-stated convention. Neither AI subject hedged, flagged low confidence, or refused.

Both produced clean, deployable prose with the wrong substantive content, which is the version of AI failure that is hardest for a reviewer to catch on a fast-moving deliverable. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate, and records the AI subject, the question class, and the operational consequence for each affected audience.

For Legal teams at Singapore retail-banking divisions the operational consequence is concrete. A legal opinion that routes through a fabricated MAS instrument would not survive external counsel review. A consumer disclosure that builds on amendment annotation as substantive Notice text would misstate the rule estate to retail customers. Both errors expose the institution to written-record and conduct risk tied to AI output that was not bound to the regulator's source.

The RLB Specialist Panel records each error against the underlying regulator-issued text and names the AI subject for audit transparency. The two findings carry Citation IDs RLB-H-SG-MAS-NOTICE-637-CAPITAL-ADEQUACY-BANKS-2025-Q010-Opus47 and RLB-H-SG-MAS-NOTICE-637-CAPITAL-ADEQUACY-BANKS-2025-Q012-Opus47; Claude Opus 4.7 is the AI subject in both events and the source-text excerpts are quoted verbatim in the briefing body that follows.

↑ Back to top