AI Hallucination Research › Briefings

Briefings Blog

The running blog from the RLB Specialist Panel delves into real-world scenarios where the compliance, legal, or AI lab team interacts with frontier AI models under specific regulations. The blogs are anonymised to remove client-specific details and include insights from the RLB team analysing the hallucinations experienced in AI models while working on these cases. For example, when a model returns a confident answer that contradicts the regulator's primary text, such as a fabricated staff letter, a wrong appendix, or an inverted scope, these issues are discussed here. Each blog explains one set of findings and what it would have meant for the team that would have acted on it, sans this research initiative. This blog is frequently updated, a few times a day.

263 briefings in the archive · Subscribe via Atom: /briefings/feed.xml (this blog) · /feed.xml (all RegLegBrief publications)
Audience colours: AI Labs Practitioner (profession) Sector × Department
Audience
Jur.
Regulator
Profession
Sector
Dept
Range
Sort
Per page
Showing 5 of 263 · page 18 of 53
Monday, 13 July 2026
Sector: Payment Institutions and Dept: Governance & Company Secretarial INT BIS-CPMI

Payment Institutions Governance & Company Secretarial teams: documentation and reporting gaps possible from AI reading of PFMI Level 3 General Business Risk (2025)

For Payment Institutions Governance & Company Secretarial teams working with Implementation Monitoring of the PFMI: Level 3 Assessment on General Business Risks: Specialist-Panel-verified findings on where AI...

Governance and company secretarial teams at payment institutions are increasingly using AI to draft board pack methodology notes on CPMI-IOSCO oversight, prepare audit-committee briefings on the November 2025 Level 3 cycle, produce annual governance disclosure summaries touching PFMI compliance, and validate procedural-fact statements about supervisory engagement. The November 2025 CPMI-IOSCO Level 3 assessment of general business risk, recorded under PFMI Principle 15, is the supervisory exercise most directly bearing on this practice area in the current cycle.

As AI tooling enters the drafting layer, the question is no longer whether AI-assisted work product reaches client-facing deliverables; it is whether the work product reaches them with the regulator-text fidelity that PI Governance & CoSec teams need.

The RLB Specialist Panel tested two frontier AI models on a question set covering the LNAFE quantitative floor, the Basel/CRD equity carve-out condition, and the November 2025 assessment lifecycle. The Panel records 1 finding on this audience-specific cell. The failure pattern in scope: Supervisory-timeline truncation, dropping the validation phase. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

For PI Governance & CoSec teams the operational consequence is direct. A board pack that records the CPMI-IOSCO Level 3 assessment as a 2023-2024 exercise misstates the lifecycle of a primary supervisory publication, and any downstream filing or disclosure built on that pack inherits the same error.

PFMI Principle 15 is one of the cleanest primary-source surfaces in the cross-border CCP and CSD universe: a Key Consideration cited in a deliverable is either the right KC or it is not; a quantitative floor is either the regulator's text or it is not; an assessment-period date range is either accurate or it is not. Each is recoverable on a routine line-by-line read.

The audit's 1 finding for this cell carry immutable RLB Citation IDs and are bound to verbatim regulator-issued source text held by the RLB Specialist Panel: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q005-Sonnet46. The full audit on the November 2025 CPMI-IOSCO Level 3 assessment is published at the PFMI Level 3 General Business Risk hub on RegLegBrief.com.

Sector: Payment Institutions and Dept: Finance INT BIS-CPMI

Payment Institutions Finance teams: documentation and reporting gaps possible from AI reading of PFMI Level 3 General Business Risk (2025)

For Payment Institutions Finance teams working with Implementation Monitoring of the PFMI: Level 3 Assessment on General Business Risks: Specialist-Panel-verified findings on where AI summaries diverge from the...

Finance teams at payment institutions subject to PFMI oversight are increasingly using AI to draft LNAFE buffer sizing memos for the CFO, validate Basel-versus-LNAFE capital eligibility under group-level consolidation, prepare board-level capital-buffer trend reports, and update annual capital planning documentation against the November 2025 CPMI-IOSCO Level 3 findings. The November 2025 CPMI-IOSCO Level 3 assessment of general business risk, recorded under PFMI Principle 15, is the supervisory exercise most directly bearing on this practice area in the current cycle.

As AI tooling enters the drafting layer, the question is no longer whether AI-assisted work product reaches client-facing deliverables; it is whether the work product reaches them with the regulator-text fidelity that PI Finance teams need.

The RLB Specialist Panel tested two frontier AI models on a question set covering the LNAFE quantitative floor, the Basel/CRD equity carve-out condition, and the November 2025 assessment lifecycle. The Panel records 2 findings on this audience-specific cell. The failure pattern in scope: Source-text condition replacement with an invented overlay test; Quantitative-floor inflation into a fabricated composite minimum. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

For PI Finance teams the operational consequence is direct. A board-level capital memo that adopts a "greater of" framing for the KC3 floor, or that excludes Basel CET1 from LNAFE on the basis of a fabricated liquidity test, materially miscalibrates the institution's reported buffer and triggers capital decisions on a wrong baseline.

PFMI Principle 15 is one of the cleanest primary-source surfaces in the cross-border CCP and CSD universe: a Key Consideration cited in a deliverable is either the right KC or it is not; a quantitative floor is either the regulator's text or it is not; an assessment-period date range is either accurate or it is not. Each is recoverable on a routine line-by-line read.

The audit's 2 findings for this cell carry immutable RLB Citation IDs and are bound to verbatim regulator-issued source text held by the RLB Specialist Panel: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q002-Opus47, RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q003-Opus47. The full audit on the November 2025 CPMI-IOSCO Level 3 assessment is published at the PFMI Level 3 General Business Risk hub on RegLegBrief.com.

Sector: Payment Institutions and Dept: Compliance INT BIS-CPMI

Payment Institutions Compliance teams: documentation and reporting gaps possible from AI reading of PFMI Level 3 General Business Risk (2025)

For Payment Institutions Compliance teams working with Implementation Monitoring of the PFMI: Level 3 Assessment on General Business Risks: Specialist-Panel-verified findings on where AI summaries diverge from the...

Compliance teams at payment institutions whose regulatory framework references PFMI Principle 15 as part of their oversight envelope are increasingly using AI to scope Principle 15 readiness exercises, draft LNAFE buffer policy notes, generate cross-cycle assessment briefings for the CCO, and update regulatory-change registers on the November 2025 CPMI-IOSCO Level 3 findings. The November 2025 CPMI-IOSCO Level 3 assessment of general business risk, recorded under PFMI Principle 15, is the supervisory exercise most directly bearing on this practice area in the current cycle.

As AI tooling enters the drafting layer, the question is no longer whether AI-assisted work product reaches client-facing deliverables; it is whether the work product reaches them with the regulator-text fidelity that PI Compliance teams need.

The RLB Specialist Panel tested two frontier AI models on a question set covering the LNAFE quantitative floor, the Basel/CRD equity carve-out condition, and the November 2025 assessment lifecycle. The Panel records 3 findings on this audience-specific cell. The failure pattern in scope: Source-text condition replacement with an invented overlay test; Key Consideration mis-attribution of a quantitative threshold; and Supervisory-timeline truncation, dropping the validation phase. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for.

The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

For PI Compliance teams the operational consequence is direct. A regulatory-change register that records the CPMI-IOSCO Level 3 assessment as a 2023-2024 exercise, that attributes the six-month LNAFE floor to KC2, and that imports a non-existent Basel/CRD liquidity overlay into Principle 15 readiness scoping carries three independent factual inaccuracies, any one of which is recoverable on a routine regulator query.

PFMI Principle 15 is one of the cleanest primary-source surfaces in the cross-border CCP and CSD universe: a Key Consideration cited in a deliverable is either the right KC or it is not; a quantitative floor is either the regulator's text or it is not; an assessment-period date range is either accurate or it is not. Each is recoverable on a routine line-by-line read.

The audit's 3 findings for this cell carry immutable RLB Citation IDs and are bound to verbatim regulator-issued source text held by the RLB Specialist Panel: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q002-Opus47, RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q003-Sonnet46, RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q005-Sonnet46. The full audit on the November 2025 CPMI-IOSCO Level 3 assessment is published at the PFMI Level 3 General Business Risk hub on RegLegBrief.com.

Sector: Management & Risk Consulting and Dept: Risk INT BIS-CPMI

Management & Risk Consulting Risk teams: documentation and reporting gaps possible from AI reading of PFMI Level 3 General Business Risk (2025)

For Management & Risk Consulting Risk teams working with Implementation Monitoring of the PFMI: Level 3 Assessment on General Business Risks: Specialist-Panel-verified findings on where AI summaries diverge from the...

Risk teams at management and risk consulting firms supporting CCP, CSD, and PS clients are increasingly using AI to design Principle 15 risk-mapping exercises, validate LNAFE sizing methodology for client liquidity-risk functions, draft scenario-analysis programme frameworks under KC2, and produce post-assessment remediation roadmaps drawing on the November 2025 CPMI-IOSCO Level 3 findings. The November 2025 CPMI-IOSCO Level 3 assessment of general business risk, recorded under PFMI Principle 15, is the supervisory exercise most directly bearing on this practice area in the current cycle.

As AI tooling enters the drafting layer, the question is no longer whether AI-assisted work product reaches client-facing deliverables; it is whether the work product reaches them with the regulator-text fidelity that consulting Risk teams need.

The RLB Specialist Panel tested two frontier AI models on a question set covering the LNAFE quantitative floor, the Basel/CRD equity carve-out condition, and the November 2025 assessment lifecycle. The Panel records 2 findings on this audience-specific cell. The failure pattern in scope: Quantitative-floor inflation into a fabricated composite minimum; Outright denial of a carve-out the rule records explicitly. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

For consulting Risk teams the operational consequence is direct. A remediation roadmap that inflates the KC3 six-month floor into a "greater of" dual-track minimum miscalibrates the client's regulatory baseline and produces a work programme that does not match the rule. PFMI Principle 15 is one of the cleanest primary-source surfaces in the cross-border CCP and CSD universe: a Key Consideration cited in a deliverable is either the right KC or it is not; a quantitative floor is either the regulator's text or it is not; an assessment-period date range is either accurate or it is not.

Each is recoverable on a routine line-by-line read.

The audit's 2 findings for this cell carry immutable RLB Citation IDs and are bound to verbatim regulator-issued source text held by the RLB Specialist Panel: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q003-Opus47, RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q002-Sonnet46. The full audit on the November 2025 CPMI-IOSCO Level 3 assessment is published at the PFMI Level 3 General Business Risk hub on RegLegBrief.com.

Sector: Management & Risk Consulting and Dept: Compliance INT BIS-CPMI

Management & Risk Consulting Compliance teams: documentation and reporting gaps possible from AI reading of PFMI Level 3 General Business Risk (2025)

For Management & Risk Consulting Compliance teams working with Implementation Monitoring of the PFMI: Level 3 Assessment on General Business Risks: Specialist-Panel-verified findings on where AI summaries diverge...

Compliance teams at management and risk consulting firms advising CCP, CSD, and PS client portfolios are increasingly using AI to draft Principle 15 readiness gap analyses, build LNAFE compliance dashboards for client COOs, validate Basel-versus-LNAFE capital eligibility scoping memos, and prepare cross-client benchmarking decks on the November 2025 CPMI-IOSCO Level 3 assessment cycle. The November 2025 CPMI-IOSCO Level 3 assessment of general business risk, recorded under PFMI Principle 15, is the supervisory exercise most directly bearing on this practice area in the current cycle.

As AI tooling enters the drafting layer, the question is no longer whether AI-assisted work product reaches client-facing deliverables; it is whether the work product reaches them with the regulator-text fidelity that consulting Compliance teams need.

The RLB Specialist Panel tested two frontier AI models on a question set covering the LNAFE quantitative floor, the Basel/CRD equity carve-out condition, and the November 2025 assessment lifecycle. The Panel records 1 finding on this audience-specific cell. The failure pattern in scope: Source-text condition replacement with an invented overlay test. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

For consulting Compliance teams the operational consequence is direct. A client-facing gap analysis that frames the Basel/CRD equity carve-out as gated by a liquidity test the regulator has not issued recommends a stricter standard than the rule requires, and triggers downstream client decisions, on capital redeployment or buffer reshaping, that are not warranted by the underlying Principle.

PFMI Principle 15 is one of the cleanest primary-source surfaces in the cross-border CCP and CSD universe: a Key Consideration cited in a deliverable is either the right KC or it is not; a quantitative floor is either the regulator's text or it is not; an assessment-period date range is either accurate or it is not. Each is recoverable on a routine line-by-line read.

The audit's 1 finding for this cell carry immutable RLB Citation IDs and are bound to verbatim regulator-issued source text held by the RLB Specialist Panel: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-L3-GENERAL-BUSINESS-RISK-2025-Q002-Opus47. The full audit on the November 2025 CPMI-IOSCO Level 3 assessment is published at the PFMI Level 3 General Business Risk hub on RegLegBrief.com.

↑ Back to top