AI Hallucination Research › Briefings

Briefings Blog

The running blog from the RLB Specialist Panel delves into real-world scenarios where the compliance, legal, or AI lab team interacts with frontier AI models under specific regulations. The blogs are anonymised to remove client-specific details and include insights from the RLB team analysing the hallucinations experienced in AI models while working on these cases. For example, when a model returns a confident answer that contradicts the regulator's primary text, such as a fabricated staff letter, a wrong appendix, or an inverted scope, these issues are discussed here. Each blog explains one set of findings and what it would have meant for the team that would have acted on it, sans this research initiative. This blog is frequently updated, a few times a day.

263 briefings in the archive · Subscribe via Atom: /briefings/feed.xml (this blog) · /feed.xml (all RegLegBrief publications)
Audience colours: AI Labs Practitioner (profession) Sector × Department
Audience
Jur.
Regulator
Profession
Sector
Dept
Range
Sort
Per page
Showing 5 of 263 · page 5 of 53
Thursday, 23 July 2026
Sector: Corporate Banking and Dept: Risk INT BIS-CPMI

Corporate Banking Risk teams: documentation and reporting gaps possible from AI reading of CPMI FPS Interlinking Governance 2024

For Corporate Banking Risk teams working with Linking Fast Payment Systems Across Borders: Governance and Oversight — Final Report: Specialist-Panel-verified findings on where AI summaries diverge from the...

Misstated recommendation count, fabricated consultation respondents, and scoping drift on the CPMI October 2024 final report on FPS interlinking governance. Two frontier AI models tested by the RegLeg Brief Specialist Panel produced confident, citable answers across six distinct questions on the October 2024 CPMI final report on linking fast payment systems across borders that the regulator's own primary text in publication d223 directly contradicts. The audit covers the count and scope of the report's oversight recommendations, the named list of public consultation respondents in Annex 1, and the distinction between the interim publication d219 and the final publication d223.

For Risk teams at Corporate Banking firms working CPMI FPS interlinking governance matters, the failure pattern is operationally consequential. The audit tested six questions designed by the RLB Specialist Panel to mirror how legal, compliance, risk, operations, and board-secretariat teams at payment institutions, hub entities, and banks participating in fast payment system interlinking arrangements actually use AI on this practice area: counterparty-risk memoranda on FPS interlinking exposures, board-paper risk sections on participation in interlinking arrangements, regulator-engagement notes on the d223 oversight regime, and risk-appetite framework inputs for cross-border FPS counterparties. Each question is bound to verbatim regulator-issued primary substrate.

Across the six findings the AI subjects committed, in board-style and analyst-style deliverables, to approximately ten oversight recommendations (against the seven set out in d223 Section 5.2), to consultation-respondent lists of fifteen to twenty named organisations (against the seven specific respondents recorded in d223 Annex 1), and to a scoping treatment that places the single access point gateway model inside the report's recommendations (against d223 Section 2.2, which records that the single access point is not the focus of the report).

The findings are operationally consequential for legal teams, compliance teams, risk teams, operations teams, and board secretariats at payment institutions, banks, hub entities, and FPS operators whose practice touches the October 2024 CPMI final report. A board-level briefing memo that records the report as setting out approximately ten recommendations conflates the interim d219's ten considerations with the final d223's seven recommendations and embeds that confusion into the board's understanding of the oversight regime. A legal opinion that scopes a single access point arrangement inside the d223 recommendation set creates a falsifiable regulatory-interpretation error in a partner-level deliverable.

An analyst report that lists fifteen to twenty named consultation respondents (including fabricated organisation names) attributes positions and counts to stakeholders that the regulator's Annex 1 does not record.

The audit's six findings are published with immutable RLB Citation IDs. Representative entries include RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q001-Opus47, RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q003-Opus47, RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q006-Opus47. The full audit is published at the CPMI FPS Interlinking Governance 2024 hub on RegLegBrief.com.

Sector: Payment Institutions and Dept: Operations INT BIS-CPMI

Payment Institutions Operations teams: documentation and reporting gaps possible from AI reading of CPMI FPS Interlinking Governance 2024

For Payment Institutions Operations teams working with Linking Fast Payment Systems Across Borders: Governance and Oversight — Final Report: Specialist-Panel-verified findings on where AI summaries diverge from the...

Misstated recommendation count, fabricated consultation respondents, and scoping drift on the CPMI October 2024 final report on FPS interlinking governance. Two frontier AI models tested by the RegLeg Brief Specialist Panel produced confident, citable answers across six distinct questions on the October 2024 CPMI final report on linking fast payment systems across borders that the regulator's own primary text in publication d223 directly contradicts. The audit covers the count and scope of the report's oversight recommendations, the named list of public consultation respondents in Annex 1, and the distinction between the interim publication d219 and the final publication d223.

For Operations teams at Payment Institutions working CPMI FPS interlinking governance matters, the failure pattern is operationally consequential. The audit tested six questions designed by the RLB Specialist Panel to mirror how legal, compliance, risk, operations, and board-secretariat teams at payment institutions, hub entities, and banks participating in fast payment system interlinking arrangements actually use AI on this practice area: operating manuals for FPS interlinking arrangements, service-level agreement drafting against the d223 recommendation set, incident-management playbooks for interlinking links, and consultation-engagement briefings on the d223 outcome. Each question is bound to verbatim regulator-issued primary substrate.

Across the six findings the AI subjects committed, in board-style and analyst-style deliverables, to approximately ten oversight recommendations (against the seven set out in d223 Section 5.2), to consultation-respondent lists of fifteen to twenty named organisations (against the seven specific respondents recorded in d223 Annex 1), and to a scoping treatment that places the single access point gateway model inside the report's recommendations (against d223 Section 2.2, which records that the single access point is not the focus of the report).

The findings are operationally consequential for legal teams, compliance teams, risk teams, operations teams, and board secretariats at payment institutions, banks, hub entities, and FPS operators whose practice touches the October 2024 CPMI final report. A board-level briefing memo that records the report as setting out approximately ten recommendations conflates the interim d219's ten considerations with the final d223's seven recommendations and embeds that confusion into the board's understanding of the oversight regime. A legal opinion that scopes a single access point arrangement inside the d223 recommendation set creates a falsifiable regulatory-interpretation error in a partner-level deliverable.

An analyst report that lists fifteen to twenty named consultation respondents (including fabricated organisation names) attributes positions and counts to stakeholders that the regulator's Annex 1 does not record.

The audit's six findings are published with immutable RLB Citation IDs. Representative entries include RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q001-Opus47, RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q005-Opus47, RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q006-Opus47. The full audit is published at the CPMI FPS Interlinking Governance 2024 hub on RegLegBrief.com.

Sector: Payment Institutions and Dept: Compliance INT BIS-CPMI

Payment Institutions Compliance teams: documentation and reporting gaps possible from AI reading of CPMI FPS Interlinking Governance 2024

For Payment Institutions Compliance teams working with Linking Fast Payment Systems Across Borders: Governance and Oversight — Final Report: Specialist-Panel-verified findings on where AI summaries diverge from the...

Misstated recommendation count, fabricated consultation respondents, and scoping drift on the CPMI October 2024 final report on FPS interlinking governance. Two frontier AI models tested by the RegLeg Brief Specialist Panel produced confident, citable answers across six distinct questions on the October 2024 CPMI final report on linking fast payment systems across borders that the regulator's own primary text in publication d223 directly contradicts. The audit covers the count and scope of the report's oversight recommendations, the named list of public consultation respondents in Annex 1, and the distinction between the interim publication d219 and the final publication d223.

For Compliance teams at Payment Institutions working CPMI FPS interlinking governance matters, the failure pattern is operationally consequential. The audit tested six questions designed by the RLB Specialist Panel to mirror how legal, compliance, risk, operations, and board-secretariat teams at payment institutions, hub entities, and banks participating in fast payment system interlinking arrangements actually use AI on this practice area: compliance-monitoring frameworks for the d223 recommendations, internal control checklists keyed to each recommendation, regulator-engagement files on oversight expectations, and senior-management compliance reports on the FPS interlinking regime. Each question is bound to verbatim regulator-issued primary substrate.

Across the six findings the AI subjects committed, in board-style and analyst-style deliverables, to approximately ten oversight recommendations (against the seven set out in d223 Section 5.2), to consultation-respondent lists of fifteen to twenty named organisations (against the seven specific respondents recorded in d223 Annex 1), and to a scoping treatment that places the single access point gateway model inside the report's recommendations (against d223 Section 2.2, which records that the single access point is not the focus of the report).

The findings are operationally consequential for legal teams, compliance teams, risk teams, operations teams, and board secretariats at payment institutions, banks, hub entities, and FPS operators whose practice touches the October 2024 CPMI final report. A board-level briefing memo that records the report as setting out approximately ten recommendations conflates the interim d219's ten considerations with the final d223's seven recommendations and embeds that confusion into the board's understanding of the oversight regime. A legal opinion that scopes a single access point arrangement inside the d223 recommendation set creates a falsifiable regulatory-interpretation error in a partner-level deliverable.

An analyst report that lists fifteen to twenty named consultation respondents (including fabricated organisation names) attributes positions and counts to stakeholders that the regulator's Annex 1 does not record.

The audit's six findings are published with immutable RLB Citation IDs. Representative entries include RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q001-Opus47, RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q002-Sonnet46, RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q006-Opus47. The full audit is published at the CPMI FPS Interlinking Governance 2024 hub on RegLegBrief.com.

Sector: Payment Institutions and Dept: Risk INT BIS-CPMI

Payment Institutions Risk teams: documentation and reporting gaps possible from AI reading of CPMI FPS Interlinking Governance 2024

For Payment Institutions Risk teams working with Linking Fast Payment Systems Across Borders: Governance and Oversight — Final Report: Specialist-Panel-verified findings on where AI summaries diverge from the...

Misstated recommendation count, fabricated consultation respondents, and scoping drift on the CPMI October 2024 final report on FPS interlinking governance. Two frontier AI models tested by the RegLeg Brief Specialist Panel produced confident, citable answers across six distinct questions on the October 2024 CPMI final report on linking fast payment systems across borders that the regulator's own primary text in publication d223 directly contradicts. The audit covers the count and scope of the report's oversight recommendations, the named list of public consultation respondents in Annex 1, and the distinction between the interim publication d219 and the final publication d223.

For Risk teams at Payment Institutions working CPMI FPS interlinking governance matters, the failure pattern is operationally consequential. The audit tested six questions designed by the RLB Specialist Panel to mirror how legal, compliance, risk, operations, and board-secretariat teams at payment institutions, hub entities, and banks participating in fast payment system interlinking arrangements actually use AI on this practice area: link-related risk taxonomies for interlinking arrangements, board-paper risk sections on the d223 recommendation set, regulator-engagement notes on link risk, and risk-appetite framework inputs for cross-border FPS exposures. Each question is bound to verbatim regulator-issued primary substrate.

Across the six findings the AI subjects committed, in board-style and analyst-style deliverables, to approximately ten oversight recommendations (against the seven set out in d223 Section 5.2), to consultation-respondent lists of fifteen to twenty named organisations (against the seven specific respondents recorded in d223 Annex 1), and to a scoping treatment that places the single access point gateway model inside the report's recommendations (against d223 Section 2.2, which records that the single access point is not the focus of the report).

The findings are operationally consequential for legal teams, compliance teams, risk teams, operations teams, and board secretariats at payment institutions, banks, hub entities, and FPS operators whose practice touches the October 2024 CPMI final report. A board-level briefing memo that records the report as setting out approximately ten recommendations conflates the interim d219's ten considerations with the final d223's seven recommendations and embeds that confusion into the board's understanding of the oversight regime. A legal opinion that scopes a single access point arrangement inside the d223 recommendation set creates a falsifiable regulatory-interpretation error in a partner-level deliverable.

An analyst report that lists fifteen to twenty named consultation respondents (including fabricated organisation names) attributes positions and counts to stakeholders that the regulator's Annex 1 does not record.

The audit's six findings are published with immutable RLB Citation IDs. Representative entries include RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q001-Opus47, RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q003-Opus47, RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q006-Opus47. The full audit is published at the CPMI FPS Interlinking Governance 2024 hub on RegLegBrief.com.

Wednesday, 22 July 2026
Sector: Payment Institutions and Dept: Legal INT BIS-CPMI

Payment Institutions Legal teams: documentation and reporting gaps possible from AI reading of CPMI FPS Interlinking Governance 2024

For Payment Institutions Legal teams working with Linking Fast Payment Systems Across Borders: Governance and Oversight — Final Report: Specialist-Panel-verified findings on where AI summaries diverge from the...

Misstated recommendation count, fabricated consultation respondents, and scoping drift on the CPMI October 2024 final report on FPS interlinking governance. Two frontier AI models tested by the RegLeg Brief Specialist Panel produced confident, citable answers across six distinct questions on the October 2024 CPMI final report on linking fast payment systems across borders that the regulator's own primary text in publication d223 directly contradicts. The audit covers the count and scope of the report's oversight recommendations, the named list of public consultation respondents in Annex 1, and the distinction between the interim publication d219 and the final publication d223.

For Legal teams at Payment Institutions working CPMI FPS interlinking governance matters, the failure pattern is operationally consequential. The audit tested six questions designed by the RLB Specialist Panel to mirror how legal, compliance, risk, operations, and board-secretariat teams at payment institutions, hub entities, and banks participating in fast payment system interlinking arrangements actually use AI on this practice area: outside-counsel instructions on FPS interlinking arrangements, counsel notes on cross-border interlinking risk allocation, board-paper inputs on the d223 oversight regime, and contract templates for hub entities and component FPS. Each question is bound to verbatim regulator-issued primary substrate.

Across the six findings the AI subjects committed, in board-style and analyst-style deliverables, to approximately ten oversight recommendations (against the seven set out in d223 Section 5.2), to consultation-respondent lists of fifteen to twenty named organisations (against the seven specific respondents recorded in d223 Annex 1), and to a scoping treatment that places the single access point gateway model inside the report's recommendations (against d223 Section 2.2, which records that the single access point is not the focus of the report).

The findings are operationally consequential for legal teams, compliance teams, risk teams, operations teams, and board secretariats at payment institutions, banks, hub entities, and FPS operators whose practice touches the October 2024 CPMI final report. A board-level briefing memo that records the report as setting out approximately ten recommendations conflates the interim d219's ten considerations with the final d223's seven recommendations and embeds that confusion into the board's understanding of the oversight regime. A legal opinion that scopes a single access point arrangement inside the d223 recommendation set creates a falsifiable regulatory-interpretation error in a partner-level deliverable.

An analyst report that lists fifteen to twenty named consultation respondents (including fabricated organisation names) attributes positions and counts to stakeholders that the regulator's Annex 1 does not record.

The audit's six findings are published with immutable RLB Citation IDs. Representative entries include RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q001-Opus47, RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q003-Opus47, RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q005-Opus47, RLB-H-INT-BIS-CPMI-CPMI-FPS-INTERLINKING-GOVERNANCE-2024-Q006-Opus47. The full audit is published at the CPMI FPS Interlinking Governance 2024 hub on RegLegBrief.com.

↑ Back to top