AI Hallucination Research › Briefings

Briefings Blog

The running blog from the RLB Specialist Panel delves into real-world scenarios where the compliance, legal, or AI lab team interacts with frontier AI models under specific regulations. The blogs are anonymised to remove client-specific details and include insights from the RLB team analysing the hallucinations experienced in AI models while working on these cases. For example, when a model returns a confident answer that contradicts the regulator's primary text, such as a fabricated staff letter, a wrong appendix, or an inverted scope, these issues are discussed here. Each blog explains one set of findings and what it would have meant for the team that would have acted on it, sans this research initiative. This blog is frequently updated, a few times a day.

263 briefings in the archive · Subscribe via Atom: /briefings/feed.xml (this blog) · /feed.xml (all RegLegBrief publications)
Audience colours: AI Labs Practitioner (profession) Sector × Department
Audience
Jur.
Regulator
Profession
Sector
Dept
Range
Sort
Per page
Showing 5 of 263 · page 7 of 53
Tuesday, 21 July 2026
Sector: Investment Banking and Dept: Risk INT BIS-CPMI

Investment Banking Risk teams: documentation and reporting gaps possible from AI reading of CPMI-IOSCO VM Effective Practices 2025

For Investment Banking Risk teams working with Streamlining Variation Margin in Centrally Cleared Markets — Examples of Effective Practices: Specialist-Panel-verified findings on where AI summaries diverge from the...

Risk teams inside investment-banking divisions acting as clearing members at central counterparties are increasingly using AI to draft variation margin policy updates referencing CPMI-IOSCO d226, prepare board risk committee briefings on intraday VM call obligations, classify each d226 effective practice in the firm's regulatory-change inventory, and validate proposed amendments to the firm's liquidity risk policy against d226 language. Leading AI assistants tested by the RLB Specialist Panel produced confident, citable answers on the binding force of d226 that the document itself directly contradicts.

The RLB Specialist Panel tested whether two frontier AI models could correctly characterise the legal status of d226, asking them to classify each of the eight effective practices set out in the document as either a mandatory requirement with enforcement consequences, a supervisory expectation that regulators will test against, or voluntary guidance with no binding legal force. The exercise targeted what the Panel calls inverted modality: AI commitments that flip the binding force of a source text from voluntary illustration to supervisory or mandatory rule.

The frontier model under test produced a complete compliance obligations memo that classified every one of the eight effective practices as either a supervisory expectation in its own right or as overlapping with mandatory national rules, with a threshold classification asserting that d226 carries "a strong gravitational pull into (B) SUPERVISORY EXPECTATION." The document's own stated purpose paragraph, by contrast, records that d226 sets out "examples of how standards set out in the CPMI-IOSCO Principles for financial market infrastructures, as supplemented by the relevant guidance, can be met."

For Clearing-member Risk, the operational consequence is direct. Policy updates and board risk committee briefings that characterise d226 practices as supervisory expectations or mandatory obligations push the firm toward implementation timelines and liquidity buffers calibrated against a non-binding publication, distorting the risk function's capacity to focus on the underlying PFMI Principles and national rulebook obligations that drive actual supervisory examination. The pattern is also reproducible: it surfaces wherever a deliverable asks the model to commit to a legal characterisation of an international standard-setter publication, and it is not addressed by general-purpose prompting.

The RLB Specialist Panel records the finding under the misstated-rule failure category and binds it to verbatim regulator text drawn from the d226 final report held as primary substrate.

The full finding is recorded under Citation ID RLB-H-INT-BIS-CPMI-CPMI-IOSCO-VARIATION-MARGIN-CCPs-2025-Q004-Opus47. The regulation hub is at /regulators/j1/INT/BIS-CPMI-INT-001/CPMI-IOSCO-VARIATION-MARGIN-CCPs-2025/. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Sector: Investment Banking and Dept: Legal INT BIS-CPMI

Investment Banking Legal teams: documentation and reporting gaps possible from AI reading of CPMI-IOSCO VM Effective Practices 2025

For Investment Banking Legal teams working with Streamlining Variation Margin in Centrally Cleared Markets — Examples of Effective Practices: Specialist-Panel-verified findings on where AI summaries diverge from the...

Legal teams inside investment-banking divisions acting as clearing members at central counterparties are increasingly using AI to draft client-clearing disclosure updates referencing CPMI-IOSCO d226, prepare opinion notes on whether the January 2025 publication imposes new pass-through obligations on clearing members, classify each d226 effective practice for the General Counsel's regulatory monitoring log, and validate proposed amendments to client clearing agreements against d226 language. Leading AI assistants tested by the RLB Specialist Panel produced confident, citable answers on the binding force of d226 that the document itself directly contradicts.

The RLB Specialist Panel tested whether two frontier AI models could correctly characterise the legal status of d226, asking them to classify each of the eight effective practices set out in the document as either a mandatory requirement with enforcement consequences, a supervisory expectation that regulators will test against, or voluntary guidance with no binding legal force. The exercise targeted what the Panel calls inverted modality: AI commitments that flip the binding force of a source text from voluntary illustration to supervisory or mandatory rule.

The frontier model under test produced a complete compliance obligations memo that classified every one of the eight effective practices as either a supervisory expectation in its own right or as overlapping with mandatory national rules, with a threshold classification asserting that d226 carries "a strong gravitational pull into (B) SUPERVISORY EXPECTATION." The document's own stated purpose paragraph, by contrast, records that d226 sets out "examples of how standards set out in the CPMI-IOSCO Principles for financial market infrastructures, as supplemented by the relevant guidance, can be met."

For Clearing-member Legal, the operational consequence is direct. Opinion notes and client clearing agreement amendments that treat d226 practices as supervisory or mandatory obligations create disclosure exposure to clients, drive over-implementation budgets across the clearing-member function, and produce inconsistencies between the firm's d226 position and the national rulebook position it must actually adhere to. The pattern is also reproducible: it surfaces wherever a deliverable asks the model to commit to a legal characterisation of an international standard-setter publication, and it is not addressed by general-purpose prompting.

The RLB Specialist Panel records the finding under the misstated-rule failure category and binds it to verbatim regulator text drawn from the d226 final report held as primary substrate.

The full finding is recorded under Citation ID RLB-H-INT-BIS-CPMI-CPMI-IOSCO-VARIATION-MARGIN-CCPs-2025-Q004-Opus47. The regulation hub is at /regulators/j1/INT/BIS-CPMI-INT-001/CPMI-IOSCO-VARIATION-MARGIN-CCPs-2025/. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Practitioner: Company Secretaries INT BIS-CPMI

Company Secretaries: AI summaries of CPMI-IOSCO VM Effective Practices 2025 may understate professional obligations

For Company Secretaries working with Streamlining Variation Margin in Centrally Cleared Markets — Examples of Effective Practices: where Specialist-Panel-verified divergences between frontier AI summaries and the...

Company secretaries supporting CCP boards, clearing member boards, and clearing-house-affiliated holding companies are increasingly using AI to draft Audit and Risk Committee agenda items on d226, prepare board minutes that record the directors' position on CPMI-IOSCO recommendations, draft regulator-correspondence templates referencing the January 2025 publication, and validate disclosure language for annual reports that mention international standard setters. Leading AI assistants tested by the RLB Specialist Panel produced confident, citable answers on the binding force of d226 that the document itself directly contradicts.

The RLB Specialist Panel tested whether two frontier AI models could correctly characterise the legal status of d226, asking them to classify each of the eight effective practices set out in the document as either a mandatory requirement with enforcement consequences, a supervisory expectation that regulators will test against, or voluntary guidance with no binding legal force. The exercise targeted what the Panel calls inverted modality: AI commitments that flip the binding force of a source text from voluntary illustration to supervisory or mandatory rule.

The frontier model under test produced a complete compliance obligations memo that classified every one of the eight effective practices as either a supervisory expectation in its own right or as overlapping with mandatory national rules, with a threshold classification asserting that d226 carries "a strong gravitational pull into (B) SUPERVISORY EXPECTATION." The document's own stated purpose paragraph, by contrast, records that d226 sets out "examples of how standards set out in the CPMI-IOSCO Principles for financial market infrastructures, as supplemented by the relevant guidance, can be met."

For company secretaries, the operational consequence is direct. Board agenda items and committee briefing notes that present d226 effective practices as supervisory or mandatory obligations distort the directors' adoption decisions, create misleading minute records that may later be reviewed by national supervisors, and risk drawing the board into an over-implementation posture relative to the document's own voluntary framing. The pattern is also reproducible: it surfaces wherever a deliverable asks the model to commit to a legal characterisation of an international standard-setter publication, and it is not addressed by general-purpose prompting.

The RLB Specialist Panel records the finding under the misstated-rule failure category and binds it to verbatim regulator text drawn from the d226 final report held as primary substrate.

The full finding is recorded under Citation ID RLB-H-INT-BIS-CPMI-CPMI-IOSCO-VARIATION-MARGIN-CCPs-2025-Q004-Opus47. The regulation hub is at /regulators/j1/INT/BIS-CPMI-INT-001/CPMI-IOSCO-VARIATION-MARGIN-CCPs-2025/. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Practitioner: Accountants (CA/PA) INT BIS-CPMI

Accountants (CA/PA): AI summaries of CPMI-IOSCO VM Effective Practices 2025 may understate professional obligations

For Accountants (CA/PA) working with Streamlining Variation Margin in Centrally Cleared Markets — Examples of Effective Practices: where Specialist-Panel-verified divergences between frontier AI summaries and the...

Accountants supporting central counterparties, clearing members, and asset-management clients on variation margin control reviews are increasingly using AI to map d226 effective practices against client control libraries, draft compliance scoring matrices for internal audit, prepare regulator-readiness self-assessments for CCP governance committees, and validate disclosure footnotes that reference CPMI-IOSCO standards. Leading AI assistants tested by the RLB Specialist Panel produced confident, citable answers on the binding force of d226 that the document itself directly contradicts.

The RLB Specialist Panel tested whether two frontier AI models could correctly characterise the legal status of d226, asking them to classify each of the eight effective practices set out in the document as either a mandatory requirement with enforcement consequences, a supervisory expectation that regulators will test against, or voluntary guidance with no binding legal force. The exercise targeted what the Panel calls inverted modality: AI commitments that flip the binding force of a source text from voluntary illustration to supervisory or mandatory rule.

The frontier model under test produced a complete compliance obligations memo that classified every one of the eight effective practices as either a supervisory expectation in its own right or as overlapping with mandatory national rules, with a threshold classification asserting that d226 carries "a strong gravitational pull into (B) SUPERVISORY EXPECTATION." The document's own stated purpose paragraph, by contrast, records that d226 sets out "examples of how standards set out in the CPMI-IOSCO Principles for financial market infrastructures, as supplemented by the relevant guidance, can be met."

For accountants, the operational consequence is direct. Control assessment matrices and audit work papers that score clients against d226 practices as if they were supervisory pass/fail criteria distort residual-risk ratings, push remediation budgets toward voluntary illustrations, and risk under-rating exposures that arise from the underlying PFMI Principles or national rulebook overlays. The pattern is also reproducible: it surfaces wherever a deliverable asks the model to commit to a legal characterisation of an international standard-setter publication, and it is not addressed by general-purpose prompting.

The RLB Specialist Panel records the finding under the misstated-rule failure category and binds it to verbatim regulator text drawn from the d226 final report held as primary substrate.

The full finding is recorded under Citation ID RLB-H-INT-BIS-CPMI-CPMI-IOSCO-VARIATION-MARGIN-CCPs-2025-Q004-Opus47. The regulation hub is at /regulators/j1/INT/BIS-CPMI-INT-001/CPMI-IOSCO-VARIATION-MARGIN-CCPs-2025/. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

Practitioner: Lawyers INT BIS-CPMI

Lawyers: AI summaries of CPMI-IOSCO VM Effective Practices 2025 may understate professional obligations

For Lawyers working with Streamlining Variation Margin in Centrally Cleared Markets — Examples of Effective Practices: where Specialist-Panel-verified divergences between frontier AI summaries and the regulator's...

Lawyers advising central counterparties, clearing members, and asset managers on variation margin obligations are increasingly using AI to draft board memos on CPMI-IOSCO d226, classify the legal status of each effective practice for the Audit and Risk Committee, validate cross-references between d226 and the underlying PFMI Principles, and prepare partner-level briefings on whether national regulators will treat the document as a supervisory expectation or as non-binding guidance. Leading AI assistants tested by the RLB Specialist Panel produced confident, citable answers on the binding force of d226 that the document itself directly contradicts.

The RLB Specialist Panel tested whether two frontier AI models could correctly characterise the legal status of d226, asking them to classify each of the eight effective practices set out in the document as either a mandatory requirement with enforcement consequences, a supervisory expectation that regulators will test against, or voluntary guidance with no binding legal force. The exercise targeted what the Panel calls inverted modality: AI commitments that flip the binding force of a source text from voluntary illustration to supervisory or mandatory rule.

The frontier model under test produced a complete compliance obligations memo that classified every one of the eight effective practices as either a supervisory expectation in its own right or as overlapping with mandatory national rules, with a threshold classification asserting that d226 carries "a strong gravitational pull into (B) SUPERVISORY EXPECTATION." The document's own stated purpose paragraph, by contrast, records that d226 sets out "examples of how standards set out in the CPMI-IOSCO Principles for financial market infrastructures, as supplemented by the relevant guidance, can be met."

For lawyers, the operational consequence is direct. Partner-level memos and board briefings that classify d226 practices as supervisory expectations or mandatory obligations create disclosure exposure to clients, audit committees, and counterparties who rely on the legal characterisation to size implementation budgets, draft rulebook amendments, and respond to supervisory dialogue. The pattern is also reproducible: it surfaces wherever a deliverable asks the model to commit to a legal characterisation of an international standard-setter publication, and it is not addressed by general-purpose prompting.

The RLB Specialist Panel records the finding under the misstated-rule failure category and binds it to verbatim regulator text drawn from the d226 final report held as primary substrate.

The full finding is recorded under Citation ID RLB-H-INT-BIS-CPMI-CPMI-IOSCO-VARIATION-MARGIN-CCPs-2025-Q004-Opus47. The regulation hub is at /regulators/j1/INT/BIS-CPMI-INT-001/CPMI-IOSCO-VARIATION-MARGIN-CCPs-2025/. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

↑ Back to top