AI Hallucination ResearchFindings by audienceSectorsInternational / MultilateralInvestment BankingOperationsDetail › Finding
Investment Banking × Operations — International / Multilateral · Last updated 11 Jun 2026 · Hallucination Register
Share / Print X LinkedIn Email

Finding#1, Annex F critical service provider oversight, supervisory scope inverted

RLB Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-PFMI-2012-Q011
AI's failure:Inference Drift Risk for Investment Banking × Operations:Operational decision risk
What the RLB Specialist Panel found
Question (paraphrased to protect IP)

Annex F critical service provider oversight, supervisory scope inverted

RLB's analysis

On Annex F, Claude Sonnet 4.6 with web search inverted the regulator's stated scope, asserting that authorities do not directly supervise or oversee critical service providers and that Annex F's expectations "flow from the FMI to its CSPs." Annex F's opening text expressly contemplates the opposite: a regulator, supervisor, or overseer of an FMI may want to establish expectations directed at CSPs, and the outlined expectations are "specifically targeted at critical service providers." The inversion is structural rather than textual, the model converted a regulator-to-CSP oversight channel into an FMI-internalised contractual obligation, and is the kind of failure that would not surface in standard text-completion evaluations because the surface form of the answer is internally coherent.

A probe specifically on Annex F's scope-direction language, tested against the model's default framing of FMI-CSP supervisory relationships, would expose whether the inversion is model-specific or a corpus-level pattern.

AI Head's analysis — what weakness in the AI model caused this

On Annex F, Claude Sonnet 4.6 with web search inverted the regulator's stated scope, asserting that authorities do not directly supervise or oversee critical service providers and that Annex F's expectations "flow from the FMI to its CSPs." Annex F's opening text expressly contemplates the opposite: a regulator, supervisor, or overseer of an FMI may want to establish expectations directed at CSPs, and the outlined expectations are "specifically targeted at critical service providers." The inversion is structural rather than textual — the model converted a regulator-to-CSP oversight channel into an FMI-internalised contractual obligation — and is the kind of failure that would not surface in standard text-completion evaluations because the surface form of the answer is internally coherent.

A probe specifically on Annex F's scope-direction language, tested against the model's default framing of FMI-CSP supervisory relationships, would expose whether the inversion is model-specific or a corpus-level pattern.

Impact for Operations Teams in Investment Banking Sector in international jurisdictions working with the Principles for Financial Market Infrastructures (PFMI)

For Operations teams at Investment Banking firms teams managing live CSP relationships under an FMI's operating model, the inverted scope would frame CSP performance failures as a purely contractual escalation path without contemplating a regulator-driven inquiry that may reach the CSP directly. Annex F's opening provision creates a parallel channel that operations leads need to anticipate in CSP contract governance and incident response runbooks.

References — raw findings (per AI model)
This finding also affects
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-PFMI-2012-Q011
Plain text Download
RegLeg Specialist Panel (2026). "Finding#1, Annex F critical service provider oversight, supervisory scope inverted — Investment Banking × Operations — International / Multilateral." Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-PFMI-2012-Q011. RegLegBrief AI Hallucination Research, published 2026-06-11. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/sectors/investment_banking/operations/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-011/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#1, Annex F critical service provider oversight, supervisory scope inverted [Hallucination finding RLB-F-INT-BIS-CPMI-IOSCO-PFMI-2012-Q011]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/sectors/investment_banking/operations/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-011/
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#1, Annex F critical service provider oversight, supervisory scope inverted [RLB-F-INT-BIS-CPMI-IOSCO-PFMI-2012-Q011], RegLegBrief AI Hallucination Research (June 11, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/sectors/investment_banking/operations/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-011/.
BibTeX Download
@misc{reglegbrief_RLB_F_INT_BIS_CPMI_IOSCO_PFMI_2012_Q011,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#1, Annex F critical service provider oversight, supervisory scope inverted},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-INT-BIS-CPMI-IOSCO-PFMI-2012-Q011},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/sectors/investment_banking/operations/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-011/}
}
← Back to case study summary Case study detail →

Every finding on this page compares an AI subject's account of the rule against the regulator's verbatim text from the regulator's own portal. Both are linked. Each delta, its root causes, and impact analysis are documented and published with immutable Citation IDs.