AI Hallucination ResearchAudiencesSectorsInternational / MultilateralInvestment BankingOperations › Guidance on Cyber Resilience for Financial Market Infrastructures (CPMI-IOSCO 2016)
Investment Banking × Operations — International / Multilateral · updated 2026-06-11 · methodology v2.3
Share / Print Twitter LinkedIn Email

AI Hallucination on Guidance on Cyber Resilience for Financial Market Infrastructures (CPMI-IOSCO 2016) for Operations teams at Investment Banking firms in international jurisdictions

Investment Banking Operations teams: documentation and reporting gaps possible from AI reading of CPMI-IOSCO Cyber Resilience Guidance

Operations teams at investment banks running CCP-clearing and CSD-settlement participation are increasingly relying on AI to draft cyber-incident response runbooks for clearing-counterparty operations, generate operational-recovery playbooks, prepare resilience-testing scope documents, and update business-continuity briefings citing the CPMI-IOSCO 2016 framework. In practice, AI is used to draft cyber-incident response runbooks for clearing and settlement counterparty operations, generate operational-recovery playbooks citing CPMI-IOSCO 2016 expectations, prepare resilience-testing scope documents against the 2016 guidance categories, and update CCP/CSD-participant business-continuity briefings.

That workflow places the regulator-issued text of the 2016 guidance, its 2018-2020 derivative standards, and its current operative status at the centre of every AI-generated deliverable for investment-banking operations teams.

Two frontier AI models tested by the RegLeg Brief Specialist Panel produced confident, citable reconstructions of the CPMI-IOSCO 2016 Cyber Guidance (June 2016) that the regulator-issued primary text directly contradicts across nine findings spanning four failure classes: Source-Credit Fabrication (an asserted NIST Cybersecurity Framework citation that the 2016 guidance does not contain), Misattribution (the slogan 'secure the periphery, protect the core' located inside CPMI-IOSCO 2016 guidance or its 2018 wholesale-payments paper rather than the actual 2018 speech source), Anachronistic Cross-Reference (the 2016 guidance asserted as definitionally aligned with the November 2018 FSB Cyber Lexicon and the October 2020 FSB Effective Practices that postdate it), and Outdated Standing Claim (the 2016 guidance presented as the unchanged operative standard when CPMI-IOSCO has issued a May 2026 consultative document under active revision).

Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows investment-banking operations teams use AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.

For investment-banking operations teams, the failure pattern is operationally consequential. A cyber-incident response runbook that records the 2016 guidance as containing forensic-analysis-database operational depth points the operations team at a specification level the 2016 text does not contain. A resilience-testing scope document that records the 2016 guidance as the unchanged operative standard misstates the regulatory horizon at the testing-scope date.

The audit's nine findings are documented with immutable RLB Citation IDs. Representative entries include RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q008-Opus47, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q008-Sonnet46, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q014-Opus47, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q014-Sonnet46, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q019-Sonnet46, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q020-Opus47, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q020-Sonnet46, RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q022-Opus47, and RLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q022-Sonnet46. The full audit is documented at the CPMI-IOSCO 2016 Cyber Resilience Guidance hub on RegLegBrief.com.

<- Take me back to my Operations x Investment Banking (INT) overview

Executive Summary

The CPMI-IOSCO 2016 Cyber Resilience Guidance is the international FMI cyber standard, and it sits at the centre of cyber-programme work for operations teams at investment banks responsible for cyber-incident response, operational resilience workflow, and clearing/settlement continuity that anchor on the international FMI cyber standard. Across 9 findings in this cell, AI models on web search produced confident answers on the regulator-framework alignment, the strategic provenance of CPMI cyber language, the depth of incident response and recovery content, the definitional consistency of cyber-resilience terminology with the 2018 FSB Cyber Lexicon, and the operative status of the 2016 guidance.

Each answer recorded a position the source documents do not support, and each one converts into operational programme reference exposure when the AI output enters a Operations teams at Investment Banking firms deliverable without verification.

How AI gets this regulation wrong

The 9 findings cluster across 3 failure modes. The models inferred regulator-framework cross-references that the source does not establish, misattributed regulator strategic language to the wrong publication, overstated the operational depth of the 2016 standard against later FSB work, asserted definitional consistency with the FSB Cyber Lexicon across a two-year publication gap, and missed the active CPMI-IOSCO revision cycle opened by the May 2026 consultative document. The table below maps each finding to its failure mode.

AI's Failure ModeCountAffected findings
Inference Drift1Finding#1
Inference Drift1Finding#2
Misattributed2Finding#3 · Finding#4
Misattributed1Finding#5
Inference Drift1Finding#6
Inference Drift1Finding#7
Outdated1Finding#8
Outdated1Finding#9

What that means for your practice

For Operations teams at Investment Banking firms, every failure in this cell feeds into the same risk concentration: operational programme reference exposure. The table below shows how that risk distributes across the individual findings; whether the underlying fault was an asserted framework alignment, a misattributed regulator phrase, or a missed revision cycle, the deliverable exposure for Operations teams at Investment Banking firms is materially the same.

Risk ImpactCountAffected findings
Wrong deliverable on cybersecurity framework alignment2Finding#1 · Finding#2
Wrong deliverable from misattributed regulator phrase2Finding#3 · Finding#4
Wrong deliverable on incident response and recovery scope1Finding#5
Wrong deliverable on definitional alignment with FSB Lexicon1Finding#6
Wrong deliverable on definitional derivation from FSB Lexicon1Finding#7
Outdated deliverable on the current operative cyber guidance2Finding#8 · Finding#9

When this affects Operations teams at Investment Banking firms

Operations teams at Investment Banking firms apply the 2016 CPMI-IOSCO Cyber Resilience Guidance across incident response runbook design, post-trade resilience workflow, programme alignment evidence packs for operational risk committees, and inputs to the operations annual programme review. AI tools enter the work where the team is drafting programme-foundation references, regulator-alignment passages, definitional grounding in policy and KRI documentation, and horizon-scanning entries on the operative status of the standard.

The five question types tested here map onto the five places AI output is most likely to enter a team deliverable: the framework cross-reference question, the regulator strategic-phrase provenance question, the operational-depth question on incident response and recovery, the definitional alignment question with the FSB Cyber Lexicon, and the operative-status question on whether the 2016 guidance is under revision.

The specific findings show how each of those question types fails. The framework cross-reference returns an asserted NIST CSF alignment the 2016 source does not contain. The strategic-phrase provenance attributes 'secure the periphery, protect the core' to the 2016 guidance or to a 2018 fraud paper rather than to the 2018 Cœuré speech that is the actual source. The operational-depth answer imports FSB 2020 'Effective Practices' content into the 2016 standard. The definitional alignment asserts consistency between the 2016 guidance and the November 2018 FSB Cyber Lexicon across a two-year publication gap.

The operative-status answer misses the May 2026 CPMI-IOSCO consultative document and records the 2016 guidance as standing without active revision.

The findings at a glance

The table below lists each finding from the AI testing on the CPMI-IOSCO Cyber Resilience Guidance in this cell, showing the topic, the AI failure mode, and the citation identifier.

#Finding titleTypeCitation ID
1NIST Cybersecurity Framework cross-reference asserted without verificationHallucinationRLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q008-Opus47
2NIST Cybersecurity Framework citation asserted as explicitHallucinationRLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q008-Sonnet46
3'Secure the periphery, protect the core' misattributed to 2018 wholesale-payments workHallucinationRLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q014-Opus47
4'Secure the periphery, protect the core' misattributed to May 2019 BIS-CPMI speechHallucinationRLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q014-Sonnet46
5Operational depth of incident response and recovery overstated against FSB 2020 workHallucinationRLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q019-Sonnet46
6Cyber resilience definition asserted consistent with later FSB Cyber LexiconHallucinationRLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q020-Opus47
7FSB Cyber Lexicon derivation claim added beyond the source textHallucinationRLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q020-Sonnet46
82016 guidance presented as unrevised in 2026, missing the May 2026 consultationHallucinationRLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q022-Opus47
92016 guidance presented as ongoing monitoring only, missing the May 2026 consultative documentHallucinationRLB-H-INT-BIS-CPMI-IOSCO-CYBER-RESILIENCE-FMI-2016-Q022-Sonnet46

Aggregate impact

Considered together, the 9 findings describe a generation pattern that Operations teams at Investment Banking firms should anticipate when AI tools are used for work on the 2016 CPMI-IOSCO guidance. The models produce confident framework-alignment, provenance, definitional, and operational-depth answers without grounding them in the source text, and miss regulator revision activity that breaks the assumption the 2016 guidance is the standing operative standard. Three structural drivers compound the failure modes.

First, the principles-based category structure of the 2016 guidance is structurally similar to the NIST CSF five functions, which makes the wrong assertion of an explicit NIST citation look plausible. Second, the FSB and BIS publication streams around cyber resilience are dense and overlapping (the 2018 FSB Cyber Lexicon, the 2020 FSB 'Effective Practices' paper, Cœuré's 2018 speech, the 2018 wholesale-payments fraud work, the Level 3 monitoring reports), which makes provenance attribution easy to get wrong.

Third, CPMI-IOSCO's revision cycle on the 2016 guidance opened publicly on 6 May 2026; models with a January 2026 cutoff will record the guidance as standing without active revision unless a retrieval step pulls the BIS press release stream for the deliverable period.

For Operations teams at Investment Banking firms, the practical effect is that any deliverable referencing the 2016 guidance, any framework-alignment passage, any cyber-strategy provenance line, any definitional alignment to the FSB Cyber Lexicon, any operational-depth comparison against FSB 2020, and any horizon-scanning entry on the operative status of the standard needs to be verified against the source documents and against the BIS press release stream for the deliverable period before it enters the team's deliverable.

What your team should do

Operations teams at Investment Banking firms should treat AI tools as a research-prompt generator on 2016 CPMI-IOSCO guidance work, with a mandatory verification step against the source documents and the BIS press release stream before AI output enters a team deliverable. The five question types in this cell concentrate on the five places AI output is most likely to enter a deliverable: regulator-framework cross-reference, strategic-phrase provenance, operational-depth comparison, definitional alignment with the FSB Cyber Lexicon, and operative-status statement.

Practical safeguards: (a) every regulator-framework cross-reference (NIST CSF, ISO/IEC 27000, COBIT) must be matched to the cited regulator document directly; the asserted alignment from the AI is not evidence. (b) Every CPMI or BIS strategic-phrase attribution must be verified against the BIS speech archive and the publications page for the cited year. (c) Every operational-depth statement on incident response and recovery must be checked against the FSB 2020 'Effective Practices' document directly, not inferred from the 2016 guidance. (d) Every definitional alignment with the FSB Cyber Lexicon must be tested definition-by-definition against the November 2018 FSB document.

(e) Every statement on the operative status of the 2016 guidance must be checked against the BIS press release stream for the deliverable period, with a specific check for any open CPMI-IOSCO consultation; the May 2026 consultative document is the current marker.

Where AI tools support the work: outlining the structure of a deliverable on the 2016 guidance, identifying which of the guidance categories may be relevant to a particular question, drafting first-pass summaries for verification against the source, and surfacing adjacent regulator publications that the team can verify directly.

How RLB Can Help

RegLeg's published Hallucination Research is available as a free pre-flight check for international cyber-programme work on the 2016 CPMI-IOSCO guidance. Before relying on AI-assisted output for regulator-framework cross-references, definitional alignments, or operative-status statements, Operations teams at Investment Banking firms can consult the research to identify where AI tools have demonstrably mis-stated the regulator record: asserted NIST CSF alignments, misattributed CPMI strategic phrases, overstated operational depth, asserted FSB Cyber Lexicon consistency, and missed revision activity. The research covers specific regulator instruments and surfaces the exact questions where AI tools have failed, making it a practical reference rather than a general caution.

For firms where multiple teams in Investment Banking are working the same regulatory portfolio, RegLeg offers bespoke deep-dives into individual cyber instruments. These engagements go beyond the published findings to examine the full pattern of AI failure modes relevant to the instrument, with the failure modes mapped to Operations deliverables specifically. The output is designed to be shared across functions and used as a durable reference, reducing duplicated due-diligence effort and creating a consistent internal standard for AI-assisted regulatory work.

RegLeg also develops training and CPD-aligned content for Operations teams at Investment Banking firms. The material translates the failure-mode catalogue into practical guidance on the classes of error to watch for: asserted regulator citations that the source does not contain, misattributed regulator strategic phrases, definitional alignments collapsed across publication gaps, and missed regulator revision activity. Separately, RegLeg offers a confidential review of a Operations teams at Investment Banking firms AI-use policy against the failure-mode catalogue, identifying gaps between the policy's assumptions and the documented evidence of how AI tools perform on the 2016 guidance in practice.

Every finding on this page compares an AI subject's account of the rule against the regulator's verbatim text from the regulator's own portal. Both are linked. Each delta, its root causes, and impact analysis are documented and published with immutable Citation IDs.