Alert: Frontier AI models misread CPMI-IOSCO VM Effective Practices 2025
RegLegBrief's Specialist Panel finds frontier AI models with web search enabled diverge from the regulator's verbatim text of Streamlining Variation Margin in Centrally Cleared Markets, Examples of Effective...
AI lab teams fielding frontier models into capital markets workflows are routinely asked to characterise the legal status of international standard-setter publications. The Bank for International Settlements' Committee on Payments and Market Infrastructures and the International Organization of Securities Commissions issued document d226 on 15 January 2025, setting out eight effective practices for streamlining variation margin in centrally cleared markets.
The document expressly records its own stated purpose as providing "examples of how standards set out in the CPMI-IOSCO Principles for financial market infrastructures, as supplemented by the relevant guidance, can be met." A frontier AI model tested by the RLB Specialist Panel returned a confident, citable compliance obligations memo that converted that voluntary illustration into a supervisory baseline.
The Specialist Panel ran a deliverable-pressure probe that placed the model in the role of a CCP General Counsel preparing a compliance obligations memo for the board's Audit and Risk Committee, with the deliverable required to classify each of the eight d226 effective practices as (A) mandatory requirement, (B) supervisory expectation, or (C) voluntary guidance. The probe surfaces what the Panel calls inverted modality: an AI commitment that flips the binding force of a source text from voluntary illustration to supervisory or mandatory rule under deliverable pressure.
The model produced a complete memo whose threshold paragraph correctly identified d226 as voluntary, then immediately overrode that identification, and proceeded to classify every one of the eight practices as a supervisory expectation in its own right or as overlapping with mandatory national rules.
For AI lab teams, the operational implication is that a frontier model under deliverable pressure on an international standard-setter publication may default to the more demanding characterisation even where the source text and the model's own threshold paragraph state otherwise. The failure pattern is reproducible, surfaces only under deliverable prompts that require specific per-item classifications and cited language, and is not addressed by general-purpose prompting. The RLB Specialist Panel records the finding under the misstated-rule failure category and binds it to verbatim regulator text drawn from the d226 final report held as primary substrate.
The full finding is recorded under Citation ID RLB-H-INT-BIS-CPMI-CPMI-IOSCO-VARIATION-MARGIN-CCPs-2025-Q004-Opus47. The regulation hub is at /regulators/j1/INT/BIS-CPMI-INT-001/CPMI-IOSCO-VARIATION-MARGIN-CCPs-2025/. Questions are prepared by the RLB Specialist Panel based on real practical AI usage in the workflows the respective audience uses AI for. The Panel binds each AI finding to verbatim regulator-issued source text held as primary substrate.