AI Labs · updated 2026-05-29 · methodology v2.1

Finding on 'Q017 Probe' for Claude Sonnet 4.6 with web search ON

RLB Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q017-Sonnet46

What the RLB Specialist Panel found

Finding on 'Q017 Probe' for Claude Sonnet 4.6 with web search ON

Question (paraphrased to protect IP): What changes to PFMI Principle 15's general business risk requirements are currently proposed? Is the 6-month liquid net assets floor being revised or supplemented?
AI's response: "d229 proposes to supplement it with risk-sensitive guidance requiring FMIs to assess LNAFE based on their specific general business risk profile rather than defaulting to a mechanical 6-month minimum… Comments closed 6 February 2026."
Regulator's text: [d229 published November 2025 — beyond the training window of all current AI models]
Why the AI went wrong: The model produced a specific and detailed account of a November 2025 document — including a precise comment-period closing date — that it could not have retrieved from any accessible source. The direction of the proposed change (risk-based supplement, not mechanical minimum) is plausible given the general trajectory of CPMI-IOSCO work, but the specific comment deadline is a fabricated fact that would mislead a compliance professional managing a consultation response. The cited URL resolves to third-party commentary, not the primary document.
Cited source(s):
https://www.regulationtomorrow.com/2025/11/cpmi-iosco-papers-on-management-of... — Pretextual

Impact for this audience

The fabricated comment-period closing date (6 February 2026) is the most operationally consequential single error in this finding set: a compliance professional managing a consultation response who acts on this date would miss the actual deadline. This specific type of fabrication — a precise, actionable date presented with high confidence — should be explicitly targeted in safety and harm-assessment eval design for models deployed in legal and compliance contexts.

← Previous finding Finding on 'Q014 Probe' for Claude Sonnet 4.6 with web search ON Next finding → Finding on 'Q022 Probe' for Claude Sonnet 4.6 with web search ON

Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q017-Sonnet46

Plain text Download

RegLeg Specialist Panel (2026). "Finding on 'Q017 Probe' for Claude Sonnet 4.6 with web search ON — AI Labs." Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q017-Sonnet46. RegLegBrief AI Hallucination Research, published 2026-05-29. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-017--sonnet-46-websearch/

APA 7th edition Download

RegLeg Specialist Panel. (2026). Finding on 'Q017 Probe' for Claude Sonnet 4.6 with web search ON [Hallucination finding RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q017-Sonnet46]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-017--sonnet-46-websearch/

Bluebook / OSCOLA (US + UK legal) Download

RegLeg Specialist Panel, Finding on 'Q017 Probe' for Claude Sonnet 4.6 with web search ON [RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q017-Sonnet46], RegLegBrief AI Hallucination Research (May 29, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-017--sonnet-46-websearch/.

BibTeX Download

@misc{reglegbrief_RLB_H_INT_BIS_CPMI_IOSCO_PFMI_2012_Q017_Sonnet46,
  author    = {RegLeg Specialist Panel},
  title     = {Finding on 'Q017 Probe' for Claude Sonnet 4.6 with web search ON},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-H-INT-BIS-CPMI-IOSCO-PFMI-2012-Q017-Sonnet46},
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-017--sonnet-46-websearch/}
}

← Back to case study summary Case study detail →

About Citation IDs →

Every finding on this page compares an AI subject's account of the rule against the regulator's verbatim text from the regulator's own portal. Both are linked. Each delta, its root causes, and impact analysis are documented and published with immutable Citation IDs.