AI Hallucination Research › Regulators › Global standard-setters › INT › BIS-CPMI › CPMI-IOSCO-PFMI-2012 › White paper › Detail › Finding
AI Labs · published 2026-05-29 · methodology v2.1

Claude Sonnet 4.6 with web search

What the RLB Specialist Panel found
  • Question (paraphrased to protect IP): What specific findings, including verbatim text, does the CPMI-IOSCO Level 3 monitoring assessment on general business risks contain regarding FMI compliance with the 6-month LNAFE standard?
  • AI's response: "I do not have verbatim access to d228. I cannot retrieve or reproduce specific verbatim text, exact paragraph references, or precise quotations from the d228 PDF itself."
  • Regulator's text: [Not provided — verbatim-access question]
  • Why the AI went wrong: The model correctly declined to produce verbatim content from a November 2025 document it could not retrieve. The refusal is appropriately scoped. The cited URL maps to the d228 PDF directly — as with parallel findings, citing an acknowledged-inaccessible source is a minor inconsistency in an otherwise well-calibrated refusal.
  • Cited source(s):
  • https://www.bis.org/cpmi/publ/d228.pdf — Pretextual
Impact for this audience

Well-calibrated refusal with citation-alongside-refusal. The parallel with the Opus 4.7 finding on the same question confirms the cross-model consistency of this pattern for the d228 document specifically — a document that is formally published but not retrievable as text, which places it in a category that should be specifically represented in retrieval-failure eval probes.

← Previous finding Finding 18. Claude Sonnet 4.6 with web search Next finding → Finding 20. Claude Sonnet 4.6 with web search
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

Plain text 
RegLeg Specialist Panel (2026). "Claude Sonnet 4.6 with web search — AI Labs." Citation ID: . RegLegBrief AI Hallucination Research, published 2026-05-29. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-l3-024--sonnet-46-websearch/
APA 7th edition 
RegLeg Specialist Panel. (2026). Claude Sonnet 4.6 with web search [Hallucination finding ]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-l3-024--sonnet-46-websearch/
Bluebook / OSCOLA (US + UK legal) 
RegLeg Specialist Panel, Claude Sonnet 4.6 with web search [], RegLegBrief AI Hallucination Research (May 29, 2026), https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-l3-024--sonnet-46-websearch/.
BibTeX 
@misc{reglegbrief_,
  author    = {RegLeg Specialist Panel},
  title     = {Claude Sonnet 4.6 with web search},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: },
  url       = {https://reglegbrief.com/regulators/j1/int/bis-cpmi/cpmi-iosco-pfmi-2012/whitepaper/finding/INT-BIS-CPMI-INT-001-CPMI-IOSCO-PFMI-2012-v1-l3-024--sonnet-46-websearch/}
}
← Back to case study summary Case study detail →
About Citation IDs →