AI subject tested: Claude Sonnet 4.6 (web search on)
Question (paraphrased): Which FCA Dear CEO letters remain in force after Consumer Duty implementation, and how many pre-Consumer Duty letters did the FCA formally withdraw?
AI response:
"there is no publicly available consolidated list in the search results specifying exactly which pre-Consumer Duty letters have been formally withdrawn and how many remain in force as at 2025... I cannot provide a verified count or a complete current list from the available search results."
Regulator verbatim text:
"From FS25/2 (March 2025): FCA reviewed all Dear CEO letters pre-dating the 2022-25 strategy and withdrew 90+ such letters. These are no longer live supervisory expectations."
Failure mode: inference_drift
Substrate document: p_15_OTHER_PART_CIRCULAR___Dear_CEO_letters_withdra_page.html
This finding documents a confirmed hallucination by Claude Sonnet 4.6 (web search on) on a probe of the regulation. The model's response was tested against the regulator's verbatim primary text and classified as inference_drift. Full per-finding context is available via the linked Citation ID.
Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.
RegLeg Specialist Panel (2026). "Which FCA Dear CEO letters remain in force after Consumer Duty implementation, and how many pre-Consumer Duty letters di — AI Labs." Citation ID: RLB-H-GB-FCA-CONSUMER-DUTY-PS22-9-Q020-Sonnet46. RegLegBrief AI Hallucination Research, published 2026-06-07. https://reglegbrief.com/regulators/j3/GB/FCA/CONSUMER-DUTY-PS22-9/whitepaper/finding/GB-FCA-GB-001-CONSUMER-DUTY-PS22-9-v1-020--sonnet-46-websearch/
RegLeg Specialist Panel. (2026). Which FCA Dear CEO letters remain in force after Consumer Duty implementation, and how many pre-Consumer Duty letters di [Hallucination finding RLB-H-GB-FCA-CONSUMER-DUTY-PS22-9-Q020-Sonnet46]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j3/GB/FCA/CONSUMER-DUTY-PS22-9/whitepaper/finding/GB-FCA-GB-001-CONSUMER-DUTY-PS22-9-v1-020--sonnet-46-websearch/
RegLeg Specialist Panel, Which FCA Dear CEO letters remain in force after Consumer Duty implementation, and how many pre-Consumer Duty letters di [RLB-H-GB-FCA-CONSUMER-DUTY-PS22-9-Q020-Sonnet46], RegLegBrief AI Hallucination Research (June 07, 2026), https://reglegbrief.com/regulators/j3/GB/FCA/CONSUMER-DUTY-PS22-9/whitepaper/finding/GB-FCA-GB-001-CONSUMER-DUTY-PS22-9-v1-020--sonnet-46-websearch/.
@misc{reglegbrief_RLB_H_GB_FCA_CONSUMER_DUTY_PS22_9_Q020_Sonnet46,
author = {RegLeg Specialist Panel},
title = {Which FCA Dear CEO letters remain in force after Consumer Duty implementation, and how many pre-Consumer Duty letters di},
year = {2026},
publisher = {RegLegBrief AI Hallucination Research},
note = {Hallucination finding Citation ID: RLB-H-GB-FCA-CONSUMER-DUTY-PS22-9-Q020-Sonnet46},
url = {https://reglegbrief.com/regulators/j3/GB/FCA/CONSUMER-DUTY-PS22-9/whitepaper/finding/GB-FCA-GB-001-CONSUMER-DUTY-PS22-9-v1-020--sonnet-46-websearch/}
}
Every finding on this page compares an AI subject's account of the rule against the regulator's verbatim text from the regulator's own portal. Both are linked. Each delta, its root causes, and impact analysis are documented and published with immutable Citation IDs.