AI subject tested: Claude Sonnet 4.6 (web search on)
Question (paraphrased): Has the FCA withdrawn pre-Consumer Duty Dear CEO letters following implementation, and if so how many were removed and under what document?
AI response:
"I cannot provide a verified specific number of withdrawn letters from the available search results... the search results do not identify a definitive public list of how many specific pre-Consumer Duty Dear CEO letters have been formally withdrawn"
Regulator verbatim text:
"FS25/2 (March 2025): FCA removed more than 90 pre-Consumer Duty Dear CEO letters and cleared over 100 old multi-firm reports. Harmonising definitions of 'retail customer' and 'SME' across Handbook."
Failure mode: inference_drift
Substrate document: p_21_ACT_FS25_2__March_2025____Rules_and_Dear_CEO_137A.html
This finding documents a confirmed hallucination by Claude Sonnet 4.6 (web search on) on a probe of the regulation. The model's response was tested against the regulator's verbatim primary text and classified as inference_drift. Full per-finding context is available via the linked Citation ID.
Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.
RegLeg Specialist Panel (2026). "Has the FCA withdrawn pre-Consumer Duty Dear CEO letters following implementation, and if so how many were removed and u — AI Labs." Citation ID: RLB-H-GB-FCA-CONSUMER-DUTY-PS22-9-Q013-Sonnet46. RegLegBrief AI Hallucination Research, published 2026-06-07. https://reglegbrief.com/regulators/j3/GB/FCA/CONSUMER-DUTY-PS22-9/whitepaper/finding/GB-FCA-GB-001-CONSUMER-DUTY-PS22-9-v1-013--sonnet-46-websearch/
RegLeg Specialist Panel. (2026). Has the FCA withdrawn pre-Consumer Duty Dear CEO letters following implementation, and if so how many were removed and u [Hallucination finding RLB-H-GB-FCA-CONSUMER-DUTY-PS22-9-Q013-Sonnet46]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j3/GB/FCA/CONSUMER-DUTY-PS22-9/whitepaper/finding/GB-FCA-GB-001-CONSUMER-DUTY-PS22-9-v1-013--sonnet-46-websearch/
RegLeg Specialist Panel, Has the FCA withdrawn pre-Consumer Duty Dear CEO letters following implementation, and if so how many were removed and u [RLB-H-GB-FCA-CONSUMER-DUTY-PS22-9-Q013-Sonnet46], RegLegBrief AI Hallucination Research (June 07, 2026), https://reglegbrief.com/regulators/j3/GB/FCA/CONSUMER-DUTY-PS22-9/whitepaper/finding/GB-FCA-GB-001-CONSUMER-DUTY-PS22-9-v1-013--sonnet-46-websearch/.
@misc{reglegbrief_RLB_H_GB_FCA_CONSUMER_DUTY_PS22_9_Q013_Sonnet46,
author = {RegLeg Specialist Panel},
title = {Has the FCA withdrawn pre-Consumer Duty Dear CEO letters following implementation, and if so how many were removed and u},
year = {2026},
publisher = {RegLegBrief AI Hallucination Research},
note = {Hallucination finding Citation ID: RLB-H-GB-FCA-CONSUMER-DUTY-PS22-9-Q013-Sonnet46},
url = {https://reglegbrief.com/regulators/j3/GB/FCA/CONSUMER-DUTY-PS22-9/whitepaper/finding/GB-FCA-GB-001-CONSUMER-DUTY-PS22-9-v1-013--sonnet-46-websearch/}
}
Every finding on this page compares an AI subject's account of the rule against the regulator's verbatim text from the regulator's own portal. Both are linked. Each delta, its root causes, and impact analysis are documented and published with immutable Citation IDs.