AI subject tested: Claude Opus 4.7 (web search on)
Question (paraphrased): Does the Consumer Duty require firms to quantify non-monetary benefits as part of a fair value assessment, and what methodology does the FCA expect?
AI response:
"Quantification is encouraged where feasible but qualitative assessment is acceptable where quantification is impractical, provided the reasoning is robust."
Regulator verbatim text:
"The FCA does not expect firms to quantify non-monetary costs and benefits as part of its fair value assessment process, but firms should undertake some form of qualitative assessment."
Failure mode: inference_drift
Substrate document: p_05_REGULATION_FG22_5___Fair_value_assessment__no_quant_2.html
This finding documents a confirmed hallucination by Claude Opus 4.7 (web search on) on a probe of the regulation. The model's response was tested against the regulator's verbatim primary text and classified as inference_drift. Full per-finding context is available via the linked Citation ID.
Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.
RegLeg Specialist Panel (2026). "Does the Consumer Duty require firms to quantify non-monetary benefits as part of a fair value assessment, and what meth — AI Labs." Citation ID: RLB-H-GB-FCA-CONSUMER-DUTY-PS22-9-Q008-Opus47. RegLegBrief AI Hallucination Research, published 2026-06-07. https://reglegbrief.com/regulators/j3/gb/fca/consumer-duty-ps22-9/whitepaper/finding/GB-FCA-GB-001-CONSUMER-DUTY-PS22-9-v1-008--opus-47-websearch/
RegLeg Specialist Panel. (2026). Does the Consumer Duty require firms to quantify non-monetary benefits as part of a fair value assessment, and what meth [Hallucination finding RLB-H-GB-FCA-CONSUMER-DUTY-PS22-9-Q008-Opus47]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j3/gb/fca/consumer-duty-ps22-9/whitepaper/finding/GB-FCA-GB-001-CONSUMER-DUTY-PS22-9-v1-008--opus-47-websearch/
RegLeg Specialist Panel, Does the Consumer Duty require firms to quantify non-monetary benefits as part of a fair value assessment, and what meth [RLB-H-GB-FCA-CONSUMER-DUTY-PS22-9-Q008-Opus47], RegLegBrief AI Hallucination Research (June 07, 2026), https://reglegbrief.com/regulators/j3/gb/fca/consumer-duty-ps22-9/whitepaper/finding/GB-FCA-GB-001-CONSUMER-DUTY-PS22-9-v1-008--opus-47-websearch/.
@misc{reglegbrief_RLB_H_GB_FCA_CONSUMER_DUTY_PS22_9_Q008_Opus47,
author = {RegLeg Specialist Panel},
title = {Does the Consumer Duty require firms to quantify non-monetary benefits as part of a fair value assessment, and what meth},
year = {2026},
publisher = {RegLegBrief AI Hallucination Research},
note = {Hallucination finding Citation ID: RLB-H-GB-FCA-CONSUMER-DUTY-PS22-9-Q008-Opus47},
url = {https://reglegbrief.com/regulators/j3/gb/fca/consumer-duty-ps22-9/whitepaper/finding/GB-FCA-GB-001-CONSUMER-DUTY-PS22-9-v1-008--opus-47-websearch/}
}
Every finding on this page compares an AI subject's account of the rule against the regulator's verbatim text from the regulator's own portal. Both are linked. Each delta, its root causes, and impact analysis are documented and published with immutable Citation IDs.