AI Hallucination Research › Briefings

Briefings Blog

The running blog from the RLB Specialist Panel delves into real-world scenarios where the compliance, legal, or AI lab team interacts with frontier AI models under specific regulations. The blogs are anonymised to remove client-specific details and include insights from the RLB team analysing the hallucinations experienced in AI models while working on these cases. For example, when a model returns a confident answer that contradicts the regulator's primary text, such as a fabricated staff letter, a wrong appendix, or an inverted scope, these issues are discussed here. Each blog explains one set of findings and what it would have meant for the team that would have acted on it, sans this research initiative. This blog is frequently updated, a few times a day.

263 briefings in the archive · Subscribe via Atom: /briefings/feed.xml (this blog) · /feed.xml (all RegLegBrief publications)
Audience colours: AI Labs Practitioner (profession) Sector × Department
Audience
Jur.
Regulator
Profession
Sector
Dept
Range
Sort
Per page
Showing 5 of 263 · page 44 of 53
Thursday, 03 September 2026
Sector: Hedge Funds and Dept: Risk US CFTC

Hedge Funds Risk teams: documentation and reporting gaps possible from AI reading of CFTC Digital Asset Collateral & Tokenized Assets Staff Guidance (2025)

For Hedge Funds Risk teams working with CFTC Digital Asset Collateral No-Action Relief and Tokenized Asset Staff Guidance (Market Participants Division, December 2025): Specialist-Panel-verified findings on where AI...

Risk teams at hedge funds posting digital assets as customer margin collateral under the CFTC Digital Asset Collateral Framework are increasingly using AI to model haircut treatment across registered DCOs, generate desk-facing notes on under-collateralisation exposure, and validate the multi-DCO haircut rule against the CFTC's published staff guidance.

The RLB Specialist Panel put a set of practitioner-grade questions on the CFTC Digital Asset Collateral Framework to two frontier AI models with web search active. Each question is prepared by the Panel based on the workflows that risk teams at hedge funds firms actually use AI for under the Market Participants Division's December 2025 staff letter, as amended by Staff Letter 26-05. The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate.

On the CFTC Digital Asset Collateral Framework, the AI subjects returned a single hallucinated answer for risk teams at hedge funds firms, in the form of Dropped-Qualifier Misstated Rule.

For risk teams at hedge funds firms accepting or posting digital asset margin collateral under the CFTC Digital Asset Collateral Framework, the accuracy of the haircut methodology and the post-onboarding reporting map drives the firm's customer-collateral coverage and its ongoing regulatory standing. A haircut model built on the base 20 per cent floor instead of the multi-DCO highest-accepted-rate rule produces systematically light collateralisation across customer accounts that hold the same digital asset across multiple DCOs, an exposure that surfaces only in stress, by which point the under-collateralisation has been priced into the customer book for months.

A post-phase obligation map that drops the weekly digital asset reporting cadence creates a recurring reporting violation that accrues silently between regulator engagements. The risk team owns the model assumptions and the obligation map, and each of these errors translates directly into mis-priced customer-collateral exposure, regulatory enforcement risk, and an inaccurate stress-testing baseline. The downstream cost of correcting a haircut model assumption after the customer book has been onboarded under the wrong rule is materially higher than the cost of verifying the conditional selection rule against the staff letter before the model goes into production.

The published Specialist Panel findings carry the following citation identifiers:

Sector: Investment Banking and Dept: Risk US CFTC

Investment Banking Risk teams: documentation and reporting gaps possible from AI reading of CFTC Digital Asset Collateral & Tokenized Assets Staff Guidance (2025)

For Investment Banking Risk teams working with CFTC Digital Asset Collateral No-Action Relief and Tokenized Asset Staff Guidance (Market Participants Division, December 2025): Specialist-Panel-verified findings on...

Risk teams at investment banks accepting digital assets as customer margin collateral under the CFTC Digital Asset Collateral Framework are increasingly using AI to model haircut requirements across registered DCOs, generate counterparty-risk update notes on payment stablecoin acceptability, and validate the post-onboarding obligation map against the CFTC's published conditions.

The RLB Specialist Panel put a set of practitioner-grade questions on the CFTC Digital Asset Collateral Framework to two frontier AI models with web search active. Each question is prepared by the Panel based on the workflows that risk teams at investment banking firms actually use AI for under the Market Participants Division's December 2025 staff letter, as amended by Staff Letter 26-05. The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate.

On the CFTC Digital Asset Collateral Framework, the AI subjects returned two hallucinated answers for risk teams at investment banking firms, in the form of Inverted-Position Fabrication together with Dropped-Qualifier Misstated Rule.

For risk teams at investment banking firms accepting or posting digital asset margin collateral under the CFTC Digital Asset Collateral Framework, the accuracy of the haircut methodology and the post-onboarding reporting map drives the firm's customer-collateral coverage and its ongoing regulatory standing. A haircut model built on the base 20 per cent floor instead of the multi-DCO highest-accepted-rate rule produces systematically light collateralisation across customer accounts that hold the same digital asset across multiple DCOs, an exposure that surfaces only in stress, by which point the under-collateralisation has been priced into the customer book for months.

A post-phase obligation map that drops the weekly digital asset reporting cadence creates a recurring reporting violation that accrues silently between regulator engagements. The risk team owns the model assumptions and the obligation map, and each of these errors translates directly into mis-priced customer-collateral exposure, regulatory enforcement risk, and an inaccurate stress-testing baseline. The downstream cost of correcting a haircut model assumption after the customer book has been onboarded under the wrong rule is materially higher than the cost of verifying the conditional selection rule against the staff letter before the model goes into production.

The published Specialist Panel findings carry the following citation identifiers:

Sector: Investment Banking and Dept: Compliance US CFTC

Investment Banking Compliance teams: documentation and reporting gaps possible from AI reading of CFTC Digital Asset Collateral & Tokenized Assets Staff Guidance (2025)

For Investment Banking Compliance teams working with CFTC Digital Asset Collateral No-Action Relief and Tokenized Asset Staff Guidance (Market Participants Division, December 2025): Specialist-Panel-verified findings...

Compliance teams at investment banks operating under the CFTC Digital Asset Collateral Framework are increasingly using AI to update FCM customer-onboarding checklists, generate trade-monitoring rule-update bulletins for the digital asset margin desk, and validate threshold calculations and reporting cadences against the operative CFTC staff letter.

The RLB Specialist Panel put a set of practitioner-grade questions on the CFTC Digital Asset Collateral Framework to two frontier AI models with web search active. Each question is prepared by the Panel based on the workflows that compliance teams at investment banking firms actually use AI for under the Market Participants Division's December 2025 staff letter, as amended by Staff Letter 26-05. The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate.

On the CFTC Digital Asset Collateral Framework, the AI subjects returned three hallucinated answers for compliance teams at investment banking firms, in the form of Inverted-Position Fabrication, Dropped-Qualifier Misattribution, and Dropped-Qualifier Misstated Rule.

For compliance teams at investment banking firms operating or supporting an FCM business under the CFTC Digital Asset Collateral Framework, internal onboarding procedures, CFTC-facing filings, and supervisor-engagement memos turn on the accuracy of the post-onboarding obligation map and the eligibility framework for payment stablecoin issuers. A compliance submission that drops the weekly digital asset reporting obligation at month four creates a recurring reporting violation that accrues silently until the next CFTC engagement. A payment stablecoin eligibility checklist missing the OCC Interpretive Letter 1183 cross-reference produces representations that cannot withstand examiner scrutiny.

A haircut model built on the base 20 per cent floor instead of the multi-DCO highest-accepted-rate rule produces systematically under-collateralised customer accounts on the digital asset book.

The published Specialist Panel findings carry the following citation identifiers:

Practitioner: Stockbrokers / Trading Reps US CFTC

Stockbrokers / Trading Reps: AI summaries of CFTC Digital Asset Collateral & Tokenized Assets Staff Guidance (2025) may understate professional obligations

For Stockbrokers / Trading Reps working with CFTC Digital Asset Collateral No-Action Relief and Tokenized Asset Staff Guidance (Market Participants Division, December 2025): where Specialist-Panel-verified...

Stockbrokers and trading representatives operating under the CFTC Digital Asset Collateral Framework are increasingly using AI to draft client-facing summaries of digital asset margin eligibility, update internal trading-desk procedure notes on payment stablecoin acceptance, and validate the haircut treatment for customer-posted digital asset collateral against the operative CFTC staff letter.

The RLB Specialist Panel put a set of practitioner-grade questions on the CFTC Digital Asset Collateral Framework to two frontier AI models with web search active. Each question is prepared by the Panel based on the workflows that stockbrokers and trading representatives actually use AI for under the Market Participants Division's December 2025 staff letter, as amended by Staff Letter 26-05. The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate.

On the CFTC Digital Asset Collateral Framework, the AI subjects returned three hallucinated answers for stockbrokers and trading representatives, in the form of Inverted-Position Fabrication, Dropped-Qualifier Misattribution, and Dropped-Qualifier Misstated Rule.

For stockbrokers and trading representatives whose desks accept digital asset margin collateral on behalf of FCM-affiliated firms, or who interact with FCM-counterparty desks under this framework, citation accuracy in client-facing summaries and internal trading-desk procedure notes is load-bearing. A trading-desk memo that mis-classifies the weekly digital asset reporting obligation as ceasing at month four will mislead operational staff into dropping the recurring submission, and the gap only surfaces at the next CFTC engagement, by which point the violation has accrued.

A payment stablecoin eligibility summary missing the OCC Interpretive Letter 1183 hook leaves the desk unable to defend its acceptance decision to a supervisor or examiner. A haircut summary anchored to the base 20 per cent floor rather than the multi-DCO highest-accepted-rate rule produces systematically light collateralisation on customer accounts.

The published Specialist Panel findings carry the following citation identifiers:

Wednesday, 02 September 2026
Practitioner: Lawyers US CFTC

Lawyers: AI summaries of CFTC Digital Asset Collateral & Tokenized Assets Staff Guidance (2025) may understate professional obligations

For Lawyers working with CFTC Digital Asset Collateral No-Action Relief and Tokenized Asset Staff Guidance (Market Participants Division, December 2025): where Specialist-Panel-verified divergences between frontier...

Lawyers advising on the CFTC Digital Asset Collateral Framework are increasingly using AI to draft 2-page client memos on payment stablecoin eligibility, generate partner-level briefings on the phased onboarding obligations for futures commission merchants, and validate staff-letter citation language against the published CFTC text before issuing legal opinions on customer margin collateral acceptance.

The RLB Specialist Panel put a set of practitioner-grade questions on the CFTC Digital Asset Collateral Framework to two frontier AI models with web search active. Each question is prepared by the Panel based on the workflows that lawyers actually use AI for under the Market Participants Division's December 2025 staff letter, as amended by Staff Letter 26-05. The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate.

On the CFTC Digital Asset Collateral Framework, the AI subjects returned three hallucinated answers for lawyers, in the form of Inverted-Position Fabrication, Dropped-Qualifier Misattribution, and Dropped-Qualifier Misstated Rule.

For lawyers issuing legal opinions, client memos, transactional documents, and regulatory submissions that engage the CFTC Digital Asset Collateral Framework, staff-letter citation accuracy is load-bearing: a counterparty, opposing counsel, or regulator who can identify a citation error or a missing cross-reference on first reading of the document calls the entire piece of advice into question.

An AI-drafted memo that classifies the weekly digital asset reporting obligation as sunsetting when the regulator continues it, or that describes payment stablecoin eligibility without the OCC Interpretive Letter 1183 hook, or that presents the base 20 per cent haircut as the multi-DCO rule, leaves the lawyer exposed to professional liability, the firm exposed to reputational risk, and the FCM or stablecoin issuer client exposed to a reporting violation, an eligibility defect, or a customer collateral shortfall.

The published Specialist Panel findings carry the following citation identifiers:

↑ Back to top