AI Hallucination Research › Briefings

Briefings Blog

The running blog from the RLB Specialist Panel delves into real-world scenarios where the compliance, legal, or AI lab team interacts with frontier AI models under specific regulations. The blogs are anonymised to remove client-specific details and include insights from the RLB team analysing the hallucinations experienced in AI models while working on these cases. For example, when a model returns a confident answer that contradicts the regulator's primary text, such as a fabricated staff letter, a wrong appendix, or an inverted scope, these issues are discussed here. Each blog explains one set of findings and what it would have meant for the team that would have acted on it, sans this research initiative. This blog is frequently updated, a few times a day.

263 briefings in the archive · Subscribe via Atom: /briefings/feed.xml (this blog) · /feed.xml (all RegLegBrief publications)
Audience colours: AI Labs Practitioner (profession) Sector × Department
Audience
Jur.
Regulator
Profession
Sector
Dept
Range
Sort
Per page
Showing 5 of 263 · page 8 of 53
Friday, 16 October 2026
Sector: Investment Banking and Dept: Compliance US CFTC

Investment Banking Compliance teams: documentation and reporting gaps possible from AI reading of CFTC Regulation 1.25 (Customer Funds Investments)

For Investment Banking Compliance teams working with Amendments to Regulation 1.25, Permissible Investments of Customer Funds by Futures Commission Merchants and Derivatives Clearing Organizations:...

Compliance teams at investment banking firms with FCM, DCO, or customer-funds clearing exposure under Regulation 1.25 are increasingly using frontier AI assistants to update FCM-affiliate compliance manuals for the 2024 amendment package, validate concentration-limit policies against the published rule, draft DWAM rule-change briefings for the regulatory affairs desk, and to surface practical readings of the 2024 amendment package issued by the Commodity Futures Trading Commission (CFTC) on permissible investments of customer segregated funds under Regulation 1.25.

The amendments restate the 50 per cent concentration ceiling for government money market funds and qualified Treasury ETFs, the 24-month portfolio dollar-weighted average maturity (DWAM) standard and its carve-out set, and the separate March 31, 2025 compliance anchor for the Segregation Investment Detail Report (SIDR) and customer risk disclosure statement updates. Across this question set the model outputs that compliance teams at investment banks would carry into a FCM-affiliate compliance manuals departed from the regulator's verbatim text on each of the three operative axes.

Two frontier AI models tested by the RegLeg Brief (RLB) Specialist Panel reproduced the same failure shape across the audited question set on the CFTC's 2024 amendments to Regulation 1.25 (permissible investments of customer segregated funds by futures commission merchants and derivatives clearing organizations). The Panel calls the pattern Threshold-Trigger Elision and Carve-Out Inversion. The frontier AI models dropped the asset-size and management-company-size triggers that activate the 50 per cent concentration ceiling, swapped U.S. Treasury repurchase agreements into the DWAM exclusion set in place of the regulator's actual three carved-out classes, returned a no-DWAM-standard answer for direct U.S.

Treasury obligations where the 24-month portfolio standard governs by default, and drifted from the March 31, 2025 SIDR compliance anchor into a generic "roughly six months to a year after the effective date" formulation. The Panel records the failure class as inference_drift across the five audited findings, each bound to verbatim regulator-issued primary substrate held by the Panel.

For compliance teams at investment banks the operational consequence is direct. A compliance manual entry that frames the 50 per cent ceiling as uniform across FCM size misstates the rule's two activating triggers. A DWAM briefing that lists U.S. Treasury repos as a carved-out class directs internal testing away from the actual exclusion set. A SIDR deadline tracker anchored to a relative range misaligns supervisory reporting against the March 31, 2025 anchor.

The failure surfaces in workflows the audience already uses AI for, the model output reads as a fluent reconstruction of the amended rule, and validation only happens if the reader independently knew the dual-trigger structure of the 50 per cent ceiling, the three-class DWAM carve-out, and the March 31, 2025 SIDR anchor. None of these are properties the audience can recover at runtime from the AI output alone.

The five findings are published with immutable RLB Citation IDs and bound to verbatim Commodity Futures Trading Commission source text: RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001-Opus47, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001-Sonnet46, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q002-Opus47, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q002-Sonnet46, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q004-Opus47. The full audit on Regulation 1.25 is on the Regulation 1.25 (2024 amendments) hub on RegLegBrief.com.

Sector: Corporate Banking and Dept: Treasury US CFTC

Corporate Banking Treasury teams: documentation and reporting gaps possible from AI reading of CFTC Regulation 1.25 (Customer Funds Investments)

For Corporate Banking Treasury teams working with Amendments to Regulation 1.25, Permissible Investments of Customer Funds by Futures Commission Merchants and Derivatives Clearing Organizations:...

Treasury teams at corporate banking firms managing customer-segregated investment portfolios under Regulation 1.25 are increasingly using frontier AI assistants to draft post-amendment investment policy statements for customer-segregated books, validate counterparty-eligibility carve-outs against the 50 per cent ceiling, produce DWAM-compliant portfolio construction playbooks, and to surface practical readings of the 2024 amendment package issued by the Commodity Futures Trading Commission (CFTC) on permissible investments of customer segregated funds under Regulation 1.25.

The amendments restate the 50 per cent concentration ceiling for government money market funds and qualified Treasury ETFs, the 24-month portfolio dollar-weighted average maturity (DWAM) standard and its carve-out set, and the separate March 31, 2025 compliance anchor for the Segregation Investment Detail Report (SIDR) and customer risk disclosure statement updates. Across this question set the model outputs that treasury teams at corporate banks would carry into a customer-segregated investment policy statements departed from the regulator's verbatim text on each of the three operative axes.

Two frontier AI models tested by the RegLeg Brief (RLB) Specialist Panel reproduced the same failure shape across the audited question set on the CFTC's 2024 amendments to Regulation 1.25 (permissible investments of customer segregated funds by futures commission merchants and derivatives clearing organizations). The Panel calls the pattern Threshold-Trigger Elision and Carve-Out Inversion. The frontier AI models dropped the asset-size and management-company-size triggers that activate the 50 per cent concentration ceiling, swapped U.S. Treasury repurchase agreements into the DWAM exclusion set in place of the regulator's actual three carved-out classes, returned a no-DWAM-standard answer for direct U.S.

Treasury obligations where the 24-month portfolio standard governs by default, and drifted from the March 31, 2025 SIDR compliance anchor into a generic "roughly six months to a year after the effective date" formulation. The Panel records the failure class as inference_drift across the five audited findings, each bound to verbatim regulator-issued primary substrate held by the Panel.

For treasury teams at corporate banks the operational consequence is direct. An investment policy statement that frames the 50 per cent ceiling as uniform across FCM size would permit concentration against funds and management companies the regulator's two-trigger structure excludes. A DWAM portfolio construction playbook that treats U.S. Treasury repos as carved out would over-allocate to a book inside the 24-month standard. A SIDR submission timeline anchored to a relative range would miss the regulator's March 31, 2025 date.

The failure surfaces in workflows the audience already uses AI for, the model output reads as a fluent reconstruction of the amended rule, and validation only happens if the reader independently knew the dual-trigger structure of the 50 per cent ceiling, the three-class DWAM carve-out, and the March 31, 2025 SIDR anchor. None of these are properties the audience can recover at runtime from the AI output alone.

The five findings are published with immutable RLB Citation IDs and bound to verbatim Commodity Futures Trading Commission source text: RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001-Opus47, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001-Sonnet46, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q002-Opus47, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q002-Sonnet46, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q004-Opus47. The full audit on Regulation 1.25 is on the Regulation 1.25 (2024 amendments) hub on RegLegBrief.com.

Sector: Corporate Banking and Dept: Operations US CFTC

Corporate Banking Operations teams: documentation and reporting gaps possible from AI reading of CFTC Regulation 1.25 (Customer Funds Investments)

For Corporate Banking Operations teams working with Amendments to Regulation 1.25, Permissible Investments of Customer Funds by Futures Commission Merchants and Derivatives Clearing Organizations:...

Operations teams at corporate banking firms supporting FCM, DCO, and customer-funds clearing flows under Regulation 1.25 are increasingly using frontier AI assistants to generate post-amendment operational impact assessments for customer-segregated flows, validate the carve-out set used in DWAM-related operational reporting, draft SIDR Report data-feed change-request specifications, and to surface practical readings of the 2024 amendment package issued by the Commodity Futures Trading Commission (CFTC) on permissible investments of customer segregated funds under Regulation 1.25.

The amendments restate the 50 per cent concentration ceiling for government money market funds and qualified Treasury ETFs, the 24-month portfolio dollar-weighted average maturity (DWAM) standard and its carve-out set, and the separate March 31, 2025 compliance anchor for the Segregation Investment Detail Report (SIDR) and customer risk disclosure statement updates. Across this question set the model outputs that operations teams at corporate banks would carry into a post-amendment operational impact assessments departed from the regulator's verbatim text on each of the three operative axes.

Two frontier AI models tested by the RegLeg Brief (RLB) Specialist Panel reproduced the same failure shape across the audited question set on the CFTC's 2024 amendments to Regulation 1.25 (permissible investments of customer segregated funds by futures commission merchants and derivatives clearing organizations). The Panel calls the pattern Threshold-Trigger Elision and Carve-Out Inversion. The frontier AI models dropped the asset-size and management-company-size triggers that activate the 50 per cent concentration ceiling, swapped U.S. Treasury repurchase agreements into the DWAM exclusion set in place of the regulator's actual three carved-out classes, returned a no-DWAM-standard answer for direct U.S.

Treasury obligations where the 24-month portfolio standard governs by default, and drifted from the March 31, 2025 SIDR compliance anchor into a generic "roughly six months to a year after the effective date" formulation. The Panel records the failure class as inference_drift across the five audited findings, each bound to verbatim regulator-issued primary substrate held by the Panel.

For operations teams at corporate banks the operational consequence is direct. An operational impact assessment that records the 50 per cent ceiling as uniform across FCM size would miss the rule's two activating triggers. A SIDR data-feed specification anchored to a relative compliance range would deliver the data feed out of phase with the regulator's March 31, 2025 anchor. A DWAM reporting specification that excludes U.S. Treasury repos from the 24-month standard would test the wrong book and leave the actual carve-out set unmonitored.

The failure surfaces in workflows the audience already uses AI for, the model output reads as a fluent reconstruction of the amended rule, and validation only happens if the reader independently knew the dual-trigger structure of the 50 per cent ceiling, the three-class DWAM carve-out, and the March 31, 2025 SIDR anchor. None of these are properties the audience can recover at runtime from the AI output alone.

The five findings are published with immutable RLB Citation IDs and bound to verbatim Commodity Futures Trading Commission source text: RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001-Opus47, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001-Sonnet46, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q002-Opus47, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q002-Sonnet46, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q004-Opus47. The full audit on Regulation 1.25 is on the Regulation 1.25 (2024 amendments) hub on RegLegBrief.com.

Sector: Corporate Banking and Dept: Compliance US CFTC

Corporate Banking Compliance teams: documentation and reporting gaps possible from AI reading of CFTC Regulation 1.25 (Customer Funds Investments)

For Corporate Banking Compliance teams working with Amendments to Regulation 1.25, Permissible Investments of Customer Funds by Futures Commission Merchants and Derivatives Clearing Organizations:...

Compliance teams at corporate banking firms with FCM, DCO, or customer-funds clearing exposure under Regulation 1.25 are increasingly using frontier AI assistants to update onboarding checklists for FCM and DCO counterparties, draft concentration-limit monitoring rule-update bulletins for the regulator's 2024 amendment package, validate the carve-out set used in client DWAM testing artefacts, and to surface practical readings of the 2024 amendment package issued by the Commodity Futures Trading Commission (CFTC) on permissible investments of customer segregated funds under Regulation 1.25.

The amendments restate the 50 per cent concentration ceiling for government money market funds and qualified Treasury ETFs, the 24-month portfolio dollar-weighted average maturity (DWAM) standard and its carve-out set, and the separate March 31, 2025 compliance anchor for the Segregation Investment Detail Report (SIDR) and customer risk disclosure statement updates. Across this question set the model outputs that compliance teams at corporate banks would carry into a FCM/DCO counterparty onboarding checklists departed from the regulator's verbatim text on each of the three operative axes.

Two frontier AI models tested by the RegLeg Brief (RLB) Specialist Panel reproduced the same failure shape across the audited question set on the CFTC's 2024 amendments to Regulation 1.25 (permissible investments of customer segregated funds by futures commission merchants and derivatives clearing organizations). The Panel calls the pattern Threshold-Trigger Elision and Carve-Out Inversion. The frontier AI models dropped the asset-size and management-company-size triggers that activate the 50 per cent concentration ceiling, swapped U.S. Treasury repurchase agreements into the DWAM exclusion set in place of the regulator's actual three carved-out classes, returned a no-DWAM-standard answer for direct U.S.

Treasury obligations where the 24-month portfolio standard governs by default, and drifted from the March 31, 2025 SIDR compliance anchor into a generic "roughly six months to a year after the effective date" formulation. The Panel records the failure class as inference_drift across the five audited findings, each bound to verbatim regulator-issued primary substrate held by the Panel.

For compliance teams at corporate banks the operational consequence is direct. A counterparty onboarding checklist that frames the 50 per cent ceiling as uniform across FCM size would miss the fund-side and management-company-side triggers the regulator keys the ceiling to. A monitoring bulletin that lists U.S. Treasury repos as a DWAM carve-out would direct the bank's exposure-monitoring tool away from the actual exclusion set. A SIDR reminder anchored to a relative deadline would misalign the compliance calendar against the March 31, 2025 anchor.

The failure surfaces in workflows the audience already uses AI for, the model output reads as a fluent reconstruction of the amended rule, and validation only happens if the reader independently knew the dual-trigger structure of the 50 per cent ceiling, the three-class DWAM carve-out, and the March 31, 2025 SIDR anchor. None of these are properties the audience can recover at runtime from the AI output alone.

The five findings are published with immutable RLB Citation IDs and bound to verbatim Commodity Futures Trading Commission source text: RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001-Opus47, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001-Sonnet46, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q002-Opus47, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q002-Sonnet46, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q004-Opus47. The full audit on Regulation 1.25 is on the Regulation 1.25 (2024 amendments) hub on RegLegBrief.com.

Thursday, 15 October 2026
Practitioner: Public Auditors US CFTC

Public Auditors: AI summaries of CFTC Regulation 1.25 (Customer Funds Investments) may understate professional obligations

For Public Auditors working with Amendments to Regulation 1.25, Permissible Investments of Customer Funds by Futures Commission Merchants and Derivatives Clearing Organizations: where Specialist-Panel-verified...

Public auditors examining FCM and DCO segregated-funds investment policy compliance and controls under Regulation 1.25 are increasingly using frontier AI assistants to draft investment-policy compliance audit programmes for FCM clients, validate the carve-out set used in the client's DWAM portfolio testing, prepare SIDR Report sample-selection memos against the regulator's compliance anchor, and to surface practical readings of the 2024 amendment package issued by the Commodity Futures Trading Commission (CFTC) on permissible investments of customer segregated funds under Regulation 1.25.

The amendments restate the 50 per cent concentration ceiling for government money market funds and qualified Treasury ETFs, the 24-month portfolio dollar-weighted average maturity (DWAM) standard and its carve-out set, and the separate March 31, 2025 compliance anchor for the Segregation Investment Detail Report (SIDR) and customer risk disclosure statement updates. Across this question set the model outputs that public auditors would carry into a investment-policy compliance audit programmes departed from the regulator's verbatim text on each of the three operative axes.

Two frontier AI models tested by the RegLeg Brief (RLB) Specialist Panel reproduced the same failure shape across the audited question set on the CFTC's 2024 amendments to Regulation 1.25 (permissible investments of customer segregated funds by futures commission merchants and derivatives clearing organizations). The Panel calls the pattern Threshold-Trigger Elision and Carve-Out Inversion. The frontier AI models dropped the asset-size and management-company-size triggers that activate the 50 per cent concentration ceiling, swapped U.S. Treasury repurchase agreements into the DWAM exclusion set in place of the regulator's actual three carved-out classes, returned a no-DWAM-standard answer for direct U.S.

Treasury obligations where the 24-month portfolio standard governs by default, and drifted from the March 31, 2025 SIDR compliance anchor into a generic "roughly six months to a year after the effective date" formulation. The Panel records the failure class as inference_drift across the five audited findings, each bound to verbatim regulator-issued primary substrate held by the Panel.

For public auditors the operational consequence is direct. An audit programme that tests the 50 per cent ceiling as a uniform percentage limit would walk past the fund-asset and management-company-asset triggers that the regulator records as the only conditions under which the ceiling engages. A DWAM testing review that accepts U.S. Treasury repos as a carved-out class would sign off on a non-conforming exclusion. A SIDR sample-selection memo dated to a relative range would miss the regulator's March 31, 2025 compliance anchor and the population it implies.

The failure surfaces in workflows the audience already uses AI for, the model output reads as a fluent reconstruction of the amended rule, and validation only happens if the reader independently knew the dual-trigger structure of the 50 per cent ceiling, the three-class DWAM carve-out, and the March 31, 2025 SIDR anchor. None of these are properties the audience can recover at runtime from the AI output alone.

The five findings are published with immutable RLB Citation IDs and bound to verbatim Commodity Futures Trading Commission source text: RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001-Opus47, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001-Sonnet46, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q002-Opus47, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q002-Sonnet46, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q004-Opus47. The full audit on Regulation 1.25 is on the Regulation 1.25 (2024 amendments) hub on RegLegBrief.com.

↑ Back to top