AI Hallucination Research › Briefings

Briefings Blog

The running blog from the RLB Specialist Panel delves into real-world scenarios where the compliance, legal, or AI lab team interacts with frontier AI models under specific regulations. The blogs are anonymised to remove client-specific details and include insights from the RLB team analysing the hallucinations experienced in AI models while working on these cases. For example, when a model returns a confident answer that contradicts the regulator's primary text, such as a fabricated staff letter, a wrong appendix, or an inverted scope, these issues are discussed here. Each blog explains one set of findings and what it would have meant for the team that would have acted on it, sans this research initiative. This blog is frequently updated, a few times a day.

263 briefings in the archive · Subscribe via Atom: /briefings/feed.xml (this blog) · /feed.xml (all RegLegBrief publications)
Audience colours: AI Labs Practitioner (profession) Sector × Department
Audience
Jur.
Regulator
Profession
Sector
Dept
Range
Sort
Per page
Showing 5 of 263 · page 45 of 53
Saturday, 20 June 2026
Practitioner: Accountants (CA/PA) US CFTC

Accountants (CA/PA): AI summaries of CFTC Regulation 1.25 (Customer Funds Investments) may understate professional obligations

For Accountants (CA/PA) working with Amendments to Regulation 1.25, Permissible Investments of Customer Funds by Futures Commission Merchants and Derivatives Clearing Organizations: where Specialist-Panel-verified...

Accountants (CA/PA) supporting FCM and DCO clients on customer-funds investment policy testing and concentration-testing controls under Regulation 1.25 are increasingly using frontier AI assistants to draft concentration-testing control narratives for the post-amendment book, validate carved-out asset classifications against the DWAM portfolio standard, prepare client-facing summaries of the SIDR Report compliance calendar, and to surface practical readings of the 2024 amendment package issued by the Commodity Futures Trading Commission (CFTC) on permissible investments of customer segregated funds under Regulation 1.25.

The amendments restate the 50 per cent concentration ceiling for government money market funds and qualified Treasury ETFs, the 24-month portfolio dollar-weighted average maturity (DWAM) standard and its carve-out set, and the separate March 31, 2025 compliance anchor for the Segregation Investment Detail Report (SIDR) and customer risk disclosure statement updates. Across this question set the model outputs that accountants (ca/pa) would carry into a concentration-testing control narratives departed from the regulator's verbatim text on each of the three operative axes.

Two frontier AI models tested by the RegLeg Brief (RLB) Specialist Panel reproduced the same failure shape across the audited question set on the CFTC's 2024 amendments to Regulation 1.25 (permissible investments of customer segregated funds by futures commission merchants and derivatives clearing organizations). The Panel calls the pattern Threshold-Trigger Elision and Carve-Out Inversion. The frontier AI models dropped the asset-size and management-company-size triggers that activate the 50 per cent concentration ceiling, swapped U.S. Treasury repurchase agreements into the DWAM exclusion set in place of the regulator's actual three carved-out classes, returned a no-DWAM-standard answer for direct U.S.

Treasury obligations where the 24-month portfolio standard governs by default, and drifted from the March 31, 2025 SIDR compliance anchor into a generic "roughly six months to a year after the effective date" formulation. The Panel records the failure class as inference_drift across the five audited findings, each bound to verbatim regulator-issued primary substrate held by the Panel.

For accountants (ca/pa) the operational consequence is direct. A control narrative that frames the 50 per cent ceiling as a uniform percentage limit independent of fund and management-company size would misclassify the trigger structure that gates the ceiling. A DWAM testing playbook that excludes U.S. Treasury repos from the 24-month portfolio standard would over-test the wrong book and miss the actual carve-out set. A management letter that records the SIDR compliance anchor as a relative-to-effective-date range would mis-flag the firm's annual compliance posture.

The failure surfaces in workflows the audience already uses AI for, the model output reads as a fluent reconstruction of the amended rule, and validation only happens if the reader independently knew the dual-trigger structure of the 50 per cent ceiling, the three-class DWAM carve-out, and the March 31, 2025 SIDR anchor. None of these are properties the audience can recover at runtime from the AI output alone.

The five findings are published with immutable RLB Citation IDs and bound to verbatim Commodity Futures Trading Commission source text: RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001-Opus47, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q001-Sonnet46, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q002-Opus47, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q002-Sonnet46, RLB-H-US-CFTC-FCM-DCO-CUSTOMER-FUNDS-INVESTMENTS-REG-1-25-2024-Q004-Opus47. The full audit on Regulation 1.25 is on the Regulation 1.25 (2024 amendments) hub on RegLegBrief.com.

Sector: Statutory Boards & Agencies and Dept: Legal INT UNTC

Statutory Boards & Agencies Legal teams: documentation and reporting gaps possible from AI reading of BBNJ Agreement

For Statutory Boards & Agencies Legal teams working with BBNJ High Seas Biodiversity Agreement: Specialist-Panel-verified findings on where AI summaries diverge from the regulator's text, and what that means for the...

Legal teams at statutory boards and agencies engaging with the BBNJ Agreement are increasingly using AI to draft inter-agency briefings, generate position papers on Conference of the Parties authority and the non-undermining duty toward other competent bodies, and validate treaty-citation language for board-level and ministerial advice.

The RLB Specialist Panel put a set of practitioner-grade questions on the BBNJ Agreement to two frontier AI models with web search active.

Each question is prepared by the Panel based on the workflows that legal teams at statutory boards & agencies firms actually use AI for under this treaty, covering the screening threshold for environmental impact assessments under Part IV, the temporal scope of the marine genetic resources and digital sequence information regime under Part II, the benefit-sharing duty for digital sequence information, and the non-undermining duty constraining Conference of the Parties decisions on area-based management tools under Part III.

The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate, comparing the AI output line-by-line against the deposited treaty text. Only responses where the AI subject was demonstrably wrong against the verbatim regulator-issued source text are published; responses that were substantively correct, or that refused on calibration grounds, are retained internally and not surfaced. On the BBNJ Agreement, the AI subjects returned a single hallucinated answer in the form of Source-Credit Misattribution for legal teams at statutory boards & agencies firms.

For legal teams at statutory boards & agencies firms advising on the BBNJ Agreement, treaty-citation accuracy is load-bearing in legal opinions, contractual representations, due-diligence disclosures, and any pleading or position paper engaging the Agreement. A counterparty or opposing counsel who identifies a misattributed article on first reading calls the entire piece of advice into question. The marine genetic resources retroactivity inversion is the more serious failure: a legal opinion structured around a retroactive-by-default rule when the treaty establishes the opposite default produces fundamentally wrong contract terms and exposes the firm to professional liability if the underlying position is later corrected.

The published Specialist Panel findings, with model attribution, carry the following citation identifiers, each hyperlinked to the bound regulator-issued source text on the BBNJ Agreement regulation hub. The audit register surfaces these findings for legal teams at statutory boards & agencies firms so that any AI-assisted treaty citation, paraphrase, or rule-statement entering a deliverable can be re-validated against the deposited treaty text before the document is issued:

Friday, 19 June 2026
Sector: Clinical Research and Dept: Compliance INT UNTC

Clinical Research Compliance teams: documentation and reporting gaps possible from AI reading of BBNJ Agreement

For Clinical Research Compliance teams working with BBNJ High Seas Biodiversity Agreement: Specialist-Panel-verified findings on where AI summaries diverge from the regulator's text, and what that means for the...

Compliance teams at clinical research firms are increasingly using AI to update sample-provenance screening checklists, generate research-governance bulletins on the marine genetic resource regime under the BBNJ Agreement, and validate which obligations apply to legacy specimen collections held before treaty entry into force.

The RLB Specialist Panel put a set of practitioner-grade questions on the BBNJ Agreement to two frontier AI models with web search active. Each question is prepared by the Panel based on the workflows that compliance teams at clinical research firms actually use AI for under this treaty, covering the screening threshold for environmental impact assessments under Part IV, the temporal scope of the marine genetic resources and digital sequence information regime under Part II, the benefit-sharing duty for digital sequence information, and the non-undermining duty constraining Conference of the Parties decisions on area-based management tools under Part III.

The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate, comparing the AI output line-by-line against the deposited treaty text. Only responses where the AI subject was demonstrably wrong against the verbatim regulator-issued source text are published; responses that were substantively correct, or that refused on calibration grounds, are retained internally and not surfaced. On the BBNJ Agreement, the AI subjects returned a single hallucinated answer in the form of Inverted-Position Hallucination for compliance teams at clinical research firms.

For compliance teams at clinical research firms working under the BBNJ Agreement, internal policies, regulator-facing filings, and supervisor-engagement memos turn on citation accuracy. A compliance submission that mis-numbers the source article will be identified by a national Clearing-House Mechanism reviewer or a treaty-body monitoring reviewer on first reading, and the wider compliance narrative loses credibility.

Where the AI subjects inverted the direction of the marine genetic resources retroactivity default, the consequence is more serious: the firm could initiate costly and unnecessary remediation of legacy collections, or misstate its position in due diligence disclosures, licensing negotiations, and regulatory filings - any of which could attract scrutiny from national implementing authorities or treaty-body monitoring mechanisms.

The published Specialist Panel findings, with model attribution, carry the following citation identifiers, each hyperlinked to the bound regulator-issued source text on the BBNJ Agreement regulation hub. The audit register surfaces these findings for compliance teams at clinical research firms so that any AI-assisted treaty citation, paraphrase, or rule-statement entering a deliverable can be re-validated against the deposited treaty text before the document is issued:

Sector: Biotechnology and Dept: Product & Business Development INT UNTC

Biotechnology Product & Business Development teams: documentation and reporting gaps possible from AI reading of BBNJ Agreement

For Biotechnology Product & Business Development teams working with BBNJ High Seas Biodiversity Agreement: Specialist-Panel-verified findings on where AI summaries diverge from the regulator's text, and what that...

Product and business development teams at biotechnology firms are increasingly using AI to scope new digital sequence information programmes, draft partnership term sheets for high-seas marine genetic resource projects, and generate licensing-template language that anchors to the correct provision of the BBNJ Agreement.

The RLB Specialist Panel put a set of practitioner-grade questions on the BBNJ Agreement to two frontier AI models with web search active.

Each question is prepared by the Panel based on the workflows that product & business development teams at biotechnology firms actually use AI for under this treaty, covering the screening threshold for environmental impact assessments under Part IV, the temporal scope of the marine genetic resources and digital sequence information regime under Part II, the benefit-sharing duty for digital sequence information, and the non-undermining duty constraining Conference of the Parties decisions on area-based management tools under Part III.

The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate, comparing the AI output line-by-line against the deposited treaty text. Only responses where the AI subject was demonstrably wrong against the verbatim regulator-issued source text are published; responses that were substantively correct, or that refused on calibration grounds, are retained internally and not surfaced. On the BBNJ Agreement, the AI subjects returned a single hallucinated answer in the form of Source-Credit Misattribution for product & business development teams at biotechnology firms.

For product and business development teams at biotechnology firms scoping programmes that touch high-seas marine genetic resources or digital sequence information, citation accuracy in term sheets, licensing templates, and partnership scoping documents shapes downstream commercial terms. A go-to-market scope anchored to the wrong article reference under the {REG_SHORT} is brittle: the substantive position may be salvageable, but the citation will need to be reworked, and downstream collateral, including counterparty memos and external pitches, may need to be revised mid-flight.

The published Specialist Panel findings, with model attribution, carry the following citation identifiers, each hyperlinked to the bound regulator-issued source text on the BBNJ Agreement regulation hub. The audit register surfaces these findings for product & business development teams at biotechnology firms so that any AI-assisted treaty citation, paraphrase, or rule-statement entering a deliverable can be re-validated against the deposited treaty text before the document is issued:

Sector: Renewables & Clean Energy and Dept: Legal INT UNTC

Renewables & Clean Energy Legal teams: documentation and reporting gaps possible from AI reading of BBNJ Agreement

For Renewables & Clean Energy Legal teams working with BBNJ High Seas Biodiversity Agreement: Specialist-Panel-verified findings on where AI summaries diverge from the regulator's text, and what that means for the...

Legal teams at renewables and clean energy firms are increasingly using AI to draft client memos on environmental impact assessment scoping for offshore projects in areas beyond national jurisdiction, generate counsel-facing briefings on the BBNJ Agreement, and validate treaty-citation language in contractual representations and regulatory submissions.

The RLB Specialist Panel put a set of practitioner-grade questions on the BBNJ Agreement to two frontier AI models with web search active.

Each question is prepared by the Panel based on the workflows that legal teams at renewables & clean energy firms actually use AI for under this treaty, covering the screening threshold for environmental impact assessments under Part IV, the temporal scope of the marine genetic resources and digital sequence information regime under Part II, the benefit-sharing duty for digital sequence information, and the non-undermining duty constraining Conference of the Parties decisions on area-based management tools under Part III.

The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate, comparing the AI output line-by-line against the deposited treaty text. Only responses where the AI subject was demonstrably wrong against the verbatim regulator-issued source text are published; responses that were substantively correct, or that refused on calibration grounds, are retained internally and not surfaced. On the BBNJ Agreement, the AI subjects returned a single hallucinated answer in the form of Source-Credit Misattribution for legal teams at renewables & clean energy firms.

For legal teams at renewables & clean energy firms advising on the BBNJ Agreement, treaty-citation accuracy is load-bearing in legal opinions, contractual representations, due-diligence disclosures, and any pleading or position paper engaging the Agreement. A counterparty or opposing counsel who identifies a misattributed article on first reading calls the entire piece of advice into question. The marine genetic resources retroactivity inversion is the more serious failure: a legal opinion structured around a retroactive-by-default rule when the treaty establishes the opposite default produces fundamentally wrong contract terms and exposes the firm to professional liability if the underlying position is later corrected.

The published Specialist Panel findings, with model attribution, carry the following citation identifiers, each hyperlinked to the bound regulator-issued source text on the BBNJ Agreement regulation hub. The audit register surfaces these findings for legal teams at renewables & clean energy firms so that any AI-assisted treaty citation, paraphrase, or rule-statement entering a deliverable can be re-validated against the deposited treaty text before the document is issued:

↑ Back to top