AI Hallucination Research › Briefings

Briefings Blog

The running blog from the RLB Specialist Panel delves into real-world scenarios where the compliance, legal, or AI lab team interacts with frontier AI models under specific regulations. The blogs are anonymised to remove client-specific details and include insights from the RLB team analysing the hallucinations experienced in AI models while working on these cases. For example, when a model returns a confident answer that contradicts the regulator's primary text, such as a fabricated staff letter, a wrong appendix, or an inverted scope, these issues are discussed here. Each blog explains one set of findings and what it would have meant for the team that would have acted on it, sans this research initiative. This blog is frequently updated, a few times a day.

263 briefings in the archive · Subscribe via Atom: /briefings/feed.xml (this blog) · /feed.xml (all RegLegBrief publications)
Audience colours: AI Labs Practitioner (profession) Sector × Department
Audience
Jur.
Regulator
Profession
Sector
Dept
Range
Sort
Per page
Showing 5 of 263 · page 46 of 53
Friday, 19 June 2026
Sector: Renewables & Clean Energy and Dept: Compliance INT UNTC

Renewables & Clean Energy Compliance teams: documentation and reporting gaps possible from AI reading of BBNJ Agreement

For Renewables & Clean Energy Compliance teams working with BBNJ High Seas Biodiversity Agreement: Specialist-Panel-verified findings on where AI summaries diverge from the regulator's text, and what that means for...

Compliance teams at renewables and clean energy firms with offshore or seabed exposure are increasingly using AI to update high-seas activity screening checklists, generate regulator-facing filing bulletins, and validate which provision of the BBNJ Agreement governs the screening threshold for planned activities.

The RLB Specialist Panel put a set of practitioner-grade questions on the BBNJ Agreement to two frontier AI models with web search active.

Each question is prepared by the Panel based on the workflows that compliance teams at renewables & clean energy firms actually use AI for under this treaty, covering the screening threshold for environmental impact assessments under Part IV, the temporal scope of the marine genetic resources and digital sequence information regime under Part II, the benefit-sharing duty for digital sequence information, and the non-undermining duty constraining Conference of the Parties decisions on area-based management tools under Part III.

The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate, comparing the AI output line-by-line against the deposited treaty text. Only responses where the AI subject was demonstrably wrong against the verbatim regulator-issued source text are published; responses that were substantively correct, or that refused on calibration grounds, are retained internally and not surfaced. On the BBNJ Agreement, the AI subjects returned a single hallucinated answer in the form of Source-Credit Misattribution for compliance teams at renewables & clean energy firms.

For compliance teams at renewables & clean energy firms working under the BBNJ Agreement, internal policies, regulator-facing filings, and supervisor-engagement memos turn on citation accuracy. A compliance submission that mis-numbers the source article will be identified by a national Clearing-House Mechanism reviewer or a treaty-body monitoring reviewer on first reading, and the wider compliance narrative loses credibility.

Where the AI subjects inverted the direction of the marine genetic resources retroactivity default, the consequence is more serious: the firm could initiate costly and unnecessary remediation of legacy collections, or misstate its position in due diligence disclosures, licensing negotiations, and regulatory filings - any of which could attract scrutiny from national implementing authorities or treaty-body monitoring mechanisms.

The published Specialist Panel findings, with model attribution, carry the following citation identifiers, each hyperlinked to the bound regulator-issued source text on the BBNJ Agreement regulation hub. The audit register surfaces these findings for compliance teams at renewables & clean energy firms so that any AI-assisted treaty citation, paraphrase, or rule-statement entering a deliverable can be re-validated against the deposited treaty text before the document is issued:

Sector: Ports & Terminals and Dept: Legal INT UNTC

Ports & Terminals Legal teams: documentation and reporting gaps possible from AI reading of BBNJ Agreement

For Ports & Terminals Legal teams working with BBNJ High Seas Biodiversity Agreement: Specialist-Panel-verified findings on where AI summaries diverge from the regulator's text, and what that means for the sector's...

Legal teams at ports and terminals firms are increasingly using AI to draft client memos on transit-rights exposure under area-based management tools, generate partner-level briefings on Conference of the Parties authority under the BBNJ Agreement, and validate treaty-citation language in concession and regulatory submissions.

The RLB Specialist Panel put a set of practitioner-grade questions on the BBNJ Agreement to two frontier AI models with web search active. Each question is prepared by the Panel based on the workflows that legal teams at ports & terminals firms actually use AI for under this treaty, covering the screening threshold for environmental impact assessments under Part IV, the temporal scope of the marine genetic resources and digital sequence information regime under Part II, the benefit-sharing duty for digital sequence information, and the non-undermining duty constraining Conference of the Parties decisions on area-based management tools under Part III.

The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate, comparing the AI output line-by-line against the deposited treaty text. Only responses where the AI subject was demonstrably wrong against the verbatim regulator-issued source text are published; responses that were substantively correct, or that refused on calibration grounds, are retained internally and not surfaced. On the BBNJ Agreement, the AI subjects returned a single hallucinated answer in the form of Source-Credit Misattribution for legal teams at ports & terminals firms.

For legal teams at ports & terminals firms advising on the BBNJ Agreement, treaty-citation accuracy is load-bearing in legal opinions, contractual representations, due-diligence disclosures, and any pleading or position paper engaging the Agreement. A counterparty or opposing counsel who identifies a misattributed article on first reading calls the entire piece of advice into question. The marine genetic resources retroactivity inversion is the more serious failure: a legal opinion structured around a retroactive-by-default rule when the treaty establishes the opposite default produces fundamentally wrong contract terms and exposes the firm to professional liability if the underlying position is later corrected.

The published Specialist Panel findings, with model attribution, carry the following citation identifiers, each hyperlinked to the bound regulator-issued source text on the BBNJ Agreement regulation hub. The audit register surfaces these findings for legal teams at ports & terminals firms so that any AI-assisted treaty citation, paraphrase, or rule-statement entering a deliverable can be re-validated against the deposited treaty text before the document is issued:

Sector: Oil & Gas and Dept: ESG & Sustainability INT UNTC

Oil & Gas ESG & Sustainability teams: documentation and reporting gaps possible from AI reading of BBNJ Agreement

For Oil & Gas ESG & Sustainability teams working with BBNJ High Seas Biodiversity Agreement: Specialist-Panel-verified findings on where AI summaries diverge from the regulator's text, and what that means for the...

ESG and sustainability teams at oil and gas firms are increasingly using AI to draft stakeholder communications, generate board papers on environmental impact assessment exposure for high-seas activities, and validate which provision of the BBNJ Agreement should be cited in sustainability disclosures and TCFD-aligned reporting.

The RLB Specialist Panel put a set of practitioner-grade questions on the BBNJ Agreement to two frontier AI models with web search active.

Each question is prepared by the Panel based on the workflows that esg & sustainability teams at oil & gas firms actually use AI for under this treaty, covering the screening threshold for environmental impact assessments under Part IV, the temporal scope of the marine genetic resources and digital sequence information regime under Part II, the benefit-sharing duty for digital sequence information, and the non-undermining duty constraining Conference of the Parties decisions on area-based management tools under Part III.

The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate, comparing the AI output line-by-line against the deposited treaty text. Only responses where the AI subject was demonstrably wrong against the verbatim regulator-issued source text are published; responses that were substantively correct, or that refused on calibration grounds, are retained internally and not surfaced. On the BBNJ Agreement, the AI subjects returned a single hallucinated answer in the form of Source-Credit Misattribution for esg & sustainability teams at oil & gas firms.

For ESG and sustainability teams at oil & gas firms preparing stakeholder communications, sustainability disclosures, and board papers on high-seas activity obligations under the {REG_SHORT}, citation accuracy is the credibility floor. A sustainability disclosure that cites the wrong article exposes the firm to reputational risk when NGOs, journalists, academic reviewers, or sustainability-rating agencies verify the citation against the deposited treaty text. The deliverables are designed to be scrutinised by external parties whose interest is precisely to identify and surface inaccuracies in voluntary disclosures.

The published Specialist Panel findings, with model attribution, carry the following citation identifiers, each hyperlinked to the bound regulator-issued source text on the BBNJ Agreement regulation hub. The audit register surfaces these findings for esg & sustainability teams at oil & gas firms so that any AI-assisted treaty citation, paraphrase, or rule-statement entering a deliverable can be re-validated against the deposited treaty text before the document is issued:

Thursday, 18 June 2026
Sector: Oil & Gas and Dept: Compliance INT UNTC

Oil & Gas Compliance teams: documentation and reporting gaps possible from AI reading of BBNJ Agreement

For Oil & Gas Compliance teams working with BBNJ High Seas Biodiversity Agreement: Specialist-Panel-verified findings on where AI summaries diverge from the regulator's text, and what that means for the sector's...

Compliance teams at oil and gas firms with offshore or seabed-adjacent exposure are increasingly using AI to update high-seas activity screening checklists, generate regulator-facing filing bulletins on environmental impact assessment obligations, and validate which provision of the BBNJ Agreement governs the screening threshold for planned activities.

The RLB Specialist Panel put a set of practitioner-grade questions on the BBNJ Agreement to two frontier AI models with web search active. Each question is prepared by the Panel based on the workflows that compliance teams at oil & gas firms actually use AI for under this treaty, covering the screening threshold for environmental impact assessments under Part IV, the temporal scope of the marine genetic resources and digital sequence information regime under Part II, the benefit-sharing duty for digital sequence information, and the non-undermining duty constraining Conference of the Parties decisions on area-based management tools under Part III.

The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate, comparing the AI output line-by-line against the deposited treaty text. Only responses where the AI subject was demonstrably wrong against the verbatim regulator-issued source text are published; responses that were substantively correct, or that refused on calibration grounds, are retained internally and not surfaced. On the BBNJ Agreement, the AI subjects returned a single hallucinated answer in the form of Source-Credit Misattribution for compliance teams at oil & gas firms.

For compliance teams at oil & gas firms working under the BBNJ Agreement, internal policies, regulator-facing filings, and supervisor-engagement memos turn on citation accuracy. A compliance submission that mis-numbers the source article will be identified by a national Clearing-House Mechanism reviewer or a treaty-body monitoring reviewer on first reading, and the wider compliance narrative loses credibility.

Where the AI subjects inverted the direction of the marine genetic resources retroactivity default, the consequence is more serious: the firm could initiate costly and unnecessary remediation of legacy collections, or misstate its position in due diligence disclosures, licensing negotiations, and regulatory filings - any of which could attract scrutiny from national implementing authorities or treaty-body monitoring mechanisms.

The published Specialist Panel findings, with model attribution, carry the following citation identifiers, each hyperlinked to the bound regulator-issued source text on the BBNJ Agreement regulation hub. The audit register surfaces these findings for compliance teams at oil & gas firms so that any AI-assisted treaty citation, paraphrase, or rule-statement entering a deliverable can be re-validated against the deposited treaty text before the document is issued:

Sector: Clinical Research and Dept: Legal INT UNTC

Clinical Research Legal teams: documentation and reporting gaps possible from AI reading of BBNJ Agreement

For Clinical Research Legal teams working with BBNJ High Seas Biodiversity Agreement: Specialist-Panel-verified findings on where AI summaries diverge from the regulator's text, and what that means for the sector's...

Legal teams at clinical research firms are increasingly using AI to draft sample-handling agreements, generate counsel-facing memos on the marine genetic resource and digital sequence information regime under the BBNJ Agreement, and validate treaty-citation language for due-diligence questionnaires from sponsors and collaborators.

The RLB Specialist Panel put a set of practitioner-grade questions on the BBNJ Agreement to two frontier AI models with web search active. Each question is prepared by the Panel based on the workflows that legal teams at clinical research firms actually use AI for under this treaty, covering the screening threshold for environmental impact assessments under Part IV, the temporal scope of the marine genetic resources and digital sequence information regime under Part II, the benefit-sharing duty for digital sequence information, and the non-undermining duty constraining Conference of the Parties decisions on area-based management tools under Part III.

The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate, comparing the AI output line-by-line against the deposited treaty text. Only responses where the AI subject was demonstrably wrong against the verbatim regulator-issued source text are published; responses that were substantively correct, or that refused on calibration grounds, are retained internally and not surfaced. On the BBNJ Agreement, the AI subjects returned a single hallucinated answer in the form of Inverted-Position Hallucination for legal teams at clinical research firms.

For legal teams at clinical research firms advising on the BBNJ Agreement, treaty-citation accuracy is load-bearing in legal opinions, contractual representations, due-diligence disclosures, and any pleading or position paper engaging the Agreement. A counterparty or opposing counsel who identifies a misattributed article on first reading calls the entire piece of advice into question. The marine genetic resources retroactivity inversion is the more serious failure: a legal opinion structured around a retroactive-by-default rule when the treaty establishes the opposite default produces fundamentally wrong contract terms and exposes the firm to professional liability if the underlying position is later corrected.

The published Specialist Panel findings, with model attribution, carry the following citation identifiers, each hyperlinked to the bound regulator-issued source text on the BBNJ Agreement regulation hub. The audit register surfaces these findings for legal teams at clinical research firms so that any AI-assisted treaty citation, paraphrase, or rule-statement entering a deliverable can be re-validated against the deposited treaty text before the document is issued:

↑ Back to top