AI Hallucination ResearchAudiencesSectorsInternational / MultilateralStatutory Boards & AgenciesLegal › BBNJ High Seas Biodiversity Agreement
Statutory Boards & Agencies × Legal — International / Multilateral · updated 2026-06-11 · methodology v2.3
Share / Print Twitter LinkedIn Email

AI Hallucination on BBNJ High Seas Biodiversity Agreement for Legal teams at Statutory Boards & Agencies firms in international jurisdictions

Statutory Boards & Agencies Legal teams: documentation and reporting gaps possible from AI reading of BBNJ Agreement

Legal teams at statutory boards and agencies engaging with the BBNJ Agreement are increasingly using AI to draft inter-agency briefings, generate position papers on Conference of the Parties authority and the non-undermining duty toward other competent bodies, and validate treaty-citation language for board-level and ministerial advice.

The RLB Specialist Panel put a set of practitioner-grade questions on the BBNJ Agreement to two frontier AI models with web search active.

Each question is prepared by the Panel based on the workflows that legal teams at statutory boards & agencies firms actually use AI for under this treaty, covering the screening threshold for environmental impact assessments under Part IV, the temporal scope of the marine genetic resources and digital sequence information regime under Part II, the benefit-sharing duty for digital sequence information, and the non-undermining duty constraining Conference of the Parties decisions on area-based management tools under Part III.

The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate, comparing the AI output line-by-line against the deposited treaty text. Only responses where the AI subject was demonstrably wrong against the verbatim regulator-issued source text are published; responses that were substantively correct, or that refused on calibration grounds, are retained internally and not surfaced. On the BBNJ Agreement, the AI subjects returned a single hallucinated answer in the form of Source-Credit Misattribution for legal teams at statutory boards & agencies firms.

For legal teams at statutory boards & agencies firms advising on the BBNJ Agreement, treaty-citation accuracy is load-bearing in legal opinions, contractual representations, due-diligence disclosures, and any pleading or position paper engaging the Agreement. A counterparty or opposing counsel who identifies a misattributed article on first reading calls the entire piece of advice into question. The marine genetic resources retroactivity inversion is the more serious failure: a legal opinion structured around a retroactive-by-default rule when the treaty establishes the opposite default produces fundamentally wrong contract terms and exposes the firm to professional liability if the underlying position is later corrected.

The published Specialist Panel findings, with model attribution, carry the following citation identifiers, each hyperlinked to the bound regulator-issued source text on the BBNJ Agreement regulation hub. The audit register surfaces these findings for legal teams at statutory boards & agencies firms so that any AI-assisted treaty citation, paraphrase, or rule-statement entering a deliverable can be re-validated against the deposited treaty text before the document is issued:

Take me back to my Legal x Statutory Boards & Agencies (INT) overview

Executive Summary

The BBNJ Agreement, formally the United Nations Treaty on Marine Biodiversity of Areas Beyond National Jurisdiction, establishes a binding framework governing environmental impact assessments, access to marine genetic resources, benefit-sharing over digital sequence information, and area-based management tools in the high seas. The Agreement entered into force on 17 January 2026. For Legal teams at Statutory Boards & Agencies firms operating across international jurisdictions, this is new law that already affects ongoing programmes and internal documentation.

Across 1 relevant question that the team is likely to encounter, AI tools tested on the Agreement produced incorrect answers, with the principal errors covering the Conference of the Parties non-undermining duty attributed to Article 5 or Article 8 rather than Article 22(2). The errors are material because the team is the control point for internal policy, regulator-facing filings, contractual representations, or commercial scoping decisions that depend on accurate citation of the Agreement's operative provisions.

How AI gets this regulation wrong

The dominant failure pattern across our research on this regulation for Legal teams at Statutory Boards & Agencies firms is article-level misattribution paired with substantively correct paraphrases. AI tools stated the operative content of a provision broadly correctly while pinning it to the wrong article number. In one case the AI also inverted the treaty's default rule on retroactivity, producing a position that is the opposite of what the Agreement provides. Both failure types are particularly hazardous because the substantive plausibility of the answer makes the citation error easy to miss on internal review.

AI's Failure ModeCountAffected findings
Misattributed1Finding#1

What that means for your team

For Legal teams at Statutory Boards & Agencies firms, every error documented in this cell translates into a legal opinion, contract, or transactional disclosure that misstates a treaty provision. The risk category is direct legal exposure: a counterparty, opposing counsel, or regulatory reviewer who checks the citation against the deposited BBNJ text will identify the defect immediately, and the underlying advice will need to be corrected.

Risk ImpactCountAffected findings
Legal exposure1Finding#1

When this affects your department

Statutory boards and agencies encounter the BBNJ Agreement through implementation of the treaty domestically, supervisory oversight of regulated entities operating in areas beyond national jurisdiction, or representation in treaty-body processes.

The team is most likely to need accurate AI assistance on the Agreement when it is scoping the limits of Conference of the Parties authority over area-based management tools under Article 22(2). These are precisely the questions where the documented errors land. An AI tool that misattributes the screening article, inverts the retroactivity default, or places the digital sequence information duty at the wrong article will produce internal documentation that misstates the Agreement's position even when the underlying substantive criterion is correctly paraphrased.

The risk profile is amplified by the BBNJ Agreement's novelty. It entered into force on 17 January 2026, and the secondary body of professional commentary, supervisory guidance, and academic interpretation that normally lets a team triangulate an uncertain AI response is thin. A legal team that receives a confident AI answer on a BBNJ provision has fewer cross-checks available than for a mature instrument. Where the team's deliverable cites the Agreement's operative articles, independent verification against the deposited treaty text is the only reliable safeguard, and it is the safeguard most likely to be skipped under time pressure.

The findings at a glance

The table below summarises each finding from our research on this regulation for Legal teams at Statutory Boards & Agencies firms, with the question area tested, the type of AI failure observed, and the risk category that failure creates for the team.

#Finding titleTypeCitation ID
1Non-undermining clause attributed to wrong articleHallucinationRLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q005

Aggregate impact

The errors documented in this cell cluster on operative provisions that Legal teams at Statutory Boards & Agencies firms most often need accurate citations for: the Conference of the Parties non-undermining duty placed at Article 5 or Article 8 when Article 22(2) governs.

The article-level misattributions documented here are particularly hard to catch on internal review because the substantive paraphrase is broadly correct: the AI tool states the operative obligation accurately while pinning it to the wrong article number. For a legal team relying on AI to orient toward the controlling provision, the error survives technical review and surfaces only when the cited article is verified against the deposited treaty text.

For a legal team at a statutory boards & agencies firm, the systemic risk is that the AI's confident, structured presentation of the wrong answer closely mimics the format of a competent treaty-law summary. Internal reviewers under time pressure rarely re-check article numbers against the deposited text. The errors documented here are the kind that pass through governance and into client-facing or regulator-facing documentation.

What your team should do

The default position for Legal teams at Statutory Boards & Agencies firms relying on AI tools for BBNJ Agreement research should be: treat AI-generated article citations as unverified until confirmed against the deposited treaty text at treaties.un.org. The errors documented here are not matters of interpretation. They involve the wrong article number, the wrong operative standard, and the inverted operative default. For any deliverable that will be relied on internally, by a counterparty, or by a regulator, independent verification is not optional.

In practical terms, the team should adopt a short checklist for any AI-assisted research on the BBNJ Agreement: confirm the article number cited, confirm the operative threshold or standard verbatim, and confirm whether a provision is stated as a default or an opt-in. These three checks would have caught every error in this cell. Firms with active BBNJ exposure should consider building treaty-text lookups directly into the research workflow rather than relying on AI to supply article-level precision.

AI tools remain useful for orientation on the BBNJ Agreement, including understanding the broad structure, identifying which Part of the Agreement addresses a given topic, and generating first-draft outlines. The hazard lies in trusting AI to supply precise article numbers, operative thresholds, and default rules without verification. Given the treaty text is freely and publicly accessible, the cost of verification is low; the cost of propagating an inverted retroactivity rule or a misattributed article number into a deliverable is not.

How RLB Can Help

RegLeg's published Hallucination Research gives Legal teams at Statutory Boards & Agencies firms a structured pre-flight check before relying on AI tools for BBNJ Agreement research. Before an AI-assisted internal memo, regulator-facing filing, or commercial scoping document is finalised, the research identifies precisely which provisions of the Agreement have historically generated confident but incorrect AI output. That forewarning lets the team apply targeted human scrutiny rather than blanket scepticism, making AI assistance genuinely efficient without importing undetected risk into the deliverable.

Beyond the published research, RegLeg works with statutory boards & agencies firms on bespoke regulator deep-dives that map AI-supported workflows within the Legal function to actual hallucination exposure. Activities such as scoping new programmes, drafting internal policies, preparing regulator correspondence, or supporting commercial transactions carry different risk profiles, and the deep-dive surfaces which ones warrant additional controls or independent verification steps. RegLeg can also conduct a confidential review of the firm's existing AI-use policy against the failure-mode catalogue, delivering a prioritised remediation plan that distinguishes low-risk efficiency gains from higher-risk applications.

For teams that want to build durable in-house capability, RegLeg develops training material and CPD-aligned content tailored to the Legal context. This covers how to interpret AI-generated regulatory summaries critically, how to structure verification steps where AI confidence is high but human review is essential, and how to document AI-assisted decision-making consistent with good governance standards.

Every finding on this page compares an AI subject's account of the rule against the regulator's verbatim text from the regulator's own portal. Both are linked. Each delta, its root causes, and impact analysis are documented and published with immutable Citation IDs.