AI Hallucination ResearchFindings by audiencePractitionersInternational / MultilateralProfessional Engineers › BBNJ High Seas Biodiversity Agreement
Practitioners — Professional Engineers · Last updated 11 Jun 2026 · methodology v2.3 · Hallucination Register
Share / Print X LinkedIn Email

AI Hallucination on BBNJ High Seas Biodiversity Agreement for Professional Engineers in international jurisdictions

Professional Engineers: AI summaries of BBNJ Agreement may understate professional obligations

Professional engineers scoping projects that may touch areas beyond national jurisdiction are increasingly using AI to draft environmental impact assessment scoping documents, generate technical briefings for design teams on screening thresholds, and validate which provision of the BBNJ Agreement governs a particular obligation before submitting deliverables to clients or regulators.

The RLB Specialist Panel put a set of practitioner-grade questions on the BBNJ Agreement to two frontier AI models with web search active. Each question is prepared by the Panel based on the workflows that professional engineers actually use AI for under this treaty, covering the screening threshold for environmental impact assessments under Part IV, the temporal scope of the marine genetic resources and digital sequence information regime under Part II, the benefit-sharing duty for digital sequence information, and the non-undermining duty constraining Conference of the Parties decisions on area-based management tools under Part III.

The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate, comparing the AI output line-by-line against the deposited treaty text. Only responses where the AI subject was demonstrably wrong against the verbatim regulator-issued source text are published; responses that were substantively correct, or that refused on calibration grounds, are retained internally and not surfaced. On the BBNJ Agreement, the AI subjects returned a single hallucinated answer in the form of Source-Credit Misattribution for professional engineers.

For professional engineers scoping projects that may engage areas beyond national jurisdiction, citation accuracy in environmental impact assessment scoping documents is load-bearing. A scoping document that pins the screening obligation to the wrong article of the BBNJ Agreement will be challenged on first review by a regulator, a peer reviewer, or the client's own legal team. The substantive screening test the AI paraphrased may be the right test, but the citation will need to be reworked, and the engineer issuing the document carries professional responsibility for the accuracy of the regulatory reference framing the work.

The published Specialist Panel findings, with model attribution, carry the following citation identifiers, each hyperlinked to the bound regulator-issued source text on the BBNJ Agreement regulation hub. The audit register surfaces these findings for professional engineers so that any AI-assisted treaty citation, paraphrase, or rule-statement entering a deliverable can be re-validated against the deposited treaty text before the document is issued:

Take me back to my Professional Engineers (INT) overview

Executive Summary

The BBNJ Agreement establishes the international framework that governs environmental impact assessments for activities in areas beyond national jurisdiction, alongside provisions on marine genetic resources, area-based management tools, and capacity-building. For Professional Engineers scoping marine surveys, cable-laying, marine carbon dioxide removal, seabed research, or other high-seas activities, the Agreement's EIA screening trigger is the operative provision they will be asked about most frequently. Across 1 question put to AI tools that bear on a Professional Engineer's scoping work, the AI's response misattributed the article number that sets the screening threshold.

The substantive qualitative test (more than a minor or transitory effect on the marine environment) was paraphrased correctly, but the article anchor (Article 30 rather than Article 27) was wrong. For an engineering deliverable that must cite the source provision, this produces a defect identifiable on first review by a regulator or peer.

How AI gets this regulation wrong

The failure pattern here is narrow: the AI paraphrased the screening threshold correctly but attached it to the wrong article. The error is article-level misattribution, not a substantive misstatement of the engineering criterion. For a Professional Engineer using AI to orient toward the governing provision before drafting scoping documentation, this is the kind of error that survives an internal review and surfaces only when the deliverable is checked against the deposited treaty text.

AI's Failure ModeCountAffected findings
Misattributed1Finding#1

What that means for your practice

Engineering scoping work and EIA work-ups under the BBNJ Agreement rest on accurate citation of the Agreement's screening provision. The error documented in this cell does not change the substantive test the engineer applies, but it does change the citation that accompanies any deliverable. A scoping document, EIA work-up, or expert report that anchors the threshold to Article 30 will need to be corrected to Article 27 (Part IV) before it is acceptable to a regulator or peer reviewer.

Risk ImpactCountAffected findings
Wrong deliverable1Finding#1

When this affects Professional Engineers

Professional Engineers encounter the BBNJ Agreement when scoping a planned activity in areas beyond national jurisdiction that may trigger an environmental impact assessment obligation. The most common use cases include marine survey work, submarine cable installation, seabed exploration, marine carbon dioxide removal pilots, and similar activities where the screening question (whether the activity may have more than a minor or transitory effect on the marine environment) drives both the scope of the assessment and the citation that accompanies the deliverable.

Where engineers use AI tools to orient toward the controlling provision, this AI response would direct them to Article 30 of the Agreement. The screening obligation actually sits at Article 27 (Part IV). The qualitative test the model paraphrased is correct on the substance, so the scoping criterion would be applied properly in technical terms, but every scoping document, work-up, and expert report that cites the source article would carry the wrong reference. Regulators, peer reviewers, and treaty-body monitoring mechanisms read the citation first; the substantive analysis comes second.

The reputational and cost consequences fall on the firm that issues the work product. A scoping document carrying the wrong article number will need to be reissued, downstream collateral may need to be revised, and the firm's diligence record on the instrument will carry a visible defect.

The findings at a glance

The table below summarises each confirmed error documented in our research on this regulation for Professional Engineers in international jurisdictions, with the failure type and the citation identifier for each.

#Finding titleTypeCitation ID
1EIA screening threshold misattributed to wrong articleHallucinationRLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q001

Aggregate impact

The single error documented in this cell concerns the article that governs the BBNJ Agreement's EIA screening threshold. The AI's substantive paraphrase of the qualitative test (more than a minor or transitory effect on the marine environment) was correct, but the article number it pinned that test to was wrong (Article 30 rather than Article 27, Part IV). For a Professional Engineer producing scoping or EIA work-up documentation, this is a defect that survives technical review but fails on citation review.

What your team should do

The simplest safeguard for Professional Engineers using AI tools to orient on the BBNJ Agreement is to verify the article number cited for the screening provision against the deposited treaty text at treaties.un.org. The substantive screening criterion (more than a minor or transitory effect on the marine environment) is correct as paraphrased; the article anchor needs to be checked. For any deliverable that will be issued to a client, a regulator, or a peer reviewer, the citation should read Article 27 (Part IV).

AI remains useful for orienting toward the BBNJ Agreement's general structure, identifying which Part of the Agreement addresses a given technical question, and drafting first-cut scoping outlines. The specific failure documented here is narrow and easy to defend against: a one-line citation check against the deposited text before the deliverable is issued.

How RLB Can Help

RegLeg's published Hallucination Research is available as a free pre-flight check for engineering teams working on regulatory deliverables under the BBNJ Agreement. Before relying on AI-assisted output to identify the controlling provision for an EIA scoping document or technical work-up, the research flags where AI tools have historically misattributed article numbers or misstated operative thresholds. That advance warning lets the engineer apply targeted verification to the specific points most likely to be wrong, rather than treating every AI output as equally suspect.

For firms with active BBNJ practice areas, RegLeg offers bespoke deep-dive engagements that map AI-assisted workflows in scoping, surveying, and EIA work-ups against the documented failure modes. The output is a tailored briefing the engineering team can use as a standing reference, updated as the treaty's implementing rules and Conference of the Parties decisions develop.

RegLeg also works with engineering teams on training and CPD-aligned content covering how to interpret AI-generated regulatory summaries critically and how to structure verification steps in a deliverable workflow. RegLeg can also conduct a confidential review of a firm's existing AI-use policy against the failure-mode catalogue.

Every finding on this page compares an AI subject's account of the rule against the regulator's verbatim text from the regulator's own portal. Both are linked. Each delta, its root causes, and impact analysis are documented and published with immutable Citation IDs.