Compliance teams at biotechnology firms working with marine genetic resources are increasingly using AI to update sample-provenance screening checklists, generate access-and-benefit-sharing rule-update bulletins for research leads, and validate which marine genetic resource and digital sequence information obligations under the BBNJ Agreement apply to legacy collections.
The RLB Specialist Panel put a set of practitioner-grade questions on the BBNJ Agreement to two frontier AI models with web search active. Each question is prepared by the Panel based on the workflows that compliance teams at biotechnology firms actually use AI for under this treaty, covering the screening threshold for environmental impact assessments under Part IV, the temporal scope of the marine genetic resources and digital sequence information regime under Part II, the benefit-sharing duty for digital sequence information, and the non-undermining duty constraining Conference of the Parties decisions on area-based management tools under Part III.
The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate, comparing the AI output line-by-line against the deposited treaty text. Only responses where the AI subject was demonstrably wrong against the verbatim regulator-issued source text are published; responses that were substantively correct, or that refused on calibration grounds, are retained internally and not surfaced. On the BBNJ Agreement, the AI subjects returned two hallucinated answers in the form of Inverted-Position Hallucination together with Source-Credit Misattribution for compliance teams at biotechnology firms.
For compliance teams at biotechnology firms working under the BBNJ Agreement, internal policies, regulator-facing filings, and supervisor-engagement memos turn on citation accuracy. A compliance submission that mis-numbers the source article will be identified by a national Clearing-House Mechanism reviewer or a treaty-body monitoring reviewer on first reading, and the wider compliance narrative loses credibility.
Where the AI subjects inverted the direction of the marine genetic resources retroactivity default, the consequence is more serious: the firm could initiate costly and unnecessary remediation of legacy collections, or misstate its position in due diligence disclosures, licensing negotiations, and regulatory filings - any of which could attract scrutiny from national implementing authorities or treaty-body monitoring mechanisms.
The published Specialist Panel findings, with model attribution, carry the following citation identifiers, each hyperlinked to the bound regulator-issued source text on the BBNJ Agreement regulation hub. The audit register surfaces these findings for compliance teams at biotechnology firms so that any AI-assisted treaty citation, paraphrase, or rule-statement entering a deliverable can be re-validated against the deposited treaty text before the document is issued:
RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Opus47 (MGR retroactivity default inverted)RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Sonnet46 (MGR retroactivity default inverted)RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q004-Sonnet46 (DSI benefit-sharing article misidentified)This is the consolidated view of findings. Click the Citation IDs or 'see details →' on any item for the full details for each finding.
A compliance team at a biotechnology firm relying on this AI response would conclude that the firm's existing collections of high-seas marine genetic resources, obtained before the BBNJ Agreement entered into force, are presumptively subject to benefit-sharing obligations. This is the opposite of the Agreement's actual position under Article 10(1). The firm could initiate costly and unnecessary remediation of legacy collections, impose unwarranted obligations on ongoing research programmes, or misstate its legal position in due diligence disclosures, licensing negotiations, and regulatory filings - any of which could attract scrutiny from national implementing authorities or treaty-body monitoring mechanisms.
A compliance team at a biotechnology firm building an internal policy on digital sequence information benefit-sharing under the BBNJ Agreement would, on this AI response, anchor the policy to Article 15(5). The correct provision is Article 14(1). A compliance policy or regulator-facing filing that cites the wrong article is identifiable as an error on first reading by a national Clearing-House Mechanism, treaty body, or external reviewer, and calls into question the rigour of related representations in the same document.
Every finding on this page compares an AI subject's account of the rule against the regulator's verbatim text from the regulator's own portal. Both are linked. Each delta, its root causes, and impact analysis are documented and published with immutable Citation IDs.