Legal teams at pharmaceutical firms are increasingly using AI to draft access and licensing agreements for marine-sourced material, generate counsel-facing memos on the BBNJ Agreement's digital sequence information benefit-sharing framework, and validate treaty-citation language in due-diligence disclosures and transactional documents.
The RLB Specialist Panel put a set of practitioner-grade questions on the BBNJ Agreement to two frontier AI models with web search active. Each question is prepared by the Panel based on the workflows that legal teams at pharmaceuticals firms actually use AI for under this treaty, covering the screening threshold for environmental impact assessments under Part IV, the temporal scope of the marine genetic resources and digital sequence information regime under Part II, the benefit-sharing duty for digital sequence information, and the non-undermining duty constraining Conference of the Parties decisions on area-based management tools under Part III.
The Panel then binds every AI response to verbatim regulator-issued source text held as primary substrate, comparing the AI output line-by-line against the deposited treaty text. Only responses where the AI subject was demonstrably wrong against the verbatim regulator-issued source text are published; responses that were substantively correct, or that refused on calibration grounds, are retained internally and not surfaced. On the BBNJ Agreement, the AI subjects returned two hallucinated answers in the form of Inverted-Position Hallucination together with Source-Credit Misattribution for legal teams at pharmaceuticals firms.
For legal teams at pharmaceuticals firms advising on the BBNJ Agreement, treaty-citation accuracy is load-bearing in legal opinions, contractual representations, due-diligence disclosures, and any pleading or position paper engaging the Agreement. A counterparty or opposing counsel who identifies a misattributed article on first reading calls the entire piece of advice into question. The marine genetic resources retroactivity inversion is the more serious failure: a legal opinion structured around a retroactive-by-default rule when the treaty establishes the opposite default produces fundamentally wrong contract terms and exposes the firm to professional liability if the underlying position is later corrected.
The published Specialist Panel findings, with model attribution, carry the following citation identifiers, each hyperlinked to the bound regulator-issued source text on the BBNJ Agreement regulation hub. The audit register surfaces these findings for legal teams at pharmaceuticals firms so that any AI-assisted treaty citation, paraphrase, or rule-statement entering a deliverable can be re-validated against the deposited treaty text before the document is issued:
RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Opus47 (MGR retroactivity default inverted)RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Sonnet46 (MGR retroactivity default inverted)RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q004-Sonnet46 (DSI benefit-sharing article misidentified)This is the consolidated view of findings. Click the Citation IDs or 'see details →' on any item for the full details for each finding.
A legal team at a pharmaceuticals firm advising on whether the BBNJ Agreement's marine genetic resource and digital sequence information regime applies to legacy sample collections obtained before entry into force would, on this AI response, structure access agreements and benefit-sharing arrangements around a retroactive-by-default rule. The Agreement is the opposite: Article 10(1) limits the regime to resources collected after entry into force for each Party. A legal opinion or transactional document built on the inverted rule would misallocate obligation and risk across counterparties and could expose the firm to professional liability if the underlying position is later corrected.
A legal team at a pharmaceuticals firm advising on the BBNJ Agreement's digital sequence information benefit-sharing framework would, on this AI response, cite Article 15(5) as the source of the obligation. The DSI benefit-sharing duty actually sits at Article 14(1). The substantive conclusion that DSI is in scope is right; the article number is not. A legal opinion or transactional document carrying the wrong citation is defective on first review and undermines the credibility of the wider advice on the same instrument.
Every finding on this page compares an AI subject's account of the rule against the regulator's verbatim text from the regulator's own portal. Both are linked. Each delta, its root causes, and impact analysis are documented and published with immutable Citation IDs.