AI Hallucination ResearchFindings by audienceSectorsInternational / MultilateralClinical ResearchComplianceDetail › Finding
Clinical Research × Compliance — International / Multilateral · Last updated 11 Jun 2026 · Hallucination Register
Share / Print X LinkedIn Email

Finding#1 : MGR retroactivity default inverted

RLB Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003
AI's failure:Misstated Rule Risk for Clinical Research × Compliance:Regulatory enforcement
What the RLB Specialist Panel found
For Claude Opus 4.7 (web search on)
Question (paraphrased to protect IP)

Does an AI model correctly characterise the temporal scope of the BBNJ Agreement's marine genetic resources framework under Article 10(1), specifically whether the default rule is prospective or retroactive application to legacy sample collections?

RLB's analysis

The model stated the opposite of the Agreement's default rule. The Agreement is prospective by design; the model described a retroactive regime with an opt-out, which inverts both the default and the opt-out structure. This appears to reflect the model reconstructing from commentary on earlier drafts of the text, where the retroactivity question was actively contested, rather than reading the final adopted provision.

AI Head's analysis — what weakness in the AI model caused this

This finding implicates training-data weighting between pre-adoption negotiating commentary and post-adoption primary text. Claude Opus 4.7 with web search stated that the marine genetic resource and digital sequence information provisions of Article 10(1) extend to resources collected before entry into force, with a written opt-out, when Article 10(1) provides the opposite. Pre-adoption legal commentary describing earlier draft proposals that did include a retroactive default is well-indexed and voluminous; the final adopted text that reversed the default is narrower in footprint. The fix is corpus-level: weight post-adoption primary text above pre-adoption commentary, or label pre-adoption commentary as draft-stage.

For Claude Sonnet 4.6 (web search on)
Question (paraphrased to protect IP)

Does an AI model correctly characterise the temporal scope of the BBNJ Agreement's marine genetic resources framework under Article 10(1), specifically whether the default rule is prospective or retroactive application to legacy sample collections?

RLB's analysis

The model stated the opposite of the Agreement's default rule. The Agreement is prospective by design; the model described a retroactive regime with an opt-out, which inverts both the default and the opt-out structure. This appears to reflect the model reconstructing from commentary on earlier drafts of the text, where the retroactivity question was actively contested, rather than reading the final adopted provision.

AI Head's analysis — what weakness in the AI model caused this

This finding implicates training-data weighting between pre-adoption negotiating commentary and post-adoption primary text. Claude Opus 4.7 with web search stated that the marine genetic resource and digital sequence information provisions of Article 10(1) extend to resources collected before entry into force, with a written opt-out, when Article 10(1) provides the opposite. Pre-adoption legal commentary describing earlier draft proposals that did include a retroactive default is well-indexed and voluminous; the final adopted text that reversed the default is narrower in footprint. The fix is corpus-level: weight post-adoption primary text above pre-adoption commentary, or label pre-adoption commentary as draft-stage.

Impact for Compliance Teams in Clinical Research Sector in international jurisdictions working with the BBNJ High Seas Biodiversity Agreement

A compliance team at a clinical research firm relying on this AI response would conclude that the firm's existing collections of high-seas marine genetic resources, obtained before the BBNJ Agreement entered into force, are presumptively subject to benefit-sharing obligations. This is the opposite of the Agreement's actual position under Article 10(1). The firm could initiate costly and unnecessary remediation of legacy collections, impose unwarranted obligations on ongoing research programmes, or misstate its legal position in due diligence disclosures, licensing negotiations, and regulatory filings - any of which could attract scrutiny from national implementing authorities or treaty-body monitoring mechanisms.

References — raw findings (per AI model)
This finding also affects
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003
Plain text Download
RegLeg Specialist Panel (2026). "Finding#1 : MGR retroactivity default inverted — Clinical Research × Compliance — International / Multilateral." Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003. RegLegBrief AI Hallucination Research, published 2026-06-11. https://reglegbrief.com/regulators/j1/int/UNTC/BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023/sectors/clinical_research/compliance/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding#1 : MGR retroactivity default inverted [Hallucination finding RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/UNTC/BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023/sectors/clinical_research/compliance/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003/
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding#1 : MGR retroactivity default inverted [RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003], RegLegBrief AI Hallucination Research (June 11, 2026), https://reglegbrief.com/regulators/j1/int/UNTC/BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023/sectors/clinical_research/compliance/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003/.
BibTeX Download
@misc{reglegbrief_RLB_F_INT_UNTC_BBNJ_HIGH_SEAS_BIODIVERSITY_AGREEMENT_2023_Q003,
  author    = {RegLeg Specialist Panel},
  title     = {Finding#1 : MGR retroactivity default inverted},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-F-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003},
  url       = {https://reglegbrief.com/regulators/j1/int/UNTC/BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023/sectors/clinical_research/compliance/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003/}
}
← Back to case study summary Case study detail →

Every finding on this page compares an AI subject's account of the rule against the regulator's verbatim text from the regulator's own portal. Both are linked. Each delta, its root causes, and impact analysis are documented and published with immutable Citation IDs.