AI Hallucination ResearchRegulatorsGlobal standard-settersINTUNTCBBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023White paperDetail › Finding
AI Labs · Last updated 7 Jun 2026 · methodology vv2.3 · Hallucination Register

Finding on 'Q003 Probe' for Claude Opus 4.7 with web search ON

RLB Citation ID: RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Opus47
What the RLB Specialist Panel found

Finding on 'Q003 Probe' for Claude Opus 4.7 with web search ON

  • Question (paraphrased to protect IP): Does an AI model correctly characterise the temporal scope of the BBNJ Agreement's marine genetic resources framework under Article 10(1), specifically whether the default rule is prospective or retroactive application to legacy sample collections?
  • AI's response: "Under Article 10(1), the MGR/DSI provisions apply to 'utilization' of MGR and DSI of ABNJ that were collected or generated before entry into force, not just after."
  • Regulator's text: Article 10(1) provides that the marine genetic resource and digital sequence information provisions apply only to resources collected and generated after the entry into force of the Agreement for each Party. Most parties further confirmed non-retroactivity by formal declarations on deposit.
  • Why the AI went wrong: The model stated the opposite of the Agreement's default rule. The Agreement is prospective by design; the model described a retroactive regime with an opt-out, which inverts both the default and the opt-out structure. This appears to reflect the model reconstructing from commentary on earlier drafts of the text, where the retroactivity question was actively contested, rather than reading the final adopted provision.
Impact for this audience

This finding implicates training-data weighting between pre-adoption negotiating commentary and post-adoption primary text. Claude Opus 4.7 with web search stated that the marine genetic resource and digital sequence information provisions of Article 10(1) extend to resources collected before entry into force, with a written opt-out, when Article 10(1) provides the opposite. Pre-adoption legal commentary describing earlier draft proposals that did include a retroactive default is well-indexed and voluminous; the final adopted text that reversed the default is narrower in footprint. The fix is corpus-level: weight post-adoption primary text above pre-adoption commentary, or label pre-adoption commentary as draft-stage.

References — raw findings (per AI model)
This finding also affects
Next finding → Finding on 'Q004 Probe' for Claude Sonnet 4.6 with web search ON
Cite this finding

Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.

RLB Citation ID: RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Opus47
Plain text Download
RegLeg Specialist Panel (2026). "Finding on 'Q003 Probe' for Claude Opus 4.7 with web search ON — AI Labs." Citation ID: RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Opus47. RegLegBrief AI Hallucination Research, published 2026-06-07. https://reglegbrief.com/regulators/j1/int/UNTC/BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003--opus-47-websearch/
APA 7th edition Download
RegLeg Specialist Panel. (2026). Finding on 'Q003 Probe' for Claude Opus 4.7 with web search ON [Hallucination finding RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Opus47]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/UNTC/BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003--opus-47-websearch/
Bluebook / OSCOLA (US + UK legal) Download
RegLeg Specialist Panel, Finding on 'Q003 Probe' for Claude Opus 4.7 with web search ON [RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Opus47], RegLegBrief AI Hallucination Research (June 07, 2026), https://reglegbrief.com/regulators/j1/int/UNTC/BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003--opus-47-websearch/.
BibTeX Download
@misc{reglegbrief_RLB_H_INT_UNTC_BBNJ_HIGH_SEAS_BIODIVERSITY_AGREEMENT_2023_Q003_Opus47,
  author    = {RegLeg Specialist Panel},
  title     = {Finding on 'Q003 Probe' for Claude Opus 4.7 with web search ON},
  year      = {2026},
  publisher = {RegLegBrief AI Hallucination Research},
  note      = {Hallucination finding Citation ID: RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q003-Opus47},
  url       = {https://reglegbrief.com/regulators/j1/int/UNTC/BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-003--opus-47-websearch/}
}
← Back to case study summary Case study detail →

Every finding on this page compares an AI subject's account of the rule against the regulator's verbatim text from the regulator's own portal. Both are linked. Each delta, its root causes, and impact analysis are documented and published with immutable Citation IDs.