AI subject tested: Claude Opus 4.7 (web search on)
Question (paraphrased): Does an AI model correctly identify Article 22(2) as the provision that constrains the BBNJ Conference of the Parties from overriding the competences of other international bodies when designating marine protected areas?
AI response:
"Article 5 / Article 8 of the Agreement explicitly require it not to undermine relevant legal instruments, frameworks and competent global, regional, subregional and sectoral bodies"
Regulator verbatim text:
"Article 22(2): the Conference of the Parties 'shall respect the competences of, and not undermine, relevant legal instruments and frameworks and relevant global, regional, subregional and sectoral bodies'"
Failure mode: misattributed
Substrate document: p_01_ACT_Part_III___Article_22_2____non_undermini_text-bbnj-agreement.html
This finding documents a confirmed hallucination by Claude Opus 4.7 (web search on) on a probe of the regulation. The model's response was tested against the regulator's verbatim primary text and classified as misattributed. Full per-finding context is available via the linked Citation ID.
Each finding has a stable Citation ID (RLB-F-… for aggregated case-study findings, RLB-H-… for raw per-model hallucinations) — like a DOI, the ID always resolves to the canonical finding even if URLs change.
RegLeg Specialist Panel (2026). "Does an AI model correctly identify Article 22(2) as the provision that constrains the BBNJ Conference of the Parties fr — AI Labs." Citation ID: RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q005-Opus47. RegLegBrief AI Hallucination Research, published 2026-06-07. https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-005--opus-47-websearch/
RegLeg Specialist Panel. (2026). Does an AI model correctly identify Article 22(2) as the provision that constrains the BBNJ Conference of the Parties fr [Hallucination finding RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q005-Opus47]. RegLegBrief AI Hallucination Research. https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-005--opus-47-websearch/
RegLeg Specialist Panel, Does an AI model correctly identify Article 22(2) as the provision that constrains the BBNJ Conference of the Parties fr [RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q005-Opus47], RegLegBrief AI Hallucination Research (June 07, 2026), https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-005--opus-47-websearch/.
@misc{reglegbrief_RLB_H_INT_UNTC_BBNJ_HIGH_SEAS_BIODIVERSITY_AGREEMENT_2023_Q005_Opus47,
author = {RegLeg Specialist Panel},
title = {Does an AI model correctly identify Article 22(2) as the provision that constrains the BBNJ Conference of the Parties fr},
year = {2026},
publisher = {RegLegBrief AI Hallucination Research},
note = {Hallucination finding Citation ID: RLB-H-INT-UNTC-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-Q005-Opus47},
url = {https://reglegbrief.com/regulators/j1/int/untc/bbnj-high-seas-biodiversity-agreement-2023/whitepaper/finding/INT-UNTC-INT-001-BBNJ-HIGH-SEAS-BIODIVERSITY-AGREEMENT-2023-v1-005--opus-47-websearch/}
}
Every finding on this page compares an AI subject's account of the rule against the regulator's verbatim text from the regulator's own portal. Both are linked. Each delta, its root causes, and impact analysis are documented and published with immutable Citation IDs.