AI Hallucination Research › Briefings

Briefings Blog

The running blog from the RLB Specialist Panel delves into real-world scenarios where the compliance, legal, or AI lab team interacts with frontier AI models under specific regulations. The blogs are anonymised to remove client-specific details and include insights from the RLB team analysing the hallucinations experienced in AI models while working on these cases. For example, when a model returns a confident answer that contradicts the regulator's primary text, such as a fabricated staff letter, a wrong appendix, or an inverted scope, these issues are discussed here. Each blog explains one set of findings and what it would have meant for the team that would have acted on it, sans this research initiative. This blog is frequently updated, a few times a day.

263 briefings in the archive · Subscribe via Atom: /briefings/feed.xml (this blog) · /feed.xml (all RegLegBrief publications)
Audience colours: AI Labs Practitioner (profession) Sector × Department
Audience
Jur.
Regulator
Profession
Sector
Dept
Range
Sort
Per page
Showing 5 of 263 · page 31 of 53
Friday, 03 July 2026
Sector: Electricity & Power and Dept: ESG & Sustainability INT OECD

Electricity & Power ESG & Sustainability teams: documentation and reporting gaps possible from AI reading of Recommendation of the Council on Digital Technologies and the Environment

For Electricity & Power ESG & Sustainability teams working with Recommendation of the Council on Digital Technologies and the Environment (2025 Revision): Specialist-Panel-verified findings on where AI summaries...

ESG & Sustainability teams at Electricity & Power firms operating under digital infrastructure environmental impact and data-centre energy reporting are increasingly using AI to contextualise data-centre offtake exposures in climate transition-plan disclosures, draft regulator-facing policy briefs on digital-infrastructure energy obligations, and prepare due-diligence briefings on PPA counterparties with data-centre offtake concentration.

The OECD's 2025 Revision of the Recommendation on Digital Technologies and the Environment carries a named, citable statistic on Ireland's data-centre share of metered electricity, drawn from Ireland's Central Statistics Office, that ESG & Sustainability teams at electricity and power firms will reach for when populating sustainability disclosures, ESG investor responses, and regulatory briefings on digital-infrastructure environmental impact. That statistic is exactly the kind of figure the RLB Specialist Panel tested two frontier AI subjects against.

The RLB Specialist Panel issued a Specialist Panel application-style question on the share of Ireland's 2021 metered electricity that data centres accounted for, per the figure cited in the OECD Digital Economy Outlook 2024 chapter referenced by the 2025 Recommendation, sourced from Ireland's CSO (2023). Two frontier AI models tested by the RLB Specialist Panel returned the figure as 14 per cent and extended the answer with a four-point time series running from 5 per cent in 2015 through 21 per cent in 2023. The regulator's verbatim text records 11 per cent in 2021, with no multi-year trajectory.

The failure class is Fabricated Fact: a confidently delivered, citably attributed statistic that does not match the source document, compounded by a fabricated time series that does not appear anywhere in the OECD or CSO published record.

For ESG & Sustainability teams at electricity and power firms, this is operationally consequential because the wrong figure is not a vague paraphrase. It is delivered with a real source chain, CSO 2023 via OECD Digital Economy Outlook 2024, that survives standard reference-check review. AI tools tested by the Panel stated that data centres accounted for 14 per cent of Ireland's metered electricity in 2021, citing Ireland's Central Statistics Office via the OECD Digital Economy Outlook 2024, when the Recommendation's own text gives the figure as 11 per cent.

The AI compounded this by generating a fabricated time series, 5 per cent rising to 21 per cent across 2015 to 2023, that appears nowhere in the source material, giving the wrong anchor figure a false air of corroboration. For an ESG and Sustainability team at an Electricity and Power firm, this figure is live material: it is exactly the kind of OECD benchmark used to contextualise a firm's data-centre offtake or grid digitalisation footprint in climate transition plan disclosures, regulatory submissions on digital infrastructure energy obligations, or due-diligence briefings on PPA counterparties.

A three-percentage-point error on a jurisdiction the OECD has explicitly named, carried into a board sustainability report or a regulator-facing policy brief, creates both a factual mis-statement to retract and a process credibility question the team will need to answer.

The audit's finding on this question is published with an immutable RLB Citation ID. The relevant entry is RLB-H-INT-OECD-OECD-DIGITAL-TECHNOLOGIES-ENVIRONMENT-2025-Q006-Sonnet46. The full audit is published at the OECD Digital Technologies and the Environment Recommendation (2025 Revision) hub on RegLegBrief.com.

Sector: Digital Platforms & Marketplaces and Dept: ESG & Sustainability INT OECD

Digital Platforms & Marketplaces ESG & Sustainability teams: documentation and reporting gaps possible from AI reading of Recommendation of the Council on Digital Technologies and the Environment

For Digital Platforms & Marketplaces ESG & Sustainability teams working with Recommendation of the Council on Digital Technologies and the Environment (2025 Revision): Specialist-Panel-verified findings on where AI...

ESG & Sustainability teams at Digital Platforms & Marketplaces firms operating under digital infrastructure environmental impact and data-centre energy reporting are increasingly using AI to populate CDP submissions and investor ESG questionnaire responses with OECD-cited data-centre energy benchmarks, draft sustainability-report sections on digital-infrastructure footprint, and prepare internal carbon-accounting baselines for platform-side data-centre offtake exposures.

The OECD's 2025 Revision of the Recommendation on Digital Technologies and the Environment carries a named, citable statistic on Ireland's data-centre share of metered electricity, drawn from Ireland's Central Statistics Office, that ESG & Sustainability teams at digital platform and marketplace firms will reach for when populating sustainability disclosures, ESG investor responses, and regulatory briefings on digital-infrastructure environmental impact. That statistic is exactly the kind of figure the RLB Specialist Panel tested two frontier AI subjects against.

The RLB Specialist Panel issued a Specialist Panel application-style question on the share of Ireland's 2021 metered electricity that data centres accounted for, per the figure cited in the OECD Digital Economy Outlook 2024 chapter referenced by the 2025 Recommendation, sourced from Ireland's CSO (2023). Two frontier AI models tested by the RLB Specialist Panel returned the figure as 14 per cent and extended the answer with a four-point time series running from 5 per cent in 2015 through 21 per cent in 2023. The regulator's verbatim text records 11 per cent in 2021, with no multi-year trajectory.

The failure class is Fabricated Fact: a confidently delivered, citably attributed statistic that does not match the source document, compounded by a fabricated time series that does not appear anywhere in the OECD or CSO published record.

For ESG & Sustainability teams at digital platform and marketplace firms, this is operationally consequential because the wrong figure is not a vague paraphrase. It is delivered with a real source chain, CSO 2023 via OECD Digital Economy Outlook 2024, that survives standard reference-check review. AI tools tested by the Panel overstated Ireland's 2021 data-centre share of metered electricity as 14 per cent, attributed to Ireland's CSO via the OECD Digital Economy Outlook 2024, when the primary source records 11 per cent.

The AI also fabricated a multi-year trend series, 5 per cent rising to 21 per cent across 2015 to 2023, that does not appear anywhere in the source material. For an ESG or sustainability team at a digital platform or marketplace firm, this matters most when that figure is used as a benchmark in an environmental disclosure, an investor ESG questionnaire response, or an internal carbon-accounting baseline. The error is pre-cited with credible provenance, which means it will pass a junior review that assumes AI-supplied citations have been verified.

If the inflated figure enters a CDP submission or an investor-facing sustainability report, the firm faces the combination of a factually wrong claim and a traceable citation trail that any counterparty can check against the primary source. Correction requires identifying and retracting every downstream document that inherited the figure, a material remediation cost and a reputational exposure with investors and regulators who treat ESG disclosure accuracy as a governance signal.

The audit's finding on this question is published with an immutable RLB Citation ID. The relevant entry is RLB-H-INT-OECD-OECD-DIGITAL-TECHNOLOGIES-ENVIRONMENT-2025-Q006-Sonnet46. The full audit is published at the OECD Digital Technologies and the Environment Recommendation (2025 Revision) hub on RegLegBrief.com.

Thursday, 02 July 2026
Practitioner: Professional Engineers INT OECD

Professional Engineers: AI summaries of Recommendation of the Council on Digital Technologies and the Environment may understate professional obligations

For Professional Engineers working with Recommendation of the Council on Digital Technologies and the Environment (2025 Revision): where Specialist-Panel-verified divergences between frontier AI summaries and the...

Professional Engineers advising clients on digital infrastructure environmental impact and data-centre energy reporting are increasingly using AI to draft technical annexes referencing national data-centre energy intensity figures, prepare environmental impact assessment baseline statistics for digital-infrastructure projects, populate grid-operator consultation submissions with OECD-cited benchmark data, and verify regulator-issued statistics against primary publication chains.

The OECD's 2025 Revision of the Recommendation on Digital Technologies and the Environment carries a named, citable statistic on Ireland's data-centre share of metered electricity, drawn from Ireland's Central Statistics Office, that professional engineers will reach for when contextualising client engagements on data-centre offtake, sustainability reporting, and digital-infrastructure assurance work. That statistic is exactly the kind of figure the RLB Specialist Panel tested two frontier AI subjects against.

The RLB Specialist Panel issued a Specialist Panel application-style question on the share of Ireland's 2021 metered electricity that data centres accounted for, per the figure cited in the OECD Digital Economy Outlook 2024 chapter referenced by the 2025 Recommendation, sourced from Ireland's CSO (2023). Two frontier AI models tested by the RLB Specialist Panel returned the figure as 14 per cent and extended the answer with a four-point time series running from 5 per cent in 2015 through 21 per cent in 2023. The regulator's verbatim text records 11 per cent in 2021, with no multi-year trajectory.

The failure class is Fabricated Fact: a confidently delivered, citably attributed statistic that does not match the source document, compounded by a fabricated time series that does not appear anywhere in the OECD or CSO published record.

For professional engineers, this is operationally consequential because the wrong figure is not a vague paraphrase. It is delivered with a real source chain, CSO 2023 via OECD Digital Economy Outlook 2024, that survives standard reference-check review. A Professional Engineer who uses this AI response as a research shortcut will embed a wrong baseline statistic, 14 per cent rather than the verbatim 11 per cent, into a technical annex, an environmental impact assessment, or a policy submission, attributed to a real and reputable source chain (CSO 2023 via OECD Digital Economy Outlook 2024).

The fabricated time series (5 per cent rising to 21 per cent across 2015 to 2023) compounds the risk: it reads as contextual corroboration and would not be detected without independently verifying each year against the primary document. In a formal process, planning approval, grid operator consultation, or regulatory submission, a misattributed statistic of this kind is the type of error that surfaces under technical cross-examination and reflects on the engineer's verification practice, not merely their choice of tool.

The audit's finding on this question is published with an immutable RLB Citation ID. The relevant entry is RLB-H-INT-OECD-OECD-DIGITAL-TECHNOLOGIES-ENVIRONMENT-2025-Q006-Sonnet46. The full audit is published at the OECD Digital Technologies and the Environment Recommendation (2025 Revision) hub on RegLegBrief.com.

Practitioner: Accountants (CA/PA) INT OECD

Accountants (CA/PA): AI summaries of Recommendation of the Council on Digital Technologies and the Environment may understate professional obligations

For Accountants (CA/PA) working with Recommendation of the Council on Digital Technologies and the Environment (2025 Revision): where Specialist-Panel-verified divergences between frontier AI summaries and the...

Accountants (CA/PA) advising clients on digital infrastructure environmental impact and data-centre energy reporting are increasingly using AI to validate ESG-disclosure benchmark figures against regulator-cited statistics, draft client sustainability-opinion sections referencing OECD-cited national data, prepare due-diligence memos on carbon-accounting baselines for data-centre offtake engagements, and populate audit working papers with OECD-cited benchmark statistics.

The OECD's 2025 Revision of the Recommendation on Digital Technologies and the Environment carries a named, citable statistic on Ireland's data-centre share of metered electricity, drawn from Ireland's Central Statistics Office, that accountants will reach for when contextualising client engagements on data-centre offtake, sustainability reporting, and digital-infrastructure assurance work. That statistic is exactly the kind of figure the RLB Specialist Panel tested two frontier AI subjects against.

The RLB Specialist Panel issued a Specialist Panel application-style question on the share of Ireland's 2021 metered electricity that data centres accounted for, per the figure cited in the OECD Digital Economy Outlook 2024 chapter referenced by the 2025 Recommendation, sourced from Ireland's CSO (2023). Two frontier AI models tested by the RLB Specialist Panel returned the figure as 14 per cent and extended the answer with a four-point time series running from 5 per cent in 2015 through 21 per cent in 2023. The regulator's verbatim text records 11 per cent in 2021, with no multi-year trajectory.

The failure class is Fabricated Fact: a confidently delivered, citably attributed statistic that does not match the source document, compounded by a fabricated time series that does not appear anywhere in the OECD or CSO published record.

For accountants, this is operationally consequential because the wrong figure is not a vague paraphrase. It is delivered with a real source chain, CSO 2023 via OECD Digital Economy Outlook 2024, that survives standard reference-check review. A CA or PA who accepts the AI-generated figure at face value and includes it in a client deliverable, a sustainability opinion, a due-diligence memo, or a board briefing, will have signed off on a materially incorrect statistic attributed to a named official source. The client loses the ability to rely on that deliverable as an accurate benchmark.

If the figure is used to contextualise a disclosure in a regulated filing or an ESG-linked transaction document, correcting the record after publication or submission is costly and reputationally damaging. The fabricated time series compounds the risk: it provides apparent trend evidence that may influence investment or risk-assessment conclusions drawn by the client or a counterparty reviewing the document.

The audit's finding on this question is published with an immutable RLB Citation ID. The relevant entry is RLB-H-INT-OECD-OECD-DIGITAL-TECHNOLOGIES-ENVIRONMENT-2025-Q006-Sonnet46. The full audit is published at the OECD Digital Technologies and the Environment Recommendation (2025 Revision) hub on RegLegBrief.com.

Sector: Investment Banking and Dept: Governance & Company Secretarial INT BIS-CPMI

Investment Banking Governance & Company Secretarial teams: documentation and reporting gaps possible from AI reading of CPMI-IOSCO Initial Margin Disclosure (2026 consult)

For Investment Banking Governance & Company Secretarial teams working with CPMI-IOSCO Consultation on Updated Guidance and Public Disclosures to Implement Initial Margin Proposals: Specialist-Panel-verified findings...

Governance and company secretarial teams at internationally active investment banks subject to the CPMI-IOSCO Initial Margin Disclosure Consultation are increasingly using AI to scope board-level briefings on CCP counterparty governance, draft policy updates on margin model oversight standards, generate audit committee papers on the May 2026 consultative document (d232), prepare board resolution language for adoption of revised CCP disclosure assessment frameworks, brief non-executive directors on the consultation's implications for the firm's CCP exposure profile, and produce the cross-jurisdictional governance mapping that records how the consultation's expected obligations translate across the firm's home and host regulator footprint.

The work product anchors the entity's documented governance position; once it enters the board pack and the minute, it is on the formal governance record.

Two frontier AI models tested by the RLB Specialist Panel on the consultation's text on CCP override framework disclosure produced a detailed three-part enumeration that the consultation does not contain, and converted a "should" expectation into a "must" mandatory requirement. The failure class is Source-Credit Fabrication: a structured enumeration of regulator-issued requirements that the regulator did not set, supported by a secondary commentary URL rather than the primary BIS d232 cover note. The structure of the closed list, more than the words, is what makes the misstatement survive a quick pre-circulation review.

For a Governance and Company Secretarial team, the operational consequence is that any board-level briefing on CCP counterparty governance, any policy update on margin model oversight standards, or any framework for assessing the adequacy of CCP disclosures that incorporates the AI output anchors the firm's governance position to a regulatory standard that was never set. Under CPMI-IOSCO's oversight framework and the jurisdiction-level prudential requirements that implement it, a regulator examining the firm's CCP counterparty risk governance could find that the firm's assessment criteria are unsupported by the actual regulatory text.

The enforcement and remediation exposure is difficult to contain once the fabricated standard is embedded in formal governance records: a corrected document is not enough, the entity needs a corrected governance record that explains why the original was incorrect.

The finding is from a Specialist Panel application-style question, framed the way a governance analyst or assistant company secretary would type it into an AI assistant when scoping the next board briefing on CCP counterparty governance, with the request scoped narrowly to the override framework disclosure area. The Panel bound the model output against the verbatim consultation text on the override framework, held as primary substrate. Citation: RLB-H-INT-BIS-CPMI-IOSCO-INITIAL-MARGIN-DISCLOSURE-CONSULT-2026-Q005-Sonnet46.

↑ Back to top