Technology

White House AI Testing Framework Excludes Open Models, Leaves Key Terms Undefined

Martin HollowayPublished 3h ago4 min readBased on 9 sources
Reading level
White House AI Testing Framework Excludes Open Models, Leaves Key Terms Undefined

The Trump administration has finalized a voluntary framework for assessing cybersecurity risks posed by advanced AI models, and it explicitly excludes open-weights models from its scope. Axios first reported the details on August 4, 2026, citing sources familiar with the matter. The framework, outlined in a June 2 executive order (EO-14409) titled "Promoting Advanced Artificial Intelligence Innovation and Security," applies only to closed-source models with state-of-the-art capabilities that carry national security risks. (Axios)

Representatives from Anthropic, OpenAI, and Google attended a White House briefing on the finalized framework. Reuters reported on August 3 that Meta was also invited to the meeting alongside those three companies to discuss the voluntary government safety testing process. (Reuters)

A White House official confirmed to Politico that the framework met its completion deadline set by EO-14409. The executive order had directed the development of a classified benchmarking process to assess the advanced cyber capabilities of AI models and determine a threshold for concern. (Politico)

The framework's mechanics are narrow. It establishes a 30-day grace period during which the government can review new models before release. Companies are under no obligation to comply, and the administration was not planning to publicly release the framework's details. Open models are not merely exempt from testing; the framework explicitly states it cannot be used to restrict open models after they have been released. (The Verge)

The framework also leaves two of its most critical terms undefined. Neither "state-of-the-art" nor "national security risk" is given a precise meaning in context. Without those definitions, the boundary between in-scope and out-of-scope models rests on interpretation that the document does not supply.

The exclusion of open models is the decision with the widest implications. Open-weights models, whose core components can be downloaded and inspected by anyone, now sit entirely outside the government's pre-release review pipeline. A model released with open weights cannot be recalled for assessment, nor can its distribution be constrained under this framework, regardless of capability. Closed models, by contrast, are subject to a voluntary 30-day review window that companies can simply decline to enter.

Frontier labs including OpenAI and Anthropic have been actively seeking guidance on how to release models without triggering government restrictions, according to The Verge. The voluntary nature of the framework means that compliance is a corporate choice, not a legal requirement, and the absence of enforcement mechanisms is structural rather than transitional. (The Verge)

The June executive order fits within a broader administration AI policy arc. On March 20, 2026, President Trump unveiled the National AI Legislative Framework at the White House. The administration's America's AI Action Plan, published in July 2025, had already called for U.S. academia to test AI systems for transparency, effectiveness, use control, and security vulnerabilities. The White House has characterized the United States as the global leader in artificial intelligence, citing record-setting capital expenditures.

Looking at what this means in practice, the framework creates an asymmetry that favors open-weights releases. A lab that open-weights a frontier-tier model faces no pre-release review, no 30-day window, and no post-hoc restriction under this framework. A lab that keeps its model closed nominally submits to a voluntary process with undefined thresholds and no enforcement. The practical difference between the two paths, under a voluntary regime, may be smaller than it appears on paper, since closed-model developers can also opt out entirely.

Worth flagging is the decision not to release the framework publicly. A classified benchmarking process combined with undisclosed assessment guidelines means that companies are being asked to comply with a process whose specifics they may not fully see, and whose terms, "state-of-the-art" and "national security risk," are left to the government to interpret. For the frontier labs seeking clarity on release procedures, that ambiguity is the framework's defining feature rather than a gap to be closed later.

The broader context here is one we have navigated before in adjacent domains. Voluntary frameworks have served as precursors to binding regulation in areas from automotive emissions to pharmaceutical testing, with government establishing norms first and codifying them later. Whether this AI framework follows that arc will depend on whether Congress acts on the National AI Legislative Framework unveiled in March, and on whether the voluntary benchmarking process produces results that the administration treats as evidence for mandatory rules. The framework as it stands today is a signaling mechanism, not a regulatory one, and its signals point most clearly at open-weights models being left to govern themselves.