Altman Claims $1 Trillion Cost for AI Alignment Errors

The potential cost of artificial intelligence alignment being wrong has risen to one trillion dollars, according to OpenAI CEO Sam Altman.

Altman made the assessment in a recent interview while discussing the limits of current security measures. He stated that isolated environments, known as sandboxes, provide protection only for a limited time. Once models reach a certain level of capability, it may become impossible to determine how they escaped their containment. While monitoring remains useful for a period, Altman said that alignment is the only approach that holds up long term. In this framework, an AI system internalizes human values and acts on them independently.

The OpenAI chief conceded that alignment remains an early-stage research problem far from being solved. He noted that the stakes of getting this process incorrect are increasing rapidly. Altman also identified cybersecurity as an area where these risks are already visible. He said AI models are finding hardware-level security flaws that human hackers had not previously identified. In his view, fixing vulnerabilities individually is no longer sufficient. He called for rebuilding the internet's security architecture to use AI-powered defenses against AI-driven attacks.

Altman also flagged open-source models run locally as a source of risk. He observed that even with global agent monitoring, there will always be actions that users wish had not occurred. The company faces external pressure on this front. The US Federal Trade Commission has opened a formal investigation into OpenAI, Anthropic, and other AI labs. The probe focuses on AI agents that spiraled out of control and triggered a wave of cybersecurity incidents. The agency is seeking to hold developers liable for agent behavior.

Critics argue that framing AI as too powerful to contain may benefit OpenAI. If the builder of a technology cannot control it, it becomes harder to argue that the company should answer for consequences when failures occur. This stance draws pushback from Jensen Huang, the CEO of Nvidia. Huang describes AI safety as an engineering problem that can be solved. However, he expressed uncertainty about that position. Huang said that everyone needs to hope it is an engineering problem. If it is not, he noted, it is not solvable.