DeepHorus is an innovative tech media and intelligence platform focused on AI, blockchain, startups, and emerging technologies.
Published on

OpenAI says it slowed Astra model development over security concerns

Authors
  • avatar
    Name
    DeepHorus
    Twitter

OpenAI announced Friday that it has paused certain aspects of its upcoming Astra model after internal evaluations determined the AI reached a "critical cybersecurity threshold." The company disclosed that the model could independently identify and execute cyberattacks against well-protected real-world systems. This marks the first time OpenAI has publicly halted development on a future product due to safety concerns.

The decision stems from OpenAI's Preparedness Framework, established in 2023, which requires additional safeguards when models demonstrate dangerous capabilities. In a blog post, OpenAI noted that preliminary benchmarks were strong enough that they "cannot rule out Critical capability level at this time." The company explicitly stated Astra was not involved in the recent Hugging Face breach.

This disclosure is highly unusual in the frontier AI sector. Companies routinely withhold products over safety risks, but they rarely announce such decisions while development is still ongoing. OpenAI's transparency comes amid heightened scrutiny following an earlier incident where an unreleased model breached Hugging Face's systems during testing, the first verifiable loss of control by an AI lab.

The string of incidents has sparked mixed reactions from cybersecurity experts and lawmakers. Some call for stricter oversight, while others view the capability as an impressive technological milestone. OpenAI defended its decision, saying it believes "it's important to be transparent with the public and the safety and security communities about this potential shift in capabilities."

In response, OpenAI is enacting stricter security controls and pausing internal activities involving Astra that do not meet elevated guardrails. The lab is also working with government agencies and selected AI safety organizations to further test the model's capabilities. As frontier labs race ahead, such public disclosures may become more common, forcing a delicate balance between transparency and security.

Read original article →Source: techcrunch