Ursula von der Leyen warns that advanced AI could unleash hacking on an unprecedented scale as Europe prepares new protections against social media’s “capture” of children.

The post EU Chief Warns of AI-Powered Hacking, Moves to Rein In Social Media appeared first on SecurityWeek.

The company provides a standard for AI systems, testing them against risks such as jailbreaks, prompt injections, and unauthorized actions.

The post AIUC Raises $40 Million to Certify Enterprise AI Agents appeared first on SecurityWeek.

Microsoft agreed to adopt guardrails and privacy standards for its AI in schools, as negotiated with the American Federation of Teachers.

The post Microsoft Commits to Sweeping AI Privacy Rules for Students. Will Other Tech Giants Follow? appeared first on SecurityWeek.

The cybersecurity startup is building a proprietary foundation model and plans to accelerate global expansion.

The post Exein Secures $270M at $1.7B Valuation for Physical AI Security appeared first on SecurityWeek.

The incident occurred in May, when RubyGems maintainers suspended new account registrations due to what appeared like malicious activity.

The post OpenAI Investigates Report Linking AI Agents to RubyGems Attack appeared first on SecurityWeek.

The Humanist AI Code of Conduct draws a line between defensive cyber research and operational attack capability.

The post Microsoft AI Code of Conduct Sets Cyberattack Boundaries, Chain of Command, Safety Constraints appeared first on SecurityWeek.

China’s Ministry of Foreign Affairs responded to a question about Amodei’s essay by saying that all parties should work together on AI.

The post Beijing Hits Back at Anthropic CEO’s Call to Curb China’s AI Development appeared first on SecurityWeek.

Concerns over the potential risks of the technology are rising as new AI models become more powerful, heightening both the potential for misuse by people with criminal aims.

The post New Warnings About the Risks of AI to Humanity Revive a Long-Running Debate appeared first on SecurityWeek.

As researchers warn that misaligned AI could threaten human survival, even beneficial systems may erode the critical thinking that defines our humanity.

The post The Race to Control AI and Protect What Makes Us Human appeared first on SecurityWeek.

Security leaders are struggling to modernize cyber hygiene and prevent over-privileged agents from causing unintended harm.

The post CISOs Race to Control AI Agents Without Destroying Their Value appeared first on SecurityWeek.

Dario Amodei warned that within six to 12 months AI could be capable of leading a swarm of agents that could take over the entire internet.

The post Anthropic CEO Dario Amodei Says AI Industry Needs to Give Safety Measures Time to Catch Up appeared first on SecurityWeek.

Anthropic said the users did not succeed in “fielding an operational device” but did carry out a failed test of a guided rocket.

The post Users in Houthi-Held Yemen Tried to Develop Advanced Weapons With AI, Anthropic Says appeared first on SecurityWeek.

Anthropic reveals how criminal groups are increasingly targeting AI vendors' own infrastructure, including to steal a pre-release Claude model.

The post Anthropic Says Russian Hackers Used Claude AI to Automate Malware Evasion appeared first on SecurityWeek.

Both Anthropic and OpenAI have seen high-profile resignations in recent years that were tied to safety concerns.

The post Anthropic Researcher Resigns With Warning About the Dangers of AI Development appeared first on SecurityWeek.

Anthropic is most concerned about Claude Mythos 5’s reckless behavior after recent incidents in which real systems were hacked.

The post Widened Scan Turns Up Fourth Rogue Claude Cyber Incident appeared first on SecurityWeek.

The company will increase its US market presence and will expand its engineering and go-to-market teams.

The post HelmGuard Raises $7.3 Million for Agentic GRC and Security appeared first on SecurityWeek.

Criminal and state-sponsored adversaries are increasingly using AI to automate and scale their attacks, according to GTIG.

The post AI Is Giving Lesser-Resourced Attackers Nation-State-Level Reach, Google Warns appeared first on SecurityWeek.

Muse runs on a dedicated, secure virtual machine that houses both the agent and the user’s data.

The post Meta Launches Personal AI Agent, Muse, Emphasizes Safety and Privacy appeared first on SecurityWeek.

Distillation is an ‘attack’ against an AI model designed to capture outputs, understand reasoning processes, and subsequently train a different model.

The post US Agencies Warn China Is Systematically Extracting Frontier AI Capabilities appeared first on SecurityWeek.

Malicious prompts concealed in documents, metadata, emails, images and code can manipulate autonomous agents into taking dangerous actions.

The post The Hidden Instructions That Can Hijack AI Agents appeared first on SecurityWeek.