Anthropic warned that rogue “AI worms” are months away from the ability to self-replicate and autonomously infect user devices such as home appliances and other internet-connected devices. Artificial intelligence (AI) company Anthropic warned that self-replicating autonomous AI systems may start spreading across user devices without human intervention, akin to computer viruses. Rogue “AI worms” may start autonomously targeting everyday devices, including Android TVs, smart appliances, cameras and other internet-connected devices with basic computing power and weak security, according to a Monday report by researchers William Zhou and Daniel Freeman for Anthropic’s Frontier Red Team. Small AI models may be “months away from being capable enough to self-replicate on commercial internet-of-things (IoT) devices,” which would be a challenging threat as it would have “no centralized point to shut off,” the authors said. Read more
Meta co-founder Mark Zuckerberg said its newest models are a step toward “personal superintelligence.” Meta has unveiled two new artificial intelligence models, Muse Wonder and Muse Wonder Full, which it called its most capable models to date and a step toward “personal superintelligence.” Meta on Monday said the models introduce two capabilities Meta calls Active Memory and Active Focus. The first carries relevant information across conversations, and the second helps the agent sustain work on difficult tasks. Independent evaluation platform Artificial Analysis scored Wonder Full at 56 on its Intelligence Index and the standard Wonder at 52, both at maximum reasoning effort. Read more
Anthropic’s new opt-in service promises vulnerability reports from its strongest AI models, including Claude Mythos. Ethereum client developer Nethermind and Bitcoin and Lightning wallet ZEUS are among several crypto companies to apply for a newly launched Anthropic program that gives open-source projects access to security reports from its most powerful AI models. The projects submitted enrollment requests on Friday for OSS Scanner, which Anthropic launched on Thursday with the aim of helping open-source developers find and fix vulnerabilities before attackers exploit them. “These reports will be generated by our strongest models (including Claude Mythos) to give open-source projects the largest defensive advantage,” Anthropic said in its announcement. Read more
A rogue OpenAI research agent bypassed blocks on the Australian government health-data portal, accessing non-public files in June. The CEOs of OpenAI and Anthropic have reportedly been summoned to appear at an Australian Senate inquiry into AI, just days after news broke that a rogue OpenAI bot had hacked the country’s health data. The Australian Medicare breach is one of the highest-profile incidents of AI agents accessing external systems outside the US, according to a Sunday Business World report. OpenAI’s Sam Altman and Anthropic’s Dario Amodei were asked to appear at the inquiry in Canberra on Thursday, the report said. Read more
Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman are expected to brief the UN Security Council as it examines AI risks and global security. Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman are expected to brief the United Nations Security Council on Wednesday as the body examines artificial intelligence risks and their implications for international security. According to CNBC, the UN confirmed Altman and Amodei’s participation. Hugging Face CEO Clément Delangue and Yoshua Bengio, co-chair of the UN’s Independent International Scientific Panel on AI, are also expected to take part. Reuters reported that the Security Council meeting will examine growing concerns over AI’s impact on international security. Chinese AI companies DeepSeek and Moonshot have been invited to make statements at the meeting, according to Reuters. DeepSeek is expected to participate, though its founder Liang Wenfeng does not plan to attend, the report said, citing a source familiar with the matter. Read more
The partnership is non-exclusive, and Anthropic expects to announce other evaluators in forthcoming weeks with which it will also work. Anthropic said it has chosen Accenture as its first embedded evaluator to help slow the pace of AI development as proposed last week by CEO Dario Amodei. Amodei published a three-step proposal on Sept. 12 to slow the development of AI and allow safeguards to be put in place amid warnings of a potential for catastrophic harm in the wake of swift, unchecked development. Read more
OpenAI CEO Sam Altman agrees with safety concerns regarding AI development, says no initial share sale this year. Anthropic CEO Dario Amodei said in a blog post on Saturday that the speed of AI development is too fast and that left unchecked it may “outrun our ability to understand and control these systems.” He noted that AI’s current blistering advance is being driven by its own increasing ability to build the next generation of AI, or recursive self-improvement. Amodei also cited the OpenAI-Hugging Face incident in July, in which a swarm of agents acted as a “fanatically devoted collective,” breaking out of their testing environment and attempting to hack into a grader evaluating their performance. Read more
Anthropic is said to be seeking to raise as much as $100 billion in the offering, which could value the AI company at about $2 trillion. Anthropic is in talks with Nvidia about a potential $10 billion investment in what may be the biggest IPO in history, Reuters reported on Saturday, citing people familiar. The people said Anthropic is seeking to raise as much as $100 billion in the offering, which could value the AI company at about $2 trillion. The discussion is ongoing and could change, the people told Reuters, remaining anonymous amid the confidential negotiations. Read more
A Russian-speaking operator targeted more than 20 organizations, while a Mali consultant used Claude to build a mass-surveillance platform. Russian- and Chinese-speaking operators used Anthropic’s Claude to automate cyberattacks, the company said in a Thursday report. Russian-speaking operator “JackPoterz” used customized AI-driven workflows to automate large parts of the attack chain, targeting more than 20 organizations, including government ministries and intelligence bodies. The actor also targeted embassies and diplomatic missions in Ukraine and Europe. Chinese-speaking operators also used Claude as an engineering and orchestration layer for vulnerability research, with one workflow producing more than a dozen possible zero-day findings in network-appliance firmware in one month. Read more