ComputerWorld AI·
AI could soon lead to systems capable of improving their own performance faster than humans can effectively supervise them, reviving concerns about the industry’s longstanding “alignment problem,” ensuring AI systems reliably pursue human goals, senior Anthropic researchers have warned in a new blog post titled “When AI builds itself.” Anthropic Institute lead Marina Favaro and Anthropic co-founder Jack Clark outlined three possible futures: growth in AI capabilities may flatten out; AI efficiency gains may continue to grow, but expose bottlenecks elsewhere in software development; or AI systems may become capable of full recursive self-improvement, and build their successors by themselves. It’s that third scenario that’s prompting them to suggest society be ready to hit the brakes on AI development. “How the alignment problem gets solved — or not — in this future is something we are least certain about,” they wrote. Advanced, self-improving models could follow our needs and wants — or
Read full articleS&P blocks fast index entry for SpaceX, OpenAI, and Anthropic, delaying potential billions in passive fund demand. The post S&P keeps SpaceX, OpenAI, and Anthropic out of fast index entry appeared first on Crypto Briefing.
Projection, much? Microsoft’s head of AI has accused a rival’s AI service of being too pricey, just as the introduction of usage-based pricing for GitHub Copilot begins to hit developers using its own services. “Anthropic is extremely expensive and I think many people are urgently looking for alternatives,” Mustafa Suleyman, CEO of Microsoft AI, told Bloomberg News. The spotlight is on the cost of AI services at the moment, with so many different parts of the business using the technology while at the same time many businesses are finding it hard to report any meaningful ROI. This week, Microsoft at its annual Build conference looked to fight back against this when it announced seven new AI models, emphasizing the lower cost. The company hopes that cheaper AI models will mean more enterprises find that AI projects are viable. In 2025, Gartner reported that many such endeavors would be cancelled by 2027: cheaper implementations could be the way forward. Microsoft clearly sees its own AI
Anthropic calls for a coordinated pause in frontier AI development as it warns recursive self improvement could outpace oversight. The post Anthropic urges top AI labs to slow development over self-improvement risks appeared first on Crypto Briefing.
Announcement that ‘policymakers’ need to be convened by US firm viewed as marketing ploy by some experts Anthropic has floated the idea of a worldwide “temporary pause” on AI development – and said it was going to convene “policymakers” to discuss the dangers of advanced AI – in its latest release touting the capabilities of its products. In a long post on Thursday, Anthropic detailed the progress of its AI model, Claude, towards “recursive self improvement” – that is, being able to make better and more powerful versions of itself. Recursive self-improvement is a bugbear of AI safety researchers, viewed as the key step for AI to become superintelligent and therefore unleash widespread consequences on humanity. Continue reading...
The next chapter of AI could depend less on breakthrough models and more on the resources required to build and sustain them.
Anthropic's potential IPO highlights the escalating financial demands of AI development, signaling a shift towards public funding for tech innovation. The post Anthropic co-founder says soaring AI costs are pushing the company toward an IPO appeared first on Crypto Briefing.
The artificial intelligence giant said a “brake pedal” was needed to protect humanity from self-improving models. The proposal could have big consequences.
“Why wouldn’t you want to be in both Pepsi and Coke?” says one venture capitalist. “It’s the same here.”
