← HomeLarge Language Models

Safety alarm in Anthropic: The risk of AI to destroy humanity exceeds 10 percent

· Source

Safety alarm in Anthropic: The risk of AI to destroy humanity exceeds 10 percent
Photo: Mohamed Nohassi / Unsplash

Severe worries in the field of artificial intelligence came to re-day. Anthropic’s top-level security researcher, rated the possibility of emergence of a strong AI system up to 10 percent**, which could threaten the presence of the organization. This statement was made after the announcement of a researcher who stacked due to the objections for the company’s security protocols.

The promising researcher Jacob Coxon said that in Anthropic, he served to educate AI systems, and in his statement on social media, they entered an error-free race to develop powerful systems that the company and the organizations in competition are controlled. Coxon’s criticism reveals the voltage between industrial speed and safety.

Imported resignation and explanations are highlighted:

  • Control loss risk: The researchers are concerned that advanced AI systems can not be successfully controlled from human audit -** Racing dynamics**: Large-tech companies work under the market pressure of new models without completing security testing procedures -Time frame: The specialist assessing the risk implies that this threat may occur within ten years as the period
  • Internal resistance: Even in a company focused on safety like Anthropic, there are researchers who think that safety protocols are not enough

These developments show that AI security is not only a technical problem, but also a problem that requires corporate infrastructure and sectoral culture change. Coxon’s stack and descriptions are evaluated as a call for the placement of tighter control mechanisms and ethical standards in the forward-looking AI development projects.