Anthropic urges a way to pause AI development as risks grow with the tech advances

Source Domain: www.audacy.com

Anthropic, the company behind the Claude chatbot, is advocating for a global pause or slowdown in the development of advanced AI systems due to the rapid pace of technological advancement.
The company warns that AI technology is progressing so quickly that humans might lose control, especially with the potential for recursive self-improvement in AI models.
Anthropic proposes a coordinated effort among top AI companies to implement temporary pauses or slowdowns in AI development to allow time for societal structures and alignment research to catch up.
The internal research institute of Anthropic plans to explore this issue in collaboration with other entities to develop systems for managing credible slowdowns or pauses.
The coordinated pause is intended to ensure that global rivals do not secretly advance their technology during a slowdown.
Anthropic emphasizes the need for a global mechanism to prevent less cautious competitors from gaining an advantage, which could complicate safety decisions around AI.
Anthropic’s call for a pause comes amid competition for market valuation and comes as a larger group of AI researchers, including from the University of Toronto, have raised similar security concerns.

You may have missed