← 返回首页
非洲 · 综合新闻 · Mail & Guardian

Should humans control autonomous AI?

来源:Mail & Guardian · 南非 8 小时前
All-new AI.
All-new AI. · Mail & Guardian

详细摘要

As frontier AI models move towards recursive self-improvement, urgent concerns mount over whether human oversight and global regulations can keep pace with…

Leading AI companies are calling for global safety standards as frontier models edge towards recursive self-improvement. The urgent question is how far that process could go — and whether governments can act before autonomous systems escape meaningful human control. The issue is not job losses or familiar abuses such as deepfakes, blackmail or the manufacture of prohibited biological and chemical weapons. It is control itself.

The AI most people know responds to prompts within systems that leave people accountable for its use. It responds to us. More capable systems may one day help overcome diseases that remain incurable. But how should we regard systems that could also threaten human survival while acting on their own?

Autonomous AI would break with the history of human-made tools. Artificial intelligence became a formal field at the Dartmouth workshop in 1956, yet even the most sophisticated machines have relied on people to set their goals and answer for their actions. Granting greater agency to technologies whose inner workings we only partly understand would change that relationship.

Frontier models are gaining capabilities — coding, tool use and autonomous operation — that could enable recursive self-improvement. Trained on vast datasets, they can converse, operate software and support decisions at extraordinary scale. They need neither consciousness nor human-like intent to break goals into tasks, choose actions, use external resources and adapt through feedback. Give them memory, software environments and access to other agents, and the boundary between a tool and an autonomous system begins to blur.

Recursive self-improvement, or RSI, would go further. An AI system would strengthen its own capabilities, with each version producing a more capable successor — AI learning from AI. Unlike human-led retraining, RSI could outpace evaluators, regulators and institutions.

RSI could change not only what machines can do, but who remains in charge.

Sceptics rightly note…

文章开头,摘自Mail & Guardian。如需阅读全文,请前往媒体网站。

在 Mail & Guardian 阅读全文 登录后可收藏

MarketNews 仅展示媒体发布的标题和摘要,全文请在出版方网站阅读。 (mg.co.za)

推荐阅读