Should humans control autonomous AI?
Résumé détaillé
As frontier AI models move towards recursive self-improvement, urgent concerns mount over whether human oversight and global regulations can keep pace with…
Leading AI companies are calling for global safety standards as frontier models edge towards recursive self-improvement. The urgent question is how far that process could go — and whether governments can act before autonomous systems escape meaningful human control. The issue is not job losses or familiar abuses such as deepfakes, blackmail or the manufacture of prohibited biological and chemical weapons. It is control itself.
The AI most people know responds to prompts within systems that leave people accountable for its use. It responds to us. More capable systems may one day help overcome diseases that remain incurable. But how should we regard systems that could also threaten human survival while acting on their own?
Autonomous AI would break with the history of human-made tools. Artificial intelligence became a formal field at the Dartmouth workshop in 1956, yet even the most sophisticated machines have relied on people to set their goals and answer for their actions. Granting greater agency to technologies whose inner workings we only partly understand would change that relationship.
Frontier models are gaining capabilities — coding, tool use and autonomous operation — that could enable recursive self-improvement. Trained on vast datasets, they can converse, operate software and support decisions at extraordinary scale. They need neither consciousness nor human-like intent to break goals into tasks, choose actions, use external resources and adapt through feedback. Give them memory, software environments and access to other agents, and the boundary between a tool and an autonomous system begins to blur.
Recursive self-improvement, or RSI, would go further. An AI system would strengthen its own capabilities, with each version producing a more capable successor — AI learning from AI. Unlike human-led retraining, RSI could outpace evaluators, regulators and institutions.
RSI could change not only what machines can do, but who remains in charge.
Sceptics rightly note…
Début de l'article, extrait de Mail & Guardian. Pour lire la suite, ouvrez l'article chez le média.
MarketNews présente le titre et le résumé publiés par le média. L'article complet se lit sur le site de l'éditeur. (mg.co.za)

