New arXiv paper maps path to recursive self-improving AI, introduces metric exposing LLM limits

Researchers have posted a preprint on arXiv that charts a progression from today's systems to artificial intelligence capable of improving itself without human intervention, and introduces a metric designed to quantify how far current large language models fall short. The paper has not been peer reviewed.

The authors define recursive self-improvement (RSI) as a system's ability to convert experience and feedback into permanent changes that enhance both its capabilities and the improvement process itself. They argue that existing LLMs stall well below their theoretical ceiling because they lack any mechanism for sustained modification of weights or architecture based on cumulative feedback.

To track genuine progress toward that ceiling, the paper proposes the Headroom-Closed Index (HCI), which measures the fraction of the gap between current performance and theoretical potential that a system has closed. The metric is intended as a compass for real advancement rather than isolated benchmark gains.

The roadmap splits the journey into five autonomy levels: autonomy in executing improvements, autonomy in selecting improvement strategies, autonomy in acquiring experience, autonomy in adapting to the environment, and finally recursive meta-improvement — where the system improves the improvement mechanism itself. Each level demands capabilities absent from both closed and open-weight models today, including stable long-term memory, reliable self-evaluation, and the ability to write and validate code that alters the architecture.

The paper examines three application domains — scientific discovery, embodied intelligence, and software engineering — and shows that each demands a different mix of autonomies. Software engineering already possesses fast feedback loops (run, test, fix), bringing the early levels within closer reach. Scientific discovery involves longer, costlier loops. Embodied intelligence adds a physical dimension that slows experience gathering. The authors note that preliminary empirical evidence exists but remains partial and comes from closed industry systems.

Key obstacles identified include reliable self-evaluation without a human labeler, preventing catastrophic forgetting during weight updates, securing the improvement process against malicious or accidental changes, and the computational expense of continuous retraining. The researchers emphasize that true RSI requires solving all of these simultaneously, not in isolation, and that current research remains far from that point.