The Last Remote Sensing Model Built by Humans? Casting Any Earth Observation Task as Recursive Self-Improvement
cs.CV, cs.CL
Submitted: 2026-10-13
Updated: 2026-10-15
Comments: Ongoing project
Code: https://github.com/karpathy/autoresearch
License: http://creativecommons.org/licenses/by/4.0/
The gist: Earth observation (EO) models are still built by hand.
Abstract
Earth observation (EO) models are still built by hand. For each new task, experts design a training recipe and tune it against a benchmark. We show that this loop can be handed to an agent. Any verifiable task can be cast as a harness and a verifier, where the harness defines what the agent may use and the verifier defines what counts as success. Every EO task can be made verifiable, through labeled benchmarks, independent sensors, physical models or the repeated observation of the same place. Given only these two components, a general-purpose coding agent builds the EO model and improves it recursively on its own outputs. Settings long treated as separate research problems, from learning with a handful of labels to adapting across domains, become choices of harness and verifier. On six EO benchmarks spanning optical, SAR and multispectral time-series imagery, with outputs that range from land-cover maps and ship instances to canopy heights and answers about large images, agent-built models surpass the state of the art on every one, and on land-cover mapping, they do so from 11% of the training labels. This establishes a new paradigm for EO, in which people design harnesses and verifiers and agents build the models, so EO models improve as agents do.
Sources
- Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observation
- Training Verifiers to Solve Math Word Problems
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- AIDE: AI-Driven Exploration in the Space of Code
- Earth-Agent: Unlocking the Full Landscape of Earth Observation with Agents
- Insights from Autoresearch for Solar Panel Segmentation
- Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation
- Goedel Machines: Self-Referential Universal Problem Solvers Making Provably Optimal Self-Improvements
- Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents
- Tulu 3: Pushing Frontiers in Open Language Model Post-Training
- A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence
- Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops
- The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- Camyla: Scaling Autonomous Research in Medical Image Segmentation
- Towards Autonomous and Auditable Medical Imaging Model Development
- Foundation Models for Generalist Geospatial Artificial Intelligence
- The Earth in One Gaze: Training-Free Active Focus for UHR Remote Sensing Understanding
- Qwen3-VL Technical Report
- Distilling the Knowledge in a Neural Network
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models