Autonomous Driving Research Requires a Community-Driven Data Paradigm
cs.CV, cs.AI
Submitted: 2026-09-25
Updated: 2026-09-25
Comments: NeurIPS 2026 Position Paper
Code: https://github.com/open-mmlab/mmdetection3d
License: http://creativecommons.org/licenses/by/4.0/
The gist: Autonomous driving has made remarkable progress, with recent AI advances enabling commercial deployments that are reshaping urban mobility.
Abstract
Autonomous driving has made remarkable progress, with recent AI advances enabling commercial deployments that are reshaping urban mobility. Yet the field remains far from its universal social promise: autonomous systems that can operate robustly anywhere, anytime, for anyone. We posit that this gap is not merely a modeling problem, but a problem of the prevailing data paradigm. Current research relies heavily on a few benchmark datasets with limited spatial and scenario coverage, even though the community has collectively produced over 600 autonomous driving datasets across nearly 50 countries. However, this abundance has not translated into broad research impact: most datasets remain significantly underused due to fragmentation, limited visibility, incompatible protocols, and benchmark incentives that concentrate attention on a few dominant datasets. We therefore argue that autonomous driving research requires a collaborative, community-driven data paradigm. Such a paradigm would improve the discovery, reuse, integration, and evaluation of diverse datasets; make underexplored data easier and more rewarding to study; and lower the barrier for new contributors. We outline its key principles, illustrate an early realization, and call for collaboration across academia and industry to transform fragmented datasets into shared community infrastructure for anytime-anywhere autonomy.
Sources
- NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles
- Pseudo-Simulation for Autonomous Driving
- SAM 3: Segment Anything with Concepts
- First M87 Event Horizon Telescope Results. I. The Shadow of the Supermassive Black Hole
- 123D: Unifying Multi-Modal Autonomous Driving Data at Scale
- A2D2: Audi Autonomous Driving Dataset
- Lessons and Open Questions from a Unified Study of Camera-Trap Species Recognition Over Time
- Vehicle Detection from 3D Lidar Using Fully Convolutional Network
- Open-sourced Data Ecosystem in Autonomous Driving: the Present and Future
- BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation
- Bangladeshi Native Vehicle Detection in Wild
- Qwen3 Technical Report
- NuScenes-SpatialQA: A Spatial Understanding and Reasoning Benchmark for Vision-Language Models in Autonomous Driving
- LongTail Driving Scenarios with Reasoning Traces: The KITScenes LongTail Dataset
- Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail
- Learning to Drive in New Cities Without Human Demonstrations
- WOD-E2E: Waymo Open Dataset for End-to-End Driving in Challenging Long-tail Scenarios
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models