NavAble: A Large-Scale Dataset and Synthetic Data Generation Pipeline for Blind Navigation
cs.CV, cs.RO
Submitted: 2026-10-14
Updated: 2026-10-14
Code: https://github.com/HumanSignal/label-stu
License: http://creativecommons.org/licenses/by/4.0/
The gist: Reliable recognition of accessibility-critical objects (e.g., audible pedestrian signals, door-activation buttons, and handrails) is essential for assistive navigation technologies that support safe,
Terminology
Abstract
Reliable recognition of accessibility-critical objects (e.g., audible pedestrian signals, door-activation buttons, and handrails) is essential for assistive navigation technologies that support safe, independent mobility for blind and low-vision (BLV) users. Yet these categories are underrepresented in existing large-scale vision datasets, and the few datasets that include them suffer from limited class coverage, inconsistent annotations, and poor diversity. We introduce NavAble, a large-scale dataset spanning 11 accessibility-critical object classes, combining 41K curated open-source images with 8K newly collected, densely annotated real-world images. To extend scale and diversity, we develop a synthetic data generation pipeline that renders high-fidelity 3D assets across 37 environments under diverse styles and viewpoints, yielding 452K frames with rich ground-truth annotations from 565 assets. The pipeline minimizes manual effort by combining automated web image crawling, VLM-based filtering, SAM 3D-based asset generation, and convenient camera trajectory configuration, enabling large-scale data generation at a diversity unattainable through manual collection. Experiments show that fine-tuning existing segmentation models on the NavAble Dataset achieves reliable accessibility-object segmentation (>80% mIoU on our held-out test set). We also demonstrate the effectiveness of synthetic data augmentation, which yields up to +3.5 mIoU over real-world-only fine-tuning. Beyond benchmark evaluation, validation on egocentric data from two mobility-assistive robots demonstrates improved perception reliability in real-world navigation scenarios. Together, NavAble establishes a scalable foundation for BLV navigation perception, directly addressing the data scarcity and embodiment gaps. The dataset and pipeline are publicly available at https://huggingface.co/datasets/NavAble/NeurIPS 2026 BLV.
Sources
- Human-Centered Development of Guide Dog Robots: Quiet and Stable Locomotion Control
- Microsoft COCO: Common Objects in Context
- YOLOv11: An Overview of the Key Architectural Enhancements
- Masked-attention Mask Transformer for Universal Image Segmentation
- SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers
- GuideTWSI: A Diverse Tactile Walking Surface Indicator Dataset from Synthetic and Real-World Images for Blind and Low-Vision Navigation
- SANPO: A Scene Understanding, Accessibility and Human Navigation Dataset
- Space-Aware Instruction Tuning: Dataset and Benchmark for Guide Dog Robots Assisting the Visually Impaired
- A Dataset for Crucial Object Recognition in Blind and Low-Vision Individuals' Navigation
- Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
- Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection
- SAM 2: Segment Anything in Images and Videos
- SAM 3D: 3Dfy Anything in Images
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models