OmniRaindrop: A Comprehensive Benchmark for Dual-Focused Raindrop Removal under Day and Night Scenes
cs.CV
Submitted: 2025-10-20
Updated: 2026-10-11
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Adherent raindrops on camera lenses are a pervasive source of real-world image degradation, undermining outdoor visual perception for downstream applications such as robotics and 3D scene
Terminology
Abstract
Adherent raindrops on camera lenses are a pervasive source of real-world image degradation, undermining outdoor visual perception for downstream applications such as robotics and 3D scene reconstruction. However, most existing raindrop datasets and methods target only background-focused 2D images, overlooking the equally common raindrop-focused case and the impact of raindrops on 3D scene reconstruction. Moreover, they are almost exclusively daytime, lacking the complex artificial lighting and reflections of nighttime raindrop scenes. To address these issues, we introduce OmniRaindrop, a real-world dataset and benchmark that jointly evaluates 2D raindrop removal and 3D scene reconstruction across raindrop-focused and background-focused captures, under both daytime and nighttime conditions. OmniRaindrop provides spatially aligned raindrop-focused, background-focused, and rain-free ground-truth image sets: a 2D subset of 15,186 aligned pairs/triplets and a 3D subset of 40 real-world scenes evenly split between day and night, totaling 3,822 multi-view images. On top of this data, the benchmark traces how raindrop degradation propagates from 2D restoration to 3D reconstruction by testing representative restoration methods and their effects on pose estimation, point cloud initialization, and 3DGS optimization. Comprehensive experiments reveal that raindrop-focused scenes are substantially harder than background-focused ones, and that errors in 2D restoration and pose/point cloud initialization cascade into degraded 3D reconstruction, pointing to clear directions for more robust 2D restoration and 3DGS design. Building on the dataset, we have organized two consecutive NTIRE challenges (2025 and 2026) on Day and Night Raindrop Removal for Dual-Focused Images.
Sources
- 3R-GS: Best Practice in Optimizing Camera Poses Along with 3DGS
- EDGS: Eliminating Densification for Efficient Convergence of 3DGS
- WildGaussians: 3D Gaussian Splatting in the Wild
- DINOv2: Learning Robust Visual Features without Supervision
- WeatherGS: 3D Scene Reconstruction in Adverse Weather Conditions via Gaussian Splatting
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models