Borrowed Eyes: Markerless Nano-UAV Flight with an Active Quadruped Observer
cs.RO
Submitted: 2026-10-07
Updated: 2026-10-07
Comments: 8 pages, 7 figures, 2 tables. Submitted to ICRA 2027
Code: https://github.com/IMRCLab/crazyswar
License: http://creativecommons.org/licenses/by/4.0/
The gist: Nano unmanned aerial vehicles (nano-UAVs) can navigate confined spaces that larger robots cannot, but their payload capacity severely limits the sensors and compute available for self-localization in
Terminology
Abstract
Nano unmanned aerial vehicles (nano-UAVs) can navigate confined spaces that larger robots cannot, but their payload capacity severely limits the sensors and compute available for self-localization in global navigation satellite system (GNSS)-denied environments. We present a vision-based system that localizes a nano-UAV from a quadruped robot with an arm-mounted camera. The quadruped tracks the drone, estimates its position in its own coordinate system using segmentation masks and depth, and transmits that position over a real-time radio link. To ensure continuous tracking, we developed a perception-aware nonlinear Model Predictive Controller (NMPC) that dynamically adjusts the quadruped's body and arm to maximize the drone's visibility, treating observation reliability as a primary control objective. Relying solely on this external estimate, the nano-UAV executed predefined trajectories from takeoff to landing with a median 3D localization error of 59 mm. The system demonstrates robustness against short visual occlusions by smoothly transitioning to onboard inertial flight when line-of-sight is temporarily lost. Ultimately, this framework allows a quadruped to offload the localization burden of a nano-UAV, enabling inspection of complex spaces that neither robot could navigate alone.
Sources
- NanoSLAM: Enabling Fully Onboard SLAM for Tiny Robots
- Towards Quadruped-Provided Localization and Active Tracking for Micro-UAVs
- Fly, Track, Land: Infrastructure-less Magnetic Localization for Heterogeneous UAV-UGV Teaming
- Markerless Robot Detection and 6D Pose Estimation for Multi-Agent SLAM
- FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects
- Any6D: Model-free 6D Pose Estimation of Novel Objects
- SAM 2: Segment Anything in Images and Videos
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies