MOTIP2: Spatial Priors for End-to-End Multi-Object Tracking
cs.CV
Submitted: 2026-10-07
Updated: 2026-10-07
Comments: Accepted at BMVC 2026. 27 pages (14 pages main paper, appendix and references), 6 figures, 10 tables
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: End-to-end multi-object trackers have narrowed the gap with classical tracking-by-detection on association-difficult benchmarks.
Terminology
Abstract
End-to-end multi-object trackers have narrowed the gap with classical tracking-by-detection on association-difficult benchmarks. Yet they still make spatially implausible errors no classical tracker would, such as assigning one identity to objects on opposite sides of the frame. A model could learn to avoid them, but tracking annotations are scarce, so we encode spatial priors explicitly instead, while keeping inference fully end-to-end with no post-hoc association. We propose three spatial priors, at the data, loss, and representation stages. Spatial ID Switches bias trajectory permutations toward spatially overlapping objects, reducing the mismatch between training and inference confusions. Spatial ID Loss scales each identity's penalty by its box distance, so a distant switch costs more than a nearby one. Spatial Anchor gives each track token its frame position, an explicit spatial cue for attention. We instantiate the three priors in MOTIP2, a tracker adapted from MOTIP and built on the real-time DEIM detection transformer. Trained without extra data, its main model, MOTIP2-L, sets a new state of the art: 73.4 HOTA on DanceTrack, 76.0 on SportsMOT, and 71.1 IDF1 on PersonPath22. MOTIP2 is a family of models spanning the speed-accuracy trade-off: a lighter model, MOTIP2-S, matches the original MOTIP at over 3x the speed, and MOTIP2-X reaches 74.8 HOTA on DanceTrack.
Sources
- BoT-SORT: Robust Associations Multi-Pedestrian Tracking
- Extending Context Window of Large Language Models via Positional Interpolation
- YOLOX: Exceeding YOLO Series in 2021
- FastTracker: Real-Time and Accurate Visual Tracking
- MOT16: A Benchmark for Multi-Object Tracking
- CrowdHuman: A Benchmark for Detecting Human in a Crowd
- From Detection to Association: Learning Discriminative Object Embeddings for Multi-Object Tracking
- TransTrack: Multiple Object Tracking with Transformer
- MOTRv3: Release-Fetch Supervision for End-to-End Multi-Object Tracking
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models