Fusion Complexity Is Not Fusion Quality: Backbone, Cross View Fusion and Metadata as Separate Factors in Pasture Biomass Regression
cs.CV, cs.LG
Submitted: 2026-03-08
Updated: 2026-10-12
Comments: Accepted to CVPR: Vision for Agriculture Workshop 2026 (Withdrawn)
Code: https://github.com/WhiteMetagross/FusionComplexityInversionBiomass
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: Estimating pasture biomass from field images can support grazing decisions without repeated destructive sampling.
Terminology
Abstract
Estimating pasture biomass from field images can support grazing decisions without repeated destructive sampling. The task remains difficult because available datasets are small, biomass components are imbalanced and a single photograph contains two spatially distinct views of the sampled quadrat. This work evaluates vision foundation models for five target pasture biomass regression on the 357 image CSIRO dataset. Across 25 model configurations, the analysis covers convolutional and self supervised transformer backbones, seven cross view fusion configurations, models with and without 23 metadata features, classical regressors and frozen foundation features. All comparisons use one locked five fold split and raw scale weighted R squared. DINOv3 Large with cross view gated attention gives the strongest verified single model result, 0.8338 +/- 0.0503 across folds. Under a matched gated depthwise convolution head, replacing DINOv2 Large with DINOv3 Large improves R squared by 0.0372. Fusion results are not ordered by module complexity. Cross view gated attention is best, while a full Mamba fusion block reaches only 0.7930. Across four matched DINOv3 pathways, metadata narrows the score range from 0.0157 to 0.0013 while changing the mean by only +0.0034. It improves three weaker pathways but lowers the strongest attention model by 0.0061. Classical metadata models are strong, frozen DINOv3 features are linearly useful and Dry Dead biomass remains the hardest target. These results show that backbone choice, cross view interaction and metadata must be tested as separate factors on small agricultural datasets.
Sources
- Mamba: Linear-Time Sequence Modeling with Selective State Spaces
- Estimating Pasture Biomass from Top-View Images: A Dataset for Precision Agriculture
- VMamba: Visual State Space Model
- DINOv3
- Visual Mamba: A Survey and New Outlooks
- MambaVision: A Hybrid Mamba-Transformer Vision Backbone
- Gaussian Error Linear Units (GELUs)
- MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models