Efficient Real-World Dehazing via Physics-Inspired Global-Local Decoupling

summary

Video file (mp4)

The gist

The gist The proposed PGL-Net is a lightweight framework that incorporates physical inductive biases via operator-level emulation to achieve state-of-the-art real-world image dehazing with

In short

PGL-Net is a lightweight framework for real-world image dehazing that achieves state-of-the-art results with significantly reduced computational cost. It decouples dehazing into global distribution rectification using Physics-Inspired Affine Fusion (PAF) and local structural refinement via Degradation-Aware Modulation (DAM). This approach embeds physical priors to improve quality while drastically cutting inference time, making it suitable for real-time edge deployment.

Key concepts

Physics-Inspired Affine Fusion (PAF)
This module interprets image dehazing as an affine rectification process. It calculates global scale ($\gamma$) and shift ($\beta$) factors by extracting descriptors from the network features. This physically grounded transformation compensates for haze attenuation and airlight bias, aligning the global distribution of the image effectively.
Degradation-Aware Modulation (DAM)
This block handles local structural refinement using residual feature recalibration. It decomposes features into a value branch for structural cues and a modulation map prediction pathway. This allows the network to adaptively modulate local features, effectively correcting spatially variant degradation after the global step.
Joint Fidelity and Spectral Consistency Training
The model uses a composite loss function that combines pixel-wise reconstruction error with constraints on spectral consistency. By penalizing both real and imaginary components of the change in features ($\Delta F$), it ensures high spatial fidelity while preventing phase wrapping ambiguities, leading to more realistic color restoration.
Edge Deployment Efficiency
PGL-Net is designed for practical deployment by achieving over a 10x reduction in inference latency compared to existing models. Its lightweight architecture allows it to run at real-time performance on resource-constrained devices, such as running at only 14.17 ms, making high-quality dehazing feasible on edge platforms.

Terminology used across episodes

This episode discusses

The paper

Efficient Real-World Dehazing via Physics-Inspired Global-Local Decoupling · Read on arXiv

Yifei Qu, Ru Li, Junjie Chen, Jinyuan Wu

Harbin Institute of Technology

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Hi, I'm Tom.

Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.

Tom: We're looking at the paper: "Efficient Real-World Dehazing via Physics-Inspired Global-Local Decoupling".

Jane: Here's the gist of the paper. The gist The proposed PGL-Net is a lightweight framework that incorporates physical inductive biases via operator-level emulation to achieve state-of-the-art real-world image dehazing with significantly reduced computational cost.

Tom: How it works PGL-Net decouples the dehazing process into two main components: global distribution rectification and local structural refinement, which is achieved through a U-shaped architecture.

Jane: The framework embeds physical inductive biases by preserving the inverse Atmospheric Scattering Model operator form, implementing it as feature-space affine rectification rather than explicit parameter estimation.

Tom: The global distribution rectification is handled by the Physics-Inspired Affine Fusion (PAF) module.

Title and authors: Tom: So we're looking at the paper titled "Efficient Real-World Dehazing via Physics-Inspired Global-Local Decoupling." I mean, it sounds a bit technical, but the big idea is that they've created this lightweight framework for dehazing that uses physical rules to guide the learning process.

Jane: It does sound heavy on the physics part, Tom. For someone just driving or walking, what does that actually mean? Is this going to be some massive model we need a supercomputer for, or something practical?

Lu: What they're aiming for is exactly the opposite of that. They are proposing PGL-Net as a lightweight framework that incorporates physical inductive biases through operator-level emulation. This means instead of having to explicitly estimate parameters like the transmission or atmospheric light, they are preserving the form of the inverse Atmospheric Scattering Model and implementing it as feature-space affine rectification >

Meng: Operator-level emulation sounds promising if we can keep the complexity low. I mean, existing approaches either use fragile physical inversions under simple assumptions or they adopt heavy blind architectures that just don't work for edge deployment >

Lalam: The core concept here is decoupling the dehazing process into global distribution rectification and local structural refinement. They do this using a U-shaped architecture where a Physics-Inspired Affine Fusion module handles the global part, and a Degradation-Aware Modulation block handles the local part >

The paper's summary: Tom: Exactly. So, they are breaking it down into two main components. First, there’s the global distribution rectification handled by something called the Physics-Inspired Affine Fusion module. This module interprets dehazing as an affine rectification where a scale factor gamma compensates for attenuation and a shift factor beta accounts for airlight-induced bias >

Jane: That sounds like they are using those physical concepts to fix the big, overall haze problem first, before we worry about the fine details. How do they figure out those scale and shift factors? Is it just guessing, or is there some learning involved?

Lu: It involves extracting global descriptors from both the decoder and encoder features projecting them into a joint representation z, and then splitting that representation to yield the channel-wise affine parameters gamma and beta >

Meng: So they are using the network's own features to figure out how much to stretch or shift the image globally. That sounds like it could be efficient if those feature extractions aren't too costly >

Lalam: And then for the local part, they use a Degradation-Aware Modulation block. This block performs residual feature recalibration using stable normalization and lightweight modulation to handle things that are spatially and spectrally variant after the global step >

The paper's improvements: Tom: Looking at how they improved this, the training objective is pretty interesting too. They use a composite loss function. One term just enforces pixel-wise reconstruction of the clean image, and the second term constrains spectral consistency by penalizing both the real and imaginary components of delta F >

Jane: Penalizing both real and imaginary components sounds smart for keeping things stable in terms of color and tone. It stops the model from messing up the spectral information when it tries to reconstruct the scene >

Lu: The improvements really focus on making this decoupled approach work well. They show that combining both modules yields the best performance with minimal overhead, which is key since they are trying to avoid explicit parameter estimation >

Meng: If it keeps the overhead low, that's what I care about for deployment. I need to know if these physical biases actually help them learn better than just a standard blind model on real data >

Lalam: The experimental results show that this works well. For instance, the Tiny variant, PGL-Net-T, improves PSNR by up to two point six dB and consistently enhances downstream object detection accuracy >

Conclusion: Tom: So, wrapping it up on "Efficient Real-World Dehazing via Physics-Inspired Global-Local Decoupling," the main point is that they achieve state-of-the-art restoration quality while significantly reducing computational cost. They manage to integrate physical priors implicitly >

Jane: It seems like this paper provides a practical trade-off for real world dehazing. It successfully integrates those physical priors without needing heavy, explicit parameter estimation, which is what makes it suitable for edge deployment >

Lu: The mechanism analysis of the PAF module shows that the learned affine factors actually exhibit meaningful degradation-aware patterns. Specifically, the bias term beta is predominantly negative across stages and becomes progressively more negative with depth >

Meng: From a deployment standpoint, this is good because latency evaluations show PGL-Net-T runs at only fourteen point one seven milliseconds on representative computing devices. That's a substantial reduction compared to recent models like SGDN, showing over a ten times reduction in inference latency >

Lalam: And they also found that the framework is robust to spatially varying haze distributions and preserves structures in high-resolution images, which is great for real-world scenes >

More episodes

← Home