Task-Sufficient Contraction: Source Selection for Machine Information Interfaces

arXiv:2610.08884 · cs.IT, cs.LG, math.IT · Submitted 2026-10-06 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Today's paper: "Task-Sufficient Contraction: Source Selection for Machine Information Interfaces".

Jane: The gist The paper studies when one such reduction preserves the complete downstream problem family, a property termed Task-Sufficient Contraction.

Tom: First, who's behind it and why it matters.

Paper summary: Tom: So we’ve covered how Task-Sufficient Contraction works—that it lets you fix a reduced source before you pick the later operating point, and in exact cases, it means solving on that reduced source gives the same result as using the full source.

Jane: The paper "Task-Sufficient Contraction: Source Selection for Machine Information Interfaces" by Joss Armstrong lays out this framework, showing how one can certify these reductions across a declared downstream optimization family. It’s about finding that specific link between the task and a smaller, yet still sufficient, source representation.

Lu: The implication is that we can build an external interface around this certified reduced source instead of trying to align the full internal representations of two different systems first. That’s a possibility for agent protocols where the remote system might be intentionally opaque to you.

Meng: For deployment, this means that representation alignment isn't always necessary for interoperability if you design a task-sufficient interface that guarantees every distinction capable of changing your decision is preserved. That’s more practical than trying to force two complex models into perfect synchronization.

Tom: Exactly. The paper suggests that the reduction can sometimes happen before the actual optimization begins, and an exact result means you can’t improve any of those operating points by going back to the richer source.

Jane: It separates three big questions: what information does X provide about Y, which distinctions change an action's cost for this consumer, and what is still needed if only the best full-information action matters. That's a lot to chew on for how we design these systems.

Conclusion: Tom: So we’ve been talking about this Task-Sufficient Contraction idea—how a specific task can pick a smaller source before you even decide how to encode or optimize later on. Now, let's look at the actual paper titled "Task-Sufficient Contraction: Source Selection for Machine Information Interfaces" and see what it really says.

Jane: Okay, so the authors are focusing on this idea that one specific task definition can guide you toward a source reduction that keeps the whole downstream problem family intact, which they call Task-Sufficient Contraction.

Lu: What’s interesting about this is how they build this certification framework for those reductions, proving it holds true even when you fix the reduced source before you pick the distortion target or the optimizer.

Meng: From a deployment standpoint, if we can certify that reduction, it means we don't necessarily have to align every single internal representation between two different machines before they can talk to each other. That’s a big deal for scaling things up.

Lalam: The paper identifies a consumer-specific source construction, which is this specific reduced source where every possible action has the same regret in both the original and the reduced version, even when you only have finite action sets.

Tom: So it’s not just any reduction; it’s tied to what that specific consumer actually cares about—what actions they can change their cost for. It sounds like a very practical way to prune information without losing the necessary decision-making power.

Jane: That's right, and they also gave a characterization for quadratic loss on affine feasible-action sets, showing exactly how to find that canonical reduced source by looking at the directions where actions can differ.

Lu: The authors use earlier work from Information Bottleneck and semantic rate-distortion to sort out the different types of reductions they see—exact, architecture-conditioned, approximate, failed, and corrected contractions.

Meng: What I’m hearing is that this isn't one single answer; it’s a framework for figuring out *which* reduction type you have when you try to do this before deployment. It helps us know if we’re looking at something that actually works or if we just picked a variable too coarse.

Tom: Exactly, and the paper suggests that for heterogeneous machines, this interface could be an external layer where the receiving task dictates what it needs without first forcing both systems to perfectly match their entire internal state space.

Jane: It’s about finding a certified source reduction that preserves everything important for the consumer's goals. This leads us into how these concepts actually apply when we look at real-world agent protocols and system design next. (Sound of gentle, upbeat radio music swelling slightly)

Joss Armstrong

cs.IT, cs.LG, math.IT

Submitted: 2026-10-06

Updated: 2026-10-06

Comments: 19 pages, 1 figure, 1 table. An earlier version was first posted on Zenodo in September 2026 (v1: doi:10.5281/zenodo.22834532; all versions: doi:10.5281/zenodo.22834531). Companion paper on task-relative information contracts: doi:10.5281/zenodo.22819849

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Importance score: 92/100

The gist: The gist The paper studies when one such reduction preserves the complete downstream problem family, a property termed Task-Sufficient Contraction.

Key concepts

Task-Sufficient Contraction
This concept checks if a declared task can choose a smaller source before the final optimization step without losing the ability to solve the entire downstream problem exactly. It ensures that using this reduced source yields the exact same results as using the original, richer source.
Consumer-Specific Source (GC)
For a fixed consumer, this is a reduced source created by merging states only when every available action has identical regret in both sources. This specific construction preserves the entire one-step rate-regret curve for finite action sets.
Exact Contraction
An exact contraction means that solving the problem on the reduced source produces the identical result as solving it on the full source. This is achieved when a proposed variable Q satisfies gX(a) = dQ(Q, a) for every available action 'a'.

Summary

The gist The paper studies when one such reduction preserves the complete downstream problem family, a property termed Task-Sufficient Contraction.

Task-Sufficient Contraction

This concept investigates whether a declared task can determine a reduced source before the later operating point is selected, such that solving the downstream problem after the reduction gives the same result as solving it on the richer source The central question is therefore: Can a declared task determine a reduced source before the downstream encoder, codebook, rate, distortion target, or optimizer is chosen, such that solving the downstream problem after the reduction gives the same result as solving it on the richer source?

Key Findings and Results

The paper makes three connected contributions First, it develops a common certification framework for task-determined source reductions that remain exact across a declared downstream optimization family, with the reduction fixed before the later operating point is chosen. Second, for a fixed consumer, it identifies the consumer-specific regret-complete source GC and proves that, for finite action sets, replacing the richer source by GC leaves the entire one-step rate-regret curve unchanged. Third, for quadratic loss on an affine feasible-action set, the paper characterizes the exact source directly from the directions in which feasible actions can differ

Types of Reductions and Regimes

The framework distinguishes between several types of reductions:

  1. Exact consumer-complete contraction: This occurs if a proposed variable Q is regret-complete, meaning gX(a) = dQ(Q, a) ∀a If Q is merely a relabelling or refinement of that quotient, solving on Q is exact but not minimal

  2. Architecture-conditioned contraction: This occurs when the architecture deliberately restricts the downstream action channel to factor through Q, leading to E[gX(A)] = E[dQ(Q, A)] This includes stochastic encoders and intermediate representations generated from Q

  3. Surrogate contraction: A proposed Q may support a simpler approximate loss de(Q, a) satisfying α de(Q, a) ≤ gX(a) ≤ β de(Q, a) in a stated regime Working on Q then comes with a bound, but it is not an exact reduction

  4. Candidate reduction failure: A proposed task variable may merge states that still assign different costs to some admissible action, meaning the variable is then too coarse for exact contraction

  5. Corrected contraction: Failure of the obvious task variable need not mean that the full source is irreducible, and a different reduced source may still preserve the downstream problem exactly

Consumer-Specific Source Construction

For a fixed consumer, it identifies the consumer-specific regret-complete source GC This is defined as GC:= [X]∼G where x ∼G x' ⇐⇒ gx(a) = gx'(a) for every a ∈ A It records what each possible mistake would cost, while BC records what the consumer should do with full information The chain SY 7→ GC: consumer-specific coarsening is one application of TSC, not a required sequence for every problem

Relationship to Prior Work

The framework grew out of several earlier reductions, including an Information Bottleneck result, semantic rate-distortion, and goal-oriented quantization results These earlier results are revisited as evidence for the framework rather than three new contributions The comparison distinguishes exact pre-optimization contraction from architecture-conditioned reduction, approximate reduction, candidate failure, and corrected contraction

Systems Implication

Task-Sufficient Contraction suggests another possibility where an external interface can be built around a certified reduced source rather than either party’s complete internal representation This distinction is particularly natural for agent protocols in which the remote system is intentionally opaque The systems implication is narrower: Representation alignment can be sufficient for interoperability, but it need not be necessary when the receiving task admits a shared task-sufficient interface

Scope and Boundaries

The reduction is only as good as the consumer specification, meaning if the declared actions or loss leave out a consequence that actually matters, the reduced source may discard information the real problem needs The present theory is static, meaning it does not compare source requirements across changing decision problems or define a dynamic update rule for the task-sufficient source The results here do not compare source requirements across such changes or define a dynamic update rule for the task-sufficient source

Conclusion

Task-Sufficient Contraction says that the reduction can sometimes be made before the later optimization begins An exact result means that returning to the richer source cannot improve any of the operating points covered by the theorem The consumer-specific regret construction gives another exact case, keeping every distinction that can change the relative cost of an available action and discarding distinctions that cannot The chain separates three questions: What information does X provide about Y? Which of those distinctions can change the cost of an action available to this consumer? Which distinctions are still needed if only the best full-information action matters

--- Page 19 ---

References A2A Protocol Working Group. Agent2agent (a2a) protocol specification. Version 1.0.0, 2026. https://a2a-protocol.org/v1.0.0/specification. Joss Armstrong, Task-relative information contracts: Sufficiency, evidence, and hierarchical preservation in multi-agent systems. Joss Armstrong, Task-oriented quantization for quadratic scheduling: Centroid water-filling and power-diagram encoders. Joss Armstrong, Source-side sufficiency for the information bottleneck: Exact reduction and finite-block equivalence. arXiv preprint arXiv:2604.26744v2, 2026c Joss Armstrong, Designed-source reductions and a dual-purpose feasibility band for semantic ratedistortion. arXiv preprint arXiv:2606.11280, 2026d Dilip Arumugam and Benjamin Van Roy, Deciding what to learn: A rate-distortion approach. In Proceedings of the 38th International Conference on Machine Learning, volume 139 of Proceedings of Machine Learning Research, pages 373–382. PMLR, 2021. R. R. Bahadur, Sufficiency and statistical decision functions. The Annals of Mathematical Statistics, 25(3):423–462, 1954. David Blackwell, Equivalent comparisons of experiments. The Annals of Mathematical Statistics, 24 (2):265–272, 1953. Lorand Bruhacs, Task-sufficient inference and explanation: Reasoning under projection, 2026. URL https://philarchive.org/rec/BRUTIA-9. Draft preprint, 19 March 2026. Shih-Chun Chou, Hui-Ling Chang, Zoltan Toth, Pay-Liam Lin, Jing-Shan Hong, Yuan-Kang Wu, Guan-Ru Chen, Kuo-Chen Lu, and Chia-Ping Cheng. Evaluation, calibration, and application of probabilistic 100-m wind speed forecasts produced by the wrf ensemble prediction system in taiwan. Journal of Applied Meteorology and Climatology, 64(1):3–19, 2025. doi: 10.1175/JAMC-D-23-0210.1. Norm Ferns, Prakash Panangaden, and Doina Precup, Metrics for finite markov decision processes. In Proceedings of the Conference on Uncertainty in Artificial Intelligence, pages 162–169, 2004. Matthew Hennessy and Robin Milner, Algebraic laws for nondeterminism and concurrency. Journal of the ACM, 32(1):137–161, 1985. doi: 10.1145/2455.2460. Jinu Hyeon, Woobin Park, Hongjoon Ahn, and Taesup Moon, Action-sufficient goal representations. In Proceedings of the 43rd International Conference on Machine Learning, volume 306 of Proceedings of Machine Learning Research, pages 49233–49262. PMLR, 2026. URL https://proceedings.mlr.press/v306/hyeon26a.html. Yingzhuo Liu, Beyond tokens: a unified framework for latent communication in llm-based multi-agent systems. arXiv preprint arXiv:2606.05711, 2026 Alon Orlitsky and James R. Roche, Coding for computing. IEEE Transactions on Information Theory, 47(3):903–917, 2001. Daniel Russo and Benjamin Van Roy, Satisficing in time-sensitive bandit learning.

Improvements for AI systems

  1. Identify task-specific source reductions before optimizing downstream parameters to preserve problem fidelity, as described by Task-Sufficient Contraction. This allows a machine to act on a reduced source before the later information problem is optimized, ensuring that the reduced source remains valid across the range of operating points covered by the result.

  2. Implement consumer-specific source selection by merging states only when every available action has the same regret in both, leading to the identification of a consumer-specific source GC which proves that for finite action sets, it leaves the entire one-step rate-regret curve unchanged.

  3. Characterize exact reductions for quadratic loss on affine feasible-action sets by using the projection onto the directions in which feasible actions can differ, yielding a canonical reduced source like centered load under fixed-energy scheduling.

  4. Employ a certification framework that ensures Every feasible full-source solution has a reduced counterpart that preserves the task-relevant quantity and is no worse in the optimized resource, guaranteeing exactness across the declared optimization family.

  5. Utilize a nested source hierarchy where SY keeps everything X tells the receiver about Y, which can be refined to "GC (preserving relative action costs) and finally to BC" (retaining only the optimal-action endpoint).

Sources

Related papers