Feedback as an Interface: Controlling Form and Detail in LLM Translation Refinement

arXiv:2610.15661 · cs.CL · Submitted 2026-10-11 · Read on arXiv

cs.CL

Submitted: 2026-10-11

Updated: 2026-10-11

Project page: https://www.bundestag.de/en/service/legal_notice

License: http://creativecommons.org/licenses/by/4.0/

The gist: Feedback presentation shapes how LLMs use evaluator judgments during translation refinement.

Abstract

Feedback presentation shapes how LLMs use evaluator judgments during translation refinement. We introduce a machine translation protocol that keeps the evaluator score, main issue, and recommendation fixed while varying feedback form and supporting detail. Across seven models and six translation directions, low-load feedback outperforms high-load feedback in all 42 translator-direction settings under xCOMET. On the 29,400-record rewriting subset, mean xCOMET scores multiplied by 100 are 83.30 for low-load feedback and 80.67 for high-load feedback; the full-matrix original-translation reference mean is 83.46. MetricX-24 supports the low-load advantage on a stratified subset. A no-feedback second pass yields a small improvement over the original translations, and direct evaluator prompting reproduces the low-load advantage without a separate rewriting stage. These results show that compact feedback limits the quality loss from evaluator-guided refinement in the evaluated high-resource MT settings.

Sources

Related papers