Simulating Student-Tutor Interactions with LLMs for Multilingual Math Feedback
cs.CL, cs.AI
Submitted: 2025-06-05
Updated: 2026-10-10
Comments: MathNLP EMNLP 2026
Code: https://github.com/nidhaloff/deep-translator
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large language models (LLMs) have demonstrated the ability to generate formative feedback and instructional hints in English, making them increasingly relevant for AI-assisted education.
Terminology
Abstract
Large language models (LLMs) have demonstrated the ability to generate formative feedback and instructional hints in English, making them increasingly relevant for AI-assisted education. However, their ability to provide effective instructional support across different languages, especially for mathematically grounded reasoning tasks, remains largely unexamined. In this work, we present the first large-scale simulation of multilingual student-tutor interactions using LLMs. A stronger model plays the role of the tutor, generating feedback in the form of hints, while a weaker model simulates the student. We explore 352 experimental settings across 11 typologically diverse languages, four state-of-the-art LLMs, and multiple prompting strategies to assess whether language-specific feedback leads to measurable learning gains. Our study examines how student input language, tutor feedback language, model choice, and language resource level jointly influence performance. Results show that English hints are generally preferred, even by multilingual student LLMs, with few exceptions that lead to improved student learning outcomes. These findings offer practical insights for developing multilingual, LLM-based educational tools that are both effective and inclusive.
Sources
- Thinking Machines: A Survey of LLM based Reasoning Strategies
- Training Verifiers to Solve Math Word Problems
- Stepwise Verification and Remediation of Student Reasoning Errors with Large Language Model Tutors
- Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier
- The Llama 3 Herd of Models
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- GPT-4o System Card
- Mistral 7B
- Zero-Shot Chain-of-Thought Reasoning Guided by Evolutionary Algorithms in Large Language Models
- Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gap
- MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problems
- Can Large Language Models Replicate ITS Feedback on Open-Ended Math Questions?
- LLaMA: Open and Efficient Foundation Language Models
- Multi-Agent Collaboration Mechanisms: A Survey of LLMs
- Tutor CoPilot: A Human-AI Approach for Scaling Real-Time Expertise
- Self-Consistency Improves Chain of Thought Reasoning in Language Models
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering