MIND: Instruction-Conditioned Incremental Grounding for Robots
cs.RO, cs.AI
Submitted: 2026-10-13
Updated: 2026-10-13
Comments: 9 pages, 4 figures
Code: https://github.com/hojoonleokim/MLSys26
Project page: https://mind-icra27.github.io
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
- Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied Agents
- Text2Motion: From Natural Language Instructions to Feasible Plans
- Inner Monologue: Embodied Reasoning through Planning with Language Models
- ReAct: Synergizing Reasoning and Acting in Language Models
- SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planning
- Robots That Ask For Help: Uncertainty Alignment for Large Language Model Planners
- CLARA: Classifying and Disambiguating User Commands for Reliable Interactive Robotic Agents
- Context Matters! Relaxing Goals with LLMs for Feasible 3D Scene Planning
- Integrated Exploration and Sequential Manipulation on Scene Graph with LLM-based Situated Replanning
- DynaCon: Dynamic Robot Planner with Contextual Awareness via LLMs
- STMA: A Spatio-Temporal Memory Agent for Long-Horizon Embodied Task Planning
- Mimir: A Neuro-Symbolic Memory System with Dynamic Grounding for Embodied Agents in Interactive Environments
- When Memory Lies: An Empirical Study of Spatial Memory Staleness in VLM Agents
- KEEP: A KV-Cache-Centric Memory Management System for Efficient Embodied Planning
- LiP-LLM: Integrating Linear Programming and dependency graph with Large Language Models for multi-robot task planning
- DeComplex: Task planning from complex natural instructions by a collocating robot
- DART-LLM: Dependency-Aware Multi-Robot Task Decomposition and Execution using Large Language Models
- ProcTHOR: Large-Scale Embodied AI Using Procedural Generation
- AI2-THOR: An Interactive 3D Environment for Visual AI
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies