PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
PhysMent is introduced, a benchmark that evaluates LLM physical reasoning via iterative, toolmediated interaction with a MuJoCo physics simulator, and results show that current models perform reasonably well on qualitative single-concept tasks but degrade substantially on quantitative tasks that demand precise, multi-s...
Joseph Chan, Utkarsh Jha, Xi-Yin Yang et al.
· 0 citations