This work proposes SMART, a benchmark that decomposes mathematical problem-solving into four cognitive dimensions: S emantic Understanding, M athematical Reasoning, A rithmetic Computation, and R eflection & Refinemen t, and introduces dimension-specific tasks to measure the corresponding cognitive processes of LLMs.
Yu-Heng Hou, Mei Wang, Yaoyao Zhong et al.· Annual Meeting of the Associ...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.