NumTrace: Auditing the Number Provenance of Financial Analyst Agents
A numerical claim generated by a financial analyst agent can match a number in a company filing but refer to the wrong entity, concept, period, unit or scope. A check based on reference answers can mark such an answer as wrong but does not explain why it fails. In this paper, we present NumTrace, a new benchmark that a...
Tian-Lei Zhu, Matt White, Xue Liu et al.
· 0 citations