Patrick H. Chen

Attend to Fragments: How Key Information Affects Large Language Models for Factual Inconsistency Detection

A new benchmark, KIFI, is designed, which comprises 1032 carefully selected instances from the TRUE and ScreenEval datasets, with key information annotated, and it is shown that LLMs frequently fail to use the appropriate information to make correct decisions.