Mingqing Ma

QAQ: Bidirectional Semantic Coherence for Selecting High-Quality Synthetic Code Instructions

QAQ, a novel data selection framework that evaluates data quality from the reverse direction: how well can the answer predict the query conditioned on the query, is proposed and Reverse Mutual Information (RMI) is defined to quantify the information gain about the query conditioned on the answer.