Praphulla Lal Shrestha

When Do LLMs Actually Help? Evaluating LLMs as Data Quality Annotators

Testing an LLM on two e-commerce data quality tasks, entity matching and brand mislabeling, against rule based baselines and human verified ground truth, under both zero-shot and few-shot prompting suggests that the value of using an LLM over traditional methods depends heavily on the task.