Matthew DiGiuseppe

JEV versus LLMs: Accuracy, Cost and Calibration on Seven Political Science Replications

Large language models (LLMs) annotate and scale political text or constructs by generating text tokens. A new class of models, which TypeSafe markets as"System One"models, instead returns decisions and probability distributions across a user-supplied fixed answer set. A commercial model, JEV, is advertised as having a...