Calibrated User Embeddings (CUE) is introduced, a framework that both encodes observed sessions and samples continuous representations, then decodes them into persona commands to steer LLMs to act as user simulators without training.
Artificial intelligence offers an unprecedented opportunity to augment human capabilities, yet progress at the frontier has focused primarily on advancing model capabilities. We introduce StudentBench, a suite of AI teaching evaluations and a public platform that enables large-scale data collection with over 175,000 st...
Curtis G. Northcutt, Inaara Hasmani, Kevin Feng et al.· 0 citations
VIALS is introduced, a visual question-answering benchmark with 161 interpretation tasks, spanning the types of artifacts examined throughout experimental workflows in the biotech industry (rather than polished figures from publications and textbooks).
Elaine Lau, Thanuka Udumulla, Lee S. Izhaki-Tavor et al.· 0 citations
This work proposes test-time adaptation through human-agent interaction (TAHI), which integrates these signals into agent context and weights, and crystallizes each user's training and evaluation criteria via an evolving rubric module.