OptiArena is introduced, a budget-controlled testbed for studying whether LLMs can improve executable game-playing algorithms through five rounds of code edits within a fixed minimal scaffold and under bounded evaluator feedback and fixed resource budgets.
Who we communicate with influences both our interpretation of their utterances and the design of our own. Such adjustment to the conversational partner is studied as speaker modeling in comprehension and as audience design in production, with the two literatures having developed largely separately. We argue that both a...
This work finds that continuous regions of representation space not occupied by observed tokens become systematically structured from the earliest stages of learning, forming category-level geometric organization that supports generalization to unattested combinations.
Bo-Juan Wang, Holly E. Jenkins, E. Wonnacott· 0 citations
Precise instruction-following is a fundamental ability of large language models (LLMs), requiring their outputs to strictly satisfy objective constraints in input instructions. In complex application scenarios, these constraints often possess diverse scopes that govern specific response segments rather than the entire...
Bo-Si Wen, Yi-Lin Niu, Xiao-Ying Ning et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This work systematically vary the context window size of GPT-2 across four large-scale naturalistic English reading-time datasets and observes a U-shaped relationship, demonstrating that tracking long-range coreference relations is one important factor for the alignment between LM surprisal and human reading behavior.
Kohei Kajikawa, Lin Ai, Tatsuki Kuribayashi et al.· 0 citations
Voice agents depend on accurate automatic speech recognition (ASR) to act on what callers say, yet ASR is evaluated on read, English-centric speech with word error rate (WER), which penalizes surface rather than semantic differences. We introduce mu-bench, a dataset of 4,270 caller utterances from 250 phone calls to an...
PolAgentBench, a deterministic benchmark with Polish prompts and English tool schemas, is introduced and how GGUF quantization affects agentic tool use in Polish and whether the effects generalize across models is asked.
Contextual Early Reward (CER), which predicts terminal reward through behavioral evidence in a trajectory prefix, provides an interpretable, efficient, and dense evaluation method for long-horizon coding agents.
Ji-Han Yao, Si-Han Zeng, Shang-Bin Feng et al.· 0 citations
Contextual scores represent assessment items through their similarities to reference words in an external corpus. We examine the semantic structure of scores for 40 TIMSS mathematics scored units using a partially specified two-step factor procedure. A search across factor counts identifies a persistent seven-group str...
This work addresses three challenges: finding conversational events in multilingual speech, evaluating their timing without reliable word-level alignment, and judging responses across languages with IndicFDB, which extends it to ten languages spoken in India with 12,350 samples.
Rajarshi Roy, Shobhit Banga, Jonathan Raiman et al.· 1 citation
Overall, this work demonstrates the effectiveness of a new class of adversarial attacks against AI text detection, and urges post-hoc detection providers to include outputs of base models in their training.
The results establish harness-level capability composition as a practical route to broad, evolvable Omni systems without changing the host agent's reasoning core.
Yan-Lin Li, Ming-Yang Hao, Sheng-Qiong Wu et al.· 0 citations
A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.
Microsoft Research Blog· microsoft.comOct 15, 2026
Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduSep 24, 2026
A new method, called CW-Net, translates the reasoning process of an autonomous vehicle’s AI system into understandable concepts that explain its behavior.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.