Existing large language model (LLM) based multi-agent systems have been shown to scale poorly, and we identify three problems: reading burden that grows with the group, useful information diluted by shared work of unknown quality, and fragility to failed agents. We argue that the problems are largely due to agent-centr...
Zhen-Ting Qi, Zhuo-Kai Zhao, Ru-Lin Shao et al.· 0 citations
H-Spec is a hybrid Mamba-attention parallel drafter that consumes the two target-context sources through complementary modules, and consistently achieves higher throughput while maintaining lower KV cache utilization than baselines across evaluated concurrency levels.
MatrAIx is introduced, a population-scale simulated-user evaluation infrastructure for testing AI systems and digital products with heterogeneous users and provides an end-to-end infrastructure for evaluating AI systems and digital products with diverse simulated human users.
Xiaomin Li, Yuexing Hao, Jian Hou et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.