Hans Peter Lyngsøe Raaschou-jensen

BatchParScale: Sparse Batch-Mixing for Sequence Models

Recent test-time scaling methods improve model performance by increasing inference-time compute. One practical form of this is parallel scaling, where a model samples multiple independent reasoning streams and aggregates their answers using methods like voting, reranking, or verification. While effective, this approach...