Mixture-of-experts (MoE) layers increase model capacity without a proportional increase in per-example computation. However, conventional flat routers can yield imbalanced expert utilization and treat experts as an unstructured collection, whose indices carry no topological meaning. We introduce {\bf BRANCH-MoE}, a rou...
Gang Fu, Adel Javanmard, M. Bateni et al.· 0 citations
DLB, the Distributed Load Balancer is introduced, a novel system designed to minimize end-to-end user latency for large-scale, heterogeneous workloads and its design choices and practical experiences gained from the system in production are detailed.
S. Balseiro, B. Wydrowski, Sameer Agarwal et al.· 0 citations
The present work builds on the differential-equation method, itself a limiting form of the auxiliary-receiver approach in network information theory using a continuum of degraded receivers, and gives a computer-assisted proof of the Courtade--Kumar conjecture.
Zi-Jie Chen, Amin Gohari, Adel Javanmard et al.· 0 citations
In [AS21], Axiotis and Sviridenko conjectured that the linear dependence on the restricted condition number in sparse convex optimization cannot be improved by a polynomial-time algorithm. We establish their conjectured lower bound for least-squares objectives, conditional on the randomized exact-volume Small-Set Expan...
Hong-Hao Lin, V. Mirrokni, David P. Woodruff· 1 citation
Stellar Colosseum is introduced, a model-agnostic harness for allocating inference across research in mathematics and theoretical computer science that demonstrates the capabilities of Colosseum through open-ended research and evaluations on theorem-proving and competitive programming benchmarks.
Hong-Hao Lin, David P. Woodruff, Yuan Deng et al.· 2 citations· ⚡1
This work proposes Subsampled Stochastic TurboQuant (SSTQ), a framework that combines overcomplete equal-norm tight frames, coordinate subsampling, and privacy-aware one-dimensional quantization and empirically evaluates SSTQ against established baselines on federated learning tasks using CIFAR-10 and Fashion-MNIST, de...
Adel Javanmard, David P. Woodruff, V. Mirrokni· 0 citations
For the $n\times n$ lower-triangular all-ones matrix $Q$, we prove a near-optimal lower bound \[ \gamma_{2,1}(Q) := \inf_{Q=AB} \|A\|_{2\to\infty}\|B\|_{1\to1} = \Omega\!\left( \frac{\log^{3/2}n}{(\log\log n)^{3/2}} \right), \] where the infimum ranges over real factorizations of arbitrary finite inner dimension. This...
Hong-Hao Lin, V. Mirrokni, David P. Woodruff· 2 citations
This work introduces TCS-Bench, a benchmark for evaluating Large Language Models (LLMs) on research-level Theoretical Computer Science (TCS) proof generation, and benchmarks the verifier against human-expert proof judgements on a set of target statements and generated proofs pairs.
Vincent Cohen-Addad, Dimitris Paparas, Ernest van Wijland et al.· 3 citations
This work instantiates a new paradigm of incremental memory activation, where the effective capacity of memory is progressively expanded as the context grows, and applies this paradigm to state-of-the-art models, observing consistent improvements on standard language modeling and reasoning, as well as on long-context r...
Reza Bayat, Ali Behrouz, V. Mirrokni et al.· 1 citation
This work eliminates the residual-stage $O(d)$-bit payload and reduces the leading upper-bound constant by a factor of approximately $5.93$ compared with the two-stage construction of Feng et al.
Hong-Hao Lin, V. Mirrokni, David P. Woodruff· 1 citation
Experiments show that HVA establishes a new Pareto frontier for training-free sparse attention in video diffusion, reducing end-to-end latency by up to $2.13\times while improving fidelity over existing training-free sparse attention baselines.
Dongyeun Lee, A. Zandieh, V. Mirrokni et al.· 1 citation
The Paper Assistant Tool is introduced, an agentic AI framework built for deep scientific review and verification and able to identify deeper issues than a single model call alone, achieving a 34% improvement over zero-shot recall on mathematical errors in the SPOT benchmark.
Rajesh Jayaram, Drew Tyler, David P. Woodruff et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.