Skip to content

Author

Ilya Koziev

3 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Sep 2026

Change the Product, Keep the Parameters: Associative Algebra Layers for Transformers

Fast matrix multiplication algorithms keep the product fixed and search for a cheaper way to evaluate it. We instead ask whether a Transformer's learned projections can use a different, cheaper product altogether. Building on an associative-algebra construction that replaces ordinary matrix multiplication with a sparse...

Ilya Koziev, I. Oseledets · 0 citations
#artificial intelligence Preprint Sep 2026

Zarya: A Hybrid Autoregressive--Masked Diffusion Language Model with Flexible Training and Dual-Mode Inference

Autoregressive language models (ARMs) are constrained by sequential, left-to-right generation, while masked diffusion models (MDMs) enable parallel decoding but suffer from high computational overhead due to the inability to reuse Key-Value (KV) cache and from incoherent generation arising from learning dependencies ov...

Leonid S. Sinev, Ilya Koziev, Vladislav Leshchuk · 0 citations
#artificial intelligence Preprint Sep 2026

Evaluating Losslessness in Speculative Decoding Under Finite-Precision Inference

A gap between algorithmic losslessness and its implementation under finite-precision arithmetic is demonstrated and motivated, to motivate evaluating lossless speculative decoding at the level of exact generation trajectories as well as downstream task performance.

Ilya Koziev, Leonid S. Sinev, I. Oseledets · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.