Low-precision execution can substantially accelerate reinforcement learning (RL) for large language models, but discrepancies between learner and sampler execution can destabilize policy optimization. In this paper, we characterize the interaction between mismatch and the policy-gradient direction, distinguishing local...
Zhen Li, Shuai Zhang, Yang-Gan Gu et al.· 0 citations
Block diffusion language models keep a large key-value (KV) cache throughout generation and attend to it at every denoising step, limiting both memory capacity and generation speed. Reducing these costs requires deciding which past tokens to use for denoising the current block (selection) and which to keep in memory fo...
G. Molodtsov, Ekaterina Alimaskina, Е. И. Усков et al.· 0 citations
Evolution Strategies (ES) enable memory efficient full parameter fine-tuning of large language models (LLMs) using only forward computation. However, standard ES uniformly averages rewards across problems and compresses problem level population feedback into a single scalar, making it difficult to capture how the learn...
Zhishen Sun, Hongzhan Wang, Sizhe Dang et al.· 0 citations
Injecting skills into a frozen language model currently costs a million parameters and a reinforcement-learning pipeline. We introduce DecSteer, a System-1 decision operator trained by behavior cloning that lowers this cost by roughly two orders of magnitude. The default operator uses 330K parameters to match a 1.33M-p...
Ran Li, Lei Chen· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
The key-value (KV) cache of autoregressive transformers grows linearly with context length and dominates memory at long context. Most training-free remedies evict low-importance tokens, an irreversible choice along the sequence axis. We instead keep every token and store it more cheaply along the "feature" axis. We the...
Sara Abdali, Jongwoo Ko, Pashmina Cameron· 0 citations
Neural operators provide fast surrogates for time-dependent PDEs, but autoregressive deployment creates a refinement-allocation problem: prediction errors vary over space and time, while only a finite number of local corrections can be committed along a trajectory. We formulate this as budgeted adaptive neural-operator...
In this paper, a comparative review of different hybrid models for short-term forecasting of building thermal demand is carried out. Particularly, the assessment tackles the comparison of data-driven models enhanced with other state-of-the-art techniques. At the first step, the existing techniques reported in the liter...
Nikolaos A. Efkarpidis, Despoina Kothona, Georgios C. Christoforidis· 0 citations
Machine learning classifiers for bearing fault detection produce scalar confidence scores that conflate confident errors with genuinely ambiguous predictions, and the conventional truth/falsity pair (F = 1 - T) is algebraically redundant by construction. We operationalize a refined neutrosophic decomposition of a Rando...
Maikel Leyva-Vazquez, Dayron Rumbaut Rangel, Lorenzo Cevallos-Torres et al.· 0 citations
Computer-aided and artificial intelligence-aided drug design (CADD and AIDD) have long confronted a fundamental challenge: accurate prediction of the binding between dynamically evolving proteins and small-molecule ligands, not to mention the induced-fit interactions that occur throughout the binding process. This talk...
Weiliang Zhu· Zenodo (CERN European Organi...· 0 citations
Computer-aided and artificial intelligence-aided drug design (CADD and AIDD) have long confronted a fundamental challenge: accurate prediction of the binding between dynamically evolving proteins and small-molecule ligands, not to mention the induced-fit interactions that occur throughout the binding process. This talk...
Weiliang Zhu· Zenodo (CERN European Organi...· 0 citations
Analyzing the perceptions of 98 undergraduate students in International Business at the Universidad Autónoma de Nayarit regarding the viability of entrepreneurship that links smart city innovation with a democratic framework suggests that higher education must lead the transition toward Society 5.0 through pedagogical...
Julio César Cuauhtémoc Carrillo-Beltrán, Armando Ramírez-Jiménez, María del Carmen Llanos-Ramírez et al.· Revista de Tecnología y Educ...· 0 citations
With $2.1 million funding from Google.org, the open-source Public Transit Intelligence Hub will unify public transit monitoring, operations, and passenger communication.
Professor Sherry Turkle’s new book, “Artificial Intimacy,” offers a withering critique of chatbots and the antisocial dynamics she believes they encourage.