Skip to content

Category

natural language processing

6,756 papers

#machine learning Preprint Open access Oct 2026

DataFlex: A Unified Framework for Data-Centric Dynamic Training of Large Language Models

Data-centric training has emerged as a promising direction for improving large language models (LLMs) by optimizing not only model parameters but also the selection, composition, and weighting of training data during optimization. However, existing approaches to data selection, data mixture optimization, and data rewei...

Hao Liang, Zhengyang Zhao, Mingrui Chen et al. · 0 citations
#machine learning Preprint Sep 2026

Comparison of techniques for fine-tuning open-weight models for entity extraction from radiology reports

Converting free-text radiology reports into structured labels supports cohort building, quality assurance, and monitoring of clinical imaging models, but the strongest label extractors are hosted proprietary models whose use raises privacy, cost, and reproducibility concerns. We asked whether a fine-tuned open-weight m...

Aawez Mansuri, Kush Mehta, Mohammadreza Chavoshi et al. · 0 citations
#machine learning Preprint Sep 2026

OPTS-TTPO: Enhancing Finite-Sample Policy-Gradient Learning with Tree Search

The policy-gradient theorem gives the exact gradient under the current policy, but finite on-policy samples may miss rare high-return trajectories. We study whether tree search improves their coverage within a fixed budget while controlling gradient bias. We introduce On-Policy Parallel Tree Search (OPTS) and Tree Traj...

Jun-Yu Lu, Shi-Chao Weng, Zhi-Qiang Wang et al. · 0 citations
#machine learning Preprint Sep 2026

LLM Persona Unlearning

Pre-training equips large language models (LLMs) with a broad repertoire of behavioral patterns associated with roles, styles, values, and goals. Post-training teaches conditional enactment and makes a helpful Assistant the default, but it does not erase alternative modes from the weights; explicit prompts can therefor...

Ke-Mou Li, Zhuan Shi, Qi-Zhou Wang et al. · 0 citations
#machine learning Preprint Sep 2026

Better Supervision Is Nearby: Neighborhood On-Policy Self-Distillation

On-policy self-distillation (OPSD) trains mathematical reasoning models using a privileged teacher that sees a reference solution and supervises student-sampled prefixes. Standard OPSD uses one fixed parameter setting at every state, but nearby settings may offer additional supervision. We find that local parameter per...

Xin Wei, Yi-Fan Ding, Yoshua Y. Li et al. · 0 citations
#machine learning Preprint Sep 2026

CATCH: A Controllable Analysis Testbed for Reward Hacking in Coding RL

During reinforcement learning with verifiable rewards (RLVR), large language models (LLMs) can exploit loopholes in their environments to obtain high rewards without improving the intended capabilities, i.e., reward hacking. Despite its risks to training efficiency and safety, monitoring and mitigating reward hacking d...

Shou-Li Wang, Yan-Feng Jia, Zhi-Hao Ou et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Synthetic Data Characterization via Training Dynamics

Interpreting properties of LLM-generated data is important for understanding its utility and limitations across learning tasks. In this work, we characterize synthetic data through sample-level learnability, studying variation among LLM families and scales, alongside human-written data as a reference. We first generate...

Irene Lago, Ana Ezquerro, David Vilares · 0 citations
#machine learning Preprint Open access Oct 2026

QuantCode Model: Specializing Language Models for Executable Algorithmic Trading Code

Large language models are strong general-purpose code generators, but executable algorithmic trading remains a demanding specialization target: a model must translate a natural-language strategy specification into correct program logic for a specialized trading framework, execute on historical data, produce trades, and...

Alexey Chernysh, Orkhan Ekhtibarov, Dmitry Zmitrovich · 0 citations
#machine learning Preprint Open access Oct 2026

Exploring Heterogeneous Model Merging Approach for Complex Knowledge Transfer

Specialized models encode task-oriented behavior, but transferring that behavior to a general language model usually requires training, distillation, or representation alignment. We study whether such ability can instead be transferred directly at the parameter level. We apply two existing training-free heterogeneous m...

Jiahe Fan, Si Chen, Yinghao Hou et al. · 0 citations
#machine learning Preprint Sep 2026

Concept Subspaces Compute Beyond the Logit Lens: A Weights-Only Test for Locating Representations Upstream of Readout

A concept subspace's effect on model behavior does not establish how it relates to the output readout. We introduce a two-sided geometric diagnostic that measures an extracted subspace's overlap with the dominant right-singular directions of the unembedding matrix, evaluated against output-oriented positive controls. G...

Ao-Jie Yuan, Z. Su, Hai-Yu Zhang et al. · 0 citations
#machine learning Preprint Sep 2026

RSIGame: Autonomous Agentic Game Development with Recursive Self-improvement

Recent advances in large language models have made automatic game generation increasingly feasible, yet reliably improving generated games beyond a playable version remains challenging. Naive iterative refinement can easily overfit a small set of test cases, producing fragile games with unresolved bugs, missing behavio...

Wen-Yi Wu, Ming-Hao Fu, Jie-Yu You et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.