Skip to content

Category

small language model

2,968 papers

#small language model Preprint Sep 2026

Probe-VAD: Ordinal Likelihood Probing for Training-Free Video Anomaly Detection

Probe-VAD is proposed, an ordinal binary-probing framework that directly probes severity preferences from a frozen VLM, providing a simple interface for translating frozen VLM visual understanding into continuous, rank-sensitive anomaly scores without task-specific training or caption-based compression.

Jia-Wei Gu, Qi-Lin Zhao, Teng-Kuo Guo et al. · 1 citation
#small language model Review Sep 2026

FHIR as an interoperability enabler for clinical applications: a narrative review of implementations, impacts, and future challenges.

FHIR has successfully catalyzed widespread technical innovation and serves as the foundation for advanced clinical applications, however, a significant translational gap persists and future efforts should expand beyond technical development.

Wafae Abbaoui, S. Ziti, Sara Retal · 0 citations
#small language model Preprint Sep 2026

Geospatial Metadata Improves Discoverability by Connecting Datasets Across Scientific Disciplines

It is found that datasets with more missing metadata receive fewer downstream citations and have fewer resolvable connections to other datasets, suggesting that geographic metadata is a more reliable basis for cross-disciplinary interoperability than keyword vocabularies, which often remain discipline-specific.

Daniel Ebanks, Devika Jain · 0 citations

EGFR Mutation Subtype and Risk of Brain Metastases From Non-Small Cell Lung Cancer in the Osimertinib Era: EGFR Subtype and Brain Metastases in NSCLC.

Differences in brain metastasis development between EGFR L858R and Ex19Del mutations appeared to be mitigated among patients undergoing osimertinib compared with early-generation TKIs, representing an important systems bioengineering approach.

Ameya Patel, Victor Lee, A. H. Nassar et al. · 0 citations
#small language model Preprint Sep 2026

Counterfactual Reasoning for Robust Visual Question Answering

A novel training framework that enhances counterfactual contrastive learning for VQA and introduces a three-stage curriculum for stable multi-objective optimization, an enhanced Batch-Contrastive loss for more discriminative feature learning and two novel regularizers.

Truong-Binh Duong, T. Tran, Ngoc-Thao Nguyen et al. · 0 citations
#small language model Preprint Sep 2026

SaltyMeta: a curated benchmark and protein language model-informed web tool for salty peptide prediction

This work presents SaltyMeta, a curated benchmark and web-accessible screening framework for salty or saltiness-enhancing short peptides, and provides benchmark, models, scripts, GitHub, and Streamlit for reproducible screening of food-derived peptides.

Wanchao Chen, Wen Li, Ya-Nan He et al. · 0 citations
#small language model Review Sep 2026

Fine-Tuning Fixes Mode Collapse and Over-Dispersion in LLMs

This work derives a bias-variance decomposition of the expected gap between the model's and target's collision probabilities, showing that SFT is not inherently biased toward mode collapse or its opposite, and shows that diversity miscalibration can arise from finite-sample error and shrink as SFT better approximates t...

K. Skobelev, Eric Fithian, X. Y. Han · 0 citations
#natural language process... Preprint Sep 2026

Persistent Recurrent Memory Between Transformer Layers - Improves Language Model Generalization

We introduce a simple architectural modification to decoder-only transformers: a persistent recurrent state that observes hidden representations via cross-attention, updates itself through a GRU, and modulates subsequent processing via gated addition. Inserted between the lower and upper halves of a 6-layer transformer...

E. Hering · 0 citations
#natural language process... Preprint Sep 2026

Smarter by the Moment: Environment-Driven Dynamic Policies for Continual LLM Improvement

Dynamic Retrieval-based Policy Generation (DRPG) is proposed, a framework that integrates memory-based retrieval with a dynamic policy generator, leveraging historical data and environment feedback to produce task-specific policies for continual LLM improvement.

Ting-Wei Chang, Po-Chun Chen, Hen-Hsen Huang et al. · 0 citations
#natural language process... Preprint Sep 2026

PunGraph: Retrieval-Enhanced Phonetic-Semantic Graph Reasoning for Pun Understanding

Experiments on SemEval-2017 and WebPun show that PunGraph consistently improves the performance of small-scale LLMs and achieves competitive results against strong proprietary models, highlighting the benefits of integrating structured knowledge with LLMs.

Yuchen Su, Zijian Huang, Yao-Tian Shi et al. · 0 citations
#natural language process... Preprint Sep 2026

Style-Debiased DPO: Updating LLM Knowledge with Factuality-Aware Synthetic Preference Data

Continued pretraining (CPT) with data augmentation such as paraphrasing can store inside a large language model (LLM) the knowledge of a small source corpus. The stored knowledge, however, is not always retrieved correctly. We study the eliciting side rather than the storing side: we use preference optimization, which...

Takayuki Yamamoto, Daisuke Kawahara · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.