Author

Lucio M. Dery

h-index 2 View on Semantic Scholar

We have 2 of 6 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Jul 2026

SkillSmith: Learning to Compose Parametric Skills and Textual Knowledge

This work instantiate parametric learning via prefix-tuning and augment an LLM to ingest both prefix weights and rich textual data which capture relationships to a target capability, and synthesizes these inputs to perform instruction-steered parametric synthesis, directly outputting new prefix weights that manifest th...

Lucio M. Dery, Benedict Aaron Tjandra, Siavash Samiei et al. · arXiv.org · 0 citations

Preprint Aug 2026

Mixture of Training: Recombining Small-Scale Scaffolded Pretraining Runs into a Larger Language Model

Mixture of Training is introduced, a scaffolded modular pre-training procedure that partitions a target Transformer into contiguous layer blocks, trains each block inside a frozen pretrained aligner scaffold, and then recomposes the trained blocks with an optional short end-to-end adaptation pass to study whether scaff...

Mohammed Sabry, Sean Augenstein, Keith Rush et al. · 0 citations