Skip to content
Log in
Sponsored AI AM CLAUDE, A Beginner's Guide: Learn the basics of working with AI AI AM CLAUDE, A Beginner's Guide: Learn the basics of working with AI

Author

Orders Of Magnitude LLC

View on Semantic Scholar

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#small language model Open access Sep 2026

NS-Filtered Fine-Tuning: 86.8% Compute Reduction with Equal or Better Benchmark Performance

Modern language model training applies a uniform gradient update to every token, regardless of its information content. We introduce NS-weighted training, which filters training examples by their Shannon information. On a 50MB sample of the C4 web corpus, unigram NS-data filtering matches a 1000-step standard training...

Orders Of Magnitude LLC · 0 citations
#small language model Open access Sep 2026

NS-Filtered Fine-Tuning: 86.8% Compute Reduction with Equal or Better Benchmark Performance

Modern language model training applies a uniform gradient update to every token, regardless of its information content. We introduce NS-weighted training, which filters training examples by their Shannon information. On a 50MB sample of the C4 web corpus, unigram NS-data filtering matches a 1000-step standard training...

Orders Of Magnitude LLC · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.