Skip to content

Evaluating LLM Knowledge Placement Techniques for Carbon-Efficiency

· 0 citations · 25 references

TL;DR

This work compares the trade-offs between retrieval-augmented generation, prefix caching, and fine-tuning in large language models to show that when the knowledge is stable and matches the questions asked, fine-tuning is the greenest, fastest, and most accurate, because it produces shorter answers.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

LiteRAG: Cost-Efficient Graph-Based Retrieval-Augmented Generation

LiteRAG is presented, a graph-based retrieval method that replaces expensive retrieval-time LLM control with query-conditioned algorithmic exploration and reasoning-chain context construction and attains the highest overall quality among the evaluated methods.

Daniel Alejandro Coll Tejeda, Pedro García López, Daniel Barcelona-Pons · 0 citations
#artificial intelligence Preprint Sep 2026

From Parameters to Answers: How LLMs Retrieve and Use Their Internal Knowledge

This work compares country-continent questions with noun, adjective, and code answers while keeping several fitted measurements distinct across Qwen, Llama, and Gemma to separate early readability, natural strength, causal steering, and later content dependence.

Wen-Lin Wei, Yuan Fang, Ren-He Jiang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Retrieval-Augmented Generation for Scientific Code Understanding

The results indicate that front-loading code understanding into a reusable, codebase-specialised vector store enables small local models to deliver grounded and repository-specific answers, making the agent well suited as a privacy-preserving development tool for in-house scientific codebases.

Aaron Nobile, Andreas Adelmann, Mohsen Sadr · 0 citations
Preprint Aug 2026

LLMs Can Design Near-Optimal OR Algorithms

For the well-specified operations problems the authors study, a single untuned LLM query can already produce algorithms competitive with specialized methods, suggesting that frontier LLMs can be a serious empirical baseline for algorithm design in well-specified OR problems.

Jackie Baek · 0 citations
#artificial intelligence Preprint Sep 2026

Where Should a Document Live: Context, Representations, or Parameters?

A controlled comparison of representation-based (KV-cache based) and parametric (fine-tuning-based) adaptation methods on five knowledge-intensive benchmarks shows that in the oracle setting, Cartridges are the most accurate injection method at nearly every storage budget, outperforming parametric methods by 10 points.

Nathanaël Carraz Rakotonirina, Momchil Hardalov, Gonzalo Iglesias et al. · 0 citations
#machine learning Preprint Sep 2026

RAILS: Retrieval-Augmented Incremental LLM Clustering at Scale

RAILS is presented, a retrieval-augmented incremental LLM clusterer that turns clustering into a simple loop over a growing label pool and scales through document batching with bounded concurrency.

Armin Oliya, Aleksandra Sawczuk, Radosław Białobrzeski · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.