What Actually Fits: Context Selection for Local-First Retrieval on Memory-Constrained Hardware
Running a language model on your own machine keeps your files private, but consumer hardware imposes a context budget that server deployments never feel. We report measurements from a deployed local-first system that indexes a user's files and answers questions over them. Early versions injected whole-project content i...