Evaluating Edge and Server-Offloaded Retrieval-Augmented Generation for a Rehabilitation Voice Assistant on Raspberry Pi
Voice-based assistants offer a promising interface for rehabilitation patients with limited digital literacy, but reliable domain-specific responses require grounding in relevant knowledge rather than relying solely on language model parametric memory. Retrieval-augmented generation (RAG) provides this grounding, yet d...