On Device Agentic Operation Caches -- Classifier-Centric NL-to-Action Generation
This paper introduces a novel means of converting the NL-to-Action problem from a generative one into a classification-centric formulation via on-device operation caches via on-device operation caches that allow an agentic system to handle frequently occurring classes of actions completely on-device -- reducing latency...