quickthink: local-first inference control layer for small LLMs
quickthink is a local-first inference control layer that aims to give small, on-device language models more reliable structured output by inserting a compressed plan-then-answer scaffold with latency-aware routing. Its routing, plan-grammar, and validation logic run as plain-Python middleware (no extra model of its own...