Vague2Detect: Handling Ambiguous Prompts in Knowledge-Based Open-World Detection
This work proposes Vague2Detect, a hybrid pipeline in which a fine-tuned Sentence-BERT retrieves candidates from a structured household Knowledge Base, and YOLO-World verifies their presence in the image, and improves performance to 61% VPSR with high precision, and up to 85% when augmented with GPT fallback.