This work establishes a rigorous standard for trustworthiness in autonomous agents deployed for public health by evaluating VLMs across three progressive capabilities: Basic Perception (Ingredients&Cooking Methods), Quantitative Reasoning (Portion Size&Nutritional Profiling), and Safety-Critical Advisory (Disease-Specific Recommendations).
Abstract
The rapid integration of Large Vision-Language Models (VLMs) into critical infrastructure promises to revolutionize personalized healthcare and dietary management. However, in the domain of food systems, autonomous agents face a unique and persistent challenge: the"Systemic Information Asymmetry"between visual appearance and intrinsic nutritional composition. Existing benchmarks primarily focus on coarse-grained classification tasks, such as food category recognition, which fail to evaluate the intricate reasoning chain required for real-world dietary management -- specifically, the ability to traverse from identifying hidden ingredients to estimating physical mass, and finally synthesizing safety-critical medical advice. In this paper, we introduce OmniFood-Bench, a comprehensive benchmark constructed from the MM-Food-100K dataset. Unlike previous works, OmniFood-Bench evaluates VLMs across three progressive capabilities: Basic Perception (Ingredients&Cooking Methods), Quantitative Reasoning (Portion Size&Nutritional Profiling), and Safety-Critical Advisory (Disease-Specific Recommendations). We evaluate six state-of-the-art VLMs, including gpt-5.1, gemini-3-flash, and qwen3-vl-8B. Our extensive experiments reveal a startling"Semantic-Physical Gap": while models achieve near-human accuracy in naming dishes, they exhibit catastrophic failure in mass estimation and frequently hallucinate benign advice for high-risk diabetic profiles. This work establishes a rigorous standard for trustworthiness in autonomous agents deployed for public health. The code and datasets are available in: https://anonymous.4open.science/r/OmniFood-Bench-7D0B
This work proposes Nutri-ATLAS, an Embodied Agent for Tabulated Lookup and Assistance for smarter nutrition in the real world that integrates graph-grounded nutrition reasoning, hardware-aware LLM selection, and robot-based evidence acquisition.
Utteja Kallakuri, Bo-Xun Hu, A. Butala et al.· 0 citations
An embodied kitchen assistant must do more than recognize food in isolated frames. It must track ingredient states over time and integrate visual observations with recipe and nutritional knowledge to support constraint-aware decision-making. We formalize this capability as \emph{Embodied Nutrition Management}: perceivi...
Yue-Ling Wei, Xiang-Chen Wang, Jian-Hui Pan et al.· 0 citations
The efficacy of incorporating artificial intelligence technologies into personalized recommendations for health improvement and symptom reduction in chronic diseases has been proven, with results demonstrating significant enhancements in patients' metabolic parameters and life quality.
Z. Burova, Maksym Hudzenko, Y. Kryzhova et al.· Human and nation s health· 0 citations
Medical large language models (LLMs) have shown promise in medical knowledge retrieval and clinical reasoning. However, their capacity for quantitative reasoning over dense, longitudinal health data remains limited, largely due to the lack of effective training strategies that leverage large-scale, natural-language-bas...
H. Guo, L. Song, P. Ren et al.· medRxiv· 0 citations
The proposed CA-Seq2Seq-LSTM-Attn framework is a promising decision-support tool for personalised dietary control in T2DM as it generates interpretable, nutritionally balanced and clinically matched meal recommendations.
Satish Singh Mekale, Maumita Chakraborty, Chiradeep Mukherjee· International Journal of Inf...· 0 citations
AI-enabled personalized nutrition is progressing from proof of concept toward clinical translation, which will require multi-ethnic nutrition–omics cohorts, privacy-preserving multicenter collaboration, dietitian-led human–AI collaboration, and lifecycle safety governance for generative models.
Amin Gasmi, Man-Fai Leung, Rui Ma et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.