A key challenge in bringing embodied intelligence into the real world is transferring capabilities from simulation to reality and enabling agents to continually adapt after deployment. End-to-end vision-language-action policies provide strong manipulation capabilities, but their transfer to physical environments typica...
Chen-Xi Li, Zhang-Rui Zhao, Rui Li et al.· 0 citations
Wet-lab experimentation serves as the gold standard for hypothesis verification in scientific discovery; yet it is inherently labor-intensive, costly, and safety-critical. Embodied agents hold the promise of automating these tedious workflows, but their development is hindered by the scarcity of real-world training dat...
Chen-Xi Li, Hai-Yuan Wan, Rui Li et al.· 0 citations
VPTwin is proposed, a Real-Sim-Real video prediction framework that anchors real-world future prediction using real-synchronized simulation twins and establishes a predictive planning loop using VPTwin to visually verify VLM-proposed actions and guide reliable real-world execution.
Zheng-Hao Xiao, Min-Ting Pan, Nan-Tian He et al.· 0 citations
ProtoAct, a structured protocol-grounding framework that converts free-form biological procedures into state-aware, embodiment-ready action sequences, is presented, providing a practical interface between biological protocol understanding and embodied robotic execution.
Zhe Liu, Jiaming Gu, Zhao-Hui Du et al.· 1 citation
This work introduces BioVLN, a simulation platform for developing and evaluating visual-language navigation agents in biomedical laboratories and shows that geometric exploration reaches 74.4--87.5% success, while sampling multiple valid positions in the operation area improves success and reduces unsafe proximity.
Zhe Liu, Quan Lu, Zhao-Hui Du et al.· arXiv.org· 0 citations
LabRobFail, a failure-centric framework for learning and evaluating robotic failure analysis in chemical laboratories, and LabRobFail-VLM, a domain-specialized vision-language model that generates structured failure diagnoses and recovery instructions, demonstrate the value of fine-grained failure understanding for clo...
Haobo Wang, Baoli Sun, Anqi Zou et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.