Norm2Tex is introduced, a plug-in method that augments simulations of vision-based tactile sensors with high-frequency surface details from normal map textures that preserves material-dependent tactile information across domains, improving texture recognition and producing material-dependent control behavior in the rea...
Tactile information is essential for contact-rich manipulation tasks in robotics. Vision-based tactile sensors make it particularly easy to design end-to-end manipulation policies with tactile sensing, as they enable the use of existing encoders from computer vision. However, this has led to a huge variety of architect...
Seongjin Bien, Débora Oliveira Makowski, Carlo Kneissl et al.· 0 citations
This work uses intervention-based metrics that measure how visual observations, instructions, and visual memory causally influence navigation decisions and shows that these navigation policies are sensitive to all input modalities and do not depend on a single one.