Metaphorically Spatial: A Formative Design Exploration of Lightweight Smartphone Audio Guidance

Abstract

We present Metaphorically Spatial, a design probe that explores how camera-derived object relationships can be translated into lightweight auditory guidance on a commodity smartphone, intended to reveal design tensions in audio guidance for mobile interfaces. MS-2C maps horizontal image position through left–right channel balance and apparent object proximity through playback rate. MS-3C additionally maps vertical displacement to pitch. A pilot study was conducted using a between-subjects experimental design, in which 30 sighted participants used their hearing to locate objects during a blindfolded object-finding task. Participants completed 77 of 90 trials (85.6%), providing initial evidence that both mappings could support object acquisition within the controlled task. Descriptive differences varied across objects and post-task ratings rather than consistently favoring either mapping. We identify two design tensions related to balancing interface demands with audio cues and how object properties may need to be considered in designing appropriate guidance cues.