Sensory substitution as a framework to access visual and spatial information for VIP

SKERI Brown Bag

Seminar hosted at Smith-Kettlewell Eye-Research Institute, presenting the Sensory Substitution framework and its use in designing non-visual interfaces for VIP
Assistive Devices
Spatial Cognition
Sensory Substitution
Computer Vision

San Francisco, USA


January 9, 2019


Despite the progress on assistive technologies for the visually impaired, numerous sources of information remain difficult to access without vision. Most of the existing solutions for visually impaired people rely on language to convey information, whether it is through an auditory (text-to-speech synthesis) or tactile (braille) medium. However, those solutions often fall short when the information to provide is highly dynamic or difficult to efficiently convey through language (e.g. spatial or image-based information).

The Sensory Substitution framework provides a means to overcome those limitations by providing said information through low-level sensory stimulation which can be, after some training, processed and interpreted quickly, with very little attentional resources. However, a lot of questions on this particular type of human-machine communication still remain open. During this talk, I will present the projects I have been working on during the first 2 years of my Ph.D., in the context of sensory-substitution-based assistive devices, both on the accessibility of image-based content and on the autonomous navigation of visually impaired people.

Back to top