Novel framework for outdoor mobility assistance and auditory display for visually impaired people

Wasiq Khan, Abir Hussain, Bilal Khan, Raheel Nawaz, Thar Baker

Research output: Chapter in Book/Conference proceeding with ISSN or ISBNConference contribution with ISSN or ISBNpeer-review


Outdoor mobility of Visually Impaired People (VIPs) has always been challenging due to the dynamically varying scenes and environmental states. Variety of systems have been introduced to assist VIPs' mobility that include sensor mounted canes and use of machine intelligence. However, these systems are not reliable when used to navigate the VIPs in dynamically changing environments. The associated challenges are the robust sensing and avoiding diverse types of obstacles, dynamically modelling the changing environmental states (e.g. moving objects, road-works), and effective communication to interpret the environmental states and hazards. In this paper, we propose an intelligent wearable auditory display framework that will process real-time video and multi-sensor data streams to: a) identify the type of obstacles, b) recognize the surrounding scene/objects and corresponding attributes (e.g. geometry, size, shape, distance from user), c) automatically generate the descriptive information about the recognized obstacle/objects and attributes, d) produce accurate, precise and reliable spatial information and corresponding instructions in audio-visual form to assist and navigate VIPs safely with or without the assistance of traditional means.

Original languageEnglish
Title of host publicationProceedings - 12th International Conference on the Developments in eSystems Engineering, DeSE 2019
EditorsDhiya Al-Jumeily, Jade Hind, Jamila Mustafina, Assem Al-Hajj, Abir Hussain, Evgeni Magid, Hissam Tawfik
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages6
ISBN (Electronic)9781728130217
Publication statusPublished - Oct 2019
Event12th International Conference on the Developments in eSystems Engineering, DeSE 2019 - Kazan, Russian Federation
Duration: 7 Oct 201910 Oct 2019

Publication series

NameProceedings - International Conference on Developments in eSystems Engineering, DeSE
ISSN (Print)2161-1343


Conference12th International Conference on the Developments in eSystems Engineering, DeSE 2019
Country/TerritoryRussian Federation

Bibliographical note

Publisher Copyright:
© 2019 IEEE.


  • Blind people navigation
  • Data fusion
  • Healthcare aid
  • Healthcare technology framework
  • Object recognition
  • Obstacle detection
  • Outdoor mobility assistance
  • Scene recognition
  • Visual impairment

Cite this