Android Based System for Visual Assistance

  • Course: CSE4099 Capstone Project (VIT)
  • Tech Stack: Java, XML, Android Studio SDK, Libraries (TensorFlow lite, openCV, Text-to-Speech)
  • Developing an Android application to assist visually impaired individuals in daily tasks
  • The app uses object detection technology to alert users of nearby obstacles and identify what it is
  • It also informs users of the name of the object or person detected through audio using text-to-speech library
  • Pretrained models used include YOLOv4 trained on COCO dataset and FaceNet model trained on LFW
  • User can also add custom faces for future recognition in real-time or from gallery. This helps visually impaired individuals identify people they know.
System Architecture

App Landing Page in Android Studio

Sample Object Detection Using the App