Proxy Interpreter
This work is inspired by my long-term goal of building novel immersive systems that improve people’s lives. It aims to solve communication issues children with hearing loss face due to deprivation of sign language education at a young age and rely upon intricate methods for communication. I am designing and implementing a wearable device (smart glasses) called Proxy Interpreter, which integrates augmented reality (AR) and natural language processing (NLP), providing real-time visual feedback to the users while communicating with others. It comprises two independent features-
- It converts sign language and speech into visual cues.
- It translates speech into pictures of relevant information and graphical sign language animations educating the target audience with sign language.