Video Chat Application for Mutes
- Resource Type
- Conference
- Authors
- Aadit, Thanekar; Deepak, Jha; Janhavi, Patil; Jyoti, Deone
- Source
- 2021 International Conference on Emerging Smart Computing and Informatics (ESCI) Emerging Smart Computing and Informatics (ESCI), 2021 International Conference on. :181-185 Mar, 2021
- Subject
- Bioengineering
Communication, Networking and Broadcast Technologies
Components, Circuits, Devices and Systems
Computing and Processing
Fields, Waves and Electromagnetics
Photonics and Electrooptics
Robotics and Control Systems
Signal Processing and Analysis
Assistive technology
Virtual environments
Gesture recognition
Cameras
User experience
Speech processing
Informatics
Gesture Recognition
hand tracking
ASL
ISL
CNN
- Language
The current situation gives us the clear idea and justification that how much virtual environment for companies, colleges and other campus is important. To deal with this situation we always look forward to video calls and systems which is easy to manage and don’t create hindrance in our work. But what about the people who are mute and deaf who couldn’t deal with this situation because the best language they know for communication is sign language for which they use different hand gestures called ASL (American Sign Language) and ISL (Indian Sign Language). So, to deal with this problem in this project we have created Video chat application for mutes. In this project our main focus is on ISL (Indian Sign Language). To recognize different hand gestures of users we have used CNN Deep Learning algorithm. As soon as user starts showing hand gestures to camera our algorithm using CNN would detect the correct phrase/number/letter and send it to frontend. Detection and formation of sentence will be done simultaneously for better user experience.