Towards an FPGA Implementation of IOT-Based Multi-Modal Hearing AID System
- Resource Type
- Conference
- Authors
- Enemali, Godwin; Bishnu, Abhijeet; Ratnarajah, Tharmalingam; Arslan, Tughrul
- Source
- 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) Acoustics, Speech, and Signal Processing Workshops (ICASSPW), 2023 IEEE International Conference on. :1-4 Jun, 2023
- Subject
- Bioengineering
Communication, Networking and Broadcast Technologies
Computing and Processing
Signal Processing and Analysis
Soft sensors
Speech enhancement
Streaming media
Signal processing
Logic gates
Hearing aids
Real-time systems
Audio-visual speech enhancement
embedded platform
multi-modal hearing aid
- Language
This paper presents implementing a cloud-based multimodal hearing aid (HA) system. It identifies major processing blocks to be implemented on an embedded Field Programmable Gate Array (FPGA) and focuses on aspects of a custom block that deals with the integration of multiple input sources of the HA. In particular, the integration block deals with the combination of audio and video (AV) data at different sampling rates, with each having a different number of bits to encode their information. It realizes seamless combination of AV data by assigning a scaled number of bits to each component in the combined signal to achieve a real-time data transmission of all data sources. In addition, key issues such as security is discussed and plan to address this in our future work is stated.