Assessment of dyslexic children with EOG signals: Determining retrieving words/re-reading and skipping lines using convolutional neural networks
- Resource Type
- Authors
- Ramis Ileri; Esra Demirci; Fatma Latifoglu
- Source
- Subject
- medicine.diagnostic_test
General Mathematics
Applied Mathematics
Speech recognition
media_common.quotation_subject
Dyslexia
Short-time Fourier transform
General Physics and Astronomy
Eye movement
Statistical and Nonlinear Physics
Electrooculography
medicine.disease
01 natural sciences
Convolutional neural network
010305 fluids & plasmas
Reading (process)
0103 physical sciences
Classifier (linguistics)
medicine
Spectrogram
010301 acoustics
media_common
Mathematics
- Language
- English
This study aims to determine and classify the back to eye movement (retrieving words/re-reading) and skipping lines while reading from electrooculography (EOG) signals. For this aim, EOG signals were recorded during the reading of a text from healthy and from dyslexic children. In this study, a method to assist in the diagnosis and follow-up of dyslexia is proposed by determining skipping lines and back to eye movement (retrieving words/re-reading) while reading. Using the proposed method, skipping lines while reading and back to eye movement (retrieving words/re-reading movements) were determined from EOG signals and spectrogram images of these movement signals are obtained using the Short Time Fourier Transform (STFT) method. These spectrogram images were classified using the 2 Dimensional Convolutional Neural Network (2D-CNN) classifier. The 2D-CNN model has classified the skipping lines signals while reading and back to eye movement (retrieving words/re-reading) signals with 99% success. The findings show that the method proposed in the diagnosis and follow-up of dyslexia can give positive results using these EOG signals.