Educational applications have become more and more popular, making a profound influence on education and teaching. In the "Internet+" era, it is a problem on how to design and choose a high quality and effective educational APP. Based on the Education Technology Developers Guide, 2016 annual online education user white paper and related scholars on the educational APP research, in this paper, we choose students as the research object, and preparing a questionnaire, according to statistical analysis and the structural equation model analysis. We construct a five-factor model of educational APP quality evaluation, including content, instruction, art, service and technology, and 21 secondary indicators. It is found there is a correlation between content, instruction, art, service and technology, and the "content" of which is the most decisive factor in the evaluation of educational APP quality. The purpose of the paper is to provide a reference for the researchers, users and related administrative departments to develop educational APP and promote the development of educational APP.