There are limitations in existing multi-exposure fused image quality assessment (MEF-IQA) approaches. The first is that the existing approaches are hard to estimate the consistency of luminance distribution in fused images, which can be easily destroyed in fusion process. The second is that the aesthetics estimation of fused images are neglected in existing approaches, which should be considered for the images produced by fusion algorithms to give people an aesthetic experience. In order to solve these problems, a MEF-IQA approach based on the deep network was proposed. First, we adapted a quad path network as luminance error quality evaluator (LE) to extract the features, which can capture the luminance distribution patterns, from fused images. Then, we trained an aesthetic evaluator (AE) to obtain the feature which can describe the aesthetic attributes of fused image. Finally, the two extracted features are combined for predicting the perceptual quality scores. Experimental result clearly shows that the proposed approach can quantify the image quality reliably, and it is highly correlated with subjective quality scores.