Multilayer least-square (LS)-based one-class classification networks (MLS-OCNs) have gained great attention for the purpose of identifying anomalies and outliers. However, many MLS-OCNs encounter the issue of loosely connected feature coding because they use two separate mechanisms for feature encoding and final pattern recognition. This paper proposes a solution to this problem by introducing a multilayer algorithm called deep Moore-Penrose inverse network with refinement (DMPINR). In particular, DMPINR employs an end-to-end learning process based on the Moore-Penrose inverse (MPI) to identify optimal latent space and classify objects simultaneously. To enhance the robustness of representations, the DMPINR technique pulls back the residual error from the output layer to the hidden layers sequentially, recalculating the parameters of these hidden layers using MPI. The experimental results on ten popular OCC datasets demonstrate that the proposed approach outperforms many existing MLS-OCNs in G-Mean and F 1 scores.