The use of soft sensors is an alternative solution to physical sensors for real-time acquisition of key quality variables that cannot be measured online in real time. Long short-term memory (LSTM)-based methods have been improving the state-of-the-art in soft sensors. In order to mine the correlation between historical information and current input and utilize the relatively important historical information, we propose an underlying recurrent neural network (RNN) unit called information filtering unit (IFU) and an IFU-based LSTM (IF-LSTM) soft sensor. In IFU, a feedforward neural network is first constructed to predict the hidden state of the previous time step based on the current input, and subsequently, a scaling factor is obtained; the hidden state vector is then scaled to highlight those important components that contain nonredundant information with the current input. Finally, an IF-LSTM model is constructed by combining IFU and LSTM units for predicting hard-to-obtain key quality variables from easily measured process variables, and its performance is validated on two benchmark industrial datasets (sulfur recovery unit (SRU) and debutanizer column (DC) datasets). Experimental results show that the performance of the IF-LSTM outperforms popular RNN variants, such as LSTM, GRU, Bi-LSTM, and Bi-GRU in all metrics [root-mean-square error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), and ${R}$ -squared ( ${R}^{{2}}$ )], and achieves ${R}^{{2}}$ of 0.9929 on the DC dataset, indicating that the predicted values are well-fit to the true values. Furthermore, comparative experiments with state-of-the-art methods in the literature show that the IF-LSTM model achieves the best RMSE of 0.0069 on the DC dataset and the second-best RMSE of 0.0124 on the SRU dataset.