An Improved KNN Algorithm Based on Kernel Methods and Attribute Reduction
- Resource Type
- Conference
- Authors
- Xueli, Wang; Zhiyong, Jiang; Dahai, Yu
- Source
- 2015 Fifth International Conference on Instrumentation and Measurement, Computer, Communication and Control (IMCCC) Instrumentation and Measurement, Computer, Communication and Control (IMCCC), 2015 Fifth International Conference on. :567-570 Sep, 2015
- Subject
- Communication, Networking and Broadcast Technologies
Components, Circuits, Devices and Systems
Computing and Processing
Signal Processing and Analysis
Kernel
Classification algorithms
Error analysis
Algorithm design and analysis
Training
Clustering algorithms
Machine learning algorithms
KNN
stepwise
kernel methods
attribute reduction
- Language
Among the classification algorithms in machine learning, the KNN (K nearest neighbor) algorithm is one of the most frequent used methods for its characteristics of simplicity and efficiency. Even though KNN algorithm is very effective in many situations while it still has two shortcomings, not only is the efficiency of this classification algorithm obviously affected by redundant dimensional features, but also the categorization accuracy is seriously influenced by the distribution of training samples. In this paper, we proposed a stepwise KNN algorithm based on kernel methods and attribute reduction which can effectively tackle with the problems above. We calculated the accuracy rate of the proposed algorithm and compared it with basic KNN algorithm in the experiments with use of four UCI datasets. The experiment results show that the stepwise KNN algorithm (denoted by SWKNN) performs better than the original KNN algorithm with the improvement of average 13.8% in accuracy.