Intelligent Feature Engineering for Cybersecurity
- Resource Type
- Conference
- Authors
- Maxwell, Paul; Alhajjar, Elie; Bastian, Nathaniel D.
- Source
- 2019 IEEE International Conference on Big Data (Big Data) Big Data (Big Data), 2019 IEEE International Conference on. :5005-5011 Dec, 2019
- Subject
- Bioengineering
Communication, Networking and Broadcast Technologies
Computing and Processing
General Topics for Engineers
Geoscience
Signal Processing and Analysis
Transportation
Encoding
Feature extraction
Intrusion detection
Computer security
Machine learning
Telecommunication traffic
Browsers
artificial intelligence
machine learning
feature engineering
cybersecurity
- Language
Feature engineering and selection is a critical step in the implementation of any machine learning system. In application areas such as intrusion detection for cybersecurity, this task is made more complicated by the diverse data types and ranges presented in both raw data packets and derived data fields. Additionally, the time and context specific nature of the data requires domain expertise to properly engineer the features while minimizing any potential information loss. Many previous efforts in this area naively apply techniques for feature engineering that are successful in image recognition applications. In this work, we use network packet dataflows from the Defense Research and Engineering Network (DREN) and the Engineer Research and Development Center’s (ERDC) high performance computing systems to experimentally analyze various methods of feature engineering. The results of this research provide insight on the suitability of the features for machine learning based cybersecurity applications.