Improving the Efficiency of Meta AutoML via Rule-Based Training Strategies
- Resource Type
- Conference
- Authors
- Zender, Alexander; Humm, Bernhard G.; Pachmann, Tim
- Source
- 2023 18th Conference on Computer Science and Intelligence Systems (FedCSIS) Computer Science and Intelligence Systems (FedCSIS), 2023 18th Conference on. :235-246 Sep, 2023
- Subject
- Communication, Networking and Broadcast Technologies
Computing and Processing
Robotics and Control Systems
Signal Processing and Analysis
Training
Surveys
Computer science
Adaptation models
Computational modeling
Machine learning
Computer architecture
- Language
Meta Automated Machine Learning (Meta AutoML) platforms support data scientists and domain experts by automating the ML model search. A Meta AutoML platform utilizes multiple AutoML solutions searching in parallel for their best ML model. Using multiple AutoML solutions requires a substantial amount of energy. While AutoML solutions utilize different training strategies to optimize their energy efficiency and ML model effectiveness, no research has yet addressed optimizing the Meta AutoML process. This paper presents a survey of 14 AutoML training strategies that can be applied to Meta AutoML. The survey categorizes these strategies by their broader goal, their advantage and Meta AutoML adaptability. This paper also introduces the concept of rule-based training strategies and a proof-of-concept implementation in the Meta AutoML platform OMA-ML. This concept is based on the blackboard architecture and uses a rule-based reasoner system to apply training strategies. Applying the training strategy “top-3” can save up to 70% of energy, while maintaining a similar ML model performance.