A Survey of The State-Of-The-Art AutoML Tools and Their Comparisons
Abstract views: 0 / PDF downloads: 0
Keywords:
Machine Learning, Automated Machine Learning, AutoML, Hyperparameter Optimization, Model SelectionAbstract
Machine learning is used effectively in many areas today and its usage area is increasing day
by day. In addition, processes based on machine learning are also developing in a technology-oriented
manner, and users are gaining new perspectives on solving current problems. While machine learning
makes predictions about stocks in the financial sector, it also plays an active role in early diagnosis of
diseases in the healthcare sector. It is actively used in route calculation and defective product detection in
the field of production and logistics, and in situations such as analysis of customer behavior and product
recommendations in the shopping sector. AutoML can be defined as a process that aims to automate the
machine learning process end-to-end. It enables the machine learning process to be accelerated by
automating especially time-consuming tasks that work with the logic of repetition, and it allows people
who work in this field to create more efficient and productive models. In addition, AutoML helps users
who are not experts in this field in the stages of machine learning model development, data management,
analysis and evaluation of their own data, by providing various conveniences to users in model training
and subsequent stages. In this article, after discussing what AutoML is, AutoML processes and areas of
use, information about various AutoML platforms have been given, the differences between widely used
AutoML platforms will be evaluated, and their advantages and disadvantages compared to each other will
be included.
Downloads
References
Vaccaro L., Sansonetti G., Micarelli A. An empirical
review of automated machine learning.
Zöller MA., Huber MF. Benchmark and survey of
automated machine learning frameworks. Journal of
Artificial Intelligence Research 2021; 70: 409-472.
Thornton C., Hutter F., Hoos HH., Leyton-Brown K.
Auto-weka: combined selection and hyperparameter
optimization of classification algorithms. Proceedings
of the 19th ACM SIGKDD International Conference on
Knowledge Discovery and Data Mining, pp. 847-855,
Guyon, I., Sun-Hosoya L., Boullé M., Escalante HJ.,
Escalera S., Liu Z., Jajetic D., Ray B., Saeed M., Sebag
M., Statnikov AR., Tu W-W., Viegas E. Analysis of the
automl challenge series 2015-2018. NeurIPS Workshop
Proceedings, pp. 177-219, 2019.
(2023) Slideshare website. [Online]. Available:
https://www.slideshare.net/AxeldeRomblay/automate
machine-learning-pipeline-using-mlbox
Özdemir Ş., Örslü S. Makine öğrenmesinde yeni bir
bakış açısı: otomatik makine öğrenmesi (automl).
Journal of Information Systems and Management
Research, 1 (1): 23-30, 2019.
Jesmeen M., Hossen J, Sayeed S., Ho C. A survey on
cleaning dirty data using machine learning paradigm for
big data analytics. Indonesian Journal of Electrical
Engineering and Computer Science, 10(3): 1234-1243,
Operskalski JT., Barbey AK. Risk literacy in medical
decision-making. Science, 352(6284): 413-414, 2016.
(2023) Matworks website. [Online]. Available:
https://www.mathworks.com/discovery/automl.html
Feurer M., Klein A., Eggensperger K., Springenberg J.,
Blum M., Hutter F. Efficient and robust automated
machine learning. Advances in neural information
processing systems, 28: 2962–2970, 2015.
Darren C. Practical machine learning with H2o:
powerful, scalable techniques for deep learning and ai.
O’Reilly Media, Inc. 2016.
LeDell E., Poirier S. H2o automl: scalable automatic
machine learning. 7th ICML Workshop on Automated
Machine Learning 2020.
Jin H., Song Q. Auto-keras: an efficient neural
architecture search system. Proceedings of the 25th
ACM SIGKDD International Conference on Knowledge
Discovery & Data Mining, pp. 1946–1956, 2019.
Jin H., Chollet F., Song Q., Hu X. Autokeras: an automl
library for deep learning. Journal of Machine Learning
Research, 24(6): 1-6, 2023.
Kotthoff L., Thornton C., Hutter F. User guide for auto
weka version 2.6. Dept. Comput. Sci., Univ. British
Columbia, BETA Lab, Vancouver, BC, Canada, Tech,
Rep 2: 1-15, 2017.
Kotthoff L., Thornton C., Hoos HH. Auto-weka 2.0:
automatic
model selection and hyperparameter
optimization in weka. Journal of Machine Learning
Research, 17: 1-5, 2016.
Pedregosa F., Varoquaux G., Gramfort A., Scikit-learn:
machine learning in python. Journal of Machine
Learning Research, 12: 2825-2830, 2011.
Feurer M., Eggensperger K., Falkner S., Lindauer M.,
Hutter F. Auto-sklearn 2.0: hands-free automl via meta
learning. The Journal of Machine Learning Research,
(1): 1-61, 2022.
Olson RS., Urbanowicz RJ., Andrews PC, Lavender
NA., Kidd LC., Moore JH., Automating biomedical data
science through tree-based pipeline optimization.
Applications of Evolutionary Computation: 19th
European Conference, EvoApplications, pp.123-137,
Koza JR., Poli R. Genetic programming. In: Burke,
E.K., Kendall, G. (eds) Search Methodologies. Springer,
Boston, MA, pp. 127-164, 2005.
Olson RS., Bartley N., Urbanowicz RJ., Moore JH.
Evaluation of a tree-based pipeline optimization tool for
automating data science. Proceedings of the Genetic and
Evolutionary Computation Conference, pp. 485–492,