Keywords
gradient boosting
frost period
frost prediction
time series
How to Cite
Abstract
we studied the performance of ensemble machine learning methods for predicting the end of the frost period. We provided a brief overview of the considered ensemble approaches and investigated how different hyperparameter settings and input data configurations affect model training. We applied several tools, including gradient boosting methods (XGBoost, LightGBM, and CatBoost), random forest (scikit-learn), and logistic regression (scikit-learn), compared the resulting models, and assessed their predictive quality. The results show differences in performance across methods and highlight the impact of hyperparameter tuning and input data selection on prediction accuracy.
References
Солозобов В. А., Лысенкова С. А. Методика оценки и выбора оптимальной модели, прогнозирующей окончание периода заморозков. Успехи кибернетики. 2025;6(2):100–107. EDN: WKIVRC.
Архив метеоданных. Режим доступа: https://rp5.ru/.
Рубан А. А., Белогубова А. А. Прогнозирование выручки предприятий общественного питания с использованием прогноза погоды. Финансовый вестник. 2025;1:20–25. EDN: VFGNRG.
Rokach L. Ensemble-Based Classifiers. Artificial Intelligence Review. 2010;33(1):1–39. DOI: 10.1007/s10462-009-9124-7.
Yang Y., Lv H., Chen N. A Survey on Ensemble Learning under the Era of Deep Learning. Artificial Intelligence Review. 2023;56:5545–5589. DOI: 10.1007/s10462-022-10283-5.
Schonlau M., Zou R. Y. The Random Forest Algorithm for Statistical Learning. The Stata Journal. 2020;20(1):3–29. DOI: 10.1177/1536867X20909688.
Biau G., Scornet E. A Random Forest Guided Tour. Test. 2016;25(2):197–227. DOI: 10.1007/s11749-016-0481-7.
Salman H. A., Kalakech A., Steiti A. Random Forest Algorithm Overview. Babylonian Journal of Machine Learning. 2024;2024:69–79. DOI: 10.58496/BJML/2024/007.
Natekin A., Knoll A. Gradient Boosting Machines, a Tutorial. Frontiers in Neurorobotics. 2013;7:21. DOI: 10.3389/fnbot.2013.00021.
Bentéjac C., Csörgő A., Martínez-Muñoz G. A Comparative Analysis of Gradient Boosting Algorithms. Artificial Intelligence Review. 2021;54(3):1937–1967. DOI: 10.1007/s10462-020-09896-5.
Chen T., Guestrin C. Xgboost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIKGDD International Conference on Knowledge Discovery and Data Mining. 2016:785–794. DOI: 10.1145/2939672.2939785.
Ke G. et al. LightGBM: A Highly Efficient Gradient Boosting Decision Tree. Advances in Neural Information Processing Systems. 2017:30.
Zhang Y., Liu J., Shen W. A Review of Ensemble Learning Algorithms Used in Remote Sensing Applications. Applied Sciences. 2022;12(17):8654. DOI: 10.3390/app12178654.
Prokhorenkova L. et al. CatBoost: Unbiased Boosting with Categorical Features. Advances in Neural Information Processing Systems. 2018:31.
Hancock J. T., Khoshgoftaar T. M. CatBoost for Big Data: an Interdisciplinary Review. J Big Data. 2020;7:94. DOI: 10.1186/s40537-020-00369-8.
Jiang J. et al. Boosting Tree-Assisted Multitask Deep Learning for Small Scientific Satasets. Journal of Chemical Information and Modeling. 2020;60(3):1235–1244. DOI: 10.1021/acs.jcim.9b01184.