Particle Swarm Optimization based hybrid Deep Learning approach: Evidence from Europe for Predicting Air Quality Index
DOI:
https://doi.org/10.53799/5gm39s77Keywords:
Air pollution, AQI, PSO+FNN+LR, PSO+FNN, wind rose, SHAPAbstract
Air pollution remains a worldwide concern, and traditional machine-learning models often struggle to capture the complex, nonlinear relationships between the Air Quality Index (AQI) and its influencing variables. This study proposes two Particle Swarm Optimization (PSO) - based hybrid deep-learning approaches for predicting AQI by incorporating the necessary variables. In the current study, one approach uses PSO, deep learning, and Linear Regression (LR) for feature selection, feature extraction, and AQI prediction, respectively, while the other employs PSO to optimize hyperparameters of deep learning. The study examines wind speed and direction using wind rose diagrams and evaluates the features' contributions using the Shapley Additive exPlanations (SHAP) analysis. Using the Wilcoxon signed-rank test, statistical validation shows that both approaches outperform existing methods at 34 monitoring locations. Specifically, the first approach is effective for 19 locations, with an average R² of 97.0%, while the second approach performs best for 33 locations, with an average R² of 98.17%. Our findings recommend implementing region-specific air quality policies across Europe. It will aid policymakers in designing targeted, effective, and data-driven interventions to improve public health and environmental resilience across Europe.
References
1. Pedregosa, Fabian, et al. “Scikit-Learn: Machine Learning in Python.” Journal of Machine Learning Research, vol. 12, 2011, pp. 2825–2830, https://jmlr.org/papers/v12/pedregosa11a.html.
2. Abadi, Martín, et al. “TensorFlow: A System for Large-Scale Machine Learning.” 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), 2016, pp. 265–283, https://doi.org/10.48550/arXiv.1605.08695.
3. Kennedy, James. “The Particle Swarm: Social Adaptation of Knowledge.” Proceedings of the IEEE International Conference on Evolutionary Computation (ICEC’97), IEEE, 1997, pp. 303–308, https://doi.org/10.1109/ICEC.1997.592326.
4. Udristioiu, Mihaela T., Youness El Mghouchi, and Hasan Yildizhan. “Prediction, Modelling, and Forecasting of PM and AQI Using Hybrid Machine Learning.” Journal of Cleaner Production, vol. 421, 2023, article 138496, https://doi.org/10.1016/j.jclepro.2023.138496.
5. Sarkar, Nairita, et al. “Air Quality Index Prediction Using an Effective Hybrid Deep Learning Model.” Environmental Pollution, vol. 315, 2022, article 120404, https://doi.org/10.1016/j.envpol.2022.120404.
6. Sarkar, Nairita, Pankaj Kumar Keserwani, and Mahesh Chandra Govil. “A Modified PSO Based Hybrid Deep Learning Approach to Predict AQI of Urban Metropolis.” Urban Climate, vol. 58, 2024, article 102212, https://doi.org/10.1016/j.uclim.2024.102212.
7. Liu, Xingpo, and Hongyuan Guo. “Air Quality Indicators and AQI Prediction Coupling Long-Short Term Memory (LSTM) and Sparrow Search Algorithm (SSA): A Case Study of Shanghai.” Atmospheric Pollution Research, vol. 13, no. 10, 2022, article 101551, https://doi.org/10.1016/j.apr.2022.101551.
8. Ravindiran, Gokulan, et al. “Impact of Air Pollutants on Climate Change and Prediction of Air Quality Index Using Machine Learning Models.” Environmental Research, vol. 239, 2023, article 117354, https://doi.org/10.1016/j.envres.2023.117354.
9. Maltare, Nilesh N., and Safvan Vahora. “Air Quality Index Prediction Using Machine Learning for Ahmedabad City.” Digital Chemical Engineering, vol. 7, 2023, article 100093, https://doi.org/10.1016/j.dche.2023.100093.
10. Castelli, Mauro, et al. “A Machine Learning Approach to Predict Air Quality in California.” Complexity, vol. 2020, no. 1, 2020, article 8049504, https://doi.org/10.1155/2020/8049504.
11. Mishra, Ankita, and Yogesh Gupta. “Comparative Analysis of Air Quality Index Prediction Using Deep Learning Algorithms.” Spatial Information Research, vol. 32, no. 1, 2024, pp. 63–72, https://doi.org/10.1007/s41324-023-00550-6.
12. Islam, Md Mazharul, Mowshumi Sharmin, and Faroque Ahmed. “Predicting Air Quality of Dhaka and Sylhet Divisions in Bangladesh: A Time Series Modeling Approach.” Air Quality, Atmosphere & Health, vol. 13, no. 5, 2020, pp. 607–615, https://doi.org/10.1007/s11869-020-00818-7.
13. Moscoso-López, Jose Antonio, et al. “Hourly Air Quality Index (AQI) Forecasting Using Machine Learning Methods.” International Workshop on Soft Computing Models in Industrial and Environmental Applications, 2020, pp. 123–132, https://doi.org/10.1007/978-3-030-57802-2_12.
14. Bozdağ, Aslı, Yeşim Dokuz, and Öznur Begüm Gökçek. “Spatial Prediction of PM10 Concentration Using Machine Learning Algorithms in Ankara, Turkey.” Environmental Pollution, vol. 263, 2020, article 114635, https://doi.org/10.1016/j.envpol.2020.114635.
15. Gladkova, Ekaterina, and Liliya Saychenko. “Applying Machine Learning Techniques in Air Quality Prediction.” Transportation Research Procedia, vol. 63, 2022, pp. 1999–2006, https://doi.org/10.1016/j.trpro.2022.06.230.
16. Chen, Shuixia, Jian-qiang Wang, and Hong-yu Zhang. “A Hybrid PSO-SVM Model Based on Clustering Algorithm for Short-Term Atmospheric Pollutant Concentration Forecasting.” Technological Forecasting and Social Change, vol. 146, 2019, pp. 41–54, https://doi.org/10.1016/j.techfore.2019.05.007.
17. Zhu, Xuguang, Feifei Zou, and Shanghai Li. “Enhancing Air Quality Prediction with an Adaptive PSO-Optimized CNN-Bi-LSTM Model.” Applied Sciences, vol. 14, no. 13, 2024, article 5787, https://doi.org/10.3390/app14135787.
18. Zippenfenig, Patrick. Open-Meteo.com Weather API. 2023, https://doi.org/10.5281/zenodo.7970649.
19. Antonescu, Bogdan, et al. “A 41-Year Bioclimatology of Thermal Stress in Europe.” International Journal of Climatology, vol. 41, no. 7, 2021, pp. 3934–3952, https://doi.org/10.1002/joc.7067.
20. Skalák, Petr, et al. “Projected Shift of Köppen–Geiger Zones in Central Europe: A First Insight into the Implications for Ecosystems and Society.” International Journal of Climatology, vol. 38, no. 9, 2018, pp. 3595–3606, https://doi.org/10.1002/joc.5526.
21. Marini, Federico, and Beata Walczak. “Particle Swarm Optimization (PSO): A Tutorial.” Chemometrics and Intelligent Laboratory Systems, vol. 149, 2015, pp. 153–165, https://doi.org/10.1016/j.chemolab.2015.08.020.
22. Bebis, George, and Michael Georgiopoulos. “Feed-Forward Neural Networks.” IEEE Potentials, vol. 13, no. 4, 1994, pp. 27–31, https://doi.org/10.1109/45.329294.
23. Su, Xiaogang, Xin Yan, and Chih-Ling Tsai. “Linear Regression.” Wiley Interdisciplinary Reviews: Computational Statistics, vol. 4, no. 3, 2012, pp. 275–294, https://doi.org/10.1002/wics.1198.
24. Kelly, Frank J., and Julia C. Fussell. “Air Pollution and Public Health: Emerging Hazards and Improved Understanding of Risk.” Environmental Geochemistry and Health, vol. 37, 2015, pp. 631–649, https://doi.org/10.1007/s10653-015-9720-1.
25. Im, Ulas, et al. “Assessment and Economic Valuation of Air Pollution Impacts on Human Health over Europe and the United States as Calculated by a Multi-Model Ensemble in the Framework of AQMEII3.” Atmospheric Chemistry and Physics, vol. 18, no. 8, 2018, pp. 5967–5989, https://doi.org/10.5194/acp-18-5967-2018.
26. Lelieveld, Jos, et al. “Cardiovascular Disease Burden from Ambient Air Pollution in Europe Reassessed Using Novel Hazard Ratio Functions.” European Heart Journal, vol. 40, no. 20, 2019, pp. 1590–1596, https://doi.org/10.1093/eurheartj/ehz135.
27. European Environment Agency. “Air Pollution: How It Affects Our Health.” European Environment Agency, 2024, https://www.eea.europa.eu/en/topics/in-depth/air-pollution/how-it-affects-our-health. Accessed 23 Mar. 2025.
28. European Environment Agency. Harm to Human Health from Air Pollution. European Environment Agency, 2023, https://www.eea.europa.eu/publications/harm-to-human-health-from-air-pollution. Accessed 23 Mar. 2025.
29. European Environment Agency. Air Pollution and Children’s Health. European Environment Agency, 2023, https://www.eea.europa.eu/publications/air-pollution-and-childrens-health. Accessed 23 Mar. 2025.
30. European Environment Agency. Harm to Human Health from Air Pollution — 2024 Update. European Environment Agency, 2024, https://www.eea.europa.eu/en/analysis/publications/harm-to-human-health-from-air-pollution-2024. Accessed 23 Mar. 2025.
31. Gupta, N. Srinivasa, et al. “Prediction of Air Quality Index Using Machine Learning Techniques: A Comparative Analysis.” Journal of Environmental and Public Health, vol. 2023, 2023, article 4916267, https://doi.org/10.1155/2023/4916267.
32. Ahmed, Shams Forruque, et al. “Deep Learning Modelling Techniques: Current Progress, Applications, Advantages, and Challenges.” Artificial Intelligence Review, vol. 56, no. 11, 2023, pp. 13521–13617, https://doi.org/10.1007/s10462-023-10514-1.
33. Wang, Junshan, and Guojie Song. “A Deep Spatial-Temporal Ensemble Model for Air Quality Prediction.” Neurocomputing, vol. 314, 2018, pp. 198–206, https://doi.org/10.1016/j.neucom.2018.06.049.
34. Zheng, Yu, Furui Liu, and Hsun-Ping Hsieh. “U-Air: When Urban Air Quality Inference Meets Big Data.” Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2013, pp. 1436–1444, https://doi.org/10.1145/2487575.2488188.
35. Bai, Lu, et al. “Air Pollution Forecasts: An Overview.” International Journal of Environmental Research and Public Health, vol. 15, no. 4, 2018, article 780, https://doi.org/10.3390/ijerph15040780.
36. Chang, Yue-Shan, et al. “An Ensemble Learning Based Hybrid Model and Framework for Air Pollution Forecasting.” Environmental Science and Pollution Research, vol. 27, no. 30, 2020, pp. 38155–38168, https://doi.org/10.1007/s11356-020-09855-1.
37. Xu, Wenquan, et al. “A Hybrid Modelling Method for Time Series Forecasting Based on a Linear Regression Model and Deep Learning.” Applied Intelligence, vol. 49, 2019, pp. 3002–3015, https://doi.org/10.1007/s10489-019-01426-3.
38. Méndez, Manuel, Mercedes G. Merayo, and Manuel Núñez. “Machine Learning Algorithms to Forecast Air Quality: A Survey.” Artificial Intelligence Review, vol. 56, no. 9, 2023, pp. 10031–10066, https://doi.org/10.1007/s10462-023-10424-4.
39. McKinney, Wes. Python for Data Analysis: Data Wrangling with Pandas, NumPy, and IPython. O’Reilly Media, 2012, https://wesmckinney.com/book/.
40. Wong, Tzu-Tsung, and Po-Yang Yeh. “Reliable Accuracy Estimates from K-Fold Cross Validation.” IEEE Transactions on Knowledge and Data Engineering, vol. 32, no. 8, 2020, pp. 1586–1594, https://doi.org/10.1109/TKDE.2019.2912815.
41. Yang, Feifei, et al. “Enhancing Weather-Related Power Outage Prediction by Event Severity Classification.” IEEE Access, vol. 8, 2020, pp. 60029–60042, https://doi.org/10.1109/ACCESS.2020.2983159.
42. Arteaga-López, Ernesto, and César Angeles-Camacho. “Innovative Virtual Computational Domain Based on Wind Rose Diagrams for Micrositing Small Wind Turbines.” Energy, vol. 220, 2021, article 119701, https://doi.org/10.1016/j.energy.2020.119701.
43. Mangalathu, Sujith, Seong-Hoon Hwang, and Jong-Su Jeon. “Failure Mode and Effects Analysis of RC Members Based on Machine-Learning-Based SHapley Additive exPlanations (SHAP) Approach.” Engineering Structures, vol. 219, 2020, article 110927, https://doi.org/10.1016/j.engstruct.2020.110927.
44. Dara, Suresh, and Priyanka Tumma. “Feature Extraction by Using Deep Learning: A Survey.” 2018 Second International Conference on Electronics, Communication and Aerospace Technology (ICECA), 2018, pp. 1795–1801, https://doi.org/10.1109/ICECA.2018.8474912.
45. Shaheen, Fatma, Brijesh Verma, and Md Asafuddoula. “Impact of Automatic Feature Extraction in Deep Learning Architecture.” 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA), 2016, pp. 1–8, https://doi.org/10.1109/DICTA.2016.7797053.
46. Qolomany, Basheer, et al. “Parameters Optimization of Deep Learning Models Using Particle Swarm Optimization.” 2017 13th International Wireless Communications and Mobile Computing Conference (IWCMC), 2017, pp. 1285–1290, https://doi.org/10.1109/IWCMC.2017.7986470.
47. Xiao, Taijia, et al. “Based on Grid-Search and PSO Parameter Optimization for Support Vector Machine.” Proceedings of the 11th World Congress on Intelligent Control and Automation, 2014, pp. 1529–1533, https://doi.org/10.1109/WCICA.2014.7052946.
48. Zhang, Yudong, Shuihua Wang, and Genlin Ji. “A Comprehensive Survey on Particle Swarm Optimization Algorithm and Its Applications.” Mathematical Problems in Engineering, vol. 2015, 2015, article 931256, https://doi.org/10.1155/2015/931256.
49. Bao, Wei, Jun Yue, and Yulei Rao. “A Deep Learning Framework for Financial Time Series Using Stacked Autoencoders and Long-Short Term Memory.” PLOS ONE, vol. 12, no. 7, 2017, article e0180944, https://doi.org/10.1371/journal.pone.0180944.
50. Yildirim, Özal. “A Novel Wavelet Sequence Based on Deep Bidirectional LSTM Network Model for ECG Signal Classification.” Computers in Biology and Medicine, vol. 96, 2018, pp. 189–202, https://doi.org/10.1016/j.compbiomed.2018.03.016.
51. Dong, Bing, et al. “A Hybrid Model Approach for Forecasting Future Residential Electricity Consumption.” Energy and Buildings, vol. 117, 2016, pp. 341–351, https://doi.org/10.1016/j.enbuild.2015.09.033.
52. Johnson, Daniel Patrick, et al. “A Novel Hybrid Approach: Integrating Bayesian SPDE and Deep Learning for Enhanced Spatiotemporal Modeling of PM2.5 Concentrations in Urban Airsheds for Sustainable Climate Action and Public Health.” Sustainability, vol. 16, no. 23, 2024, article 10206, https://doi.org/10.3390/su162310206.
53. Woolson, Robert F. “Wilcoxon Signed-Rank Test.” Encyclopedia of Biostatistics, Wiley, 2005, https://doi.org/10.1002/0470011815.b2a15177.
54. Liu, Yong, and Shizhong Liao. “Preventing Over-Fitting of Cross-Validation with Kernel Stability.” Machine Learning and Knowledge Discovery in Databases, Springer, 2014, pp. 290–305, https://doi.org/10.1007/978-3-662-44851-9_19.
55. Wolf, Kathrin, et al. “Long-Term Exposure to Low-Level Ambient Air Pollution and Incidence of Stroke and Coronary Heart Disease: A Pooled Analysis of Six European Cohorts within the ELAPSE Project.” The Lancet Planetary Health, vol. 5, no. 9, 2021, pp. e620–e632.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 AIUB Journal of Science and Engineering
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
AJSE contents are under the terms of the Creative Commons Attribution License. This permits anyone to copy, distribute, transmit and adapt the work non-commercially provided the original work and source is appropriately cited.
