Click Here

Details



Hybrid Deep Learning Framework for Automated Weather Phenomena Recognition in Global Climate Reanalysis Data

Mushtaq Talib Ajjah, Mahdi Mazinani

10-40

Vol 24, Issue 1, Jul-Dec, 2026

Date of Submission: 2026-08-02 Date of Acceptance: 2026-09-01 Date of Publication: 2026-09-18

Abstract

Climate reanalysis data describe how large-scale climate features evolve in time and space. They can be used for training machine learning models to automatically identify specific weather features. Such models have to handle complex spatial structures, and temporal variability, as well as class imbalance and small numbers of representative data. This work proposes to use ViT in combination with TCN to recognize different weather phenomena in reanalysis data. The structures of the data used in the work are analyzed, and climatological features are removed. Finally, long range temporal sequences of the data are constructed, and the models are trained to impute missing observations. ViT is used to model spatial structures in the data, and TCN to model temporal structures.

References

  1. Eyring, V., et al. (2024). Pushing the frontiers in climate modelling and analysis with machine learning. Nature Climate Change, 14, 916–928. https://doi.org/10.1038/s41558-024-02095-y
  2. Molina, M. J., O’Brien, T. A., Anderson, G., Ashfaq, M., Bennett, K. E., Collins, W. D., Dagon, K., Restrepo, J. M., & Ullrich, P. A. (2023). A review of recent and emerging machine learning applications for climate variability and weather phenomena. Artificial Intelligence for the Earth Systems, 2(4), Article 220086. https://doi.org/10.1175/AIES-D-22-0086.1
  3. Soci, C., Hersbach, H., Simmons, A., Poli, P., Bell, B., Berrisford, P., et al. (2024). The ERA5 global reanalysis from 1940 to 2022. Quarterly Journal of the Royal Meteorological Society, 150(764), 4014–4048. https://doi.org/10.1002/qj.4803
  4. Gelaro, R., et al. (2017). The Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2). Journal of Climate, 30(14), 5419–5454. https://doi.org/10.1175/JCLI-D-16-0758.1
  5. Muszynski, G., Kashinath, K., Kurlin, V., Wehner, M., & Prabhat. (2019). Topological data analysis and machine learning for recognizing atmospheric river patterns in large climate datasets. Geoscientific Model Development, 12(2), 613–628. https://doi.org/10.5194/gmd-12-613-2019
  6. Prabhat, et al. (2021). ClimateNet: An expert-labeled open dataset and deep learning architecture for enabling high-precision analyses of extreme weather. Geoscientific Model Development, 14(1), 107–124. https://doi.org/10.5194/gmd-14-107-2021
  7. Higgins, T. B., Subramanian, A. C., Graubner, A., Kapp-Schwoerer, L., Watson, P. A. G., Sparrow, S., et al. (2023). Using deep learning for an analysis of atmospheric rivers in a high-resolution large ensemble climate data set. Journal of Advances in Modeling Earth Systems, 15(4), Article e2022MS003495. https://doi.org/10.1029/2022MS003495
  8. Kim, S., Graubner, A., Kapp-Schwoerer, L., Kashinath, K., & Schindler, K. (2025). A large-scale dataset for training deep learning segmentation and tracking of extreme weather. Scientific Data, 12, Article 1151. https://doi.org/10.1038/s41597-025-05480-0
  9. Dosovitskiy, A., et al. (2021). An image is worth 16×16 words: Transformers for image recognition at scale. In Proceedings of the International Conference on Learning Representations (ICLR).
  10. Bai, S., Kolter, J. Z., & Koltun, V. (2018). An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv. https://arxiv.org/abs/1803.01271
  11. Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020). A simple framework for contrastive learning of visual representations. In Proceedings of the 37th International Conference on Machine Learning (ICML) (Vol. 119, pp. 1597–1607).
  12. Muszynski, G., Kashinath, K., Kurlin, V., Wehner, M., & Prabhat. (2019). Topological data analysis and machine learning for recognizing atmospheric river patterns in large climate datasets. Geoscientific Model Development, 12(2), 613–628. https://doi.org/10.5194/gmd-12-613-2019
  13. Prabhat, et al. (2021). ClimateNet: An expert-labeled open dataset and deep learning architecture for enabling high-precision analyses of extreme weather. Geoscientific Model Development, 14(1), 107–124. https://doi.org/10.5194/gmd-14-107-2021
  14. Higgins, T. B., Subramanian, A. C., Graubner, A., Kapp-Schwoerer, L., Watson, P. A. G., Sparrow, S., et al. (2023). Using deep learning for an analysis of atmospheric rivers in a high-resolution large ensemble climate data set. Journal of Advances in Modeling Earth Systems, 15(4), Article e2022MS003495. https://doi.org/10.1029/2022MS003495
  15. Bi, K., Xie, L., Zhang, H., Chen, X., Gu, X., & Tian, Q. (2023). Accurate medium-range global weather forecasting with 3D neural networks. Nature, 619, 533–538. https://doi.org/10.1038/s41586-023-06185-3
  16. Chen, L., Zhong, X., Zhang, F., Cheng, Y., Xu, Y., Qi, Y., & Li, H. (2023). FuXi: A cascade machine learning forecasting system for 15-day global weather forecast. npj Climate and Atmospheric Science, 6, Article 190. https://doi.org/10.1038/s41612-023-00512-1
  17. Nguyen, T., Brandstetter, J., Kapoor, A., Gupta, J. K., & Grover, A. (2023). ClimaX: A foundation model for weather and climate. In Proceedings of the 40th International Conference on Machine Learning (ICML) (Vol. 202, pp. 25904–25938).
  18. Rasp, S., Hoyer, S., Merose, A., Langmore, I., Battaglia, P., Russell, T., et al. (2024). WeatherBench 2: A benchmark for the next generation of data-driven global weather models. Journal of Advances in Modeling Earth Systems, 16, Article e2023MS004019. https://doi.org/10.1029/2023MS004019
  19. Kim, S., Graubner, A., Kapp-Schwoerer, L., Kashinath, K., & Schindler, K. (2025). A large-scale dataset for training deep learning segmentation and tracking of extreme weather. Scientific Data, 12, Article 1151. https://doi.org/10.1038/s41597-025-05480-0
  20. Bodnar, C., Bruinsma, W. P., Lucic, A., Stanley, M., Allen, A., Brandstetter, J., et al. (2025). A foundation model for the Earth system. Nature, 641, 1180–1187. https://doi.org/10.1038/s41586-025-09005-y
  21. Camps-Valls, G., Fernández-Torres, M.-Á., Cohrs, K.-H., et al. (2025). Artificial intelligence for modeling and understanding extreme weather and climate events. Nature Communications, 16, Article 1919. https://doi.org/10.1038/s41467-025-56573-8
  22. Gahtan, J., Knapp, K. R., Schreck, C. J., III, Diamond, H. J., Kossin, J. P., & Kruk, M. C. (2024). International Best Track Archive for Climate Stewardship (IBTrACS) Project, Version 4r01 [Data set]. NOAA National Centers for Environmental Information. https://doi.org/10.25921/82ty-9e16
  23. Guan, B., & Waliser, D. E. (2024). A regionally refined quarter-degree global atmospheric rivers database based on ERA5. Scientific Data, 11, Article 440. https://doi.org/10.1038/s41597-024-03258-4
  24. Perkins, S. E., & Alexander, L. V. (2013). On the measurement of heat waves. Journal of Climate, 26(13), 4500–4517. https://doi.org/10.1175/JCLI-D-12-00383.1
  25. Rutz, J. J., et al. (2019). The Atmospheric River Tracking Method Intercomparison Project (ARTMIP): Quantifying uncertainties in atmospheric river climatology. Journal of Geophysical Research: Atmospheres. https://doi.org/10.1029/2019JD030936
Download PDF
Back

Disclaimer: Indexing of published papers is subject to the evaluation and acceptance criteria of the respective indexing agencies. While we strive to maintain high academic and editorial standards, International Journal of Innovations in Scientific Engineering does not guarantee the indexing of any published paper. Acceptance and inclusion in indexing databases are determined by the quality, originality, and relevance of the paper, and are at the sole discretion of the indexing bodies.

s