loading page

Improving machine learning-based weather forecast post-processing with clustering and transfer learning
  • +5
  • Xiaomeng Huang,
  • Yuwen Chen,
  • Yi Li,
  • Yue Chen,
  • Chi Yan Tsui,
  • Xing Huang,
  • Mingqing Wang,
  • Jonathon S Wright
Xiaomeng Huang
Tsinghua University

Corresponding Author:[email protected]

Author Profile
Yuwen Chen
Ministry of Education Key Laboratory for Earth System Modeling, Department of Earth System Science, Tsinghua University, Beijing 100084, China
Author Profile
Yi Li
Tsinghua University
Author Profile
Yue Chen
Ministry of Education Key Laboratory for Earth System Modeling, Department of Earth System Science, Tsinghua University, Beijing 100084, China
Author Profile
Chi Yan Tsui
Tsinghua University
Author Profile
Xing Huang
Tsinghua University
Author Profile
Mingqing Wang
Tsinghua University
Author Profile
Jonathon S Wright
Tsinghua University
Author Profile

Abstract

Machine learning has been widely applied in numerical weather prediction, but the incorporation of new observational sites into models trained on stations with long historical records remains a challenge. Here we propose a post-processing framework consisting of three machine learning methods: station clustering with K-means, temperature prediction based on decision trees, and transfer learning for newly-built stations. We apply this framework to post-processing forecasts of surface air temperature at 301 weather stations in China. The results show significant reductions (as much as 39.4%~20.0%) in the root-mean-square error of operational forecasts at lead times as long as 7 days. Moreover, the use of transfer learning to incorporate new stations improves forecasts at the new site by 36.4% after only one year of data collection. These results demonstrate the potential for clustering and transfer learning to boost existing applications of machine learning techniques in weather forecasting.