SynWeather: Weather Observation Data Synthesis across Multiple Regions and Variables via a General Diffusion Transformer

* Equal contribution Corresponding author
1 University of Science and Technology of China   2 Shanghai AI Laboratory   3 Shanghai Jiao Tong University  
4 Tongji University  5 Nanjing University   6 The Chinese University of Hong Kong  

📰 News & Updates

  • 🚀

    Nov 8, 2025

    Accepted by AAAI-26 Oral 🎉

Abstract

With the advancement of meteorological instruments, increasingly abundant data has become available. However, due to intrinsic limitations such as environmental sensitivity and orbital constraints, raw observations often contain temporal or spatial gaps, making it essential to employ data synthesis techniques to fill in missing information. Existing approaches typically focus on single-variable or single-region tasks and primarily rely on deterministic modeling. This limits unified synthesis across variables and regions, overlooks cross-variable complementarity, and often leads to over-smoothed results. To address these challenges, we introduce SynWeather, the first dataset designed for Unified Multi-region and Multi-variable Weather Observation Data Synthesis. SynWeather covers four representative regions—the Continental United States, Europe, East Asia, and Tropical Cyclone areas—and provides high-resolution observations of key weather variables, including Composite Radar Reflectivity, Hourly Precipitation, Visible Light, and Microwave Brightness Temperature. In addition, we present SynWeatherDiff, a general and probabilistic weather synthesis model built upon the Diffusion Transformer framework to mitigate the over-smoothing issue. Experiments on the SynWeather dataset demonstrate that our model outperforms both task-specific and general baselines. Moreover, SynWeatherDiff produces fine-grained and accurate estimates, especially in high-value weather regions. Through this dataset and baseline model, we aim to advance downstream meteorological tasks and promote the development of general models for weather variable synthesis.

Overview of datasets and pipelines in weather variable synthesis

Teaser.

Overview of datasets and pipelines in weather variable synthesis. Compared to existing single-region, single-variable and deterministic modeling, SynWeather enables general multi-region, multi-variable probabilistic modeling.

Overview of SynWeather

Teaser.

Overview of SynWeather. SynWeather is a comprehensive dataset that covers four distinct regions and four key weather observation variables, integrating data from six satellite sources as a condition to support seven synthesis tasks. Extensive evaluations are conducted on seven models, comprising both task-specific and general synthesis models.

SynWeather Dataset Details

Region Input Target Sample
Numbers
Year
Satellite Band Spatial Res. (km) Variable Source Spatial Res. (km)
CONUS GOES-16 C07–16 2 CR GREMLIN CONUS3 Dataset 3 142k 2020–2022
Precipitation MRMS 1 20k
Europe Meteosat-11 IR_016–134
WV_062–073
3 Visible light Meteosat-11 3 372k 2019–2021
Precipitation EURADCLIM 1 25k
East Asia Himawari-8 C07–16 2 Visible light Himawari-8 2 503k 2019–2021
Precipitation GPM 10 15k 2021.7
TC Region GOES-16/17/18 C07–16 2 MWBT AMSR-2 / GMI 7×12, 3×5
8.6×14, 4.4×7.2
9k 2015–2023
Himawari-8/9 C07–16

SynWeatherDiff

An overview of our SynWeatherDiff. The target variables are projected into a unified latent space using a general autoencoder. The satellite inputs are processed through a ViT-based encoder to extract features. A task-specific text prompt is encoded using a fine-tuned CLIP text encoder. The text tokens serve as conditional information to guide Text-Guided DiT for different weather synthesis tasks. granularity.

Main Results

Teaser.

Visual results of the weather synthesis standard tasks by our SynWeatherDiff and other models.

CR Synthesis & Precipitation Synthesis Results

Task name CR Synthesis Precipitation Synthesis
CONUS CONUS Europe
RMSE↓ CSI/25↑ CSI/35↑ CSI/40↑ RMSE↓ CSI/2↑ CSI/5↑ CSI/15↑ RMSE↓ CSI/2↑ CSI/5↑
SRViT# 3.5610.2770.1200.069 ---- ---
Deep-STEP# ---- 0.9160.2620.1110.007 0.4150.0830.016
TomoPE# ---- 0.9860.2470.1490.036 0.4130.0600.009
UNet# 3.3950.2990.0690.023 0.9760.2310.1660.059 0.6410.0350.016
ViT# 3.4870.3090.1410.089 0.9810.2500.1570.038 0.4970.0830.044
WeatherGFM 3.1240.3660.1660.086 1.0490.2880.1980.090 0.7140.0180.013
SynWeatherDiff 2.8200.3820.1580.101 0.9760.3120.2230.113 0.5690.0840.079

Visible Light & Microwave Brightness Temperature Synthesis Results

Task name Visible Light Synthesis MWBT Synthesis
East Asia Europe Tropical Cyclone Region
SSIM↑PSNR↑CSI/50↑ SSIM↑PSNR↑CSI/50↑ RMSE↓SSIM↑PSNR↑LPIPS↓CSI/300↑
ViT# 0.87020.870.672 0.86024.030.496 4.7680.78321.560.3240.792
UNet# 0.91721.670.711 0.87824.820.556 5.8030.81620.60.3290.741
WeatherGFM 0.82218.430.465 0.83622.260.396 4.9790.82821.860.3250.777
SynWeatherDiff 0.86819.790.690 0.86423.650.508 4.4560.83722.330.2540.795