jumponthemoon/WeatherEdit

🌦️ WeatherEdit: Controllable Weather Editing with 4D Gaussian Field

Chenghao Qian^1,*, Wenjing Li^1,†, Yuhu Guo², Gustav Markkula¹

A Controllable, Scalable and Efficient Framework for Realistic Weather Editing.

---

• 🎨 Flexible control over weather types (snow, fog, rain)
• 🌡️ Precise weather severity adjustment (light, moderate, heavy)
• 🖼️ Global consistency for multi-view driving scenes (temporal, spatial)

---

💡 The Quickiest Start

You can use our provided pretrained model for the easiest start. If you would like to try the whole pipeline, please go to the subfolder for training instructions

A. General Weather (General Scene/)

Please first configure the environment with conda:

git clone https://github.com/Jumponthemoon/WeatherEdit.git
cd General_Scene
conda env create --file environment.yml
conda activate gaussian_splatting

We provide a complete pipeline to train and render Gaussian scenes with integrated weather effects.

1. Train Your Scene

Download the Dataset Pt.1 from Mip-NeRF 360 and put the garden under data folder, then run:

python train.py -s path/to/data/

After training, the model will be saved under output folder

2. Render with Weather Effects

python render.py -m path/to/model --weather snow --fps 10

🔥 Plug into your GS-based code? 👉 Check it out here

---

B. Driving Scene Editing (Driving_Scene/)

Please first clone the repo and configure the environment with conda:

git clone https://github.com/Jumponthemoon/WeatherEdit.git
cd Driving_Scene

conda create -n weatheredit python=3.9 -y
conda activate weatheredit

pip install -r requirements.txt
pip install git+https://github.com/nerfstudio-project/[email protected]
pip install git+https://github.com/facebookresearch/pytorch3d.git
pip install git+https://github.com/NVlabs/nvdiffrast

cd third_party/smplx/
pip install -e .
cd ../..

• Note： if you encounter error ImportError: cannot import name 'cached_download' from 'huggingface_hub', please follow this instruction.

1. Download sample dataset & pretrained model

cd particle_construction

Download sample dataset and pretrained model, then place them in the data and the output directory separately.

2. Render with Weather Effects

Run the script to generate rainy weather in pandaset:

export PYTHONPATH=$(pwd)
python tools/gen_particle.py --resume_from ./output/pandaset/44/checkpoint_final.pth --weather rainy

The rendered video will be saved under ./output/pandaset/44/video_eval folder

⭐ If you like our work or find it useful, please give us a star or cite below. Thanks!

---

📌 Citation

@article{qian2025wedit,
      title={WeatherEdit: Controllable Weather Editing with 4D Gaussian Field}, 
      author={Chenghao Qian and Wenjing Li and Yuhu Guo and Gustav Markkula},
      year={2025},
      eprint={2505.20471},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2505.20471},}  

---

📬 Contact

For questions, suggestions, or collaborations:

• 📧 [email protected]

---

Thanks for your interest in WeatherEdit! We hope it helps bring new life to your 3D scenes 🌧️🌨️🌫️