A 20-year climatology of rainfall events in Germany

After downloading the German radar data set, preprocessing and applying a rain cell tracking to it, it is now finally time to have a look at the created rain event data set. Since the output of the rain cell tracking is quite elaborate, we will boil it down to a neat data base of the characteristics of rain events that I am interested in. We can then have a first look at some statistics. Follow me on this path.

This post is part of the germanRADARanalysis project.

Continue reading “A 20-year climatology of rainfall events in Germany”

Apply rain cell tracking to 20 years of rain radar data over Germany

So, I downloaded the 20-year radar data set (Mar to Nov) from the German meteorological service (DWD). It contains about 1.5 million individual radar-derived precipitation fields – one every 5 minutes. And, I was very excited to run a rain cell tracking on it. After handing in my PhD thesis, I was going for a short trip to visit family and friends in Germany. Fortunately, I have a home server and I decided to let it do the heavy work while I am on holidays. It took the full ten days of my absence plus two extra days for the 8-core Intel CPU machine to process all data. So, let’s see how I did it.

This post is part of the germanRADARanalysis project.

Continue reading “Apply rain cell tracking to 20 years of rain radar data over Germany”

Download German rain radar data and convert it to NetCDF (or what they should provide in the first place)

For a private project, I wanted to have a look at the German radar archive. I found that they have quasi-calibrated 5-minute precipitation data on a 1km2 grid available in the public domain. So, let’s download and process the data set, so that it is easier to use for further data analysis.

This post is part of the germanRADARanalysis project. All code is available on GitHub.

Continue reading “Download German rain radar data and convert it to NetCDF (or what they should provide in the first place)”

How to process many gridded climate data files in parallel with find, xargs and cdo

Climate data often comes in the format of NetCDF and most of the time we have to deal with a large number of files. For instance, when they are split into one file per year. So, what can we do if we want to process all files in the same way?

Luckily, there are tools to accomplish this task easily and even improve the performance by parallel execution. Here, I will show you a simple way to do this. In this example, I will download a small part of a global climate data set and extract a region from it. It’s just a one-liner.

Continue reading “How to process many gridded climate data files in parallel with find, xargs and cdo”