covid19-eu-zh/covid19-eu-data is an automated COVID-19 confirmed cases data collection experiment using GitHub Actions.
The covid19-eu-zh/covid19-eu-data repository is an experiment of data scraping and aggregation using GitHub Actions.
covid19-eu-zh is a dynamic and energetic team. Please consider follow their telegram channel for COVID-19 in Europe in Chinese.
The dataset is being updated regularly.1
The following is a table showing the update status and data sources.
A Demo: Confirmed Cases in Germany
The data can be directly loaded into your applications. Here is a simple demo using the data file for Germany. Please refer to
/flora/covid19_eu_data/ (link to the dataset) for the data files of all available countries.
The structure of the project is as follows.
. ├── README.md ├── dataset #where the data files lives ├── documents #where the raw data and files lives ├── now.json #zeit now setup for a FAAS service ├── scripts #scripts to download and aggregate data └── .dataherb #where the metadata lives
We have a python script for each country for more flexible schedules of each country. We are using classes from
utils.py so that the scripts have similar structures.
scripts ├── download_at.py ├── ... ├── requirements.txt └── utils.py
The dataset folder contains the full dataset of each country and the daily pdates of each country.
dataset ├── covid-19-at.csv ├── ... └── daily ├── at ├── ...
We manage the pipelines using GitHub Actions. The full set of workflows is found in the original repository.
We use Germany as an example. In the workflow for Germany, we have two triggers, pushing to master branch and schedule. The job steps are
- Checkout the repository;
- Setup python and install python requirements;
- Run the python script to download and aggregate data;
- Push data to repository.
And Much More
We run a Telegram Channel (in Chinese): 新冠肺炎欧洲中文臺
If you would like to help or track the progress of this project, check out our roadmap.