To simulate a real internal company tool where recurring data collection is automated. The focus was reliability — even if the API returns missing or inconsistent data, the pipeline continues without ...
An end-to-end ETL pipeline that extracts COVID-19 data from Our World in Data, transforms it using Pandas, and loads structured data into MySQL using an incremental loading strategy.