ETL pipeline to extract real-time weather data from Open-Meteo API, transform it with Python & Pandas, and load it using Apache Airflow and Docker.
-
Updated
Jul 13, 2025 - Python
#
cloud-etl
Here are 4 public repositories matching this topic...
Cloud-based PySpark ETL pipeline for analyzing search keyword revenue using AWS Glue, S3, and Terraform
etlanalyticsterraformweb-analyticssearch-analyticspysparkdata-engineeringdata-pipelineamazon-s3aws-gluerevenue-analyticscloud-etl
-
Updated
Jun 2, 2026 - Python
GitOps-driven Azure Data Factory pipeline that ingests multi-source data (GitHub + ADLS) into ADLS Bronze using dynamic, parameterized ETL workflows.
data-lakedata-pipelinesdata-ingestionazure-data-factoryportfolio-projectgitopsdynamic-pipelinesadf-pipelineazure-data-engineeringbronze-layerazure-projectadls-gen2cloud-etlgithub-ingestionsource-to-bronzelanding-to-bronze
-
Updated
Nov 19, 2025
This project demonstrates an end-to-end data pipeline built on cloud technologies, following the Medallion Architecture (Bronze–Silver–Gold). . Ingests raw data from cloud sources, processes via ETL/ELT in Databricks & DBT, orchestrated with Data Factory, and delivers clean, analytics-ready datasets stored in a scalable data lake.
azure-data-factoryazure-databricksdata-automationscalable-architectureelt-pipelineazure-data-lake-gen2cloud-etl
-
Updated
Sep 28, 2025 - Jupyter Notebook
Add this topic to your repo
To associate your repository with the cloud-etl topic, visit your repo's landing page and select "manage topics."