Skip to content
View donthula9908's full-sized avatar

Block or report donthula9908

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
donthula9908/README.md
Naveen Donthula — Data Engineer

LinkedInEmailGitHub

About

Data Engineer building enterprise data platforms across Azure, Databricks, Microsoft Fabric, AWS, and Snowflake. I own the full pipeline — ingestion, transformation, quality, monitoring, and delivery.

  • Delivered ~9x pipeline throughput improvement via a single SQL ordering change on a financial data pipeline
  • Built and maintain 80+ ADF pipelines across dev/staging/prod with ARM-based CI/CD
  • Designed row-level validation frameworks using PySpark exceptAll diffs for Databricks → Synapse migration
  • Built IcM automation and SOX control narratives for daily financial reconciliation

Certifications

CertificationIssuer
✅Azure Data Engineer Associate (DP-203)Microsoft
✅Fabric Analytics Engineer Associate (DP-600)Microsoft
✅Databricks Certified Data Engineer AssociateDatabricks
✅Databricks Certified Associate Developer for Apache SparkDatabricks
✅AWS Certified Data Engineer – Associate (DEA-C01)AWS
✅SnowPro Core CertificationSnowflake

Tech Stack

Cloud & Platforms

AzureDatabricksMicrosoft FabricAWSSnowflake

Data Engineering

ADFPySparkDelta LakedbtAirflowKafka

Languages & Tools

PythonSQLScalaAzure DevOpsDockerPower BI

Projects

ProjectStack
🏗️Azure End-to-End Data EngineeringADF · ADLS Gen2 · Databricks · Synapse
🔥Databricks Lakehouse PlatformPySpark · Delta Lake · DLT · Unity Catalog
🧵Microsoft Fabric AnalyticsFabric · OneLake · Dataflow Gen2 · Power BI
🎬Netflix Data Engineering PipelineAzure · Databricks · Airflow · Streaming
🌩️AWS Data Engineering PipelineGlue · Lambda · Kinesis · S3 · Redshift
❄️Snowflake & dbt AnalyticsSnowflake · dbt Core · Streams & Tasks
🌀Apache Airflow PipelinesAirflow · dbt · Databricks · Docker
🤖Azure AI for Data EngineeringAzure OpenAI · LangChain · RAG · GPT-4o
⚙️Azure DevOps CI/CDADF · Databricks Asset Bundles · dbt
🐍PySpark Interview PrepPySpark · Delta Lake · Performance Tuning
🗺️Data Engineer Roadmap 2025Azure · AWS · Databricks · Snowflake · dbt
🏅Tokyo Olympics — Azure PipelineADF · ADLS Gen2 · Databricks · Synapse · Power BI
🌊Live Streaming — NiFi + SnowpipeApache NiFi · Snowpipe · AWS S3 · Azure
🧠AI Pipeline Anomaly DetectionDatabricks · Isolation Forest · PySpark
📊Power BI Analytics DashboardsPower BI · DAX · Microsoft Fabric · DirectLake · Synapse
📈Tableau Data VisualizationsTableau · Snowflake · Redshift · LOD Expressions · Prep

GitHub Stats

Pinned Loading

  1. apache-airflow-data-pipelinesapache-airflow-data-pipelinesPublic

    Production Apache Airflow DAGs — incremental ingestion, dbt orchestration, Databricks job triggers, custom operators

    Python

  2. azure-ai-data-engineeringazure-ai-data-engineeringPublic

    AI patterns for Data Engineers — Azure OpenAI RAG over Unity Catalog, Text-to-SQL agent, LangChain + Azure AI Foundry

    Python

  3. azure-data-engineering-projectsazure-data-engineering-projectsPublic

    End-to-end Azure Data Engineering — ADF, ADLS Gen2, Databricks, Synapse Analytics, Medallion Architecture

    Python

  4. data-engineer-roadmapdata-engineer-roadmapPublic

    Practical Data Engineer Roadmap 2025 — Azure, Databricks, Fabric, AWS, Snowflake, dbt, Airflow, AI — built from 6+ years experience

  5. databricks-lakehouse-projectsdatabricks-lakehouse-projectsPublic

    Enterprise Databricks Lakehouse — PySpark, Delta Lake, Delta Live Tables, Unity Catalog, Structured Streaming

    Python

  6. netflix-data-engineering-pipelinenetflix-data-engineering-pipelinePublic

    End-to-end Netflix-style streaming analytics pipeline on Azure + Databricks — viewer sessions, content KPIs, churn signals

    Python