onelake

Automated Delta table maintenance for Microsoft Fabric Lakehouses: OPTIMIZE, V-Order, VACUUM, and conditional repartitioning across every table, with SKU-aware guardrails and a Delta log table for run history.

This repository contains a set of three projects that showcase modern data engineering, reporting, and governance capabilities using Microsoft Fabric. The work is structured to represent the responsibilities of a Senior / Lead Analytics Engineer within a large energy company operating at scale.

Production-style Microsoft Fabric + Power BI adoption platform for a synthetic UK healthcare enterprise, covering OneLake, Lakehouse, Warehouse, semantic models, Real-Time Intelligence, governance, security, CI/CD, observability and phased modernisation.

Production-pattern healthcare data lakehouse: a Bronze→Silver→Gold medallion over Synthea Coherent FHIR, built twice — Polars + delta-rs locally and Spark + Delta on Microsoft Fabric — orchestrated with Dagster, emitting one versioned, test-gated Gold data contract.

MLB play-by-play data pipeline: Azure → Microsoft Fabric migration with incremental ingestion (88% storage savings)

MCP server for Microsoft Fabric: workspaces, lakehouses, warehouses, table schemas, guarded read-only SQL, notebook jobs, and DAX

Agent Skills for Microsoft Fabric - connect, load and model, with rules measured against a live environment

Enterprise AI Data Engineering platform built primarily with Microsoft Fabric.

Advanced analytics portal for Microsoft Fabric - Semantic model exploration, anomaly detection, and operational monitoring powered by Streamlit