Selected Work

Azure Data Engineering Projects

Compare five hands-on case studies across Microsoft Fabric, Azure Data Factory and Azure Databricks, covering ingestion, transformation, lakehouse storage, validation and pipeline reliability.

Project Library

Filter by Azure Platform

Showing 5 projects

Microsoft Fabric

Lakehouse and Data Quality

Validation-First Lakehouse Ingestion with Microsoft Fabric

A Microsoft Fabric ingestion workflow that discovers incoming files, validates trusted office CSV files and loads approved records into a curated Lakehouse table while routing unsupported or schema-incompatible files to quarantine.

Microsoft FabricFabric Data FactoryFabric LakehouseFabric Notebook

Azure Data Factory + Azure Databricks

Metadata-Driven Quarterly Processing

Quarterly Policy Data Delivery and Lakehouse Processing Platform

A completed quarterly source-to-Raw platform combining metadata-driven ADF orchestration, Databricks validation, Delta Lake processing, Unity Catalog registration and protected watermark updates.

Azure Data FactoryAzure DatabricksPySparkDelta Lake

Azure Data Factory

Metadata-Driven Ingestion

Metadata-Driven Multi-Source Ingestion with Azure Data Factory

A configurable Azure Data Factory ingestion framework that reads source behaviour from metadata and processes SQL Server, HTTP or REST and file-based sources through reusable pipeline components.

Azure Data FactoryADLS Gen2SQL ServerHTTP / REST

Azure Databricks

PySpark and Data Quality

Retail Data Validation Pipeline with Azure Databricks

A retail data pipeline that ingests order and order-item data from Amazon S3, stages it in ADLS Gen2 and applies Databricks PySpark validation before loading approved records into Azure SQL Database.

Azure Data FactoryAzure DatabricksPySparkAmazon S3

Azure Data Factory

Mapping Data Flow and Conditional Routing

Movie Analytics Transformation Pipeline with Azure Data Factory

A parameterised Azure Data Factory pipeline that reads movie data from Azure Blob Storage, applies Mapping Data Flow transformations and routes validated outputs to Azure SQL Database or ADLS Gen2 according to release-year rules.

Azure Data FactoryMapping Data FlowAzure Blob StorageADLS Gen2

Next Step

Interested in My Azure Data Engineering Experience?

Review my experience and resume, or contact me regarding relevant Azure Data Engineering opportunities.