01
Microsoft Fabric
Lakehouse and Data Quality
Validation-First Lakehouse Ingestion with Microsoft Fabric
A Microsoft Fabric ingestion workflow that discovers incoming files, validates trusted office CSV files and loads approved records into a curated Lakehouse table while routing unsupported or schema-incompatible files to quarantine.
Microsoft FabricFabric Data FactoryFabric LakehouseFabric Notebook
02
Azure Data Factory + Azure Databricks
Metadata-Driven Quarterly Processing
Quarterly Policy Data Delivery and Lakehouse Processing Platform
A completed quarterly source-to-Raw platform combining metadata-driven ADF orchestration, Databricks validation, Delta Lake processing, Unity Catalog registration and protected watermark updates.
Azure Data FactoryAzure DatabricksPySparkDelta Lake
03
Azure Data Factory
Metadata-Driven Ingestion
Metadata-Driven Multi-Source Ingestion with Azure Data Factory
A configurable Azure Data Factory ingestion framework that reads source behaviour from metadata and processes SQL Server, HTTP or REST and file-based sources through reusable pipeline components.
Azure Data FactoryADLS Gen2SQL ServerHTTP / REST
04
Azure Databricks
PySpark and Data Quality
Retail Data Validation Pipeline with Azure Databricks
A retail data pipeline that ingests order and order-item data from Amazon S3, stages it in ADLS Gen2 and applies Databricks PySpark validation before loading approved records into Azure SQL Database.
Azure Data FactoryAzure DatabricksPySparkAmazon S3
05
Azure Data Factory
Mapping Data Flow and Conditional Routing
Movie Analytics Transformation Pipeline with Azure Data Factory
A parameterised Azure Data Factory pipeline that reads movie data from Azure Blob Storage, applies Mapping Data Flow transformations and routes validated outputs to Azure SQL Database or ADLS Gen2 according to release-year rules.
Azure Data FactoryMapping Data FlowAzure Blob StorageADLS Gen2