Experience

Professional Experience

Professional experience across Azure data pipeline development, cloud platform learning and enterprise data delivery.

My current focus is Azure Data Engineering, with practical work across pipeline orchestration, Databricks processing, data validation, framework logging, watermark controls and downstream data readiness.

Current Role

Azure Data Engineering Development and Pipeline Reliability

  1. Ensono Technologies LLP

    Associate Data Engineer

    Chennai, India

    Developing and supporting Azure data pipelines and medallion lakehouse processing, with a focus on ingestion, validation, incremental loading, issue investigation and reliable downstream data delivery.

    • Develop and enhance a Bronze-to-Silver-to-Gold medallion lakehouse using Azure Databricks, PySpark and Delta Lake for a mid-sized US e-commerce platform.
    • Build metadata-driven Azure Data Factory pipelines that ingest data from SQL Server, REST APIs and SFTP into the ADLS Gen2 Bronze layer.
    • Implement JSON configuration and control-table patterns for dynamic pipeline selection, parameterised execution and reusable source onboarding.
    • Apply watermark-based incremental loading and rerun-safe controls so eligible changes are processed and state updates occur only after successful execution.
    • Implement PySpark transformation and validation logic for trusted Silver and Gold datasets, with Delta Lake processing and Unity Catalog registration.
    • Validate runtime parameters, source paths, files, schemas and row counts before data proceeds to downstream processing.
    • Integrate structured Databricks notebook results and framework logging with Azure Data Factory so orchestration status reflects processing outcomes.
    • Investigate pipeline issues, implement fixes, verify downstream data readiness and document pipeline behaviour for technical handoff.
    Azure Data FactoryAzure DatabricksPySparkDelta LakeADLS Gen2Unity CatalogSQL ServerREST APIsSFTPJSON configurationControl tablesWatermark processingFramework logging

Foundation

Early-Career Training and Project Experience

These overlapping entries represent a Wipro project-trainee period and its assigned StackRoute training programme.

  1. StackRoute

    Trainee

    Bengaluru, India

    Completed a Wipro-assigned Java Full Stack and AWS Cloud training programme focused on application development fundamentals.

    • Developed hands-on web application projects using Java, JSP, Servlets, SQL and HTML.
    • Applied server-side development, relational database and application-integration concepts through structured practical assignments.
    • Practised AWS cloud deployment workflows and Git-based source-control fundamentals.
    JavaJSPServletsSQLHTMLAWSGit
  2. Wipro

    Project Trainee — Cloud and Application Development

    Chennai, India

    Completed an early-career application-development project covering Java web development, relational database integration and AWS deployment.

    • Developed and deployed a job portal application using Java, JSP, Servlets, JDBC and MySQL.
    • Hosted the application on AWS Elastic Beanstalk, used Amazon Aurora on Amazon RDS for database management and monitored the deployment with Amazon CloudWatch.
    • Managed source control and team collaboration through GitHub.
    JavaJSPServletsJDBCMySQLAWS Elastic BeanstalkAmazon AuroraAmazon RDSAmazon CloudWatchGitHub

Experience in Practice

How My Experience Connects

Pipeline Development

Current work centres on Azure Data Factory, Databricks, PySpark, Delta Lake, validation and reliable data delivery.

Reliability and Support

Pipeline observability, issue investigation and controlled recovery inform how I develop and support data workflows.

Continuous Platform Development

Hands-on portfolio projects extend my experience across Microsoft Fabric, lakehouse ingestion, Mapping Data Flows and metadata-driven architecture.