Senior Data Engineer

We are seeking an experienced Senior Data Engineer / Engineering Lead with deep expertise in the Microsoft Fabric ecosystem to deliver governed, production-ready data products for a critical enterprise public sector environment.

You will lead the implementation of end-to-end ingestion and ETL patterns, enforce Medallion Architecture standards (Bronze/Silver/Gold), and ensure seamless integration with Purview data governance frameworks.

Key Responsibilities

• Pipeline & Data Product Delivery: Design, build, and deploy 12 production-grade data products within an existing MS Fabric platform to validate core ingestion and ETL/ELT frameworks.
• Architecture Implementation: Implement Medallion Architecture patterns across OneLake, Lakehouses, and Data Warehouses to transform raw inputs into structured, business-ready datasets.
• Data Integration: Build and maintain scalable orchestration pipelines using MS Fabric Dataflows Gen2, Pipelines, PySpark/Notebooks, and integration tools such as Matillion.
• Governance & Metadata Support: Collaborate with the Data Architect and Metadata Lead to implement lineage tracking, security controls, and metadata capture natively integrated with Microsoft Purview.
• Environment Validation: Participate in early-phase platform reviews to validate capacity setup, workspace configuration, and technical readiness before scaling out.

Required Experience & Skills

• MS Fabric Core: Hands-on experience building solutions on Microsoft Fabric (OneLake, Lakehouse, Dataflows Gen2, Fabric Pipelines, DirectLake/Semantic Models).
• Data Engineering Stack: Strong proficiency in PySpark, T-SQL, Python, and Delta Lake optimizations (partitioning, OPTIMIZE/VACUUM patterns).
• ETL/ELT Tools: Experience with modern ingestion platforms, metadata-driven pipelines, and cloud connectors (experience with Matillion is a strong bonus).
• Data Architecture Knowledge: Practical application of Medallion Architecture standards and star-schema dimensional modeling.
• Governance Awareness: Familiarity with Microsoft Purview for data cataloging, sensitivity labeling, and access control execution.
• Public Sector / Enterprise background: Experience operating within complex enterprise frameworks, structured change processes, and data privacy environments.

Candidate Deliverables for Submission

Please provide profiles highlighting:

• Specific MS Fabric / Azure Lakehouse projects executed.
• Experience leading ingestion design (specifically ETL patterns and Medallion implementation).
• Availability for an immediate part-time start leading into full-time work.