Data Engineer

Data Engineer - Data Migration Programme | London (Hybrid) | Contract - up to £500/d (outside IR35)

Are you a Data Engineer with hands-on experience delivering enterprise data migration solutions? Our client - a fast-scaling European digital infrastructure provider with 100+ sites across the continent - is looking for a Data Engineer to join a major transformation programme consolidating multiple operational systems into a single target platform.

You'll be at the centre of the migration workstream: building the pipelines, transformation logic, and validation frameworks that move data from legacy systems into the new target operating platform - working closely with the Data Workstream Lead, business SMEs, and application teams.

What you'll be doing

Designing and building ETL/ingestion pipelines using Microsoft Fabric (Data Factory, Pipelines, Lakehouse, Notebooks) or equivalent Azure tooling

Implementing source-to-target mappings and transformation logic for the migration

Owning data validation, reconciliation, and defect resolution through migration test cycles

Building reusable migration frameworks - ingestion pipelines, validation routines, error-handling

Supporting CI/CD, Git-based release processes via Azure DevOps

What you'll bring

Extensive data engineering/integration/migration experience

Hands-on Azure Data Factory, Fabric Data Factory, or Synapse Pipelines

Strong SQL - profiling, transformation, validation, reconciliation

PySpark/Spark SQL notebook experience (Databricks or Fabric)

Proven experience on a data migration project end-to-end (extraction through reconciliation)

Microsoft Fabric experience is a bonus, not a requirement - strong Azure Databricks/Synapse background welcomed

Nice to have: Microsoft Purview, Delta Lake/medallion architecture, Key Vault/Managed Identities, Azure DE Associate or Databricks certification.