Data Engineer

Data Engineer | £450-£500p/day (Inside IR35) | London (Hybrid, 1-2 days per week on site) | Energy/highly regulated environments | Azure/Microsoft Fabric

Our client is looking for an experienced Data Engineer to support the ongoing maintenance, enhancement and development of their operational data platform within a highly regulated Energy from Waste (EfW) environment.

We're looking for someone who will manage and improve the flow of operational, plant and asset data from on-premises systems into the Microsoft Azure ecosystem enabling effective reporting and compliance.

The role is split roughly 60% business-as-usual (platform maintenance, support and enhancement) and 40% strategic projects.

Key Responsibilities

Design, maintain and optimise data pipelines that ingest data from operational and business systems into Azure and Microsoft Fabric

Support the ongoing operation and enhancement of Azure-based data platforms, including Azure Synapse Analytics, Azure Storage and Logic Apps

Manage and improve ingestion of operational plant data, including weighbridge systems, asset monitoring systems and real-time data feeds

Support the development and maintenance of data warehousing and lakehouse solutions within Microsoft Fabric

Configure and support access controls, security groups and user permissions in Microsoft Fabric and Microsoft Entra ID

Essential Skills & Experience

Strong Python development skills

Experience integrating data from on-premises SQL Server environments into cloud platforms

Good understanding of APIs, system integrations and data exchange mechanisms

Proven experience with Microsoft Azure data technologies, including

Azure Synapse Analytics

Azure Storage

Azure Logic Apps

Azure data integration services

Strong experience with Microsoft Fabric, including

Data warehousing

Lakehouse architecture

Data pipelines

Security and access management

If this sounds like a good fit, apply now!

Data Engineer | £450-£500p/day (Inside IR35) | London (Hybrid, 1-2 days per week on site) | Energy/highly regulated environments | Azure/Microsoft Fabric

Oscar Associates (UK) Limited is acting as an Employment Business in relation to this vacancy.

To understand more about what we do with your data please review our privacy policy in the privacy section of the Oscar website.