Senior Data Engineer

Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive.

Job Title: Senior Data Engineer

Location: Solihull - Hybrid

Contract: 3 months with possible extension.

Rate: £550 - £650 inside umbrella

Purpose

Design, build and assure scalable, secure data products and pipelines across Azure, AWS and Databricks. Lead data integration design, technical decisions and best practices, while mentoring engineers and enabling high-quality analytics, BI and data science outcomes.

Reporting & Collaboration

Reports to Lead Data Engineer with oversight from Head of Data Operations & Engineering

Works across Data Science, Analytics, Architecture, Cyber, Product and Delivery teams

Acts as a senior technical lead, guiding engineers and influencing cross-team decisions

Key Responsibilities

Lead design and delivery of scalable batch & streaming data pipelines and products

Define and assure enterprise-aligned data integration architectures

Optimise cloud platforms (Azure, AWS, Databricks) for performance and cost

Build and own ETL/ELT pipelines using PySpark, SQL and orchestration frameworks

Automate and modernise legacy data processes with reusable patterns

Design robust data models (Delta Lake, schema evolution, metadata, lineage)

Ensure data security, governance, and compliance (access control, encryption, lifecycle)

Provide technical leadership, mentoring and design reviews

Collaborate with stakeholders to translate complex technical decisions clearly

Support strategic roadmap, tooling and continuous improvement initiatives

Core Skills & Expertise

Data Engineering

Advanced PySpark and SQL, performance tuning and best practice coding

Data modelling (conceptual, logical, physical) and integration design

Data quality, testing frameworks and automated validation

Strong data analysis, profiling and insight delivery

Cloud & Platforms

Azure: Data Factory, Synapse, Databricks, ADLS Gen2, Event Hub, Purview

AWS: S3, Glue, Athena, Kinesis, Lambda, EMR, Lake Formation

Databricks: Delta Lake, Unity Catalog, Structured Streaming, MLflow

SQL Server stack (SSIS, SSRS)

Engineering Practices

CI/CD for data platforms and Infrastructure-as-Code (Terraform/Bicep)

Git, monitoring and alerting tools

Data governance, lineage and observability frameworks

Leading technical design assurance and reviews

Qualifications & Experience

Degree (or equivalent) in Computer Science or related field

Experience in enterprise-scale data engineering

Relevant certifications (Azure, AWS, Databricks) desirable

Adecco is a disability-confident employer. It is important to us that we run an inclusive and accessible recruitment process to support candidates of all backgrounds and all abilities to apply. Adecco is committed to building a supportive environment for you to explore the next steps in your career. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.

We use generative AI tools to support our candidate screening process. This helps us ensure a fair, consistent, and efficient experience for all applicants. Rest assured, all final decisions are made by our hiring team, and your application will be reviewed with care and attention.