Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale — unleashing the…
Data Engineer
Skills & Technologies
Job Description
Data Engineer - Azure or AWS with Databricks - London (Hybrid) - £75,000 + benefits
We're partnering with a high-performing organisation that continues to invest heavily in its data capability. Over the last 24 months, the business has achieved 33% growth in its data team, reinforcing data as a core driver of its long-term strategy.
As part of this expansion, they're hiring a Data Engineer to help design, build and optimise modern cloud data platforms. This role is open to engineers with experience in Azure or AWS, provided they bring strong hands-on expertise with Databricks.
You'll join a collaborative, forward-thinking environment where data engineering best practice, scalability and platform reliability are front and centre.
What You'll Be Doing
Designing and building end-to-end data pipelines using Databricks on Azure or AWS
Developing modern lakehouse architectures using
Databricks (Spark, SQL, Delta Lake)
Azure Data Lake Storage or Amazon S3
Writing high-quality PySpark, Python, and SQL for ingestion, transformation, and modelling
Implementing Bronze / Silver / Gold data layers
Embedding data quality, validation and monitoring within pipelines
Supporting analytics and BI teams with trusted, well-structured datasets
Contributing to CI/CD pipelines and version-controlled deployments
Working closely with stakeholders in a consultative, delivery-focused environment
What We're Looking For
5+ years' experience in Data Engineering roles
Strong experience working with Azure or AWS cloud platforms
Commercial, hands-on experience using Databricks in production
Proven capability across
PySpark / Python / SQL
Cloud data storage (ADLS or S3)
ETL / ELT pipeline development
Solid understanding of data architecture, modelling, and governance
Experience building scalable, reliable pipelines in enterprise environments
Nice to Have
Background in high-growth or scaling data teams
Experience in financial services or large, global data estates
Azure, AWS, or Databricks certifications
Exposure to platform governance, lineage, or standardisation initiatives
Why Apply?
Join a company that has delivered 33% growth in its data team
Work on modern Databricks-led platforms
Opportunity to influence architecture and engineering standards
Clear progression within a growing, well-funded data function
Hybrid working and a strong, collaborative engineering culture
Interested?
Apply now or get in touch to learn more about the role!
Company & Role Analysis
JobSeeker+Neutral 2–4 sentence summary of what working at this company is like, drawn from public reviews and press coverage. Tone, collaboration style, pace, benefits highlights.
Similar roles
See moreSenior Data Engineer
Senior Data Engineer Location: Germany / Spain / Romania (Remote) The Role As a Senior Data Engineer, you will drive the end-to-end developm…
AI & Data Engineer
Die AGENTUR PHILIPP GmbH ist eine mehrfach ausgezeichnete Digital-, AI- und Design-Agentur. Wir entwickeln innovative KI-gestützte Lösungen…
DATA ENGINEER Up to £70,000 + BENEFITS UK (Remote-first) This is a great opportunity to join a high-growth education technology business w…
Senior Data Engineer
Salary: £80,000 - 80,000 per year Requirements: A proven end-to-end project leader Experience with SQL Proficient in Python Familiarity with…
Salary: £60,000 - 66,000 per year Requirements: Proven experience as a Data Engineer in a fast-paced environment (HealthTech, MedTech, or re…