Data Engineering Team Lead - Databricks

We are working with a leading global Financial Services business to hire an experienced Data Engineering Team Lead to head up a team of engineers working across a large-scale enterprise data platform. This is a senior hands-on leadership role requiring both deep technical expertise and the ability to drive delivery, mentor talent, and set standards across a distributed engineering function.

Responsibilities:

• Lead, mentor, and develop a team of data engineers across multiple locations, driving code reviews, design reviews, and a culture of knowledge-sharing
• Own and drive Agile/Scrum delivery processes, ensuring the team operates effectively against roadmap priorities
• Design and develop scalable data solutions on a Lakehouse architecture platform, supporting enterprise-wide data processing and analytics
• Build, optimise, and maintain ETL/ELT pipelines and structured streaming workflows for both batch and real-time data ingestion
• Configure and tune clusters and Spark jobs to deliver consistent performance at scale
• Utilise Delta Live Tables and Unity Catalog to manage data ingestion, transformation, and access governance
• Apply IAM best practices and uphold compliance with data security and governance standards
• Support infrastructure provisioning and resource management using Terraform
• Implement monitoring frameworks covering pipeline performance, data quality, and operational health
• Contribute to technical documentation and promote continuous improvement across the engineering practice