Senior Data Engineer

We are working with a leading global Financial Services business to hire a Senior Data Engineer into their growing data engineering practice. This is a hands-on technical role sitting at the centre of a major enterprise data platform build, with scope to influence architecture, drive pipeline development, and contribute to AI initiatives across a complex, high-volume financial data environment.

Responsibilities:

• Design and develop scalable data solutions on a Lakehouse architecture platform, supporting enterprise-wide data processing and analytics
• Build, optimise, and maintain ETL/ELT pipelines and structured streaming workflows for both batch and real-time data ingestion
• Configure and tune clusters and Spark jobs to deliver consistent performance at scale
• Utilise Delta Live Tables and Unity Catalog to manage data ingestion, transformation, and access governance
• Apply IAM best practices and maintain compliance with data security standards across the platform
• Support infrastructure provisioning and resource management using Terraform
• Implement monitoring frameworks covering pipeline performance, data quality, and operational health
• Contribute to code reviews, technical documentation, and team knowledge-sharing
• Work within an Agile delivery model, collaborating closely with data scientists, analysts, and business stakeholders
• Explore emerging technologies and AI tooling to enhance development productivity and platform capability