Data Engineering Lead
David Kennedy Recruitment is working with a leading tech outsourcing company that is looking to recruit a Data Engineering Lead to join their team in Dublin, Ireland.
Position: Data Engineering Lead
Location: Onsite - Dublin, Ireland
Employment type: Full-time
Remuneration: Competitive package.
DUTIES AND RESPONSIBILITIES:
Lead the design, development, and implementation of scalable data engineering solutions
Build and optimise large-scale data pipelines for analytics and machine learning use cases
Design and maintain reusable, high-performance data products and frameworks
Integrate data from multiple structured and unstructured sources into unified platforms
Drive automation across data engineering and data science workflows
Define and evolve data architecture to support scalability, reliability, and performance
Identify opportunities to simplify complex systems and improve platform efficiency
Ensure best practices in engineering design, coding standards, and system reliability
Collaborate on the design of distributed systems and cloud-based data platforms
Work closely with Data Scientists, Product Managers, and Engineering teams
Translate business requirements into scalable technical solutions
Support cross-functional delivery of data-driven products and services
Communicate technical concepts effectively to both technical and non-technical stakeholders
Lead and mentor data engineers across projects and squads
Provide technical guidance and support engineering capability development
Contribute to team growth and engineering excellence across the organisation
Promote agile delivery and collaborative engineering practices
Develop and maintain robust ETL/ELT pipelines
Optimise performance of data processing systems and workflows
Ensure data quality, reliability, and consistency across platforms
Support production-grade deployment of data engineering solutions.
REQUIREMENTS:
8+ years of experience in Data Engineering or Big Data environments
Strong experience with Python, Scala, or Java
Hands-on experience with Apache Spark / PySpark
Strong experience with Databrick
Experience with Hadoop ecosystem (Hive, Impala, Oozie, Sqoop, NiFi)
Strong SQL skills and experience with relational and NoSQL databases
Experience building and maintaining large-scale data pipelines
Strong understanding of distributed systems and data architecture principles
Experience working in Agile engineering environments
Proven experience leading technical initiatives or engineering teams
Degree in Computer Science, Software Engineering, or related field
Experience with cloud-native data engineering platforms/Cloud experience (AWS or Azure).
BENEFITS:
Competitive salary package aligned to senior data engineering market
Opportunity to work on enterprise-scale payment technology platforms
Exposure to cutting-edge Big Data, cloud, and analytics ecosystems
Leadership opportunity within a global engineering organisation
Career progression within a major international technology environment
Work on high-impact data platforms powering analytics and AI solutions
Guidance and tools to reach career potential.
