Lead Data Platform Engineer

Lead Data Platform Engineer

Location: Remote (UK)

Salary: £85,000

This is a standout opportunity to take ownership of a modern Databricks-driven data platform for a highly respected organisation that is investing seriously in data engineering, automation, and best-in-class practices.

The Company

They are a large, well-established organisation with a strong reputation for delivering high-quality services across the UK. With thousands of employees and a modern, flexible working culture, they combine professional excellence with a supportive and people-focused environment.

Technology plays a key role in their long-term strategy, and the data function is highly invested, credible, and growing. You will join a collaborative team of data engineers, ML engineers, and platform specialists.

The Role

You will act as the go-to expert for the Databricks estate and Lakehouse platform, ensuring it is scalable, secure, automated, and built to best practice. You will work closely with engineers, architects, and senior stakeholders to build and enhance a robust data ecosystem in Azure.

Key responsibilities include:

• Designing and delivering end-to-end data platform solutions in Azure
• Developing and deploying the Lakehouse platform using Databricks
• Building automation for cluster management, integration runtimes, and infrastructure components
• Leading implementation with Databricks, PySpark, Spark SQL, and Azure Data Factory
• Creating APIs for integration and automation
• Driving CI/CD, automated testing, and DevOps best practice

Your Skills and Experience

You will have strong capability in:

• Azure and Databricks engineering
• PySpark, SQL, Python, and Spark SQL
• DevOps best practices including CI/CD, automation, and testing
• Infrastructure as code such as Terraform
• Stakeholder communication and cross-team collaboration

How to Apply

If you are a strong Data Platform Engineer with deep Databricks experience and want to lead a modern Azure Lakehouse platform, please apply with your CV!