Data Engineer

Data Engineer

Location: London (Hybrid - 3 days/week in office or client site)Day Rate: £400-£425/day (Outside IR35)Start Date: ASAPDuration: 6 monthsNO SPONSORSHIP AVAILABLE

An established London-based logistics company is undergoing a major transformation in its data and analytics capabilities and is seeking a Data Engineer to support the build and optimisation of their next-generation data platform.

Working as part of a growing data team, you will play a critical role in designing and deploying scalable data pipelines and solutions using Azure Databricks and related technologies. This is an opportunity to contribute to a cloud-first, modern data strategy within a collaborative and forward-thinking environment.

Key Responsibilities:

• Design and develop end-to-end data pipelines (batch and streaming) using Azure Databricks, Spark, and Delta Lake.
• Implement the Medallion Architecture and ensure consistency across raw, enriched, and curated data layers.
• Build and optimise ETL/ELT processes using Azure Data Factory and PySpark.
• Enforce data governance through Azure Purview and Unity Catalog.
• Apply DevOps and CI/CD practices using Git and Azure DevOps.
• Partner with analysts and business stakeholders to ensure data quality and usability.
• Contribute to performance optimisation and cost efficiency across data solutions.

Required Skills & Experience:

• Proven hands-on experience with Azure Databricks, Data Factory, Delta Lake, and Synapse.
• Strong proficiency in Python, PySpark, and advanced SQL.
• Understanding of Lakehouse architecture and medallion data patterns.
• Familiarity with data governance, lineage, and access control tools.
• Experience in Agile environments, with solid CI/CD and Git knowledge.
• Power BI experience desirable; exposure to IoT data pipelines a plus.
• Ideally strong experience in logistics, oil & gas, shipping or transport and consulting

This contract offers an exciting chance to help shape a modern data platform within a business that values innovation and collaboration. If you're a proactive and technically strong data engineer looking to make an immediate impact, we'd like to hear from you.

McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.