Data Engineer

Data Engineer - 6 month contract (inside IR35) - Canary Wharf (Hybrid working) - SC ClearanceI have an immediate requirement for an experienced Data Engineer to work on a government project. The role will be be based from Canary Wharf and will be 3 days onsite Hybrid working.Due to the urgency and the nature of the project, people with active SC clearance will be preferred.Successful candidates will:

• Design and implement robust, scalable data pipelines to support analytics and reporting needs.
• Work with with business users and multi-disciplinary teams to understand data requirements and deliver fit-for-purpose solutions.
• Develop and maintain data workflows using modern orchestration tools.
• Apply best practices for coding, testing, and deployment using CI/CD pipelines.
• Ensure data engineering approaches align with current trends and industry standards.
• Contribute to the development of infrastructure using infrastructure-as-code tools.

I am therefore very keen to speak with candidates who have

• Strong programming skills in Python, with solid SQL knowledge and familiarity with templating approaches (e.g., Jinja).
• Hands-on experience with cloud technologies, ideally within AWS environments.
• Proven ability to work with orchestration platforms-experience with tools like Apache Airflow is a plus.
• Comfortable developing CI/CD workflows, ideally using tools such as GitHub Actions.
• Experience building and maintaining modern data pipelines and infrastructure.
• Cooperative approach to working with product owners, analysts, and cross-functional delivery teams.
• Exposure to infrastructure as code tools-experience with Terraform is preferred.
• Practical experience with dbt, particularly applying best practices in a production environment.

Interested? Apply now for immediate consideration!