SC Cleared Data Engineer

SC Cleared Data Engineer - 12 months+ (Apply online only)pd Inside IR35- Remote with occasional on site travel to London

My client are a Global IT Consultancy who are looking an SC Cleared Data Engineer. Candidates ideally have experience working within the Central Gov/Policing Sector.

Essential experience:

• Data migration experience.
• AWS experience, particularly using ETL applications such as AWS Glue and storage applications such as AWS RDS. Other tools include AWS Lambda, AWS S3, AWS Step Functions and more.
• Excellent knowledge of PostgreSQL databases and SQL, as well as Python for data mapping and manually implementing AWS Glue Jobs
• Building, maintaining and refining AWS Glue jobs as part of an ETL pipeline.
• Soft skills, including pro-activeness and working with other teams such as DevOps and Database Analysts. Completing show and tells
• Ensuring proper audit and logging mechanisms in ETL pipelines, particularly in AWS

Ideal to have:

• AWS Database Migration experience (including its Change Data Capture ability)
• Experience handing queries related to the data model (data mapping, extensive SQL knowledge).
• Experience deploying ETL pipelines into AWS environments, such as using Terraform scripts of AWS CloudFormation.
• Handling migration of BLOBs for images and CLOBs (Oracle database or migration experience).
• Data Mapping experience.
• End-to-End Pipeline Execution: Supporting the execution of end-to-end pipelines using tools such as AWS Step Functions.
• (Using APIs to load data into a target system (this would be really nice experience to have, but not expected as I think it might be rare in migrations. It will be important to determine the difference between knowing what an API is and having the experience of actually using one to load data into a target system as part of an ETL pipeline).

SC Cleared Data Engineer - 12 months+ (Apply online only)pd Inside IR35- Remote with occasional on site travel to London

Damia Group Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept our Data Protection Policy which can be found on our website.

Please note that no terminology in this advert is intended to discriminate on the grounds of a person's gender, marital status, race, religion, colour, age, disability or sexual orientation. Every candidate will be assessed only in accordance with their merits, qualifications and ability to perform the duties of the job.

Damia Group is acting as an Employment Business in relation to this vacancy and in accordance to Conduct Regulations 2003.