DataState Data Engineer (IT)
Job title: DataStage Data Engineer Location: London (Hybrid) Day Rate: £514.00 per day Contract Length: 12 Months IR35 Status: Inside IR35 Public Sector Overview An exciting opportunity is available for an experienced DataStage Data Engineer to join a high-profile programme delivering complex data integration and migration solutions within a large-scale enterprise environment. The successful candidate will play a key role in designing, developing, and supporting robust data pipelines, ETL processes, and data warehouse solutions using a range of AWS and enterprise data technologies. This role requires a strong technical background in data engineering, ETL development, cloud-based data platforms, and DevSecOps practices. You will work closely with architects, developers, business stakeholders, and delivery teams to ensure the successful movement, transformation, and management of critical business data. Key Responsibilities
- Design, develop, and maintain scalable ETL and data migration solutions using IBM DataStage.
- Build and optimise batch and real-time data integration pipelines to support business and operational requirements.
- Develop and enhance data warehouse solutions, ensuring high performance, resilience, and scalability.
- Design and implement data solutions using AWS services, including Amazon Redshift, Amazon S3, and Amazon QuickSight.
- Collaborate with cross-functional teams to analyse data requirements and translate them into technical solutions.
- Support the adoption of DevSecOps principles, ensuring secure and automated deployment practices.
- Develop and maintain high-quality code using Java and SQL.
- Design, query, and optimise relational database structures and data models.
- Implement source control, version management, and CI/CD processes using GitHub and/or GitLab.
- Troubleshoot and resolve data-related issues, ensuring data integrity and platform stability.
- Contribute to technical design reviews, code reviews, and best practice initiatives across the engineering team.
- Strong commercial experience with IBM DataStage.
- Proven expertise in data migration and ETL development, including both batch and real-time processing.
- Experience designing and supporting enterprise data warehouse solutions.
- Strong understanding of DevSecOps methodologies and modern software delivery practices.
- Proficiency in Java development.
- Advanced SQL skills.
- Experience working with relational databases.
- Hands-on experience with GitHub and/or GitLab.
- Strong analytical, problem-solving, and stakeholder engagement skills.
- Ability to work effectively within Agile delivery environments.
- Experience implementing and monitoring data quality frameworks.
- Knowledge of XML technologies and data formats.
- AWS Certified Data Analytics or AWS Data Specialty Certification.
- Experience working within large-scale cloud migration or transformation programmes.
Recommended Jobs
Events Coordinator
This role offers you the opportunity to own the operational standard of every conference we run. You will be responsible for the end-to-end execution of 10 European private equity conferences a year -…
Teddington Referral Veterinary Nurse Jobs - Permanent | Indeed
JOB OVERVIEW Job Title: Referral Veterinary Nurse – Teddington Location: Teddington Employment Type: Permanent Salary: £29000 – £46000 per year depending on experience. About th…
Solution Engineer (Pre-Sales)
Coralogix is a modern, full-stack observability platform transforming how businesses process and understand their data. Our unique architecture powers in-stream analytics without reliance on expensiv…
Teacher of Mathematics - Brent | Outstanding-Rated School
Location: Brent, North West London Start: January 2027 Contract: Permanent, Full-Time Setting: Outstanding-Rated School We are seeking a motivated Teacher of Mathematics to join an…
Deputy Accommodation Manager
Change lives in a life-changing career Today, 12 children and young people in the UK hear the shocking news they have cancer. Young Lives vs Cancer is the UK's leading cancer charity for childre…
Senior Backend Engineer
An opportunity has arisen with a fast-growing health technology company with a focus on improving the communication between healthcare professionals and their patients. They have secured a large port…
Expatriate Tax Senior / Assistant Manager
Join one of the most successful expatriate tax teams in London. Due to continued growth, the team is expanding once again. As an expatriate tax senior / assistant manager, you will enjoy close co…
Quantity Surveyor - Bermuda Relocation
Imagine taking ownership of major construction projects while enjoying island life, turquoise waters and year-round sunshine. This Quantity Surveyor opportunity in Bermuda gives you the chance to make…
Early Years Worker
Northumberland County Council's (NCC) vision is ‘Land of Great Opportunities', for current and future generations. We believe there is no better place to live and work. Due to increasing numbers…
Global Customs Specialist, London (hybrid)
Job Details A newly created role with this global brand. It’s an exciting role for an experienced customs specialist to ensure compliant duty processes and identify customs and global trade oppor…