Data Engineer II
- Contribute to end-to-end data pipeline solutions on cloud infrastructure leveraging the latest technologies and the best industry practices
- Use domain modelling techniques to allow us to build best in class business products.
- Structure software so that it is easy to understand, test and evolve.
- Build solutions that avoid single points of failure, using scalable architectural patterns.
- Develop secure code so that our customers and ourselves are protected from malicious actors.
- Promptly investigate and fix issues and ensure they do not resurface in the future.
- Make sure our releases happen with zero downtime for our end-users.
- See that our data is written and read in a way that's optimized for our needs.
- Keep an eye on performance, making sure we use the right approach to identify and solve problems.
- Ensure our systems are reliable and easy to operate.
- Keep us up to date by continuously updating our technologies and patterns.
- Support the products you've built through their entire lifecycle, including in production and during incident management
- Formal training or certification on data engineering concepts and applied experience
- Recent hands-on professional experience as a data engineer
- Experience in coding in a recent version of the Python programming language
- Experience in designing and implementing effective tests (unit, component, integration, end-to-end, performance, etc.)
- Excellent written and verbal communicationskills in English
- Understanding of cloud technologies and distributed systems
- Understanding of data transformation frameworks and data pipeline orchestration tools
- Understanding of how to manage and optimize queries for large volumes of data within different kinds of data stores (including relational data stores)
- Experience with ML products/services and data would be best
- Experience with either of the two is good
- Experience with Python is fine too and willingness to learn
- Experience in working in a highly regulated environment / industry
- Understanding of AWS cloud technologies
- Understanding of data governance frameworks
- Understanding of event-base architecture, data streaming and messaging frameworks
Recommended Jobs
Penetration Tester
Company description We believe in the power of ingenuity to build a positive human future. As strategies, technologies, and innovation collide, we create opportunity from complexity. Our te...
Consultant in Old Age Psychiatry - Isleworth
Job Title: Consultant in Old Age Psychiatry Grade : Consultant Location : Isleworth, Greater London Working Hours: 40 hours per week Rate : Competitive, to be discussed upon applicat...
Assistant Environmental Project Manager
Job Description What if you could do the kind of work the world needs? At WSP, you can access our global scale, contribute to landmark projects and connect with the brightest minds i...
Banking & Capital Markets Risk Tech , Manager, Technology Consulting FS
Our UK Capital Markets technology and data capability helps our investment banking clients to deliver complex business and regulatory transformation, enabled by technology. The opportunity ...
Clinical Services Manager
About The Role In your role as a Clinical Service Manager at HC-One you’ll value kindness above all. You will play a key role within the home, overseeing and assisting every aspect of nursing care...
Senior Machine Learning Engineer
Woven by Toyota is enabling Toyota's once-in-a-century transformation into a mobility company. Inspired by a legacy of innovating for the benefit of others, our mission is to challenge the current sta...
Cyber Security Governance & Assurance Specialist - (SC Cleared)
Cyber Security Governance & Assurance Specialist – Remote Working (SC Cleared) Location: UK – Birmingham, Bristol, Glasgow, London, Manchester, or Belfast Rate: £700 per day (Inside IR35) Work...
AI Localisation Analyst- 12 month Fixed Term Contract
Job Description Job Description -AI Korean Localization Analyst: Chubb is a world leader in insurance. With operations in 54 countries and territories, Chubb provides commercial and personal pr...
Trainee Recruitment Consultant - Generous commission...
Are you an individual with 12 months+ recruitment experience OR someone with a proven track record in sales looking for a career change? Are you frustrated by office politics/unfair commission ...
Environmental Health & Safety Lawyer 3+
Job Details Environmental Health & Safety Lawyer 3+ To £££ (Permanent and also fixed term contract) Rare opening at this top 10 City firm for an ambitious environmental/H&S lawyer to join this h...