Senior Data Engineer
- The development of data ingest, transformation, analytics, and data publishing pipelines, facilitating complex data transformations to meet business requirements, ensuring optimal performance and efficiency of the data platform.
- Support for the live platform day to day, resolving issues and meeting business requests as they arise within the team's SLAs.
- The enablement and promotion of Data Engineering best practices and DevOps standards, ensuring good code quality and continuous compliance with all relevant standards.
- Providing mentorship to junior engineers, helping them enhance their skills and knowledge. Promoting a collaborative environment to deliver and integrate end to end data solutions.
- Identifying and addressing technical debt efficiently, continuously improving data processes and workflows for enhanced efficiency.
- Working collaboratively with business stakeholders and operational teams to resolve issues and minimise the defect backlog.
- Supporting estimation processes to aid in planning and portfolio management.
- Keeping abreast of industry technical best practices and new trends, ensuring innovative development of systems to meet organisational immediate and future needs.
- Responsible for managing risks inherent to the role by diligently observing internal policies and procedures.
- Technical Lead for Data Engineering
- Business System Owner
- Head of Data Engineering
- Application Specialists and Application Support
- Information Security Manager
- Data Privacy Manager
- Infrastructure Engineers
- Strong communicator with both technical and non-technical communities
- Experience of mentoring less-experienced developers
- Significant hands-on experience with the Azure Data Stack, critically ADF and Synapse (experience with Microsoft Fabric is a plus)
- Highly developed python and data pipeline development knowledge, must include substantial PySpark experience
- Demonstrable DevOps and DataOps experience with an understanding of best practices for engineering, test and ongoing service delivery
- An understanding of Infrastructure as Code concepts (Demonstrable Terraform experience a plus)
- Demonstrable experience of Data Pipeline testing, including automated testing, data validation and code assurance
- Demonstrable experience of working within Agile Delivery projects
- An understanding of data formats for ingest, transformation and analytics, data security, access control and authorisation, GDPR, data privacy, and information security
- Financial services experience
- Awareness of data models in a Medalion Architecture
- Experience building Semantic, Metric or Analytic models
- Experience of building Machine Learning models
- Any experience in MLOps or operationalising Machine Learning
- Knowledge of Data Quality Frameworks in Python
- Industry focused degree or equivalent working experience
- Azure certifications are desirable
- Developing Others
- Working Proactively
- Creativity and Innovation
- Problem Solving and Judgement
- Communication and Confidence
- Agile working - (3 Days in London Office per week)
- Competitive salary, pension & holiday allowance
- BUPA Health cover
- 4x Life Assurance
- Income Protection scheme
- Discretionary bonus
- Market leading maternity/paternity and menopause policies
- Flexible benefits
Recommended Jobs
Science Teacher - Outstanding School in Haringey - ASAP...
About the Role An Outstanding school in Haringey is seeking a Science Teacher to join their forward-thinking STEM faculty. This full-time, permanent role is available immediately, offering an opport...
Year 5 Teacher with TLR Opportunity in Haringey -...
An exciting opportunity has arisen for an experienced Year 5 Teacher with a Teaching and Learning Responsibility to join a vibrant school in Haringey from September 2025 . The successful candi...
Associate Civil Engineer (Aviation)
RPS is currently seeking an Associate Civil Engineer in Aviation. The role allows for hybrid working and can be based at either the Birmingham, Manchester, Milton Keynes, Newark or London offices. ...
KS1 Teacher - Magnificent School - Islington
Are you an enthusiastic qualified Primary Teacher looking for an exciting KS1 teacher role from September 2024? Do you want to work in a school that is dedicated to nurturing well-rounded, confiden...
Head Chef - London
Head Chef - London Company Description Searcys at The British Academy are looking for a Head Chef, and as a head Chef you will have the chance to create the finest quality dishes and deliver ...
Senior Data Associate with German, Artificial General Intelligence
DESCRIPTION Note: This is a position for a fixed-term contract. AI is the most transformational technology of our time, capable of tackling some of humanity’s most challenging problems. Am...
Managing Consultant - Transport - Digital Trust and Cyber Security
Company description We believe in the power of ingenuity to build a positive human future. As strategies, technologies, and innovation collide, we create opportunity from complexity. Our te...
Software Developer
Hanson Wade is seeking a skilled and motivated Software Developer to join our growing development team. You’ll play a vital role in building and maintaining our industry-leading software, systems, an...
Kitchen Leader
We are looking for experienced Kitchen Team Leaders to join atis and help us on our mission to create a food company that is different from any other healthy food concept in town. We are a rapid...
Cutting-edge Consultancy - Non-life
Star Actuarial, in conjunction with a major global consultancy, is seeking part-qualified and qualified actuaries to cover a range of diverse workstreams, including reserving, the London Market, capi...