Senior Data Engineer
- The development of data ingest, transformation, analytics, and data publishing pipelines, facilitating complex data transformations to meet business requirements, ensuring optimal performance and efficiency of the data platform.
- Support for the live platform day to day, resolving issues and meeting business requests as they arise within the team's SLAs.
- The enablement and promotion of Data Engineering best practices and DevOps standards, ensuring good code quality and continuous compliance with all relevant standards.
- Providing mentorship to junior engineers, helping them enhance their skills and knowledge. Promoting a collaborative environment to deliver and integrate end to end data solutions.
- Identifying and addressing technical debt efficiently, continuously improving data processes and workflows for enhanced efficiency.
- Working collaboratively with business stakeholders and operational teams to resolve issues and minimise the defect backlog.
- Supporting estimation processes to aid in planning and portfolio management.
- Keeping abreast of industry technical best practices and new trends, ensuring innovative development of systems to meet organisational immediate and future needs.
- Responsible for managing risks inherent to the role by diligently observing internal policies and procedures.
- Technical Lead for Data Engineering
- Business System Owner
- Head of Data Engineering
- Application Specialists and Application Support
- Information Security Manager
- Data Privacy Manager
- Infrastructure Engineers
- Strong communicator with both technical and non-technical communities
- Experience of mentoring less-experienced developers
- Significant hands-on experience with the Azure Data Stack, critically ADF and Synapse (experience with Microsoft Fabric is a plus)
- Highly developed python and data pipeline development knowledge, must include substantial PySpark experience
- Demonstrable DevOps and DataOps experience with an understanding of best practices for engineering, test and ongoing service delivery
- An understanding of Infrastructure as Code concepts (Demonstrable Terraform experience a plus)
- Demonstrable experience of Data Pipeline testing, including automated testing, data validation and code assurance
- Demonstrable experience of working within Agile Delivery projects
- An understanding of data formats for ingest, transformation and analytics, data security, access control and authorisation, GDPR, data privacy, and information security
- Financial services experience
- Awareness of data models in a Medalion Architecture
- Experience building Semantic, Metric or Analytic models
- Experience of building Machine Learning models
- Any experience in MLOps or operationalising Machine Learning
- Knowledge of Data Quality Frameworks in Python
- Industry focused degree or equivalent working experience
- Azure certifications are desirable
- Developing Others
- Working Proactively
- Creativity and Innovation
- Problem Solving and Judgement
- Communication and Confidence
- Agile working - (3 Days in London Office per week)
- Competitive salary, pension & holiday allowance
- BUPA Health cover
- 4x Life Assurance
- Income Protection scheme
- Discretionary bonus
- Market leading maternity/paternity and menopause policies
- Flexible benefits
Recommended Jobs
Attractive Males Aged 20-40 Required for Social Content Shoot End of July. Paid
We are casting for variois roles for a social content shoot taking place around mid June-July, dates TBC. Please only apply if you have good availability during this time. Looking for some attract…
Finance Reporting Associate - REF: 1374
Exciting Opportunity: Financial Reporting Associate (Fixed Term Contract) Are you ready to take your financial reporting skills to the next level? Our client, a leading financial institution with a …
Senior Finance Assistant - Part Time
Job Title: Senior Finance Assistant - Part Time Location: South West London Remuneration: £30,000 - £35,000 per annum Contract Details: Fixed Term Contract ( 6 - 12 months) Hours: 16 - 24 h…
Senior Platform Engineer (Infrastructure)
About Fresha Fresha is the leading marketplace platform for beauty & wellness trusted by millions of consumers and businesses worldwide . Fresha is used by 120,000+ businesses and 450,0…
Finance Manager
International Medical Corps (UK) is an international humanitarian non-governmental organisation (NGO) with its headquarters in London. IMC UK was incorporated as a company limited by guarantee in Eng…
Business Development Executive - Commercial Banking
MAIN OBJECTIVES: The Business Development Executive – Business Banking, will be responsible for supporting an assigned Relationship Manager (RM) working in the Business Banking to meet and exc…
DevOps
A fully remote, technology for good opportunity; use your expertise to make the world a better place. This company is utilising a deeper understanding of biological data, to transform healthcare and …
Team Assistant - Boutique Global Investment Firm
We are seeking a switched on Team Assistant for a boutique but global investment firm with offices in London, Stockholm, New York and Asia. Based 4 days a week from the office in Central London, y…
Venture Capital Partner / Legal Director
Job Details Join a top 50 law firm who have increased profits and turnover each year over the last 4 years and made strong strategic decisions assisting growth Venture Capital Partner / Legal D…
Senior Medical Writer
About HCG : The Healthcare Consultancy Group (HCG) is powered by a fusion of science, creativity, and digital-all catalyzed by a culture of curiosity and innovation. We work to accelerate product…