Senior Data Engineer (NHS)
- Support the build of data pipelines from data providers to our primary data store and trusted research environment. Support the design, scoping and build of data flows.
- Produce logic for data transformation steps as code, which meets the requirements for our end users and builds well curated, accessible and quality controlled data for analysis.
- Contribute to code base for multiple data pipelines while ensuring best coding practises are used.
- The opportunity to work with Data Scientists and Epidemiologists to understand their data requirements and collaborate with them to deliver the data needed for their projects.
- Keep abreast of best practice in data engineering across industry, research and Government and facilitating the adoption of these standards.
- Experience building and maintaining robust, scalable and efficient data pipelines. Capable of processing very large amounts of data based on feeds from multiple systems using a range of different technologies.
- You're an empathetic communicator, comfortable bridging technical and non-technical perspectives
- You're confident working with NHS health data and understand the nuances of secondary and primary care datasets (Hospital Episodes Statistics, Death registry data, A&E data etc) as well as Primary care (GP data) would be advantageous.
- Highly proficient in Python with solid command line knowledge and Unix skills.
- Good understanding of cloud environments (ideally Azure), distributed computing and optimising workflows and pipelines.
- Understanding of common data transformation and storage formats, e.g. Apache Parquet, Delta tables.
- Understanding of containerisation (e.g. Docker) and deployment (e.g. Kubernetes).
- Working knowledge using Spark, Databricks, Data Lakes.
- Follow best practices like code review, clean code and unit tests.
- You're comfortable working in an agile development team, familiar with version control and Git/GitHub.
- Awareness/interest of data standards such as GA4GH ( and FAIR (
- You're experienced in contributing to and navigating shared codebases within multi-person teams
- Competitive base salary
- Generous Pension Scheme - We invest in your future with employer contributions of up to 12%.
- 30 Days Holiday + Bank Holidays - Enjoy a generous holiday allowance with the flexibility to take bank holidays when it suits you.
- Enhanced Parental Leave - Supporting you during life's biggest moments.
- Career Growth & Development - £500 per year to spend on Learnerbly, our learning platform, plus regular appraisals and development opportunities.
- Cycle to Work Scheme - Save 25-39% on a new bike and accessories through salary sacrifice.
- Home & Tech Savings - Get up to 8% off on IKEA and Currys products, spreading the cost over 12 months through salary sacrifice
- £1,000 Employee Referral Bonus - Know someone amazing? Get rewarded for bringing them on board!
- Wellbeing Support - Access to Mental Health First Aiders, plus 24/7 online GP services and an Employee Assistance Programme for you and your family.
- A Great Place to Work - We have a lovely Central London office in Holborn, and offer flexible and remote working arrangements.
Recommended Jobs
Care Assistant
Care Assistant Right at Home Barnet & Edgware Hourly Rate: From £13.62 to £27.24 per hour with holiday pay + travel expenses Hours per week: Part-time or full-time hours available Look...
Band 7 REMOTE Voice SLT
Your World has a brilliant new opportunity for an experienced Band 7 Voice Speech and Language Therapist with post-graduate experience working with voice patients with dysphagia. Description: Y...
Maintenance Engineer
&##127775; Join Our Global Family at RIU Hotels & Resorts! Be part of the RIU Plaza London Victoria team! RIU Plaza London Victoria has quickly become a key player in the UK hospitality scene, off...
Primary SEND Teaching Assistant
Special Needs Teaching Assistant Special Needs school South East London ASAP Start Ongoing contract Do you have experience supporting young children with Special Educational Needs a...
Hackney Based Independent School - Head of Geography
Lead a passionate team of Geography teachers at our well-established independent school in Hackney! Head of Department vacancy. Our supportive and highly successful independent school in Hackney is ...
MD, Head of Financial Crime, Business Banking
The MD, Head of Financial Crime for Business Banking has primary responsibility for the management of Financial Crime risk across the business unit and will have a direct reporting line into the Acco...
Sonographer
This position is available on a full, part-time, or ad-hoc basis to start on 20/05/2025 with a pay of £30 - £45 P/H. To be successful in this role, you will possess the following Essential Criteri...
German Teacher - West London Elite - Full Time
Calling all passionate German Teachers! We are seeking an enthusiastic and dedicated German Teacher to join a supportive and well-resourced Languages department at a progressive school in West Lond...
Executive Assistant - Initial 1m Temp - Immediate
Executive Assistant Stratford 4 days from the office, 1 day from home Upto £21 per hour - 35 hour week Immediate start - Initial 1 month temp Randstad are delighted to be working with a...
Sport Lecturer
Deliver high-quality, inspiring lessons that motivate learners and encourage participation. Design engaging schemes of work, lesson plans, and assessments in line with curriculum requirements...