Data Engineer
- Design, build, and maintain end-to-end data pipelines and solutions using Microsoft Fabric (including Data Engineering, Data Factory, Synapse, and Power BI).
- Develop, automate, and manage cloud infrastructure using Infrastructure as Code (e.g., Azure Bicep, ARM templates, Terraform).
- Collaborate with cross-functional teams-including data architects, business analysts, and DevOps engineers-to deliver robust, scalable data solutions.
- Apply best practices for source control, CI/CD (Continuous Integration/Continuous Deployment), and automated infrastructure provisioning.
- Facilitates the design, coding, unit testing, and deployment of data processes for extraction, ingestion, and transformation of data.
- Develop and manage distributed data processing workloads using Apache Spark within Microsoft Fabric and Azure ecosystems.
- Manages the automation and monitoring of frameworks that capture metrics for data pipeline quality and performance.
- Optimises system performance and drives continuous improvement in data processing and cloud infrastructure.
- Manages the adoption of best practices for data security and privacy, ensuring compliance with all internal and external compliance requirements.
- Manages data quality, including cleansing and scrubbing of data, as well as validation automation.
- 5+ years experience managing data security and system performance at a global professional services firm, preferably in the legal sector.
- Experience in scaling data pipelines, data architecture, and Extract, Transform, Load (ETL) processes.
- Strong knowledge of Infrastructure as Code-using tools such as Azure Bicep, Azure Resource Manager (ARM), Terraform, or similar.
- Demonstrable knowledge of data modelling, ETL/ELT processes, and orchestrating complex data flows.
- Practical experience with containerization technologies, including Docker and Kubernetes
- Private Medical Insurance
- Free in-house fitness centre and subsidised health club memberships
- Free onsite GP service and periodic health assessments
- Pension and flexible savings options
- Income protection and life assurance
- Mortgage advice and will-writing services
- Electric car and cycle to work schemes
- Emergency family care
- Additional holiday/birthday leave
- Maternity/paternity/shared parental leave
- Travel insurance and season ticket loan
- Option to join sports and social clubs, as well as our employee networks groups (such as our Gender Equality Network, With Pride, or Social Mobility Networks)
Recommended Jobs
Copy #2 of Part-Time Singing Tutor - Flexible & Remote...
We are looking for dedicated and enthusiastic Primary School Teachers to join our team on a part-time basis . This role offers the flexibility to work across various schools in the UK or provide ...
Demi Chef de Partie - Afternoon Tea & Lounge
Press space or enter keys to toggle section visibility The Chancery Rosewood - opening in Summer 2025, a Rosewood Hotel Group property, is h oused in the iconic former U.S. Embassy on G...
Community Neuro Occupational Therapist
JustOT are looking to recruit a band 6 Community Neuro Occupational Therapist for a locum position with our client in London. The pay for this position is £22 - £26 per hour, and we are looking for ...
Retail Analyst
Aramark UK is seeking a highly analytical and commercially astute Retail Analyst to join our team on a 12-month fixed-term contract . This exciting opportunity involves working closely with cross-fu...
new brand partnerships executive
Parker Lane Group is a global leader in managed resale and re-commerce services. Our advanced resale solutions and in-house, end-to-end supply chain deliver the highest resale values in the market, s...
32hr Keyholder, Kurt Geiger, Stratford
Kurt Geiger | About Us We are an inclusive, creative footwear and accessories brand powered by kindness. We want to empower our talent to be confident and true to themselves, the London way. Lon...
Sales Enablement Manager
We’re a cutting-edge AI SaaS startup (~50 people) revolutionizing the way businesses operate. Our AI-powered platform is transforming industries, and our sales team is expanding fast. We need a high...
Senior Salesforce Developer
Senior Salesforce Developer London Bridge (2 days office-based, 3 days remote working) Up to £90,000 Hyde is looking to recruit a Senior Salesforce Developer. As a Senior Salesforce Develop...
Underwriter / Teams - Equity Stake
Exciting Underwriting Opportunities (Individual or Teams) with Equity Participation We are currently representing a client with a strong and consistent growth trajectory across all lines of busines...