Fabric Data Engineer
Role: Hybrid Workstyle (Full-time) Role Overview: As a Fabric Data Engineer at WTW, you will take ownership of developing and optimising data pipelines, workflows, and ETL processes. You will work with cutting-edge technologies to ensure that data is efficiently processed, stored, and made accessible for analysis. This role is a key part of our data engineering team and requires specific expertise in Microsoft Fabric, Azure, and Python. Key Responsibilities: Fabric or Azure Data Engineer (Non-Negotiable):
- Lead the design and development of scalable data pipelines and ETL processes using Microsoft Fabric or Azure technologies.
- Manage and optimise notebooks, pipelines, and workflows to enhance the performance and efficiency of our data architecture.
- Build and maintain high-quality ETL pipelines to clean, transform, and enrich data from various sources.
Ensure that pipelines are automated, scalable, and fault-tolerant to accommodate large volumes of data.
Experience with Notebooks, Pipelines, and Workflows: - Utilise Notebooks (e.g., Jupyter, Databricks) for data exploration, analysis, and reporting.
Design and optimise data workflows to streamline key processing tasks, enhancing operational efficiency.
API Integration & Data Ingestion: - Integrate external and internal APIs to ingest data into our systems, ensuring smooth and consistent data integration.
Automate the API data ingestion processes to enhance data consistency and quality.
- Contribute to projects involving AI, including integrating generative AI or machine learning models within our data workflows.
- Apply AI technologies to improve data processing and provide deeper insights.
- Adhere to Software Development Life Cycle (SDLC) best practices, including version control, testing, and continuous integration.
- Collaborate with the team to ensure code quality, review processes, and deployment practices.
- Work closely with cross-functional teams and business stakeholders to understand and meet data requirements.
- Effectively communicate complex technical solutions to both technical and non-technical teams, ensuring alignment with business goals.
- A minimum of 2 years of hands-on experience working as a Data Engineer or Fabric Data Engineer, with expertise in Microsoft Fabric, Azure, and Python.
- Proven experience in designing and implementing ETL pipelines, managing notebooks, and optimising data workflows.
- Solid experience working with API integration and data ingestion from various sources.
- Proficiency in Python for building data pipelines, automation, and data manipulation.
- Expertise in Azure cloud services and Microsoft Fabric.
- Knowledge of ETL processes, data modelling, and data integration techniques.
- Understanding of AI technologies and experience working on AI-driven projects (advantageous).
- Familiarity with Power Automate for automating business processes (optional).
- Strong communication skills, with the ability to explain complex technical concepts to non-technical stakeholders.
- Excellent problem-solving abilities, with a focus on data quality and continuous improvement.
Self-motivated and organised, with the ability to manage time effectively and prioritise tasks.
- Experience in the insurance domain or a strong understanding of industry-specific data requirements would be highly beneficial.
- Experience with Reporting & Data Visualisation:
- While not mandatory, familiarity with reporting tools or data visualisation (e.g., Power BI) is advantageous.
- Make an Impact: Work on high-profile data engineering projects that shape the future of the insurance sector.
- Innovation: Join a forward-thinking company that uses cutting-edge technologies, including AI, Azure, and Microsoft Fabric.
- Career Development: Take the next step in your career and gain exposure to exciting data engineering challenges.
- Global Reach: Collaborate with a diverse, global team on projects that span multiple industries.
Recommended Jobs
Global Construction and Real Estate Claims Lead
Job Title: Divisional Director – Claims (Construction & Real Estate) Location: London (Hybrid – Office & Home Based) Salary: Up to £120,000 Overview: My client, a leading ambitious Lloyd’s …
Senior AI Research Scientist
About AQEMIA AQEMIA is a next-gen pharmatech company generating one of the world's fastest-growing drug discovery pipeline. Our mission is to design fast innovative drug candidates for dozens o…
Live-in Nanny needed in Golders Green, London, Job ID J1D169
A lovely family in Golders Green, London is looking for a Live-in Nanny to help them in looking after their two school-aged children. They are looking for someone flexible, reliable, and energetic wh…
DBS Sous Chef / Head Chef
We are looking to recruit temporary chefs to work throughout our clients sites in the areas and surrounding areas: Heathrow, Hayes , Hillingdon Feltham, Hounslow, Slough, Staines Hackney, Islin…
Evening Cleaner
Job Introduction Evening Cleaner Location: Guinness Open Gate Brewery London, Mercers Way, Covent Garden, London Working Hours: 42 hours per week, 5 out of 7 days Shift Pattern: Evenin…
Locum Anesthetist Consultant/SpR - London
Job title: Locum Anesthetist Grade: Consultant/SpR Client Group and Setting: Barts Health NHS Trust Location: London, Greater London Working Hours: Flexible hours 7 – 50 hours Consu…
HR Officer
JRRL is looking for a Human Resources Officer to join a friendly and busy HR team of a successful financial services client based in London. This is an excellent opportunity to work as part of an effe…
Multi Trade Operative
Job Title: Multi Trade Operative Job Type: Permanent, Full-Time Sector: Property Services Location: London Borough of Ealing Hours: Monday to Friday, 08:00 - 17:00 Salary: £37,000.00 pe…
Senior Student Success Tutor (CCCU) - London
Senior Student Success Tutor (CCCU) - London Department: Student Support Location: London (On-Site) About Us: GBS is a higher education provider offering a range of sector-relevant courses a…
Principal Medical Writer
Description Principal Medical Writer Syneos Health® is a leading fully integrated biopharmaceutical solutions organization built to accelerate customer success. We translate unique clinical, me…