Fixed Term Data Engineer
- Play a key role in the execution of our data migration from AWS to Azure, working closely with the Solution Architect and Head of data to shape the technical approach and deliver scalable, cloud-native solutions.
- Evaluate existing data infrastructure and propose Azure-native solutions aligned to business needs.
- Define and lead the migration roadmap, collaborating with internal stakeholders and third parties.
- Advocate for innovation and drive adoption of Azure services, standards, and tools across the team.
- Apply and champion Azure Medallion architecture principles in future-state design.
- Design and implement ingestion pipelines into Azure (Data Lake, Synapse, Blob Storage, Azure SQL).
- Ingest structured, semi-structured, and unstructured data from APIs, FTP/SFTP, cloud platforms, and file-based sources.
- Manage data integrations with suppliers, including file transfers and API-based solutions.
- Use Power Automate (Flow) to automate tasks like copying files from SharePoint or emails to SFTP.
- Provide third-line support for code issues and existing workflows, lead resolution of data failures and integration problems.
- Collaborate with stakeholders to define integration requirements and implement robust solutions.
- Build, optimize, and maintain ETL/ELT pipelines using Azure Data Factory and other cloud-native tools.
- Develop reusable, scalable transformation logic to enable analytics and reporting needs.
- Apply data validation, cleansing, and lineage tracking throughout the pipeline lifecycle.
- Support both existing and future ETL workloads with strong SQL and scripting capabilities.
- Revamp and support existing database designs to enable a scalable migration to Azure.
- Introduce and enforce standards and governance around data structures and code.
- Optimize T-SQL code and SQL Server performance before deploying into production.
- Manage consistent data platforms across regions with a focus on reusability and modularity.
- Monitor and control database file growth, indexing strategies, and performance tuning.
- Develop scalable solutions based on both current and emerging business requirements.
- Lead initiatives in data cloud management, including usage monitoring and optimization.
- Configure and test disaster recovery processes, ensuring business continuity through backup and restore exercises.
- Archive or delete legacy data in line with governance and retention requirements.
- Conduct data mapping exercises, analysing various sources and formats to design fit-for-purpose models.
- Create and present complete logical data models to both technical teams and business stakeholders.
- Participate in scoping future platforms and assessing legacy systems for migration to Azure.
- Perform functional and systems analysis, producing supporting documentation (e.g., flowcharts, data diagrams).
- Be the lead in discovery workshops, weekly stand-ups, and cross-functional solution delivery.
- 6-10 years' experience working with SQL Server (including T-SQL development and performance tuning).
- Proven experience designing ETL/ELT pipelines, ideally in Azure Data Factory.
- Hands-on experience ingesting and transforming data in cloud environments (preferably Azure).
- Familiarity with Azure Medallion architecture or similar layered data designs.
- Integration experience with APIs, SFTP, cloud databases, and file systems.
- Comfortable working with Power Automate, SharePoint, and Office 365 integrations.
- Basic knowledge of C# or PowerShell for custom data integration tasks.
- Experience troubleshooting production systems and optimizing SQL workloads.
- Strong understanding of database administration, performance, and scalability.
- Cloud certification (e.g., Azure Practitioner or equivalent) is highly desirable.
- Experience with AWS services and data environments, especially helpful for transition planning.
- Exposure to CI/CD, DevOps pipelines, and Git for data engineering workflows.
- Familiarity with data governance, quality management, and security practices.
- Technically curious and excited by the opportunity to learn and adopt new tools.
- Naturally proactive and comfortable driving change in existing environments.
- Calm and solution-oriented in high-pressure or production-critical scenarios.
- Collaborative and open communicator who brings people on the journey.
- Able to travel occasionally within Europe to support cross-territory platforms and teams.
- This role is based in our West London Office including some remote working
Recommended Jobs
Design Cooardinator
bout Barhale Who are Barhale? Barhale is a business founded on family values having been established by our Chairman, Dennis Curran in 1980. We are one of the largest privately owned civil engin...
Data Enablement Lead
Odevo is a group of exciting brands with a shared vision of challenging status quo in the property management industry. We are committed to revolutionizing the industry with innovative software solut...
Contracts Manager
Job Title: Contracts Manager Industry: Passive Fire Salary: £55000 - £64000 + Hybrid working Location: South London A great new opportunity has arisen for a FRA Contract Manager to join a...
After-school Nanny for a busy family, Job ID J1C747
A lovely family based in Kensal Rise is seeking an after-school nanny to care for their toddler and two school-aged children on a permanent basis. All general nanny duties are required for this role....
Community Specialist Project Occupational Therapist
JustOT are recruiting for an experienced, HCPC registered Occupational Therapist to join our well-respected client in Lancashire for a specialist project. Details: Hourly rate: £38.00 Location: L...
Senior Platform Engineer (IT)
Location(s): UK, Europe & Africa : UK : London BAE Systems Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, conn...
Actuarial Analyst
Exciting Opportunity: Actuarial Analyst Our client, a leading commercial lines insurer, is seeking a talented Actuarial Analyst to join their Team. We're eager to connect with part-qualified ...
R&D Claiming and Tax Expertise - Various roles and levels of seniority
ABOUT US EmpowerRD is a fast-growing start-up fintech business based in London, UK. We are building towards a vision to help our clients unlock all the funding that rewards innovation globally....
Trainee Recruitment Consultant - New state of the art...
Are you an individual with 12 months+ recruitment experience OR someone with a proven track record in sales looking for a career change? Are you frustrated by office politics/unfair commission ...
Dynamic Drama Teacher Required in Ealing! Performing Arts...
A school in Ealing with a strong focus on the Performing Arts is seeking a dedicated and enthusiastic Drama Teacher to join their well-established department. This is an excellent opportunity for a...