Lead Data Engineer
We are committed to inclusivity, building a genuinely diverse community of tech talent and inspiring everyone to pursue careers in our sector-including our Armed Forces-and are proud to hold a Gold Award in recognition of our support of the Armed Forces Corporate Covenant. Join us and you'll be part of an open, friendly community of experts. We'll train and support you in taking your career wherever you want it to go. This is a hybrid role with regular travel in the London area. All applicants must have the right to live and work in the UK. Your future duties and responsibilities: As a Lead Data Engineer, you'll play a pivotal role in building scalable, re-usable data solutions for complex challenges. You'll be a hands-on contributor as well as a leader of teams or projects depending on your level, with involvement in architecture, design, and delivery of high-quality systems. You'll work across diverse domains, technologies, and platforms, with a strong emphasis on modern cloud ecosystems and real-time data. Key responsibilities will include: - Designing and developing scalable data pipelines and storage solutions in cloud environments (AWS, Azure, GCP)
- Writing complex queries against relational and non-relational databases
- Leading or contributing to key projects involving technologies like Databricks, Snowflake, BigQuery and Fabric
- Applying software engineering best practices to data engineering, including CI/CD, monitoring and alerting
- Collaborating with cross-functional teams including Data Scientists, Architects and Analysts
- Mentoring team members and promoting a culture of technical excellence
- Continuously improving code quality, performance and maintainability
- Working with near real-time, geospatial and AI-accelerated data applications Required qualifications to be successful in this role: - Strong proficiency in Python, including OOP principles and clean, maintainable coding practices
- Advanced SQL skills and experience designing efficient schemas and optimising performance
- Experience with code versioning, dependency management, logging, validation and monitoring
- Familiarity with modern data platforms such as Databricks, Snowflake or Microsoft Fabric
- Solid understanding of software engineering principles and SDLC best practices
- Demonstrated success working across multiple cloud platforms (AWS, Azure, or GCP)
- Excellent communication and collaboration skills with technical and non-technical stakeholders
- A proactive, delivery-oriented mindset with a passion for learning and solving hard problems #LI-RJ1 Skills:
- Data Engineering
- Snowflake
Recommended Jobs
Front end Designers
Front End Designer â Hotels Team at a Prestigious UK Practice A renowned UK architecture practice, celebrated for its cutting-edge and sustainable designs, is looking for a skilled Front End Desig...
Patent Formalities Specialist c£50,000++ London
Dawn Ellmore Employment are working with a top tier firm on their search for a Patent Formalities Specialist to join them in London on a full time, permanent basis. We are seeking candidates with at ...
Year 2 Teacher & KS1 Phase Leader - Successful Hackney...
A high-performing and inclusive primary school in Hackney is recruiting a Year 2 Teacher with KS1 phase leadership responsibilities. This role offers the perfect combination of classroom teaching and...
Senior Marketing Executive
Role Overview A great opportunity for a self-starting Senior Marketing Executive at one of the world’s leading real estate companies. Supporting the Senior Marketing Manager, this role will work o...
Senior Cyber Account Manager
Join us at Gallagher Re, the trailblazers of the reinsurance world, where every day brings new opportunities to shape the future. We empower our clients with cutting-edge analytics and insights, ...
Sales Development Representative
Greetings from The Opportunity Hub UK! We're thrilled to bring you an extraordinary opportunity to join a spirited start-up that's making waves in boosting performance, wellness, culture, and product...
Remote Freelance Norwegian Instructor
**This is a Freelance Position, Expert-level Norwegian Fluency is Required ** About The Job Students come to Berlitz not just to learn a language, but also to gain an understanding of the culture...
Floor Manager
Floor Manager | El Pastor | London Bridge, London El Pastor is a small group of Mexican taquerias in London, inspired by the decade the founders spent in Mexico City, running a cult nightclub a...
OTC Clearing Technology PM / BA Lead
About Citi Citi, the leading global bank, has approximately 200 million customer accounts and does business in more than 160 countries and jurisdictions. Citi provides consumers, corporations, gover...
Strategic Customer Success Manager
What We Do Managing cyber risk, together– Today the modern enterprise is an Enterprise of Things. We are on a mission to secure the Enterprise of Things with active defense by identifying, segmenti...