Senior Data Engineer
- Engineer and implement advanced data products, frameworks, and pipelines, focusing on automation and innovation
- Take on technical ownership of a work stream, be the subject matter expert and work proactively to address project requirements, and articulate issues, challenges with enough lead time to address project delivery risk
- System monitoring and alerting, dashboards, charts/reports and alerts delivery
- Performance tuning of code and review of peer contributions to validate conformance with best practices and the adoption of emerging development trends
- Mentoring of more junior members of the team
- Coordinate and support the verification of program logic by managing test data preparation and ensuring thorough testing and debugging activities
- Collaborate with Project Managers and TPMs to ensure project deliverables are completed on schedule and align fully with defined requirements
- Demonstrable experience in leading and developing large-scale data processing platforms
- Extensive experience throughout the software development lifecycle
- Strong communication skillsets. It is vital that the successful candidate can explain complex technical issues in non-technical terms to business stakeholders
- Demonstrates deep knowledge and hands-on experience in cutting-edge data technologies, with a proactive approach to driving innovation and keeping teams informed of industry advancements
- Skilled in business requirements analysis with ability to translate business information into technical specifications
- Knowledge of streaming services - Flink, Kafka
- Familiarity of Dimensional Modelling concepts
- Knowledge of node based architecture, graph databases and languages - Neptune, Neo4j, Gremlin, Cypher
- 8+ years of experience with Databricks product suite, Spark, Scala, PySpark, Python
- 8+ years of experience in SQL and database technologies like Snowflake or equivalent.
- 5+ years of experience with AWS services (EKS, S3, EC2, DynamoDB, Glue etc)
- 5+ year of experience in Ab Initio, covering multiple components of the product suite
- Proven expertise in designing and architecting sophisticated data systems, with deep knowledge of design principles, architectural patterns, frameworks, and adherence to industry best practices and emerging trends
- Experience with automation, configuration management, orchestration, enterprise schedulers
- Competitive salary
- Discretionary bonus opportunity
- Excellent in-house training opportunities
- BUPA Private Medical Insurance
- Dental Scheme
- 25 days holiday per year plus national holidays and wellness breaks
- Free eye test and glasses voucher
- Cycle to work scheme
Recommended Jobs
European VAT Compliance Specialist, London
Have you got approx. 5 years good quality European Indirect Tax compliance experience? Do you have the right to work in the UK? Do you like the sound of a friendly, dynamic team where you’ll get …
Mid/Senior Laravel Developer (Remote)
Project Overview We’re seeking a Mid/Senior Laravel Developer to join our team and improve our core application; you’ll need 4+ years of PHP/Laravel experience, strong TDD and design-pattern skill…
Senior Trust HR Lead
Our vision is to be a key provider for quality education so that all of our students leave us as highly qualified, confident and articulate young people with a wealth of experience. This vision is un…
Customer Service & Office Coordinator
Surrey Docks Farm is a working city farm and education charity that enables the whole community to learn about farming, food production and the natural environment. We deliver a range of commun…
Exciting Opportunity for a Real Estate Deals Tax Manager!
Are you a skilled tax professional with a passion for Real Estate deals? Are you ready to take on a challenging and rewarding role as a Real Estate Deals Tax Manager? Look no further - we have the pe…
Business Development Manager
Are you a goal-oriented business development professional looking to take your career to the next level? At People Puzzles, we're on the lookout for a passionate Business Development Manager to join …
Corporate Knowledge Lawyer
THE FIRM The London office of a global law firm. THE ROLE A Corporate Knowledge Lawyer is sought for a role where much of the focus will include supporting the Corporate Finance practice, …
Trading Support Engineer
Old Mission is a global proprietary trading firm that leverages state-of-the-art technology and research to identify and execute profitable trading strategies across multiple asset classes around the …
Senior EU Advocate
Who we are CHEM Trust is a highly respected environmental and health NGO dedicated to preventing synthetic chemicals from causing long-term harm to wildlife and human health. Every day, people …
Opex Business Controlling Manager
If you’ve worn a pair of glasses, we’ve already met. We are a global leader in the design, manufacture, and distribution of ophthalmic lenses, frames, and sunglasses. We offer our industry stake…