Senior Data Engineer
- Engineer and implement advanced data products, frameworks, and pipelines, focusing on automation and innovation
- Take on technical ownership of a work stream, be the subject matter expert and work proactively to address project requirements, and articulate issues, challenges with enough lead time to address project delivery risk
- System monitoring and alerting, dashboards, charts/reports and alerts delivery
- Performance tuning of code and review of peer contributions to validate conformance with best practices and the adoption of emerging development trends
- Mentoring of more junior members of the team
- Coordinate and support the verification of program logic by managing test data preparation and ensuring thorough testing and debugging activities
- Collaborate with Project Managers and TPMs to ensure project deliverables are completed on schedule and align fully with defined requirements
- Demonstrable experience in leading and developing large-scale data processing platforms
- Extensive experience throughout the software development lifecycle
- Strong communication skillsets. It is vital that the successful candidate can explain complex technical issues in non-technical terms to business stakeholders
- Demonstrates deep knowledge and hands-on experience in cutting-edge data technologies, with a proactive approach to driving innovation and keeping teams informed of industry advancements
- Skilled in business requirements analysis with ability to translate business information into technical specifications
- Knowledge of streaming services - Flink, Kafka
- Familiarity of Dimensional Modelling concepts
- Knowledge of node based architecture, graph databases and languages - Neptune, Neo4j, Gremlin, Cypher
- 8+ years of experience with Databricks product suite, Spark, Scala, PySpark, Python
- 8+ years of experience in SQL and database technologies like Snowflake or equivalent.
- 5+ years of experience with AWS services (EKS, S3, EC2, DynamoDB, Glue etc)
- 5+ year of experience in Ab Initio, covering multiple components of the product suite
- Proven expertise in designing and architecting sophisticated data systems, with deep knowledge of design principles, architectural patterns, frameworks, and adherence to industry best practices and emerging trends
- Experience with automation, configuration management, orchestration, enterprise schedulers
- Competitive salary
- Discretionary bonus opportunity
- Excellent in-house training opportunities
- BUPA Private Medical Insurance
- Dental Scheme
- 25 days holiday per year plus national holidays and wellness breaks
- Free eye test and glasses voucher
- Cycle to work scheme
Recommended Jobs
Timetable and Assessment Manager
Are you looking for an exciting and rewarding challenge working within data? If so, we have the perfect opportunity for you as our new Timetable and Assessment Manager at Kensington Aldridge Academ...
SEND Teacher Supply Manager - London
This position is for an experienced education recruitment professional with experience in recruitment management and supplying SEND teachers and support staff. The basic salary is up to £55,000 ...
Environment, Health and Safety (EHS) Legal Consultant
Infopro Digital group are recruiting for a Environment, Health and Safety (EHS) Legal Consultant on a permanent basis to join our Red on Line brand to work remote out of our London offices. This i...
Architectural Technician
As an Architectural Technician, you will play a pivotal role overseeing construction projects from inception to completion. What we are looking for: Previous experience working as a Archi...
Tax Manager - Global Brand
Tax Manager // Global Brand// Tax Reporting Focused A leading media & entertainment brand are looking to hire a tax reporting specialist to play a key role in the team. The business are loo...
Year 3 Teaching Assistant
Year 3 Teaching Assistant Prospero Teaching is looking for a hardworking, motivating teaching assistant in Waltham Forest, East London. The school is a Three-form Primary school with a supportiv...
AI Research Intern (PhD) - AI Assurance
Who we are Helsing is a defence AI company. Our mission is to protect our democracies. We aim to achieve technological leadership, so that open societies can continue to make sovereign decisions a...
EARLY YEARS END POINT ASSESSOR
Location: London Hybrid: 50% homebased working Salary: £28,300 - £32,800 Hours: 37.5 per week, Mon - Fri, no evenings/weekends/bank holidays Contract: 6 Month fixed term contract Are yo...
PR & Marketing Executive
Are you an imaginative and innovative Marketing & PR Executive? Do you have a passion for travel and the desire to elevate the vacation rental industry? If you answered yes to these questions, then y...
Director of Operations
Job Details Director of Operations (for a mixed-use complex) Location: London Contract: 6–9 months (potential to extend) Day Rate: c£500–£650 day (via umbrella company) Start: ASAP Int...