Data Engineer
- Build and maintain scalable, efficient ETL/ELT pipelines for both real-time and batch processing.
- Integrate data from APIs, streaming platforms, and legacy systems, with a focus on data quality and reliability.
- Design and manage data storage solutions, including databases, warehouses, and lakes.
- Leverage cloud-native services and distributed processing tools (e.g., Apache Flink, AWS Batch) to support large-scale data workloads.
- Monitor, troubleshoot, and optimize data pipelines to ensure performance and cost efficiency.
- Implement data governance, access controls, and security measures in line with best practices and regulatory standards.
- Develop observability and anomaly detection tools to support Tier 1 systems.
- Work with engineers and business teams to gather requirements and translate them into technical solutions.
- Maintain documentation, follow coding standards, and contribute to CI/CD processes.
- Stay current with new technologies and help improve the team's tooling and infrastructure.
- 8+ years of experience in data engineering or a related field.
- Strong programming skills in Java, Python and SQL; familiarity with Rust is a plus.
- Proven experience designing and maintaining scalable ETL/ELT pipelines and data architectures.
- Hands-on expertise with cloud platforms (e.g., AWS) and cloud-native data services.
- Comfortable with big data tools and distributed processing frameworks such as Apache Flink or AWS Batch.
- Strong understanding of data governance, security, and best practices for data quality.
- Effective communicator with the ability to work across technical and non-technical teams.
- Experience with orchestration tools like Apache Airflow.
- Knowledge of real-time data processing and event-driven architectures.
- Familiarity with observability tools and anomaly detection for production systems.
- Exposure to data visualization platforms such as Tableau or Looker.
- Relevant cloud or data engineering certifications.
- A collaborative and transparent company culture founded on Integrity, Innovation and Performance.
- Competitive salary with two discretionary bonus payments a year.
- Benefits such as Healthcare, Dental, Vision, Retirement Planning, 30 days holiday and free lunches when in the office.
- Regular Town Halls, team lunches and drinks.
- A Corporate and Social Responsibility program as well as charity fundraising matching and volunteer days.
Recommended Jobs
Maintenance Engineer
Maintenance Engineer - South London Are you passionate about safety and security? Since 1992, Clymac has been a leader in delivering fully integrated Fire & Security Systems across the UK. We’re l…
Part-Time Private Chef in Chelsea
LocationChelsea London RolePrivate/Personal Chefs SalaryNegotiable Our clients, a family of four (two adults and two children), are seeking a part-time private chef to cook for them on Mondays, We…
UK&I Region GRC Manager
Job Location: Greenford Job Location: Greenford Company Description Ferrero is a family-owned company with a truly progressive and global outlook and iconic brands such as Nutella®, Tic Tac…
Labourer
Job Category: Trade & Operatives Location: Broadwater Farm Community Centre, London Borough of Haringey Hours Per Week: 36.00 Start Date: Immediate Start Start Time: 08:00 End Time: …
Site Supervisor
Site Supervisor (Repairs & Voids) Location: Ealing or Staines Job Type: Full-Time, Permanent Salary: Competitive + Van/Allowance + Benefits About the Role We're looking for an experienced Site Supe…
Part time Office Coordinator
Ensure the office environment is well-organised and fully equipped for daily operations. Welcome guests and prep meeting rooms as required. Coordinate and manage incoming calls, emails, and cor…
Early Years Practitioner - Flexible days
Marylebone Services work with a huge variety of Early Years settings in and around London who require Level 3 Early Years Practitioners to work on a supply/bank cover basis, this can be day to day, sh…
Head of Education and Student Experience
London Film Academy (LFA) has a global reputation for excellence in film education. We are proud to see our graduates go on to build notable careers in both TV and film all over the world. We’re seek…
Baggage Engineer
Our Client has a requirement for a Baggage Engineer, who will be required to work on a contract basis in London/Stansted. Role Purpose: We are seeking a Baggage Engineer to support the delivery of t…
Marketing & PR Executive
Are you a marketing and PR whiz? Do you love coming up with creative ideas that make brands shine? Well, have we got the job for you! We're looking for a Marketing & PR Executive to join our team and…