Data Engineer
- Build and maintain scalable, efficient ETL/ELT pipelines for both real-time and batch processing.
- Integrate data from APIs, streaming platforms, and legacy systems, with a focus on data quality and reliability.
- Design and manage data storage solutions, including databases, warehouses, and lakes.
- Leverage cloud-native services and distributed processing tools (e.g., Apache Flink, AWS Batch) to support large-scale data workloads.
- Monitor, troubleshoot, and optimize data pipelines to ensure performance and cost efficiency.
- Implement data governance, access controls, and security measures in line with best practices and regulatory standards.
- Develop observability and anomaly detection tools to support Tier 1 systems.
- Work with engineers and business teams to gather requirements and translate them into technical solutions.
- Maintain documentation, follow coding standards, and contribute to CI/CD processes.
- Stay current with new technologies and help improve the team's tooling and infrastructure.
- 8+ years of experience in data engineering or a related field.
- Strong programming skills in Java, Python and SQL; familiarity with Rust is a plus.
- Proven experience designing and maintaining scalable ETL/ELT pipelines and data architectures.
- Hands-on expertise with cloud platforms (e.g., AWS) and cloud-native data services.
- Comfortable with big data tools and distributed processing frameworks such as Apache Flink or AWS Batch.
- Strong understanding of data governance, security, and best practices for data quality.
- Effective communicator with the ability to work across technical and non-technical teams.
- Experience with orchestration tools like Apache Airflow.
- Knowledge of real-time data processing and event-driven architectures.
- Familiarity with observability tools and anomaly detection for production systems.
- Exposure to data visualization platforms such as Tableau or Looker.
- Relevant cloud or data engineering certifications.
- A collaborative and transparent company culture founded on Integrity, Innovation and Performance.
- Competitive salary with two discretionary bonus payments a year.
- Benefits such as Healthcare, Dental, Vision, Retirement Planning, 30 days holiday and free lunches when in the office.
- Regular Town Halls, team lunches and drinks.
- A Corporate and Social Responsibility program as well as charity fundraising matching and volunteer days.
Recommended Jobs
Nursery Manager
Our client a stunning and welcoming nursery situated in East London, offering fulltime and flexible childcare for children aged 6months to 5 years. They aim to provide a safe, healthy, fun, stimulatin…
Client Experience and Sales Specialist London Victoria St
CardHeading: [Join Thérapie to gain incredible earning potential and fast-track your career as a Client Experience and Sales Specialist!] CardIntro: [Offer expert consultations, guide clients on thei…
Early Years Executive Manager / Area Manager
Early Years Executive Manager / Area Manager– Four-Branch Private Nursery Group (London) *Salary:* Up to £65,000 + Annual bonus (Annual bonus scheme based on performance and company target + 40+ Paid…
Product Coordinator
Are you passionate about off-the-beaten track adventure travel? Do you have experience arranging Escorted Group Tours? We are excited to be working with this growing independent adventure tour ope…
Senior Consultant
Momentum ITSMA is a growth consultancy that enables global organizations to achieve market-beating performance by winning, growing, and retaining their most valuable client relationships. Due to the …
Supervisor - Black Sheep Coffee
Requirements: Mon-Sun Flexibility, Supervisor Experience Are you a Black Sheep? Do you want to challenge the establishment and leave the herd behind? So do we! Black Sheep Coffee are ready to ta…
Senior People Advisor
Recruitment Support - Advise hiring managers, post job ads, and liaise with agencies to ensure smooth hiring processes. Onboarding & Offboarding - Oversee contracts, right-to-work checks, referenc…
Underwriting Assistant - Tech Onshore (6M FTC)
Starr Insurance Companies is a leading insurance and investment organization, providing commercial property and casualty insurance, including travel and accident coverage, to almost every imaginable b…
Graduate Teaching Assistant
Graduate Teaching Assistant - Southeast London Join Tradewind Recruitment Are you a recent graduate looking to kickstart your career in education? Tradewind Recruitment is hiring Graduate Teachi…
PE Teaching Assistant
PE Teaching Assistant - Secondary School (Agency Role) Location: Lewisham Contract Type: Full-Time, Term-Time Only (Temporary / Ongoing) Salary: £95-£110 per day (dependent on experience) Start Da…