Data Engineer
- Drive end-to-end development of data engineering initiatives across multiple systems including financial services, CRM platforms, and analytics tools, leveraging technologies such as DLT and SQLMesh
- Oversee the implementation and optimization of scalable ETL pipelines with robust error handling, incremental loading, and schema evolution for destinations like PostgreSQL
- Manage cross-functional collaboration with product, engineering, compliance, and business intelligence teams to ensure timely and accurate data delivery
- Develop and maintain data infrastructure roadmaps, resource plans, and risk mitigation strategies aligned with business and regulatory priorities
- Lead the strategic evolution of our data stack to support real-time processing, advanced analytics, and compliance reporting in the financial services domain
- Monitor and report on key data pipeline metrics including latency, throughput, and data quality benchmarks
- Create and maintain detailed technical documentation, including pipeline designs, data contracts, and operational procedures
- Coordinate with data governance and security teams to ensure adherence to GDPR, KYC/AML, and PCI-DSS standards
- Collaborate with DevOps to maintain CI/CD pipelines and containerized environments, ensuring smooth deployment and system stability
- 5+ years of hands-on data engineering, designing and maintaining production-grade data pipelines
- Advanced SQL for data analysis (window functions, performance tuning)
- Proficient in ETL/ELT frameworks (e.g., DLT, Airflow, dbt/SQLMesh, Dagster) for ingesting, transforming, and loading data
- Intermediate programming skills in Python (pandas, pyarrow, REST API integrations) and bash for scheduling and orchestration
- Experience with data warehouses (PostgreSQL), including partitioning, clustering, and indexing
- SQLMesh for data processing
- Strong command of data validation and quality tooling, implementing checks, alerts, and retry logic for high-volume data flows
- Hands-on with containerized deployments (Docker, Kubernetes) and CI/CD pipelines (GitLab/GitHub Actions) to automate testing and rollout of payment-data services
- Skilled in real-time streaming and batch architectures, using Kafka or Pub/Sub
- Team and our Product: We are team players and we are passionate about our
product and understand what we aim to achieve and the impact it will make. - Growth Opportunities: You can Influence and shape our story while advancing your career.
- Flexibility: We always listen to our people and can be flexible with arrangements.
- Hybrid or Remote Working: We don't expect you to be in the office every day.
- Local Market Perks: Enjoy insurance coverage, local perks, and beautiful offices.
We may not be perfect, but our strength lies in our resilience. Facing challenges with our expertise, positive attitude, and a supportive environment where everyone relies on one another gives us confidence in what we do. We empower our people to make decisions, explore, and experiment - micromanagement isn't our style. We reward those who take on additional responsibilities and go the extra mile. We are proud of how diverse and unique we are. We thrive on diverse views, love learning from one another, and believe that our differences fuel our curiosity
Recommended Jobs
Head of E-commerce in City of London
Job description ABOUT THE ROLE At Drake’s, we have always taken the scenic route - crafting garments with character, quality, and soul. Our online journey started organically, but now it’s time…
Senior Global Innovation Manager - Futures
Who are we? Helping you have healthy hair has been our mane goal since 2007. No matter your hair type – straight, curly, fine, fragile, or coily – our range of gentle brushes will leave you with …
Frontend Technical Architect
Frontend Technical Architect – Retail Wealth Management £90000 Plus Bonus and Bens Quant Capital is urgently looking for a Technical Architect with strong frontend JavaScript Experience to…
Supplier Quality Engineer
To strengthen our customer team in London (Southend ), England, United Kingdom , we are looking for a Supplier Quality Engineer ~ Perform source inspections at supplier facilities to assess th…
Sales Assistant - Stratford
LUXURY SALES ASSISTANT - FINE JEWELLERY SALARY :UP TO £30K + COMMISSION OFFERING: * Competitive base salary with generous commission structure. * Comprehensive training and career developm…
Mechanical Pipe Fitter
Chapman Recruitment are seeking a qualified Mechanical Pipe fitter with HVAC experience on a mixture of days and nights at Heathrow Airport. Mechanical Pipe Fitter * PAYE JIB rates plus uplift * …
License Owner, London
Turn Your Love for Football into a Thriving Business – Lead the Game in London! Are you someone who dreams of turning your passion for football into a full-fledged venture? We’re looking for a mo…
Supported Housing Worker
We are Hestia. We make a difference. At Hestia, we are guided by our core values and are dedicated to fostering an equitable, diverse, and inclusive organisation. Our mission is to empower indivi…
FRA Carpenter
FRA Carpenter needed in Camden, £21.05ph PAYE – Reference: RQ1583304 • Fitting new fire doors , repair frames and upgrading existing doors • Fitting electrical enclosures • Installing fire rela…
Senior Finance Business Partner - Financial Services (Fixed-Term Contract)
Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change. By combining world-class engineering, industry expertise and …