Data Engineer
- Evaluating, onboarding, and integrating complex data products from diverse vendors, serving as a key technical liaison to ensure data feeds meet our stringent requirements for research and live trading.
- Designing, implementing, and optimizing robust, production-grade data pipelines to transform raw vendor data into analysis-ready datasets, adhering to software engineering best practices and ensuring seamless consumption by our automated trading systems.
- Engineering and maintaining sophisticated automated validation frameworks to guarantee the accuracy, timeliness, and integrity of all datasets, directly upholding the quality standards essential for the efficacy of our quantitative strategies.
- Providing expert operational support for our data pipelines, rapidly diagnosing and resolving critical issues to ensure the uninterrupted flow of high-availability data powering our daily trading activities.
- Participating actively in team rotations, including on-call schedules, to provide essential coverage and maintain the resilience of our data systems outside of standard business hours.
- 5+ years' experience building ETL/ELT pipelines using Python and pandas within a financial environment.
- Strong knowledge of relational databases and SQL.
- Familiarity with various technologies such as S3, Kafka, Airflow, Iceberg
- Proficiency working with large financial datasets from various vendors.
- A commitment to engineering excellence and pragmatic technology solutions.
- A desire to work in an operational role at the heart of a dynamic data-centric enterprise.
- Excellent communication and collaboration skills, and the ability to work in a team.
- Strong understanding of financial markets.
- Experience working with hierarchical reference data models.
- Proven expertise in handling high-throughput, real-time market data streams
- Familiarity with distributed computing frameworks such as Apache Spark
- Operational experience supporting real time systems.
Recommended Jobs
Junior PR Account Executive
Junior PR Account Executive Join an award-winning PR agency specialising in B2B tech clients. They represent some of the most innovative companies shaping the future of technology. Their integrate...
Data Protection Analyst/Paralegal
An exciting opportunity has arisen for a dedicated and detail-oriented Data Protection Analyst/Paralegal. This role sits within the legal department, providing crucial support to the company's data p...
Year 2 Teacher Opportunity - Exceptional Primary School...
An esteemed Primary School and Nursery is seeking a dedicated and enthusiastic classroom teacher with a passion for delivering exceptional education to join their KS1 team as a Year 2 Teacher. The id...
Locum Band 7 Advanced Paediatric Respiratory PT
Globe Locums About Globe Globe Locums, the UK's medical recruitment agency run by clinicians for clinicians have the following Physiotherapy job available: Physiotherapy Job Description S...
Qualified Experienced Tree Surgeon Required - Stains-Upon-Thames
Arborist jobs in Greater London Due to ongoing high workload we are looking for motivated, capable, qualified individuals to work within our established and friendly Arb Association Approved ...
CI/CD Engineer
CI/CD Engineer** (Contract) Duration: 3 - 6 Months (Possibility for extension) Location: London/Hybrid (3 days on site) Rate: A highly competitive Umbrella Day Rate is available for suitable can...
Personal Trainer in Slough
Role: Buzz Gym Coach - Personal Trainer Location: Harrow Transform Lives Whilst Building Your Dream Career! Join our elite team of Personal Trainers who are currently earning £40,000 - £50,00...
Trainee Recruitment Consultant - Positive atmosphere!
Trainee Recruitment Consultant Wayman Education is looking for driven and enthusiastic Recruitment Consultants to join a rapidly expanding recruitment company. We want to be the premier nat...
Senior Capital Analyst (Igloo)
Our client is looking to hire a Part or Nearly Qualified Actuary ideally with Igloo capital modelling experience to join their team in London. The company does 3 days a week in the office. In this...
Head of Product - High Growth SaaS FinTech
Head of Product - High Growth SaaS FinTech Are you a Product Manager looking to become a Head of Product Management? Are you passionate about making a difference? Are you working for an FCA Re...