Senior Data Engineer(Python)
- Work with product, product engineering, data engineering, and data science peers to build and support our AdTech platform.
- Architect and build data-oriented solutions that are simple, scalable, reliable, secure, maintainable, and make a measurable impact.
- Provide our teams with the data they need to build, sell, and manage our platform. Develop, deliver and maintain batch and real-time data pipelines, analysis services, workflows and orchestrations, and create and manage the platforms and data infrastructure that hold, secure, cleanse and validate, govern, and manage our data.
- Manage our data platform, incorporating services using Airflow/Composer, BigQuery, Snowflake, Kafka, and Redis running on Kubernetes, GCP, and AWS.
- Support our Data Science teams with access to data, performing code reviews, aiding model evaluation and testing, deploying models, and supporting their execution.
- Employ modern pragmatic engineering principles, practices, and tooling, including TDD/BDD/ATDD, XP, QA Engineering, Trunk Based Development, Continuous Delivery, automation, DevSecOps, and Site Reliability Engineering.
- Contribute to driving ongoing improvements to our engineering principles, practices, and tooling. Provide support & mentorship to junior engineers.
- Develop and maintain a contemporary understanding of AdTech developments, industry standards, partner and competitor platform developments, and commercial models, from an engineering perspective.
- Be Extraordinary by Leading Collectively to Inspire transformational Creativity.
- Create an Open environment by Balancing People and Client Experiences by Cultivating Trust.
- Lead Optimistically by Championing Growth and Development to Mobilize the Enterprise.
- Proven experience designing, building, and operating data-oriented solutions in a high volume, transactional, global, industry. Experience with advertising technology (AdTech) highly desired.
- Proven experience and a passion for developing and operating data-oriented solutions using Python, Airflow/Composer, Kafka, Snowflake, BigQuery, and a mix of data platforms such as Spark, AWS Athena, Postgres and Redis. Excellent SQL development, query optimization and data pipeline development skills required. Strong experience using public cloud platforms including AWS and GCP is required; experience with docker and Kubernetes strongly preferred. Experience in the use of multiple programming languages is highly desirable. Experience using Functional programming is ideal.
- Proven experience in developing data structures and algorithms. Experience supporting ML/AI highly desirable.
- Proven experience contributing to product strategy development with Product Management teams. Experience in SaaS product engineering and operations highly desirable.
- Proven experience in data engineering and testing practices and implementing these in teams, with a willingness to share, partner and coach engineers, product people, and operations through pragmatic and effective development and delivery practices.
- Proven experience shaping and evolving the principles, practices, and tooling supporting agile, testing/QA, DevSecOps, automation and SRE in a data-focussed team. Experience in Trunk Based Development, XP, & implementing CI/CD as used in data teams is highly desirable.
- A focus on continuous learning and improving, both technically and professionally, in your industry, for you and your teams.
- Demonstrated resilience, with experience working in ambiguous situations.
- Strong English, excellent influencing and communication skills, and excellent documentation skills.
Recommended Jobs
Associate Director - Life Science
Company Description At Turner & Townsend we're passionate about making the difference. That means delivering better outcomes for our clients, helping our people to realize their potential, and doi...
Grease Ventilation Team Leader
Location: London area Starting Salary £110 per day Shifts: Working day, night, and weekend shifts, varying from week to week (flexibility required) Our client is a family-run business who have...
Oracle Solutions Architect
Engagement Type: Support Description : Talenterprize are delighted to be working with a global consultancy recruiting for an Oracle solutions architect. A career role within the Oracle Consul...
Technology Advisory Assistant Manager
Ideas | People | Trust We’re BDO. An accountancy and business advisory firm, providing the advice and solutions businesses need to navigate today’s changing world. Our clients are Britain’s eco...
Senior Data Scientist - Tax, Technology and Transformation
At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and...
Band 6 Community Social Worker - West London NHS Trust
Liquid Personnel is currently recruiting for a Social Worker to join integrated community and mental health services based in West London. If you are a passionate and driven individual you will th...
Corporate Solicitor (Associate)
Job Details Corporate Associate (1-4 years PQE) London Top 50 International Law Firm £100,000 - £115,000 + benefits My client, a top 50 international law firm, are looking for a talented...
M&E Cost Manager
Archer is working with an independent London construction consultancy to recruit an M&E Quantity Surveyor / Senior QS in its central London office. The business has been established for over 15 year...
Residential Conveyancer
Job Details Residential Conveyancer - London A new opportunity for an experienced Conveyancer has arisen at this full-service firm in London. What is in it for you? Competitive salary, gen...
Associate Director - Investments - London
Associate Director – Investments Salary: £80,000 - £89,000 + excellent benefits, including 27 days holiday, 2:1 pension (up to 12% employer contribution), plus many more Location: Hybrid/Lond...