Senior Data Engineer
WHO ARE WE:
We’re Mediahub, the industry’s best-kept secret. This year we got our first Campaign School Report, coming in at number one for building the most ethnically diverse team in the industry.
COMvergence rank us as the UK's fastest-growing media agency for the second year running.
We bring a challenger mindset to everything we do. Brands choose to work with us to disrupt category norms.
We offer the best of both worlds. A start-up culture backed by Mediabrands.
Just some of the brands we work with – New Balance, Pinterest, Celebrity Cruises.
Role Overview:
As a Senior Data Engineer, you will lead the design, development, and optimisation of data pipelines and systems, ensuring scalability, reliability, and performance. This role involves managing Python-based development projects, automating workflows, and creating frameworks that empower analytics and data science teams. You will collaborate across teams, mentor junior engineers, and take ownership of key initiatives, including infrastructure migration and the development of analytics solutions.
This position is ideal for an experienced data engineer with a passion for innovation, problem-solving, and delivering impactful data-driven solutions.
Key Responsibilities:
Python Development and CI/CD Practices:
- Collaborate on Python-based projects, ensuring adherence to best coding practices and standards.
- Implement and manage CI/CD pipelines to streamline development workflows and support scalable systems.
- Utilise Git/GitHub for version control and team collaboration, promoting efficient development processes.
Data Pipeline Design and Optimisation:
- Design, build, and optimise data pipelines within Databricks and MySQL Warehouse to meet client, analyst, and data scientist needs.
- Leverage PySpark to enable high-performance data processing and analytics at scale.
Automation and Standardisation:
- Champion automation-first solutions to solve complex challenges, including integrating machine learning models and developing bespoke tools.
- Create and maintain Python packages to standardise systems across projects, reducing redundancy and enhancing scalability.
Quality Assurance and Debugging:
- Establish comprehensive QA systems to enforce data integrity and streamline debugging processes across pipelines and projects.
Project Leadership and Team Management:
- Take ownership of multiple concurrent projects, managing priorities, client expectations, and technical challenges.
- Mentor and guide junior engineers and analysts, fostering professional growth and technical excellence within the team.
Stakeholder Management and Communication:
- Effectively communicate technical and project updates with stakeholders, ensuring clarity and alignment across all initiatives.
- Coordinate efforts between internal teams (data infrastructure and internal tools) and external clients (analytics and measurement frameworks).
Experience & Skills Required:
- Technical Expertise: Proficient in Python, PySpark, and SQL, with experience in CI/CD pipelines and version control using Git/GitHub.
- Data Engineering: Strong background in designing and optimising data pipelines within Databricks and MySQL Warehouse.
- Automation: Proven ability to develop scalable, reusable Python packages to enhance efficiency and standardisation across projects.
- Data Analytics and Reporting: Skilled in creating insights dashboards using Google Data Studio and Power BI, and conducting correlation analysis.
- Infrastructure Migration: Experience leading large-scale infrastructure migration projects, particularly within cloud-based environments like Databricks.
- Media and AdTech Ecosystems: Familiarity with media adtech platforms, ecosystems, and measurement frameworks.
- Communication and Leadership: Strong verbal and written communication skills, with experience mentoring team members and managing stakeholder relationships.
- Project Management: Ability to manage complex projects, prioritising tasks and delivering high-quality results under tight deadlines.
Ideal Candidate Profile
We are seeking a skilled and motivated Senior Data Engineer with a proven track record of delivering innovative data solutions. The ideal candidate will thrive in a collaborative and dynamic environment, bringing technical excellence, leadership, and a passion for driving impactful change through data engineering. If you are ready to lead transformative projects and mentor a growing team, we would love to hear from you.
Employee Transparency
At IPG Mediabrands, we celebrate differences and believe this makes us stronger. IPG Mediabrands are equal-opportunity employers committed to championing an inclusive culture that provides a sense of belonging for all our employees. We do not discriminate against any applicant based on age, disability, race, colour, ethnicity, national origin, gender, sexual orientation, gender identity, religion, belief, marital status or any other characteristic protected by law.
Please reach out to our Talent Inclusion Specialist Jess at [email protected] if you would like to have a confidential conversation regarding any adjustments that would ensure our recruitment process is accessible for you. Please note requesting a reasonable adjustment will not affect your application.
The Perks
We aim to provide all our people with a supportive and fun work environment where you can develop your full potential and benefit from the broad range of opportunities within the agency. When you join us, we want to make sure you feel valued – and that you are rewarded for your fantastic work. So, we also offer a range of benefits:
- Flexi–leave, with 25 days annual leave to be taken as minimum. In addition to your holiday entitlement, the office usually closes between Christmas & New Year
- Free breakfast and free lunch
- Early finish Fridays
- Core Hours (Mon-Thurs, flexible start/finish times)
- Retail discounts
- Wellbeing programme
- Interest free season ticket loan
- Paid time off for Volunteering
- Group Income Protection
- Life Assurance
- Private Medical Insurance or Health Cash Plan (dependent on level)
- Group Personal Pension Plan with matched contributions from 3-6%
- Generous Parental Leave & Pay
- Independent mortgage advice
- Financial education
- Employee Assistance Programme
- Free eye tests
- Flexible benefits including Dental, Travel insurance, Cycle to Work, Gym Discounts and many more!
Recommended Jobs
Senior Underwriter - Property & Casualty Multinational Lead
Senior Property & Casualty Underwriter (Multinational Lead)My client, a leading specialist insurer, is seeking a dynamic Senior Underwriter to join their thriving team. With a strong track record of ...
Financial Crime Executive
FAST Global Bank (iGB) is a licensed Bank in the UK that aspires to provide Global Banking connectivity to individuals, corporates and financial institutions. We are currently looking for a Financial...
Head of IT
Job Description A long-established and trusted global brokerage is seeking a Head of IT to lead our technology strategy, infrastructure, and security operations. With over 30 years of industry p...
React Native Developer
React Native Developer Pearson Carter are currently working with a gamification organisation who work heavily in the Sports industry who are expanding their team. They offer a base salary o...
Bid Manager
OCS UK & Ireland is a leading facilities management company with 50,000+ colleagues and a turnover in excess of £2bn. We deliver innovative, award-winning services within facilities management, hard ...
Locum Band 5 Medicines Management Pharmacy Technician
Globe Locums About Globe Globe Locums, the UK's medical recruitment agency run by clinicians for clinicians have the following Pharmacy job available: Pharmacy Job Description Speciality ...
Planning Lawyer
Job Details Senior Planning Lawyer London Local Authority Locum Contract Hybrid Working Arrangement £50-60 per hour umbrella rate (DOE) Sellick Partnership are pleased to be working w...
Client Enablement Lead (talent pool)
We’re always ready to hire the best people when they become available, so while we’re not urgently hiring for this “talent pool” role at the moment, there’s a good chance we’ll still make an offer if...
Design & Technology Teacher (Resistant Materials focus) |...
A creative and enthusiastic Design & Technology Teacher with a focus on Resistant Materials is required to join an Outstanding Mixed school in Camden. The successful candidate will inspire students a...
Director of Delegated Underwriting
Director of Delegated UnderwritingA leading international (re)insurer is seeking an experienced and strategic professional to take on a critical role in the management of their delegated authority po...