Senior Data Engineer
WHO ARE WE:
We’re Mediahub, the industry’s best-kept secret. This year we got our first Campaign School Report, coming in at number one for building the most ethnically diverse team in the industry.
COMvergence rank us as the UK's fastest-growing media agency for the second year running.
We bring a challenger mindset to everything we do. Brands choose to work with us to disrupt category norms.
We offer the best of both worlds. A start-up culture backed by Mediabrands.
Just some of the brands we work with – New Balance, Pinterest, Celebrity Cruises.
Role Overview:
As a Senior Data Engineer, you will lead the design, development, and optimisation of data pipelines and systems, ensuring scalability, reliability, and performance. This role involves managing Python-based development projects, automating workflows, and creating frameworks that empower analytics and data science teams. You will collaborate across teams, mentor junior engineers, and take ownership of key initiatives, including infrastructure migration and the development of analytics solutions.
This position is ideal for an experienced data engineer with a passion for innovation, problem-solving, and delivering impactful data-driven solutions.
Key Responsibilities:
Python Development and CI/CD Practices:
- Collaborate on Python-based projects, ensuring adherence to best coding practices and standards.
- Implement and manage CI/CD pipelines to streamline development workflows and support scalable systems.
- Utilise Git/GitHub for version control and team collaboration, promoting efficient development processes.
Data Pipeline Design and Optimisation:
- Design, build, and optimise data pipelines within Databricks and MySQL Warehouse to meet client, analyst, and data scientist needs.
- Leverage PySpark to enable high-performance data processing and analytics at scale.
Automation and Standardisation:
- Champion automation-first solutions to solve complex challenges, including integrating machine learning models and developing bespoke tools.
- Create and maintain Python packages to standardise systems across projects, reducing redundancy and enhancing scalability.
Quality Assurance and Debugging:
- Establish comprehensive QA systems to enforce data integrity and streamline debugging processes across pipelines and projects.
Project Leadership and Team Management:
- Take ownership of multiple concurrent projects, managing priorities, client expectations, and technical challenges.
- Mentor and guide junior engineers and analysts, fostering professional growth and technical excellence within the team.
Stakeholder Management and Communication:
- Effectively communicate technical and project updates with stakeholders, ensuring clarity and alignment across all initiatives.
- Coordinate efforts between internal teams (data infrastructure and internal tools) and external clients (analytics and measurement frameworks).
Experience & Skills Required:
- Technical Expertise: Proficient in Python, PySpark, and SQL, with experience in CI/CD pipelines and version control using Git/GitHub.
- Data Engineering: Strong background in designing and optimising data pipelines within Databricks and MySQL Warehouse.
- Automation: Proven ability to develop scalable, reusable Python packages to enhance efficiency and standardisation across projects.
- Data Analytics and Reporting: Skilled in creating insights dashboards using Google Data Studio and Power BI, and conducting correlation analysis.
- Infrastructure Migration: Experience leading large-scale infrastructure migration projects, particularly within cloud-based environments like Databricks.
- Media and AdTech Ecosystems: Familiarity with media adtech platforms, ecosystems, and measurement frameworks.
- Communication and Leadership: Strong verbal and written communication skills, with experience mentoring team members and managing stakeholder relationships.
- Project Management: Ability to manage complex projects, prioritising tasks and delivering high-quality results under tight deadlines.
Ideal Candidate Profile
We are seeking a skilled and motivated Senior Data Engineer with a proven track record of delivering innovative data solutions. The ideal candidate will thrive in a collaborative and dynamic environment, bringing technical excellence, leadership, and a passion for driving impactful change through data engineering. If you are ready to lead transformative projects and mentor a growing team, we would love to hear from you.
Employee Transparency
At IPG Mediabrands, we celebrate differences and believe this makes us stronger. IPG Mediabrands are equal-opportunity employers committed to championing an inclusive culture that provides a sense of belonging for all our employees. We do not discriminate against any applicant based on age, disability, race, colour, ethnicity, national origin, gender, sexual orientation, gender identity, religion, belief, marital status or any other characteristic protected by law.
Please reach out to our Talent Inclusion Specialist Jess at [email protected] if you would like to have a confidential conversation regarding any adjustments that would ensure our recruitment process is accessible for you. Please note requesting a reasonable adjustment will not affect your application.
The Perks
We aim to provide all our people with a supportive and fun work environment where you can develop your full potential and benefit from the broad range of opportunities within the agency. When you join us, we want to make sure you feel valued – and that you are rewarded for your fantastic work. So, we also offer a range of benefits:
- Flexi–leave, with 25 days annual leave to be taken as minimum. In addition to your holiday entitlement, the office usually closes between Christmas & New Year
- Free breakfast and free lunch
- Early finish Fridays
- Core Hours (Mon-Thurs, flexible start/finish times)
- Retail discounts
- Wellbeing programme
- Interest free season ticket loan
- Paid time off for Volunteering
- Group Income Protection
- Life Assurance
- Private Medical Insurance or Health Cash Plan (dependent on level)
- Group Personal Pension Plan with matched contributions from 3-6%
- Generous Parental Leave & Pay
- Independent mortgage advice
- Financial education
- Employee Assistance Programme
- Free eye tests
- Flexible benefits including Dental, Travel insurance, Cycle to Work, Gym Discounts and many more!
Recommended Jobs
C# Dot Net Software Developer with Fixed Income and FX (IT)
Job Description C# .NET Software Developer with FX and Fixed Income Our Client is a niche boutique broker specialising in FX. They are looking to recruit a C# .NET Software Developer with at lea...
Lead Practitioner - Singing and Music
Type of contract: Permanent, full-time Hours of work: 37 hours per week Salary: Grade 6, £45,480 - £49,699 plus benefits The Role We are currently seeking a versatile and creative individual to...
Support Assistant
Learning Support Assistant Annual Salary: £24,000 Location: Tower Hamlets Job Type: Full-time, Permanent Start Date: September We are seeking a dedicated Learning Support Assistant t...
Locum Band 7/8a pharmacist
Globe Locums About Globe Globe Locums, the UK's medical recruitment agency run by clinicians for clinicians have the following Pharmacy job available: Pharmacy Job Description Speciality ...
Senior Electrical Engineer
The Anthro joint venture between Egis and VVB Engineering will provide comprehensive turn-key services for London’s state-of-the-art HS2 gateway station at Old Oak Common. We have been awarded ...
Business Studies teacher- Great school in Haringey- April...
With our proven track record of over 20 years in the education and finance field, we have established ourselves as a leading specialist recruitment agency. We are currently looking for a highly motiv...
Senior Client Account Set Up Analyst (ISA)
We are a growing FinTech company looking for a talented and enthusiastic individual to join our team. As we expand, this position offers the perfect opportunity to make a significant impact on our co...
Art Teacher
Art Teacher: Unleash Creativity - Hammersmith's Artistic Heart Are you an Art Teacher who can inspire students to express themselves visually, explore different mediums, and appreciate diverse cult...
Year 5 Teacher | Highly Regarded School in Camden |...
We are partnering with a brilliant one-form entry primary school located in Camden to find a diligent and dedicated Year 5 Teacher for a September start. The school holds a Good Ofsted rating report....
Customer Success Manager EMEA
Customer Success Manager - EMEA Retail Media | SaaS | Enterprise Clients £70,000 - £80,000 + Bonus | Hybrid (London HQ) Are you a strategic relationship builder with a passion for retail and...