Data Engineer (Python, Kibana, Elasticsearch & AWS) - DV Security Clearance (IT)

CGI
London

Shape secure, data-driven solutions that help government clients tackle some of their most complex challenges. As a Senior Data Engineer within CGI?s Secure Innovation team, you?ll turn complex datasets into trusted insight, with particular emphasis on Kibana visualisation and hands-on data engineering. You?ll take ownership of data quality and end-to-end flows, creatively solve technical challenges, and collaborate with experts to deliver secure, scalable solutions that make a measurable difference. Working with modern technologies including Python, Elasticsearch, Kibana and AWS, you?ll have the freedom to innovate while being supported with ongoing learning and development to keep your skills at the forefront of an evolving technology landscape. CGI was recognised in the Sunday Times Best Places to Work List 2025 and has been named a UK ?Best Employer? by the Financial Times. We offer a competitive salary, excellent pension, private healthcare, plus a share scheme (3.5% + 3.5% matching) which makes you a CGI Partner not just an employee. We are committed to inclusivity, building a genuinely diverse community of tech talent and inspiring everyone to pursue careers in our sector, including our Armed Forces, and are proud to hold a Gold Award in recognition of our support of the Armed Forces Corporate Covenant. Join us and you?ll be part of an open, friendly community of experts. We?ll train and support you in taking your career wherever you want it to go. Due to the secure nature of the programme, you will need to hold DV level UK Security Clearance or be eligible to go through this clearance. This is a hybrid position and will require the holder to spend a minimum of 3 days a week on site in Central London Candidate profile: In this role, you will engineer, analyse and validate data that supports secure, high-value solutions for our government clients. You?ll take ownership of data quality and integrity across end-to-end data flows, using Kibana and Elasticsearch to create visualisations, dashboards and investigations that turn complex information into actionable insight. You?ll work collaboratively across upstream and downstream teams, bringing creative thinking to technical challenges and identifying risks, anomalies and dependencies before they affect delivery. Supported by CGI colleagues and ongoing development opportunities, you?ll communicate findings clearly to technical and non-technical stakeholders, including senior leadership and client teams.

  • Engineer & Deliver: Develop and support robust data engineering solutions using Python and modern data tooling.
  • Visualise & Investigate: Use Kibana and Elasticsearch extensively to build dashboards, investigate datasets and communicate meaningful insights.
  • Analyse & Validate: Perform detailed data analysis, integrity checks and quality validation across multiple data formats.
  • Automate & Improve: Use Python and command-line tooling to automate analysis and operational activities.
  • Manage Data Flows: Load data into bespoke visualisation tools and work with AWS services, including S3.
  • Own Data Quality: Understand end-to-end data flows, dependencies and impacts, proactively identifying risks and anomalies.
  • Collaborate & Communicate: Work across technical teams and provide clear status updates and findings to clients and senior stakeholders.
  • Innovate & Develop: Explore new technologies and approaches while sharing knowledge within a supportive, collaborative engineering environment.
Required qualifications to be successful in this role You should bring strong, hands-on data engineering experience combined with practical Kibana visualisation expertise. You?ll be comfortable analysing complex data, investigating quality issues and using Python, Elasticsearch, AWS and command-line tooling to deliver reliable outcomes. Strong analytical thinking, attention to detail and the ability to communicate effectively across technical and non-technical audiences will be essential.
  • Strong data engineering experience, including working with complex datasets and end-to-end data flows.
  • Strong practical experience with Kibana, including dashboards, data visualisation and investigative analysis.
  • Experience with Elasticsearch and its use alongside Kibana.
  • Proficiency in Python for data analysis, development and automation.
  • Proven experience in data analysis, validation, integrity and quality checking.
  • Familiarity with AWS, particularly navigating services and working with S3.
  • Experience with command-line tools for investigation, file handling and operational activities.
  • Strong analytical and problem-solving skills, with the ability to identify risks, issues and anomalies.
  • Excellent attention to detail and the ability to interpret nuances across multiple data formats.
  • Effective stakeholder communication and collaboration skills, including working across teams and communicating with senior and client stakeholders.
  • A demonstrable interest in learning, innovation and continuous technical development.

#LI-RB8

Posted 2026-09-19

Recommended Jobs

Quant - Systematic Multi-Strat

Man Group
London

About Man Group Man Group is a global alternative investment management firm focused on pursuing outperformance for sophisticated clients via our Systematic, Discretionary and Solutions offerings.…

View Details
Posted 2026-09-18

After School Supervisor | Croydon | January 2026

Marchant Recruitment
Croydon, Greater London

Are you a dependable, caring, and enthusiastic After School Supervisor looking for a rewarding opportunity starting in January 2026? Do you enjoy supporting children in a structured, safe, and engagi…

View Details
Posted 2026-09-17

Professional Services Consultant - AI Security

Cato Networks
London

Welcome to the future of cloud networking and security!   Cato Networks is the first company to converge enterprise networking and security into one centralized and global service that is delivered…

View Details
Posted 2026-09-06

Principal Fire Engineer

Brandon James
London

Principal Fire Engineer | Hybrid Working | 9-Day Fortnight A specialist fire engineering consultancy are seeking a Principal Fire Engineer to join their growing team. This opportunity suits a Fire En…

View Details
Posted 2026-09-18

Copy of Governance & Risk Manager

LegalAndGeneral
London

Legal & General (L&G) is a leading UK financial services group and major global investor.  We’ve been safeguarding people’s financial futures since 1836, and strive to build a better society, w…

View Details
Posted 2026-09-18

👤 HR Manager - Haringey | Full HR Responsibility

Marchant Recruitment
London

Haringey | ⏰ ASAP Start | Temporary to Permanent | 8:30am–4:30pm, Monday–Friday | Term Time Only | £45,000–£51,000 FTE A secondary school in Haringey is seeking an experienced HR professional to t…

View Details
Posted 2026-09-18

Early Years Foundation Stage (EYFS) Lead | Maintained...

Marchant Recruitment
Barnet, Greater London

CORE PURPOSE We require an inspiring, pedagogically rigorous Early Years specialist to lead our foundational provisions. The role involves driving high-quality early childhood education, tracking …

View Details
Posted 2026-09-17

Teacher of Business & Economics | North London | Top-Tier...

Marchant Recruitment
Barnet, Greater London

A prestigious mixed secondary school in Barnet is seeking a dedicated Business and Economics Teacher for a permanent September start. You will be responsible for delivering high-quality instruction a…

View Details
Posted 2026-09-17

Lead QPU Design Engineer

QUANTUM MOTION TECHNOLOGIES LIMITED
London

About The Role and Team Quantum Motion is a fast-growing quantum computing scale-up based in London. We are developing quantum processors based on industrial-grade silicon chips, with the potentia…

View Details
Posted 2026-06-24