Data Engineer (Java Skills) (IT)
Job title: Data Engineer (Java Skills) Location: London - Hybrid Contract: 6 months, with possibility of extension Clearance: SC Cleared or eligible to obtain SC clearance We are currently recruiting for an experienced Data Engineer with strong Java skills to support a major technology programme based in London. The successful candidate will work within a technical engineering environment, helping to design, build and maintain scalable data solutions and services. The role requires strong hands-on development experience, particularly across Java, Kafka, Kubernetes and Python. Key Responsibilities
- Design, develop and maintain scalable data engineering solutions and services.
- Develop robust applications and data-processing components using Java.
- Build and support event-driven and streaming solutions using Apache Kafka.
- Develop and maintain Python-based data processing, automation and integration solutions.
- Deploy and support applications and services within Kubernetes environments.
- Work with large and complex datasets across distributed systems.
- Develop reliable and maintainable data pipelines and integration services.
- Support the integration of data across applications, platforms and services.
- Troubleshoot technical issues across data pipelines, applications and infrastructure.
- Work closely with software engineers, architects, DevOps teams and other technical stakeholders.
- Contribute to technical design discussions and engineering best practices.
- Ensure solutions are scalable, secure, resilient and suitable for production environments.
- Support testing, deployment, monitoring and continuous improvement of engineering solutions.
- Produce and maintain appropriate technical documentation.
- Candidates should have strong commercial experience across the following:
- Java - strong hands-on development experience.
- Apache Kafka - experience developing or supporting Kafka-based messaging, streaming or event-driven solutions.
- Kubernetes - experience deploying, managing or supporting containerised applications.
- Python - experience developing scripts, applications, APIs or data-processing solutions.
- Strong understanding of software and data engineering principles.
- Experience working with distributed systems and data integration.
- Experience developing reliable, scalable production solutions.
- Strong troubleshooting and problem-solving skills.
- Experience working within Agile or collaborative engineering environments.
- Ability to communicate effectively with both technical and non-technical stakeholders.
- Experience in any of the following would be beneficial:
- Cloud platforms such as AWS, Azure or GCP.
- Docker and containerised environments.
- CI/CD pipelines and automated deployment.
- REST APIs and microservices.
- SQL and relational or NoSQL databases.
- Data streaming and real-time processing.
- Infrastructure-as-Code or DevOps tooling.
- Working within large-scale enterprise or public-sector technology programmes.
Recommended Jobs
E-Commerce Work Placement
At TJX Europe, every day brings new opportunities for growth, exploration, and achievement. You’ll be part of our vibrant team that embraces diversity, fosters collaboration, and prioritises your dev…
Social Media Content Views Editor (Hiring Immediately)
We’re VaynerMedia! We are a contemporary global creative and media agency built for the now. Born in social, our work is now full service, simply loving big ideas that connect and create real change f…
Product Marketing Manager (Hiring Immediately)
About WGSN Group WGSN Group brings together two global intelligence businesses. WGSN is the global authority on consumer and design trend forecasting, helping brands understand what people will wa…
Social Worker Safeguarding - Barking & Dagenham
Liquid Personnel are currently looking for an experienced Social Worker for the Child Protection team to join our clients in Barking & Dagenham Your benefits as a Social Worker: ~£2,500 welcom…
Data Migration Manager
We are seeking an experienced Data Migration Lead to take ownership of data migration activities across a major business transformation or ERP programme. The successful candidate will lead the end-…
Talent Director - Global Businesses and Functions - London
Talent Director - Global Businesses and Functions - London, United Kingdom Locations : London | Lisbon Who We Are Boston Consulting Group partners with leaders in business and society to ta…
Programmatic and Display Manager - Senior Associate (Hiring Immediately)
Are you ready to lead one of the most commercially impactful digital media disciplines across a global financial services firm? This is a rare opportunity to combine strategic channel leadership with…
Contracts and Compliance Manager
Role Summary The role is responsible for the day to day management of our Contracts & Compliance function, with a focus on reviewing and negotiating contractual terms, giving commercially-minded g…
2nd Officer DPO -Platform Supply vessel (Hiring Immediately)
Vessel Information Type: Platform Supply vessel Gross Tonnage: 1973 Dead Weight: 1748 Flag: VCT Engine Maker: CAT MAK Additional Requirements Experience : 2 years as 2O DPO r…