Big Data Engineer
- Scripting and Automation: Develop and maintain scripts for automating data processes and workflows.
- Troubleshooting: Diagnose and resolve technical issues related to big data systems, data pipelines, and integrations.
- Integration Testing: Conduct thorough testing to ensure seamless integration of new tools and technologies into existing systems.
- Linux Internals: Utilize in-depth knowledge of Linux internals to optimize performance and reliability of big data infrastructure.
- Network Protocols: Apply understanding of TCP/IP and OSI models in the design and troubleshooting of networked systems.
- Data Pipeline Support: Manage and optimize data pipelines and orchestration tools such as NiFi and Airflow.
- Scalable System Design: Design scalable big data systems with a focus on security, GDPR compliance, and privacy
- Hybrid Cloud Management: Leverage hybrid cloud experience to manage on-premise and AWS cloud resources effectively
- Data Science Support: Support data science, machine learning, and AI workloads using tools like Jupyter, Spacy, Transformers, and NLTK.
- Big Data Platforms: Utilize big data NoSQL engines and platforms such as Hive, Impala, and Elasticsearch for data storage and processing
- BI and Visualization: Implement and support business intelligence and visualization tools like Tableau, Kibana, and PowerBI to provide actionable insights.
- Strong troubleshooting skills and the ability to diagnose and resolve complex technical issues.
- Experience with integration testing and ensuring seamless tool integration.
- In-depth knowledge of Linux internals and system administration.
- Understanding of TCP/IP and OSI models.
- Hands-on experience with data pipeline tools like NiFi and Airflow.
- Proven ability to design scalable big data systems with a focus on security and GDPR compliance.
- Hybrid cloud experience, specifically with on-premise and AWS cloud environments.
- Familiarity with data science, machine learning, and AI tools such as Jupyter, Spacy, Transformers, and NLTK.
- Experience with big data NoSQL engines/platforms such as Hive, Impala, and Elasticsearch.
- Proficiency with business intelligence and visualization tools like Tableau, Kibana, and PowerBI.
- Excellent communication and collaboration skills.
- Certification in AWS or other cloud platforms.
- Experience with additional data orchestration tools.
- Familiarity with other big data tools and technologies.
- Previous experience in a similar role within a dynamic and fast-paced environment.
- Full time on-site presence required
- A mission to believe in - Every day we contribute to building a more secure and connected world, expanding our reach from land, sea, and air to space and cyberspace. From engineering data and intelligence solutions, to developing maritime navigation and control systems and innovating command and control systems for the UK and NATO, what we do together matters.
- A place to belong and thrive - Every voice matters at our table meaning you can bring your authentic self to work. From our Employee Resource Groups backed by thousands of employees to our partnerships with the Association For Black and Minority Ethnic Engineers, Forces Transition Group, Mind, and Women in Defence - we are passionate about growing and supporting our inclusive community where everyone can belong.
- Your career, your way - Shape your career journey with diverse roles, mentorship, and development opportunities that fuel your curiosity, channel your expertise, and nurture your passion. Looking for flexibility? Balance your professional career with your personal life through our health and wellbeing benefits, discount schemes, and investment in your future development. Speak to our team to find the balance that's right for you.
Recommended Jobs
Dental Technician - Milling Department Supervisor
A respected and modern dental laboratory in North London is seeking an experienced Dental Technician with a strong background in milling to join the team in a supervisory role . This is an ex...
Account Director - Theatre
Reports to: Head of Strategy and Account Management Direct Reports: Account Managers/Account Executives Position Objectives Responsible for devising and implementing the overall marketing st...
Teaching Assistant
SEN Teaching Assistant SEN Schools and PRUs Throughout Greater London Long Term and Permanent Jobs Starting ASAP Reeson Education are actively looking to recruit experienced people ...
Senior Spa Therapist
Press space or enter keys to toggle section visibility The Chancery Rosewood – opening Summer 2025, is redefining luxury in Mayfair, housed in the former U.S. Embassy and reimagined by S...
Chief Operating Officer
Why Aqovia? At the Intersection of Innovation and Impact, introducing Aqovia. Aqovia is a UK-based technology firm dedicated to creating tangible value through the power of AI, data-driven, and b...
Senior Data Scientist
About Faculty At Faculty, we transform organisational performance through safe, impactful and human-centric AI. With a decade of experience, we provide over 300 global customers with software, ...
Digital Operations Director
ABOUT US Climate Impact Partners delivers solutions for climate action. We are carbon market specialists and a go-to partner for every stage of the net zero journey. With over 25 years of indus...
Service Engineer (S&F)
Are you a confident at decision making and using initiative? Do you have strong influencing and communication skills? We have great opportunities for Service Engineers to join us within the Service ...
Senior Underwriter - Property & Casualty (Multinational Lead)
Senior Property & Casualty Underwriter (Multinational Lead) My client, a leading specialist insurer, is seeking a dynamic Senior Underwriter to join their thriving team. With a strong track record of...
Market Facing Director - Life & Pensions - AI & Data Tech Consulting
Thu, 06/12/2025 - 10:12 Market-facing Director, AI & Data Team – Insurance (Life & Pensions), London The EY Financial Services AI & Data team is continuing to grow and develop unique advisory p...