Backend Software Engineer - Search, Crawler Team (London, Belgrade, Berlin)
- Take ownership of and lead projects focused on developing large-scale web crawlers, ingestion pipelines, and data processing systems.
- Build, maintain, and optimize core backend and frontend components for crawler services, including storage, retrieval, and UI dashboards for data management.
- Collaborate closely with Search and Infrastructure teams to ensure the reliable, high-quality ingestion and processing of billions of web pages.
- Architect and implement fullstack features and scalable distributed systems that handle high-load and real-time data operations.
- Rapidly iterate, experiment with novel approaches, and continuously enhance system performance, usability, and reliability.
- Minimum of 5 years of software development experience, with strong knowledge of data structures and algorithms in at least one of the following languages: Python, C++, Rust, or Go.
- Experience with large-scale web crawlers is highly desirable.
- Proven experience building, deploying, and optimizing high-load, distributed, and hardware-adjacent services.
- Deep understanding of cloud infrastructure, with hands-on experience in Kubernetes (K8s) and AWS.
- Demonstrated passion for writing clean, efficient, and scalable systems.
Recommended Jobs
Retail Operations Manager
The roar of the crowd, the thrill of events, and the taste of victory. AFC Wimbledon, a club reborn from passion, continues its incredible journey at the new Plough Lane. But the excitement doe…
Geography Teacher - Rigorous Inquiry - Redbridge
Geography Teacher – Instil Rigorous Inquiry and Analytical Fieldwork Skills – Redbridge An academically rigorous secondary school in Redbridge requires a highly capable Geography Teacher comm…
Sr. Creative Designer
Job description At a Glance: Position: Senior Creative Designer Team: Marketing Location: London, United Kingdom Contract: Full-time Type: On-site Benefits: Competitive package w…
EYFS Teacher - Outstanding School - Sutton - January 2026...
Join a warm, community-minded Outstanding primary in Sutton as an EYFS Teacher , working on a Part-Time basis from January 2026 . This Part-Time EYFS Teacher role suits a reflective, playfu…
Daily Nanny to start in December, Job ID J1E6AF
A lovely family in Queens Park, London, is looking for a reliable and adaptable Full-time Nanny to provide dedicated care for their three school-aged children. The ideal candidate will be nurturing, …
Reinsurance Technician
Our client, a prestigious Lloyd's Syndicate, are looking for a Reinsurance Technician. It will involve handling all aspects of reinsurance, including Treaty, Excess of Loss and Facultative RI, across …
Tenancy Management & Resettlement Officer (SO2)
Job Category : Housing Location :Laurence House – Fifth Floor, Lewisham Council Hours Per Week : 35.00 Start Date : Immediate Start Start Time : 09:00 End Time : 17:00 Salary: £22.78 …
Finance Manager - £70k (5 days in office)
Oversee and manage all financial operations, including budgeting and forecasting. Prepare accurate financial reports to support business decision-making. Ensure compliance with financial regula…
Head of Development
Job Description Charity People is delighted to be partnering with Maudsley Charity to recruit for their next Head of Development. Job title: Head of Development Salary: Location: Hybrid…