Staff / Senior Software Engineer (Agentic Search) - Index

Requirements:

  • 5+ years of experience building production backend or data infrastructure systems
  • Strong Go experience (C++/Rust is a plus)
  • Experience with large-scale data processing systems (10+ GiB/sec throughput, petabyte-scale datasets, etc.)
  • Experience building or operating databases, storage systems, data planes, or indexing pipelines
  • Strong understanding of distributed systems, fault tolerance, consistency, and scalability
  • Experience running production systems and handling operational incidents
  • Systems-thinking mindset and ability to reason about end-to-end data flows

Nice to Haves:

  • Distributed data processing frameworks such as Spark, Flink, MapReduce, or Beam
  • Content systems including, scraping, proxying, or anti-bot infrastructure
  • Ad tech, social networks, or other large-scale content platforms
  • DBMS internals (open source or SaaS) and cloud infrastructure
  • Open-source contributions or active involvement in the engineering community
  • Competitive programming or CTF participation (ICPC, IOI, or similar)
  • SHAD or similar advanced technical programmes
  • Conference talks or technical publications

What You'll Be Doing:

  • Design, implement, and operate large-scale indexing systems and data pipelines that sit at the core of our search infrastructure
  • Develop and optimise indexing strategies balancing performance, freshness, and resource efficiency
  • Work on storage formats, compaction strategies, and update mechanisms to keep data accessible and current
  • Ensure reliability and predictability of pipelines under high-throughput conditions
  • Build well-tested components with clear responsibilities and interaction contracts, while remaining flexible as the system evolves
  • Define and implement observability primitives, including structured logs, metrics, and data quality signals across offline and nearline pipelines
  • Monitor throughput, resource usage, and cost, and drive optimizations when business needs require it
  • Collaborate with runtime and ML teams to ensure indexing outputs meet retrieval and ranking requirements
  • Enable safe experimentation on indexing strategies and data processing logic through controlled rollouts and clearly defined quality signals

Perks and Benefits:

  • Competitive compensation
  • Career growth and learning opportunities
  • Flexibility and ownership
  • Collaborative and innovative culture
  • Opportunity to work on impactful AI projects
  • International environment and talented teams
AI Summary ✨

Similar jobs

  • Principal Engineer - Data Retrieval

    NVIDIASwitzerlanda day ago
    New
  • Senior Member of Technical Staff, Web Data

    CohereLondon, UKa month ago
    Remote EMEARegistered sponsor
  • Senior Data Engineer

    PhantomRemote EMEAa year ago
    Still lookingRemote EMEA
  • See all jobs in Switzerland →