Skip to content
Jobport

Member of Technical Staff (Site Reliability Engineer, Search Crawler)

Perplexity AI · Dublin, Ireland 🇮🇪

On-siteFull-timeLead / ManagerSoftware & IT

Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes.

Responsibilities

  • Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.

  • Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.

  • Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.

  • Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners.

  • Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.

  • Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.

Qualifications

  • 5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.

  • Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.

  • Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, HTTP, and load balancing.

  • Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.

  • Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.

Nice to have

  • Experience operating web crawlers, search infrastructure, or browser fleets at scale.

  • Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.

Posted 6d ago (13 Nov 2026) · Source: Perplexity AI via Ashby

Similar jobs in Ireland

AECOM · Dublin, County Dublin, Ireland 🇮🇪

On-siteFull-time

Company Description Work with Us. Change the World. At AECOM, we're delivering a better world. Whether improving your commute, keeping the lights on, providing access to clean water, or transforming skylines, our work helps people and communities thrive. We are the world's truste

8h ago · AECOM via SmartRecruiters

Datadog · Dublin, Ireland · Paris, France 🇮🇪

On-siteFull-time

Datadog is seeking a highly motivated, results oriented Director to join our high-growth organization and cutting-edge team. Our Technical Solutions team shares technical and product expertise with customers through ongoing guidance, presentations, technical evaluations, and demo

9h ago · Datadog via Greenhouse

MongoDB · Dublin · Dublin, Ireland 🇮🇪

On-siteFull-time

The Enterprise Advanced team is a diverse group of individuals across Europe and India, who develop software to run MongoDB on any type of infrastructure at global scale. Our software and services allow users to deploy fault-tolerant, globally distributed MongoDB clusters in minu

10h ago · MongoDB via Greenhouse

Toast · Dublin, Ireland 🇮🇪

On-siteInternship

Toast is driven by building the all-in-one restaurant platform that helps restaurants operate their business, increase sales, engage guests, and keep employees happy. Toast helps restaurants adapt, take control, and get back to what they do best : building the businesses they lov

11h ago · Toast via Greenhouse