Skip to content

Member of Technical Staff (Site Reliability Engineer, Search Crawler)

PerplexityLondon, Belgrade, DublinOn-Site

Estimated salary, not published by the employer: Est. $109k–164k/yr

Needs a free Superjobs account. You'll finish on Perplexity's Ashby page.

Skill score

Summary

This SRE on Perplexity's Crawler team keeps crawler fleets (fetching and rendering) productive and reliable through Kubernetes operations, safer deployments, SLO-driven monitoring, capacity planning, and incident response. It suits an engineer with 5+ years in production or infrastructure-heavy backend roles who can write real software and diagnose distributed-system failures.

Function
Development
Estimated salary
Est. $109k–164k/yr
Estimated for a staff-level role, ~5 yrs experience, United Kingdom. Not published by the employer.
Work mode and location
On-Site, London, Belgrade, Dublin
Experience
5+ yrs
Employment type
Full-time

Job description

Overview

Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes.

Roles and responsibilities

  • Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.
  • Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.
  • Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.
  • Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners.
  • Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.
  • Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.

Skills required

Top skills

  • Kubernetes
  • Infrastructure as code
  • Terraform
  • CI/CD pipelines

All skills (11)

  • Linux
  • Networking
  • Observability
  • Prometheus
  • Datadog
  • Grafana
  • Python
  • Go
  • Web crawlers
  • Distributed queues
  • Multi-region recovery

Qualifications

  • 5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.
  • Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.
  • Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, HTTP, and load balancing.
  • Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.
  • Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.

Nice to have

  • Experience operating web crawlers, search infrastructure, or browser fleets at scale.
  • Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.

Company info

We’ve scaled beyond the millions of people using Perplexity every day for research, shopping, investing, and curiosity into a new paradigm of using AI to transform knowledge into action.

More jobs at Perplexity