Skip to content

Staff SRE Engineer - Voice Core Platform

ServiceNowHyderabad, Telangana, IndiaOn-Site

Estimated salary, not published by the employer: Est. ₹18–28 LPA

Needs a free Superjobs account. You'll finish on ServiceNow's SmartRecruiters page.

Skill score

Summary

The Staff SRE Engineer owns reliability, performance, and operational architecture for a real-time conversational AI voice platform, defining SLOs, tracing latency, planning capacity for stateful connections, and leading incident response. It suits a senior site reliability engineer with deep experience in production systems, voice protocols, LLM serving, and Kubernetes who can also mentor and set technical direction.

Function
Development
Estimated salary
Est. ₹18–28 LPA
Estimated for a staff-level role, ~8 yrs experience, India. Not published by the employer.
Work mode and location
On-Site, Hyderabad, Telangana, India
Experience
8+ yrs
Employment type
Full-time

Job description

Overview

About the role

We are building a real-time conversational AI voice platform. An orchestrator runs every call through Voice Activity Detection, Speech-to-Text, LLM-based agent matching, tool calling against ServiceNow platform (Glide) APIs, and Text-to-Speech.

In voice, latency and reliability are the product. You will own the platform's reliability, performance and operational architecture, and set direction across teams.

Roles and responsibilities

  • Define and drive SLIs/SLOs for availability, perceived latency (end-of-speech to first audio), and call quality.
  • Instrument end-to-end tracing across every pipeline stage, and lead architectural work to cut latency.
  • Design autoscaling and capacity plans for stateful, real-time connections (WebSocket, WebRTC, SIP/RTP).
  • Lead load, soak and breakpoint testing, and turn results into capacity models.
  • Build resilience for LLM, STT and TTS dependencies: failover, fallbacks, rate-limit handling and graceful degradation.
  • Own Kubernetes architecture, infrastructure-as-code and CI/CD with safe progressive delivery.
  • Lead incident response and postmortems, and mentor engineers across the team.

Skills required

Top skills

  • Site reliability engineering
  • Kubernetes
  • Cloud infrastructure
  • Terraform

All skills (10)

  • Observability
  • Python, Go or Java
  • Real-time voice systems
  • VoIP, SIP/RTP, WebRTC
  • STT/TTS integration
  • AI agentic systems
  • LLM deployment
  • CI/CD
  • Inference serving (vLLM, Triton)
  • ServiceNow platform

Qualifications

To be successful in this role you have

  • Experience in leveraging or critically thinking about how to integrate AI into work processes, decision-making, or problem-solving. This may include using AI-powered tools, automating workflows, analyzing AI-driven insights, or exploring AI’s potential impact on the function or industry.
  • 8+ years in SRE, DevOps, production engineering or software engineering on production systems at scale.
  • 1+ year building or operating real-time voice systems (VoIP, SIP/RTP, WebRTC, or STT/TTS integration).
  • 2+ years building or operating AI agentic systems and orchestration pipelines (agent routing, tool calling, multi-step LLM workflows).
  • 1+ year deploying and operating LLMs in production (model serving, inference optimization, provider integration and failover).
  • Strong expertise in Kubernetes, cloud infrastructure ([AWS / Azure / GCP]) and Terraform or similar.
  • Hands-on observability experience (OpenTelemetry, Prometheus, Grafana, Datadog or similar).
  • Proficiency in Python, Go or Java.

Nice to have

  • Experience Inference serving experience (vLLM, Triton, GPU scheduling).
  • Familiarity with the ServiceNow platform or enterprise SaaS backends.

Other details

Work Personas

We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.

Company info

ServiceNow provides a cloud-based AI platform that connects people, systems, and processes so organizations can find smarter ways to work. Enterprises and organizations use the platform, along with its AI and automation technologies, to design solutions that transform how they operate.

More jobs at ServiceNow