Skip to content

Senior Staff AI Engineer

Zscaler SoftechSanta Clara, California, USARemote

Estimated salary, not published by the employer: Est. $207k–311k/yr

Needs a free Superjobs account. You'll finish on Zscaler Softech's Greenhouse page.

Skill score

Summary

This senior staff engineer leads technical direction across the AI Platform and AI Solutions and Support groups, designing enterprise AI infrastructure such as model gateways and evaluation pipelines while also writing hands-on code. It suits an experienced engineer who can lead distributed teams across the US and India and who has run production services.

Function
Data Science
Estimated salary
Est. $207k–311k/yr
Estimated for a staff-level role, ~8 yrs experience, United States. Not published by the employer.
Work mode and location
Remote, Santa Clara, California, USA
Experience
8+ yrs

Job description

Overview

We are looking for a Senior Staff AI Engineer to join our Information Technology Artificial Intelligence and Machine Learning Engineering team, reporting directly to the Senior Manager, AI Engineering, based out of our Santa Clara, CA office on a 3-day hybrid schedule. In this hands-on leadership role, you will serve as the technical lead across two high-impact organizations—the AI Platform group and the AI Solutions and Support group—defining architectural vision, establishing core enterprise infrastructure, such as model gateways and context management, and driving production-grade AI applications and operational workflows across global teams.

Roles and responsibilities

  • Architect and scale enterprise AI platform capabilities, including model gateways, intelligent routing, cost governance, LLM observability, evaluation pipelines, and long-term agent memory
  • Direct technical execution for AI solutions and support, spearheading enterprise AI platform administration, intelligent search experiences, and scalable L2 operational support frameworks
  • Lead distributed engineering teams across the US and India, aligning roadmap priorities, conducting technical reviews, and fostering seamless communication across time zones
  • Establish engineering excellence and production AI quality gates, overseeing hands-on code development, CI/CD pipelines, regression suites, and latency and cost optimization
  • Partner with cross-functional stakeholders in Security, Legal, Privacy, and enterprise business units to ensure compliant, secure, and impactful AI enablement

Skills required

Top skills

  • Retrieval-augmented generation
  • LLM application development
  • Prompt engineering
  • Python

All skills (8)

  • TypeScript/Node.js
  • React
  • API design
  • AWS
  • Docker
  • Kubernetes
  • CI/CD pipelines
  • Incident response

Qualifications

  • You are a seasoned technical leader who thrives at the intersection of enterprise architecture, distributed team leadership, and hands-on software engineering.
  • You possess deep technical breadth in architecting production-grade LLM applications, retrieval-augmented generation systems, and comprehensive AI evaluation frameworks.
  • You are an operational driver with a proven track record of reducing systemic friction, resolving production incidents, and automating support processes.
  • You excel at bridging time zones and cultures, empowering both internal engineers and external partners through empathetic mentorship and clear technical guidance.
  • You are an articulate communicator and collaborative partner who seamlessly aligns technical strategy with executive stakeholders across business, security, and governance functions.

What We're Looking for

  • Demonstrated hands-on experience building and deploying production-grade AI/LLM applications, including prompt engineering, retrieval-augmented generation (RAG), agents, function calling/MCP, and model evaluation or observability frameworks
  • 8+ years of professional software engineering experience, with a Bachelor's or Master's degree in Computer Science, Engineering, or equivalent practical experience
  • 3+ years of technical leadership experience guiding distributed engineering teams and external contractors across multiple time zones
  • Proficiency in full-stack development utilizing Python, TypeScript/Node.js (or Java/Go), modern front-end frameworks like React, and robust API design
  • Hands-on expertise in cloud and containerized infrastructure, including AWS (or GCP/Azure), Docker, Kubernetes, and automated CI/CD deployment pipelines
  • Proven background operating production enterprise services, including incident response, on-call management, runbook development, and SLA governance

Nice to have

  • Advanced expertise administering enterprise AI platforms (such as OpenAI, Anthropic Claude, Amazon Bedrock, or Google Vertex AI) with comprehensive cost governance, security controls, and usage optimization
  • Experience architecting vector and graph database solutions, semantic caching, and dynamic long-term agent memory management
  • Proven success deploying intelligent conversational bots, search experiences, and Slack integrations within enterprise workflows, alongside familiarity with model fine-tuning, open-weight model serving, or compliance standards in regulated environments such as FedRAMP

Other details

Zscaler’s salary ranges are benchmarked and are determined by role and level. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations and could be higher or lower based on a multitude of factors, including job-related skills, experience, and relevant education or training.

The base salary range listed for this full-time position excludes commission/ bonus/ equity (if applicable) + benefits.

Base Pay Range

$180,000—$225,000 USD

Benefits

Our Benefits program is one of the most important ways we support our employees. Zscaler proudly offers comprehensive and inclusive benefits to meet the diverse needs of our employees and their families throughout their life stages, including:

  • Various health plans
  • Time off plans for vacation and sick time
  • Parental leave options
  • Retirement options
  • Education reimbursement
  • In-office perks, and more!

Learn more about Zscaler's hybrid working model and benefits here.

Company info

Zscaler (NASDAQ: ZS) accelerates digital transformation so customers can be more agile, efficient, resilient, and secure. The Zscaler Zero Trust Exchange platform protects thousands of customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location. Distributed across 200+ public data centers globally and thousands

More jobs at Zscaler Softech