Skip to content

Senior AI Platform Engineer

Zscaler SoftechPune, INDRemote

Estimated salary, not published by the employer: Est. ₹10–16 LPA

Needs a free Superjobs account. You'll finish on Zscaler Softech's Greenhouse page.

Skill score

Summary

The Senior AI Platform Engineer designs, builds, and maintains secure, highly available AWS infrastructure for AI/ML workloads using Terraform, automates GitLab CI/CD release pipelines, and builds observability and alerting with Prometheus and Grafana. This suits an experienced platform, SRE, or DevOps engineer who works autonomously, drives reliability and DORA metrics, and mentors others while partnering with AI/ML teams.

Function
Development
Estimated salary
Est. ₹10–16 LPA
Estimated for a senior role, ~4 yrs experience, India. Not published by the employer.
Work mode and location
Remote, Pune, IND
Experience
4+ yrs

Job description

Overview

As a Senior AI Platform Engineer, you will design, build, and maintain scalable, secure, and highly available AWS infrastructure optimized for complex AI/ML workloads. Utilizing Terraform and modern IaC principles, you will establish robust cloud architectures, automate release pipelines, and architect comprehensive observability and alerting solutions. Operating with a high degree of autonomy, you will champion platform reliability, security, and governance while partnering with AI/ML teams to deploy production-grade systems and mentor engineers across the organization.

Roles and responsibilities

  • Design, build, and maintain scalable, secure, and highly available AWS infrastructure (EKS, Lambda, ECS, VPC, IAM) for AI/ML workloads using Terraform best practices.
  • Own and continuously evolve GitLab CI/CD pipelines for AI platform services to enable fast, reliable, and repeatable automated releases.
  • Architect a centralized observability stack using Prometheus and Grafana with golden-signal dashboards and design intelligent alerting strategies to lead efficient incident response.
  • Define and track DORA metrics to drive delivery and reliability improvements while building self-healing, auto-scaling, and cost-optimized infrastructure for AI/ML services on Kubernetes.
  • Implement infrastructure security best practices, establish platform governance standards, partner on production-grade AI/RAG deployments, and mentor junior/mid-level engineers.

Skills required

Top skills

  • AWS
  • Terraform
  • GitLab CI/CD
  • Prometheus

All skills (9)

  • Grafana
  • Kubernetes
  • EKS
  • Helm
  • Python
  • DORA metrics
  • LiteLLM
  • Vector databases
  • MLflow

Qualifications

  • You are expert at designing and running production-grade environments, specializing in AWS cloud-native architectures tailored specifically for high-demand AI/ML workloads.
  • You are driven to automate everything from infrastructure provisioning to multi-environment code deployment, ensuring systems are repeatable, secure, and easily maintained.
  • You rely on concrete observability tools and DORA metrics to diagnose bottlenecks, resolve production incidents, and continuously improve platform reliability and delivery speeds.
  • You enjoy working closely with cross-functional AI/ML and data teams to bridge the gap between development and operations, while actively mentoring peers.
  • You work exceptionally well independently, taking complete ownership of complex infrastructure initiatives and communicating technical concepts with Staff-level clarity.

What We're Looking For (Minimum Qualifications)

  • Foundational understanding of AI/ML technologies and experience leveraging, securing, or positioning AI-driven solutions to optimize outcomes within your functional domain.
  • 4+ years of experience as a Platform, SRE, or DevOps Engineer, including 1+ years supporting AI/ML or data platform infrastructure, with deep hands-on AWS skills (EKS, Lambda, ECS, VPC, IAM, S3).
  • Strong hands-on experience using Terraform (modules, workspaces, remote state) for Infrastructure as Code and designing/maintaining GitLab CI/CD pipelines with runners and automated deployments.
  • Proven expertise in centralized monitoring using Prometheus and Grafana (custom exporters, dashboards, alerting) alongside tuning alerting systems (Alertmanager, PagerDuty, OpsGenie).
  • Solid, hands-on understanding of DevOps/DORA metrics (deployment frequency, lead time for changes, change failure rate, MTTR) to measure and drive engineering improvements.
  • Experience operating containerized apps on Kubernetes (EKS, Helm, Karpenter/HPA), strong scripting skills in Python (and/or Go/Bash), and excellent communication skills.

Nice to have

  • Demonstrate a proven ability to leverage AI technologies and workflows to drive measurable operational efficiency.
  • Experience with LiteLLM (multi-region deployments), distributed compute frameworks like Ray.io/Anyscale, workflow engines like Temporal, and agentic frameworks (LangGraph, LangChain, or LlamaIndex).
  • Working knowledge of vector databases (Qdrant, Pinecone, Weaviate), memory/context layers like ZEP, MLOps practices (model registry, MLflow/Kubeflow), and LLM observability tools (Arize Phoenix).
  • Exposure to GitOps workflows (ArgoCD/Flux), log aggregation and distributed tracing (Loki, ELK, Jaeger/Tempo), cloud cost optimization (FinOps), and security compliance frameworks (SOC 2, ISO 27001).

Other details

Our Benefits program is one of the most important ways we support our employees. Zscaler proudly offers comprehensive and inclusive benefits to meet the diverse needs of our employees and their families throughout their life stages, including:

  • Various health plans
  • Time off plans for vacation and sick time
  • Parental leave options
  • Retirement options
  • Education reimbursement
  • In-office perks, and more!

Learn more about Zscaler's hybrid working model and benefits here.

Company info

Zscaler (NASDAQ: ZS) accelerates digital transformation so customers can be more agile, efficient, resilient, and secure. The Zscaler Zero Trust Exchange platform protects thousands of customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location. Distributed across 200+ public data centers globally and thousands

More jobs at Zscaler Softech