Skip to content

Staff AI Platform Engineer, Infrastructure Services

SentinelOneIndiaOn-Site

Estimated salary, not published by the employer: Est. ₹21–32 LPA

Needs a free Superjobs account. You'll finish on SentinelOne's site.

Skill score

Summary

The Staff AI Platform Engineer owns SentinelOne's Kong-based AI Gateway that authenticates, routes, rate-limits and monitors AI coding assistant traffic, and sets technical direction for AI infrastructure including reliability, incident response, and self-hosted model serving. The role suits a senior platform or DevOps engineer with long production ownership who can work across CI/CD, Kubernetes, and GPU infrastructure with high autonomy.

Function
Development
Estimated salary
Est. ₹21–32 LPA
Estimated for a staff-level role, ~10 yrs experience, India. Not published by the employer.
Work mode and location
On-Site, India
Experience
10–12 yrs

Job description

Overview

As a Staff AI Platform Engineer, Infrastructure Services, you will be tasked with taking ownership of our AI Gateway infrastructure (built on Kong AI Gateway), the system that authenticates, routes, rate-limits, and monitors AI coding assistant traffic org-wide, while also being fluent enough across our broader platform stack to design solutions that span the two. This is a high-autonomy, high-scope role: you will set technical direction for AI infrastructure, drive incident response and reliability work, and partner closely with the engineers who own our CI/CD, GitOps, and artifact systems rather than working in isolation from them.

Roles and responsibilities

Primary responsibilities include

  • Work on the AI Gateway platform: architect, harden, and scale our Kong AI Gateway deployment (Konnect Hybrid on KCP/EKS), including auth (Okta/OIDC), consumer tiers and budgets, rate limiting, semantic caching, and observability.
  • Lead reliability and incident response: drive root-cause analysis and remediation for gateway issues (timeouts, latency, capacity, failover) and build the monitoring and alerting needed to catch them before users do.
  • Design across the platform, not just the gateway: work fluently with our CI/CD (Jenkins, JPAAS), GitOps and Kubernetes deployment tooling (ArgoCD across dev, gov, and prod), artifact management (Artifactory/Xray), GitHub Enterprise administration, and GitHub Actions runner fleet, so that AI infrastructure decisions account for how the rest of the platform actually works.
  • Evaluate and roll out AI developer tooling: run structured pilots and adoption efforts for tools like AI-assisted PR review (Qodo) and engineering metrics platforms (LinearB), and make clear build-versus-buy recommendations.
  • Set technical direction and mentor: define architecture and standards for AI infrastructure, review designs across the team, and raise the bar for other engineers working in this space.
  • Partner cross-functionally: work directly with security, DevEx, and product engineering teams consuming the gateway to translate their needs into platform capabilities.
  • Host and serve local models: stand up and operate self-hosted and open-weight model serving infrastructure (for example vLLM, NVIDIA Triton/NIM, TGI, and Ollama) for workloads where routing to an external provider is not the right fit, including GPU capacity planning, autoscaling, and cost and performance tuning.
  • Support the broader model lifecycle: help build LLMOps practices such as model versioning, evaluation, and safe rollout, plus supporting infrastructure for retrieval-augmented generation (vector stores and embedding pipelines) as use cases mature.
  • Track usage and cost: build observability into token usage, latency, and spend across both API-based and self-hosted models so the business can see what AI infrastructure actually costs.

Skills required

Top skills

  • Kong AI Gateway
  • API gateway technologies
  • Kubernetes
  • GitOps and ArgoCD

All skills (8)

  • CI/CD and Jenkins
  • Artifactory and Xray
  • GitHub Enterprise administration
  • Terraform
  • AWS EKS
  • Self-hosted LLM inference
  • LLMOps
  • Vector databases and RAG

Qualifications

Ideal candidates will have

  • 10- 12 years of experience in platform, infrastructure, or DevOps engineering, with a track record of owning systems end to end in production.
  • Hands-on experience with API gateway technologies (Kong, Envoy, Apigee, or similar); direct experience with AI and LLM gateway patterns (rate limiting, semantic caching, prompt and response observability) is a strong plus.
  • Strong Kubernetes and GitOps experience (ArgoCD or comparable), and comfort operating across multiple environments (dev, gov, and prod).
  • Solid CI/CD background: Jenkins pipeline design and administration, build infrastructure, and runner and agent fleet management (GitHub Actions runners or equivalent).
  • Experience with artifact and package management systems (Artifactory, Xray, or similar) and source control platform administration (GitHub Enterprise).
  • Working knowledge of infrastructure as code (Terraform) and cloud platforms (AWS/EKS).
  • Experience deploying and operating self-hosted LLM inference stacks (vLLM, NVIDIA Triton/NIM, TGI, Ollama, or similar) and GPU-backed infrastructure, including Kubernetes GPU scheduling and autoscaling.
  • Familiarity with LLMOps practices: model versioning, evaluation harnesses, and usage and cost observability across API-based and self-hosted models.
  • Track record of setting technical direction, driving cross-team initiatives, and mentoring other engineers; this role has significant scope and minimal day-to-day oversight.
  • Clear, proactive communication skills, with the ability to explain infrastructure trade-offs to both engineers and non-technical stakeholders.

Nice to have

  • Experience operating LLM and AI-assisted developer tooling at scale (Claude Code, Copilot, or similar) inside an enterprise is preferred.
  • Familiarity with Okta/OIDC and enterprise auth patterns for internal platforms is preferred.
  • Experience with engineering productivity metrics tooling (LinearB or similar) and AI-based code review tooling (Qodo or similar) is preferred.
  • Experience with vector databases and RAG pipelines (for example Milvus, Pinecone, pgvector, or similar) in a production setting is preferred.
  • Exposure to model fine-tuning or lightweight training pipelines (LoRA/QLoRA or similar) for domain-specific model adaptation is preferred.

Other details

We invest in our Sentinels with comprehensive, competitive benefits designed to support you and your family:

Equity & Rewards

  • Restricted Stock Units (RSUs)
  • Employee Stock Purchase Plan (ESPP)

Time Off & Wellbeing

  • Competitive leave benefits
  • Gender-neutral parental leave

Insurance & Financial Security

  • Medical and insurance benefits
  • Employee Assistance Program (EAP)

Work Perks & Flexibility

  • Global home office allowance
  • Internet allowance
  • LinkedIn Learning license
  • Social Connect program
  • Food allowance (Bangalore office)
  • Meal vouchers (Sodexo)

Wellness & Lifestyle

  • Health & wellness benefit

Company info

SentinelOne is a company at the intersection of AI and security, pioneering a new operating model for cybersecurity. Our AI-native platform unifies protection across endpoint, cloud, identity, data, and AI systems to deliver autonomous detection and response with clarity and speed. By combining real-time analytics, intelligent automation, and a unified

More jobs at SentinelOne