Skip to content

Distributed ML/AI Infrastructure Engineer

ZenteiQ.aiBengaluru, IndiaOn-Site

Estimated salary, not published by the employer: Est. ₹9.5–14 LPA

Needs a free Superjobs account. You'll finish on ZenteiQ.ai's site.

Skill score

Summary

The engineer in this role builds and optimizes distributed training infrastructure for multi-node GPU and TPU clusters that train ZenteiQ's BrahmAI foundation models, owning performance, scalability and reliability. The role suits hands-on systems engineers with 3+ years in distributed systems, HPC or ML infrastructure who want to work closely with research teams.

Function
Data Science
Estimated salary
Est. ₹9.5–14 LPA
Estimated for a mid-level role, ~3 yrs experience, India. Not published by the employer.
Work mode and location
On-Site, Bengaluru, India
Experience
3+ yrs

Job description

Overview

We are looking for a Distributed ML Infrastructure Engineer to build and optimize the large-scale distributed training systems behind our foundation models. You will own the performance, scalability and reliability of training infrastructure spanning multi-node GPU and TPU clusters.

This is a hands-on systems role at the core of how BrahmAI gets trained, working closely with our research teams to turn raw compute into efficient, dependable training throughput.

Roles and responsibilities

  • Build and maintain distributed training infrastructure for large-scale AI workloads.
  • Optimize training performance through profiling, memory, communication and compute optimization.
  • Implement distributed training strategies including data, tensor, pipeline and sequence parallelism.
  • Improve training throughput, scalability and reliability across multi-node clusters.
  • Develop automation, monitoring, profiling and debugging tools for production training systems.
  • Collaborate with research and engineering teams to deliver efficient and scalable training infrastructure.

Skills required

Top skills

  • Distributed training
  • GPU/TPU clusters
  • Python
  • Linux

All skills (8)

  • Shell scripting
  • CUDA
  • PyTorch Distributed
  • NCCL
  • MPI
  • Docker
  • Kubernetes
  • Performance profiling

Qualifications

  • 3+ years of experience in Distributed Systems, HPC or ML Infrastructure.
  • Strong proficiency in Python, Linux and shell scripting.
  • Experience with multi-node GPU/TPU clusters, CUDA, PyTorch Distributed, NCCL,

MPI/OpenMPI and distributed communication.

  • Strong understanding of GPU/TPU architecture, distributed computing, profiling and performance optimization.
  • Experience with Docker, Kubernetes, Git and containerized development.
  • Strong debugging, profiling and performance analysis skills.

Nice to have

  • JAX, XLA, MaxText, XPK, PJRT and TPU training infrastructure.
  • Triton, Pallas or custom kernel optimization.
  • Slurm, Ray, InfiniBand/RDMA and distributed storage systems.
  • Experience with TensorBoard Profiler, Nsight Systems/Compute or XProf.
  • Experience supporting large-scale LLM pretraining and distributed training at scale.

Company info

ZenteiQ builds scientific foundation models grounded in physics, engineered for real-world industry. The sources do not name the customers or users of its models or products.

More jobs at ZenteiQ.ai