Distributed ML/AI Infrastructure Engineer
ZenteiQ.aiBengaluru, IndiaOn-Site
Needs a free Superjobs account. You'll finish on ZenteiQ.ai's site.
Skill score
Summary
The engineer in this role builds and optimizes distributed training infrastructure for multi-node GPU and TPU clusters that train ZenteiQ's BrahmAI foundation models, owning performance, scalability and reliability. The role suits hands-on systems engineers with 3+ years in distributed systems, HPC or ML infrastructure who want to work closely with research teams.
- Function
- Data Science
- Estimated salary
- Est. ₹9.5–14 LPA
- Estimated for a mid-level role, ~3 yrs experience, India. Not published by the employer.
- Work mode and location
- On-Site, Bengaluru, India
- Experience
- 3+ yrs
Job description
Overview
We are looking for a Distributed ML Infrastructure Engineer to build and optimize the large-scale distributed training systems behind our foundation models. You will own the performance, scalability and reliability of training infrastructure spanning multi-node GPU and TPU clusters.
This is a hands-on systems role at the core of how BrahmAI gets trained, working closely with our research teams to turn raw compute into efficient, dependable training throughput.
Roles and responsibilities
- Build and maintain distributed training infrastructure for large-scale AI workloads.
- Optimize training performance through profiling, memory, communication and compute optimization.
- Implement distributed training strategies including data, tensor, pipeline and sequence parallelism.
- Improve training throughput, scalability and reliability across multi-node clusters.
- Develop automation, monitoring, profiling and debugging tools for production training systems.
- Collaborate with research and engineering teams to deliver efficient and scalable training infrastructure.
Skills required
Top skills
- Distributed training
- GPU/TPU clusters
- Python
- Linux
All skills (8)
- Shell scripting
- CUDA
- PyTorch Distributed
- NCCL
- MPI
- Docker
- Kubernetes
- Performance profiling
Qualifications
- 3+ years of experience in Distributed Systems, HPC or ML Infrastructure.
- Strong proficiency in Python, Linux and shell scripting.
- Experience with multi-node GPU/TPU clusters, CUDA, PyTorch Distributed, NCCL,
MPI/OpenMPI and distributed communication.
- Strong understanding of GPU/TPU architecture, distributed computing, profiling and performance optimization.
- Experience with Docker, Kubernetes, Git and containerized development.
- Strong debugging, profiling and performance analysis skills.
Nice to have
- JAX, XLA, MaxText, XPK, PJRT and TPU training infrastructure.
- Triton, Pallas or custom kernel optimization.
- Slurm, Ray, InfiniBand/RDMA and distributed storage systems.
- Experience with TensorBoard Profiler, Nsight Systems/Compute or XProf.
- Experience supporting large-scale LLM pretraining and distributed training at scale.
Company info
About ZenteiQ.ai
ZenteiQ builds scientific foundation models grounded in physics, engineered for real-world industry. The sources do not name the customers or users of its models or products.