AI Research Engineer
ZenteiQ.aiBengaluru, IndiaOn-Site
Needs a free Superjobs account. You'll finish on ZenteiQ.ai's site.
Skill score
Summary
This person designs and runs post-training pipelines on base language models, including RLAIF, constitutional AI, process reward models, and distributed RL rollouts. It suits an experienced RL or fine-tuning engineer who can independently form research hypotheses and ship robust training runs quickly.
- Function
- Development
- Estimated salary
- Est. ₹8–12 LPA
- Estimated for a mid-level role, ~3 yrs experience, India. Not published by the employer.
- Work mode and location
- On-Site, Bengaluru, India
- Experience
- 3+ yrs
Job description
Overview
Role: Reinforcement Learning & Post-Training Engineer
Role Overview
As a founding post-training specialist, you will own the end-to-end alignment and reasoning stack taking base pre-trained models through advanced alignment. You will design and execute novel post-training recipes spanning RLAIF, Constitutional AI, and dense process supervision (PRMs) to unlock frontier reasoning and domain alignment directly on raw base weights.
Roles and responsibilities
- Base Model Post-Training: Design and scale full-spectrum post-training workflows on base foundation models using algorithms like GRPO, PPO, DPO, and iterative rejection sampling.
- RLAIF & Constitutional AI: Architect automated preference-data synthesis, iterative multi-turn critique loops, and rubric-driven constitutional refinement pipelines to eliminate human annotation bottlenecks.
- Process Reward Modeling (PRMs): Construct and train step-level PRMs to evaluate granular reasoning steps, intermediate chain-of-thought derivations, and dense domain verification tasks.
- Verifiable Reward & Environment Design: Implement deterministic verifiers, execution sandboxes for code and math, and hybrid reward functions combining outcome checks with dense step feedback.
- Alignment Infrastructure: Optimize distributed RL training and rollout loops across accelerator clusters, maximizing rollout throughput, memory management, and inference-engine integration.
Skills required
Top skills
- Reinforcement learning
- LLM post-training
- Policy gradient methods
- Reward modeling
All skills (8)
- Preference optimization
- Distributed RL training
- Ray
- vLLM
- DeepSpeed
- PyTorch
- JAX
- Process reward models
Qualifications
- 3+ Years Hands-On RL / Fine-Tuning Experience: Demonstrated track record executing post-training on LLM base models (not generic software engineering or high-level API wrapper development).
- Algorithmic Depth: Deep theoretical and practical command of modern policy gradient methods, credit assignment, value function estimation, and reward-shaping dynamics.
- Dense Reward & Alignment Mastery: Concrete experience designing reward models (ORMs/PRMs), preference optimization objectives, or constitutional self-critique mechanisms.
- High-Throughput RL Stack: Strong fluency with distributed training and rollout architectures (such as Ray, vLLM, DeepSpeed, or custom JAX/PyTorch accelerator pipelines).
- Startup Velocity & Ownership: Ability to independently formulate research hypotheses, diagnose reward hacking or mode collapse, and deploy robust training runs under fast production cycles.
Other details
- Direct Architecture Ownership: Full technical authority over the post-training, alignment, and reasoning methodology of foundation models.
- High-Density Compute: Dedicated accelerator clusters to validate novel RL formulations and train production models end-to-end.
Company info
About ZenteiQ.ai
ZenteiQ builds scientific foundation models grounded in physics, engineered for real-world industry. The sources do not name the customers or users of its models or products.