Sr. Model Engineer, RL Training Framework
xAIPalo Alto, CAOn-Site
Needs a free Superjobs account. You'll finish on xAI's Greenhouse page.
Skill score
Summary
The engineer designs and builds the systems that run all RL training workloads, from small ablation experiments to production runs, and works on profiling, debugging, and optimizing training performance. It suits someone with experience training large models and building distributed training infrastructure.
- Function
- Development
- Estimated salary
- Est. $163k–245k/yr
- Estimated for a senior role, ~6 yrs experience (typical for the level), United States. Not published by the employer.
- Work mode and location
- On-Site, Palo Alto, CA
Job description
Overview
The RL infrastructure team is looking for an engineer to help develop our RL training framework.
Roles and responsibilities
- Design and implement the systems backing all RL workloads at SpaceXSI, from small scale ablations to production training runs
- Profile, debug, and optimize end-to-end training performance
- Improve scalability and observability of the RL stack
Skills required
Top skills
- JAX
- Rust
- C++
- Performance profiling
All skills (8)
- Python
- Large model training
- PyTorch
- Observability
- Distributed systems
- LLM training infrastructure
- RL numerics
- Reinforcement learning
Qualifications
- Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++
- Experience training large models (e.g., pre-training, post-training, fine-tuning, or RL training of neural networks with 1B+ parameters)
Nice to have
- Experience building, debugging, and optimizing efficiency of large-scale distributed systems
- Experience with large scale LLM training infrastructure
- Experience with RL numerics
- Strong knowledge of reinforcement learning techniques
- Comfortable diving into unfamiliar areas and solving problems at all levels of the stack
Other details
$220,000 - $357,000 USD
Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.
Company info
About xAI
SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel where more