Sr. Model Engineer, RL Data
CursorPalo Alto, CAOn-Site
Needs a free Superjobs account. You'll finish on Cursor's Ashby page.
Skill score
Summary
This role trains frontier coding agents by designing RL experiments, data recipes, rewards, and evals, and pushing results into larger training runs. It suits a senior researcher who can own ambiguous problems end to end and cares deeply about data quality.
- Function
- Data Science
- Estimated salary
- Est. $135k–202k/yr
- Estimated for a senior role, ~3 yrs experience, United States. Not published by the employer.
- Work mode and location
- On-Site, Palo Alto, CA
- Experience
- 3+ yrs
- Employment type
- Full-time
Job description
Roles and responsibilities
- Design and run rigorous experiments that turn research ideas into measurable gains in model capability
- Improve data recipes through data quality, deduplication, and mixture experiments
- Define what makes RL data and rewards good, including grader design and preventing reward hacking
- Advance training science, from architecture and scaling experiments to post-training recipes for coding and computer-use agents
- Build evals and targeted tasks that expose model weaknesses and guide where the team invests next
- Partner with engineers to take promising results from small experiments to frontier-scale training runs
Skills required
Top skills
- C++
- Post-training large neural networks
- Pre-training
- RLHF
All skills (8)
- DPO
- Python
- PyTorch
- JAX
- Rust
- Data quality and deduplication
- Distributed training
- RL for language models
Qualifications
- 3+ years of hands-on experience training or post-training large neural networks (1B+ parameters), including work on pre-training, fine-tuning, or RL-based methods (e.g., RLHF, DPO).
- Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++
Nice to have
- Able to handle ambiguous research tasks with little guidance, and to own a research direction end to end
- Care an unusual amount about data quality, and can dive into the data when appropriate
- Truth seeking, aiming to learn more about the science than to prove your ideas are correct
- Experience with RL algorithms for language models, scaling laws, or building RL environments and evals
- Experience with distributed training at scale and debugging problems that only show up at scale
- Experience training frontier-scale models
- Strong background in RL and machine learning fundamentals
- An excellent programmer and software engineer, comfortable working across the research stack in Python and PyTorch or JAX
- Hands-on experience training large models, through pretraining, post-training or RL
- A track record of original work in ML, such as new methods or real improvements, shown through research, open source or production impact
- MS or PhD in CS, ML, math, physics or a related field, or equivalent research experience
- Onsite role: must be able to work in person at the Palo Alto office
Other details
The annual compensation range for this role is listed below.
Annual Salary
$220,000 - $357,000 USD
Your actual level and base salary will be determined on a case-by-case basis and may vary based on the following considerations: job-related knowledge and skills, education, and experience.
Benefits
Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.
Company info
About Cursor
Cursor makes an AI coding agent and software development environment that builds code from natural-language instructions. Its product is used by software teams to build software, including through its desktop and command-line interfaces.