Skip to content

Research Engineer, Reinforcement Learning Systems

Mistral AIPalo AltoRemote

Estimated salary, not published by the employer: Est. $120k–180k/yr

Needs a free Superjobs account. You'll finish on Mistral AI's Ashby page.

Skill score

Summary

The Research Engineer on the RL Systems team builds and runs Orchestral, the platform that handles training and evaluation of Mistral's models, including the rollout engine and job infrastructure. The role suits experienced software engineers who have built distributed systems and want to work on reliability and tooling for researchers, with RL experience not required.

Function
Development
Estimated salary
Est. $120k–180k/yr
Estimated for a mid-level role, ~3 yrs experience (typical for the level), United States. Not published by the employer.
Work mode and location
Remote, Palo Alto
Employment type
Full-time

Job description

Overview

As a Research Engineer on the RL Systems team, you will help build the agentic platform we use to train and evaluate our models. Orchestral is the system our researchers rely on to run training and evaluation at scale — from the rollout engine that powers agentic workflows to the infrastructure that keeps their workloads running reliably. What you build becomes the foundation the whole science team works on.

Your work will span the platform's core: the library, tooling, abstractions and rollout engine — including new capabilities like long-running tasks, subagents and RL features — and the machinery that runs data and jobs at scale, with a focus on resiliency, routing and request handling. You will own significant pieces end to end, from design to production.

This is a software engineering role rather than an ML or infrastructure-operations one: RL or PyTorch experience is not required, and you will spend your time building the platform, not operating it. You will be building a distributed RL system, with the scientists as your users.

Roles and responsibilities

  • Design and build the core of the Orchestral platform: the library, abstractions and tooling researchers use to train and evaluate models.
  • Build and evolve the rollout engine, shipping new capabilities such as long-running tasks and subagents.
  • Run Orchestral as a production system: keep training and evaluation workloads reliable at scale.
  • Improve how data and jobs flow through the platform as usage grows — scheduling, routing and request handling.
  • Treat researchers as your users: understand their workflows and turn recurring needs into robust, shared tooling.
  • Raise the bar on engineering quality across the platform: testing, code review, CI/CD, observability and documentation.
  • Contribute to open-source rollout-engine and agent-infrastructure projects where it benefits the platform.

Skills required

Top skills

  • Python
  • distributed systems
  • software design
  • testing

All skills (5)

  • code review
  • CI/CD
  • Ray
  • open-source projects
  • agentic workflows

Qualifications

  • Experience directly building and debugging complex distributed systems at scale, with an emphasis on reliability and scalability.
  • Strong Python skills and solid software-design instincts: testing, code review, CI/CD.
  • A builder mindset: you have constructed systems from the ground up, not just operated polished ones.
  • A track record in small teams running complex systems at scale — for example in finance, crypto or ad tech.
  • Self-starter, low-ego and collaborative, with a product mindset toward your users.
  • Curiosity about ML and RL — this experience is not required, but a desire to learn is.

Nice to have

  • Hands-on experience with Ray or similar distributed-computing frameworks.
  • Open-source contributions, especially to rollout-engine or agent-infrastructure projects such as SLIME, verl or PrimeRL.
  • Experience building or working with agentic workflows and environments.

Other details

We offer a comprehensive benefits package designed to support your well-being, growth, and work-life balance. Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks.

For the most up-to-date details on benefits available in your location, please refer to our Benefits page.

Company info

Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms.

More jobs at Mistral AI