Skip to content

Software Engineer, Machine Learning

EmaMountain View (Hybrid)On-Site

Estimated salary, not published by the employer: Est. $120k–180k/yr

Needs a free Superjobs account. You'll finish on Ema's Ashby page.

Skill score

Summary

This engineer builds and tests machine learning methods for AI agents that run enterprise HR, IT and finance workflows, covering areas such as post-training, evaluation, retrieval and cost-quality tradeoffs. They own experiments from baseline through production serving and monitoring, so the role suits engineers with defensible depth in one area and a record of taking ambiguous problems to working results.

Function
Data Science
Estimated salary
Est. $120k–180k/yr
Estimated for a mid-level role, ~3 yrs experience (typical for the level), United States. Not published by the employer.
Work mode and location
On-Site, Mountain View (Hybrid)
Employment type
Full-time

Job description

Overview

Ema builds AI employees that carry out complex workflows across enterprise applications. Our ML team works on the loop that makes them better: production traces become data, data becomes training and evaluation, and better agents produce better traces. The hard part is deciding which intervention will improve behavior in the next real workflow.

You’ll work with researchers and engineers across the Bay Area, Vancouver and India. We’re hiring from junior through senior levels, with project scope matched to your experience.

Roles and responsibilities

  • Harnesses and inference-time compute. Design context, tools, skills and orchestration for multi-step agents, including work across documents, slides, images, audio and video. Test where extra reasoning, search or verification earns its latency and cost. Build self-improvement loops with explicit permissions, evaluation gates and rollback.
  • Agent post-training. Curate trajectories for SFT, optimize preferences, or run RL on real agent tasks. Investigate methods such as DPO, GRPO or DAPO where they fit; compare process and outcome supervision, shape rewards, and distill useful frontier behavior into smaller models. Measure whether gains transfer beyond the training environment.
  • Environments and rewards. Turn enterprise workflows into reproducible training and evaluation environments: fixture tenants, simulated users who may get impatient and leave, and rewards grounded in verifiable outcomes. Find the shortcuts an agent can exploit before a training run optimizes for them.
  • Data engines and evaluation. Mine production agent-steps for failures; build curated corpora and useful synthetic augmentation. Calibrate judges against human labels, construct behavior-level benchmarks from real workflows, and quantify data quality, performance uplift and reliability across stochastic runs.
  • Retrieval, memory and context graphs. Connect enterprise information with user- and tenant-level learnings. Separate failures of retrieval from failures to use retrieved context; test what to retain, update and retrieve so that past experience improves the next decision.
  • Quality per dollar. Build and evaluate routing, ensembles, caching and small-model specialization. Measure downstream task success alongside latency and cost; a cheaper model is useful only if the complete agent still succeeds.

You’ll go deep in a subset of these areas. Projects combine applied research with the engineering needed to make the result work in production.

Own the experiment and the system

Most projects develop over roughly four to six months, with useful improvements shipping along the way. You’ll define the problem and baseline, build the data or environment needed to test it, run experiments, and own serving and integration. Follow the system through deployment, monitoring and failure analysis until it is ready for a clear engineering handoff.

Skills required

Top skills

  • Machine learning
  • Agent systems
  • Evaluation design
  • Statistical analysis

All skills (8)

  • Production engineering
  • Retrieval and memory
  • Distillation and quantization
  • Prompt injection security
  • vLLM or SGLang
  • Post-training
  • Reinforcement learning
  • TRL or OpenRLHF

Qualifications

  • Depth you can defend. Substantial work in at least one of agent/tool-use systems, post-training, reward modeling or RL environments, retrieval and memory, or evaluation design. Be ready to explain the mechanism, the alternatives you rejected and the failure modes you found. One area you can teach us beats five you’ve touched.
  • Evidence of zero-to-one ownership. A system, model or research project you took from an ambiguous problem to a working result. We want to understand your contribution, the tradeoffs you made, and what changed when the work met real users or realistic tasks.
  • Statistical judgment. You can size an experiment, choose meaningful baselines and held-out tests, and account for variation across tasks, seeds and repeated runs. You can distinguish a real improvement from judge bias, data leakage or a benchmark shortcut.
  • Production engineering judgment. You can debug across the model and system boundary, isolate a failure, and turn the result into maintainable production code.
  • Honest measurement. You would rather retire your own approach after a clean negative result than ship an improvement that disappears under a stronger evaluation.

A master’s or PhD in a relevant field, or equivalent work or research experience. Papers, substantial open-source contributions, trained models and well-documented experiments can demonstrate that depth.

Nice to have

  • Open-model post-training with TRL, veRL, OpenRLHF, or similar or a custom loop, especially debugging reward hacking or unstable optimization.
  • Interactive agent environments/harnesses for software engineering, web or tool use; large-scale trace analysis, data curation or synthetic generation.
  • Designing systems to support complex, long-horizon agent work across a multitude of modalities and platforms
  • Serving with vLLM or SGLang, distillation, quantization, or multi-node GPU training.
  • Practical security work on prompt injection, data governance or permission boundaries for agents that can act and improve themselves.

These are project-specific strengths; post-training experience is optional, and no candidate needs the entire list. Bring a repository, paper, model or technical write-up that lets us examine how you think and what you built.

Other details

Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience. Certain roles may be eligible for variable compensation, equity, and benefits.

Company info

Ema builds AI Employees for HR, IT and Finance. Our AI Employees take on the busy work across the employee experience, from recruiting, onboarding and benefits to IT support, invoice processing and payroll, so people can spend their time on work that needs them. Founded by former executives from Google,

More jobs at Ema