Skip to content

Member of Technical Staff - Safety

Reflection AISan Francisco, CA, London, New York, NYOn-Site

Estimated salary, not published by the employer: Est. $182k–274k/yr

Needs a free Superjobs account. You'll finish on Reflection AI's Ashby page.

Skill score

Summary

This person designs and runs safety work for Reflection's open models, including post-training safety, safeguards for open-weight deployment, API monitoring, and capability and red-team evaluations. It suits someone with deep LLM safety and ML engineering background who is comfortable making high-stakes release decisions in a fast-paced startup.

Estimated salary
Est. $182k–274k/yr
Estimated for a staff-level role, ~9 yrs experience (typical for the level), United States. Not published by the employer.
Work mode and location
On-Site, San Francisco, CA, London, New York, NY
Employment type
Full-time

Job description

Roles and responsibilities

  • Conduct safety post-training on Beam: Develop and improve our SFT and RL pipeline, including policy-conditioned reasoning traces, context-aware reward models and mixed-task safety environments.
  • Build safeguards for open-weight deployment. Develop classifiers that are cheap to run, catch nearly all harmful cases and stay reasonably precise. These include prompted and fine-tuned classifiers and linear probes on model internals, and they cover prompts, reasoning, responses and agent trajectories. Ship them with intervention guidance that inference providers and the open-source community can actually deploy.
  • Build safety systems for Reflection’s API & AI Factory. Develop, train and run state-of-the-art safeguards for our API and AI Factory deployments, covering both real-time and offline monitoring and enforcement. Combine classifiers, linear probes and lighter-weight detection to find and act on misuse at scale. Turn what we learn in production into better safeguards for the whole ecosystem.
  • Own systemic risk evaluations. Design, run and evolve capability evaluations for biological, chemical, radiological/nuclear, cyber, harmful manipulation and loss-of-control risks. Base them on clear threat models, and use them to inform OSF risk determinations and launch decisions.
  • Measure safety across every harm area. Grow Iris Safety Evaluations (ISE) across our > 15 harm categories, from self-harm, cyber, and child safety to fraud and privacy, in single-turn, multi-turn and agentic settings. Track over-refusal on real-world traffic, and verify that safety holds across quantized variants and deployment settings like search and custom system prompts.
  • Responsible release: Validate that each model meets our risk thresholds on both system risks and safety model behavior before it ships. Work with third-party evaluators and government AI safety institutes on pre-deployment testing, and help write the safety reports and model cards that explain our decisions publicly.
  • Put advanced capabilities in defenders’ hands. Build defensive cyber & bio tools, such as autonomous penetration testing, and the trusted access programs that get them, and more capable models over time, safely to vetted security teams.
  • Lead adversarial testing. Run human and automated red teaming across misuse, jailbreaks, prompt injection and alignment failures. Build attacker agents that adapt to the model, so we test against dynamic attacks rather than static datasets, and feed what we find back into training and safeguards.
  • Run Safety evaluations grounded in the real world. Design and run human uplift studies, from uplift trials to wet-lab studies, and live-deployment evaluations like our partnership with Andon Labs, where Beam runs a real business, to measure what our models can actually do in the real world.
  • Own the safety policies. The harm policies, red lines and constitution, plus working with safety subject-matter experts on data and grading.
  • Push the safety & alignment research frontier. Work on problems that matter most for open weights: resistance to abliteration and fine-tuning attacks, safety that holds up inside the model, monitorability, evaluation awareness and agentic security. Publish the results and release open tools the community can build on.

Skills required

Top skills

  • LLM safety
  • Adversarial attacks
  • Red teaming
  • Post-training

All skills (6)

  • Model evaluations
  • Interpretability
  • Software engineering
  • Automated evaluation pipelines
  • Reinforcement learning
  • RLHF

Qualifications

  • Graduate degree (MS or PhD) in Computer Science, Machine Learning, or related discipline, or equivalent practical experience in AI Safety.
  • Deep technical understanding of LLM safety, including adversarial attacks, red-teaming methodologies, post-training, evaluations, and interpretability.
  • Strong software engineering capabilities with experience building automated evaluation pipelines or large-scale ML systems.

Nice to have

  • Experience with Reinforcement Learning (RLHF) and how it impacts model safety and alignment is a strong plus.
  • Thrive in a fast-paced, high-agency startup environment with bias toward action.
  • Willing to make high-stakes decisions regarding model release and safety thresholds.
  • Mission oriented & passionate about advancing the frontier of intelligence.

Other details

  • Top-tier compensation: Salary and equity structured to recognize and retain our talent globally.
  • Stock options: Everyone who joins and contributes to Reflection's success gets to share in the upside through stock options.
  • Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance.
  • Meals: Lunch and dinner are provided in the office daily.
  • Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys.
  • Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K.
  • Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable.
  • Team building: We have regular off-sites, happy hours, and team celebrations.

Company info

Reflection AI builds open-weight AI models and systems that give enterprises, governments, and sovereign entities control over their own intelligence. Its models are used for on-premises enterprise AI deployments, by U.S. National Laboratories through the Department of Energy's Genesis Mission, and in a planned sovereign AI cloud for enterprises and

More jobs at Reflection AI