Staff AI Engineer, Agentic AI Harness & Quality - Moveworks
ServiceNowMountain View, CALIFORNIA, United StatesOn-Site
Needs a free Superjobs account. You'll finish on ServiceNow's SmartRecruiters page.
Skill score
Summary
The Staff AI Engineer builds and improves the agentic AI harness for Moveworks' enterprise assistant, covering agent behavior quality, evaluation, context engineering, and production performance across latency and reliability. The role suits experienced software engineers who ship production-quality code, rigorously evaluate model and prompt changes, and want to work on the cutting edge of agentic AI.
- Function
- Data Science
- Estimated salary
- Est. $215k–323k/yr
- Estimated for a staff-level role, ~9 yrs experience (typical for the level), United States. Not published by the employer.
- Work mode and location
- On-Site, Mountain View, CALIFORNIA, United States
- Employment type
- Full-time
Job description
Overview
The Role
We are looking for an experienced software engineer with expertise building AI-native product and platform to join us in expanding ServiceNow’s customer-facing agentic AI capabilities.
As a member of the Agentic AI Harness & Quality team, you will have all the tools of modern agentic AI engineering at your disposal, from frontier LLMs and tools to all the infrastructure needed to tune, evaluate, and serve AI agents in production. We are an eval-driven, data-centric team, and you will have the assistance of a world-class annotation team to build error-free, inclusive, and privacy-preserving datasets for tuning and evals.
You will push the envelope of AI performance in production, in every meaning of the word “performance”: not just accuracy and quality of outputs, but also latency, reliability, and capability of the end-to-end user-facing system as a whole. Successful AI engineers on the team are motivated to design and maintain high-performing compound AI systems.
Our team indexes on increasing our ability to move fast, solving challenging product and engineering challenges, and pushing the envelope of agent reliability and value provided to customers. Your work will impact our team’s core objective to build the highest-performing enterprise assistant platform the world has ever seen, in close collaboration with other functions within Moveworks and ServiceNow as a whole.
Roles and responsibilities
- Apply software engineering and compound AI system engineering to create lasting value for all our customers
- Drive quality in agent behavior, both in terms of increasing success rate at achieving goals set by end users and decreasing misbehavior in the customer business environment
- Take on exciting and difficult challenges in AI harness engineering, such as agent cognitive architecture, eval benchmark creation, context engineering, generative UI, dynamic agent orchestration, multimodal I/O such as image and voice, multilinguality, conversational memory management, reasoning strategies, grounding and verifiability for generated text, deployment safety, and automatic harness optimization
- Read, discuss, and build on the latest AI research and open-source repositories and models
- Research and develop innovative, scalable and dynamic solutions to hard problems
- Use your knowledge of machine learning fundamentals and LLMs to make improvements to the agentic harness and its AI components, evaluate them with small scale experiments and productionize your solutions at scale
- Partner closely with web and chat platform engineering teams to turn harness investments into delightful user experiences that wow our customers
Skills required
Top skills
- Python
- Golang
- LLM evaluation
- Agent architectures
All skills (8)
- Unit testing
- Compound AI systems
- Eval dataset creation
- Machine learning fundamentals
- Multimodal AI
- Agent orchestration
- Context engineering
- Prompt engineering
Qualifications
To be successful in this role you have
- Drive to ship product improvements with production-quality, fully unit-tested code and rigorously-evaluated updates to models, prompts, context curation code, or other tunable system components
- Solid grasp of LLM and agent evaluation fundamentals, especially for agent action trajectories, generated text, and non-uniform sampling regimes
- Attention to detail and high standard of data quality for eval datasets
- Thoughtfulness about API contracts and implications of exposing a platform feature to a given type of stakeholder or end user
- Readiness to hit the ground running in a Mac development environment, programming in Python and/or Golang with the assistance of coding agents
- Familiarity with industry standard agent architectures and large language models
- Critical reading skill to catch subtle “miscommunication bugs” in English-language agent instructions
- Ability to fix miscommunication bugs with precise writing and evals
- Desire to move fast with a high degree of ownership
- Drive to ship product improvements with production-grade code
- Strong appetite for continuous incremental wins and completing challenging projects fast
- High level of curiosity about engineering outside of immediate discipline and ongoing desire to learn and stay at the cutting edge of agentic AI
Other details
For positions in this location, we offer a base pay of $176,100 - $308,200, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs.
Compensation is based on the geographic location in which the role is located and is subject to change based on work location.
Company info
About ServiceNow
ServiceNow provides a cloud-based AI platform that connects people, systems, and processes so organizations can find smarter ways to work. Enterprises and organizations use the platform, along with its AI and automation technologies, to design solutions that transform how they operate.