Skip to content

Software Engineer, On-Device AI

NothingSan Francisco, California, United StatesOn-Site

Estimated salary, not published by the employer: Est. $120k–180k/yr

Needs a free Superjobs account. You'll finish on Nothing's site.

Skill score

Summary

This engineer builds the core system services, APIs, and runtime foundations that let small AI models run reliably on phones, wearables, and computers. It suits someone with strong systems fundamentals who can work without a spec, make trade-offs across CPUs, GPUs and NPUs, and own problems end to end.

Function
Development
Estimated salary
Est. $120k–180k/yr
Estimated for a mid-level role, ~3 yrs experience (typical for the level), United States. Not published by the employer.
Work mode and location
On-Site, San Francisco, California, United States
Employment type
Full-time

Job description

Overview

AI should run on the devices you carry, work across all of them, and actually get things done. That's a hard problem, and we're solving it from the operating system up.

You'll build the foundations that make this work: the system services that keep small models running reliably on real hardware, and the APIs that connect them to everything else. The problems are open. The hardware is real. You'll own them end to end.

Roles and responsibilities

  • Build core system services, abstractions and APIs for a platform others can build on
  • Have small models running reliably on real hardware: memory, scheduling and resource management, all inside tight latency, battery and thermal budgets
  • Connect model capabilities to the platform and app layers, so they finish real tasks end to end
  • Decide what runs where: wearable, phone, computer or cloud, based on the task, privacy and the hardware on hand
  • Prototype fast, profile on real hardware across CPUs, GPUs and NPUs, and ship what works
  • Work side by side with software, model and hardware engineers

Skills required

Top skills

  • Systems programming
  • Concurrency
  • Resource management
  • API design

All skills (8)

  • On-device inference
  • Inference runtimes
  • Rust
  • Python
  • JavaScript
  • Performance profiling
  • NPU and GPU hardware
  • Device software

Qualifications

  • You've owned complex systems work, from architecture to hands-on implementation and debugging
  • Strong systems fundamentals: concurrency, resource management, API design and performance trade-offs
  • Experience with on-device inference, inference runtimes, device software or another resource-constrained platform. Or proof that you learn fast across all of them
  • You make progress without a spec, explain trade-offs clearly and change course when the data says so
  • You question familiar architectures instead of copying them
  • Strong programming skills and the range to use what the problem needs. E.g. Rust, Python and JavaScript

Other details

  • Location: San Francisco, we are open to remote for the right person, with regular time in person with our SF team.

Company info

We’re building a different kind of technology company, one that puts design, emotion, and human creativity at the heart of everything we do. From the way our products look and feel to how we communicate and show up in culture, we believe technology should make you feel something. Founded in

More jobs at Nothing