Software Engineer, On-Device AI
NothingSan Francisco, California, United StatesOn-Site
Needs a free Superjobs account. You'll finish on Nothing's site.
Skill score
Summary
This engineer builds the core system services, APIs, and runtime foundations that let small AI models run reliably on phones, wearables, and computers. It suits someone with strong systems fundamentals who can work without a spec, make trade-offs across CPUs, GPUs and NPUs, and own problems end to end.
- Function
- Development
- Estimated salary
- Est. $120k–180k/yr
- Estimated for a mid-level role, ~3 yrs experience (typical for the level), United States. Not published by the employer.
- Work mode and location
- On-Site, San Francisco, California, United States
- Employment type
- Full-time
Job description
Overview
AI should run on the devices you carry, work across all of them, and actually get things done. That's a hard problem, and we're solving it from the operating system up.
You'll build the foundations that make this work: the system services that keep small models running reliably on real hardware, and the APIs that connect them to everything else. The problems are open. The hardware is real. You'll own them end to end.
Roles and responsibilities
- Build core system services, abstractions and APIs for a platform others can build on
- Have small models running reliably on real hardware: memory, scheduling and resource management, all inside tight latency, battery and thermal budgets
- Connect model capabilities to the platform and app layers, so they finish real tasks end to end
- Decide what runs where: wearable, phone, computer or cloud, based on the task, privacy and the hardware on hand
- Prototype fast, profile on real hardware across CPUs, GPUs and NPUs, and ship what works
- Work side by side with software, model and hardware engineers
Skills required
Top skills
- Systems programming
- Concurrency
- Resource management
- API design
All skills (8)
- On-device inference
- Inference runtimes
- Rust
- Python
- JavaScript
- Performance profiling
- NPU and GPU hardware
- Device software
Qualifications
- You've owned complex systems work, from architecture to hands-on implementation and debugging
- Strong systems fundamentals: concurrency, resource management, API design and performance trade-offs
- Experience with on-device inference, inference runtimes, device software or another resource-constrained platform. Or proof that you learn fast across all of them
- You make progress without a spec, explain trade-offs clearly and change course when the data says so
- You question familiar architectures instead of copying them
- Strong programming skills and the range to use what the problem needs. E.g. Rust, Python and JavaScript
Other details
- Location: San Francisco, we are open to remote for the right person, with regular time in person with our SF team.
Company info
About Nothing
We’re building a different kind of technology company, one that puts design, emotion, and human creativity at the heart of everything we do. From the way our products look and feel to how we communicate and show up in culture, we believe technology should make you feel something. Founded in