Skip to content

Member of Technical Staff, Traffic Infrastructure

Fireworks AISan MateoRemote

Estimated salary, not published by the employer: Est. $179k–269k/yr

Needs a free Superjobs account. You'll finish on Fireworks AI's Ashby page.

Skill score

Summary

The person in this role owns the traffic layer of Fireworks' generative AI platform, building and operating proxies, load balancers, service mesh and routing systems across regions and cloud providers. It suits a senior engineer with deep distributed systems and cloud networking experience who can also lead technical design and mentor others.

Function
Development
Estimated salary
Est. $179k–269k/yr
Estimated for a staff-level role, ~5 yrs experience, United States. Not published by the employer.
Work mode and location
Remote, San Mateo
Experience
5+ yrs
Employment type
Full-time

Job description

Overview

As a Member of Technical Staff on our Traffic Infrastructure team, you will own the traffic layer behind our generative AI platform: the proxies, load balancers, service mesh, and routing systems that move every request reliably across regions and cloud providers. This is a highly technical role that calls for depth in distributed systems, cloud networking, and infrastructure, along with the judgment to balance latency, cost, and operational simplicity. You will partner closely with ML, product, and platform teams, and help set the technical direction for the team.

Roles and responsibilities

  • Architect and build scalable, fault-tolerant traffic and networking services, including ingress and egress, load balancing, routing, and quality-of-service controls.
  • Lead technical design discussions, mentor other engineers, and establish best practices for operating large-scale infrastructure.
  • Drive network optimization both inside and outside data centers, including cost reduction, performance tuning, and removing scaling bottlenecks.
  • Evaluate and integrate cloud-native and open-source technologies (e.g., Kubernetes, Envoy, Istio) to strengthen platform capabilities and reliability.
  • Own systems end to end, from design through deployment and observability, with an emphasis on high availability, disaster recovery, and operational excellence.
  • Develop and maintain comprehensive monitoring, alerting, logging, and tracing to give deep insight into system health and performance.

Skills required

Top skills

  • Distributed systems
  • Cloud networking
  • Load balancing

All skills (10)

  • Observability
  • C++
  • Rust
  • Java
  • Python
  • Kubernetes
  • Envoy
  • Istio
  • Service mesh
  • Go

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience).
  • 5+ years of experience building backend or network infrastructure in cloud environments (e.g., AWS, GCP, Azure).
  • Strong software development skills in languages such as Go, C++, Rust, Java, or Python.
  • Deep understanding of distributed systems and networking fundamentals, including performance optimization.
  • Full product lifecycle ownership, from design through implementation to production.

Nice to have

  • Master's or PhD in Computer Science or a related field.
  • Hands-on experience with traffic or edge engineering, service mesh, or cloud networking (e.g., Envoy, Istio, DPDK).
  • Deep Kubernetes experience, including ingress, network policy, and custom controllers.
  • Track record of improving performance, reliability, and cost-efficiency on high-throughput systems.
  • Experience leading projects across teams and coaching distributed engineers.

Company info

Fireworks AI provides a platform for running, combining, and training open AI models so that companies can build specialized AI models of their own. Its customers are companies that want to own and tailor their AI rather than rent it from closed model providers.

More jobs at Fireworks AI