Software Engineer, Traffic Infrastructure
OpenAISan Francisco, SeattleOn-Site
Needs a free Superjobs account. You'll finish on OpenAI's Ashby page.
Skill score
Summary
This role builds and operates ingress, egress, and service-to-service networking, gateways, proxies, and cloud networking across clusters, regions, and clouds at OpenAI. It suits a senior engineer with production networking experience who takes ownership of reliability and works across teams and cloud providers.
- Function
- Development
- Estimated salary
- Est. $138k–208k/yr
- Estimated for a mid-level role, ~5 yrs experience, United States. Not published by the employer.
- Work mode and location
- On-Site, San Francisco, Seattle
- Experience
- 5+ yrs
- Employment type
- Full-time
Job description
Overview
The Cloud Infrastructure team builds and operates the infrastructure behind OpenAI’s products, including ChatGPT and the API. Within Cloud Infrastructure, the Traffic team owns how traffic enters our cloud environments, moves between services, clusters, and regions, and reaches external dependencies.
Our work spans cloud networking, Kubernetes networking, ingress and egress gateways, proxies, load balancing, and traffic steering. We build the systems, controls, and observability that make these paths reliable, secure, efficient, and straightforward for other engineering teams to use.
You’ll build and operate the networking and traffic infrastructure that connects OpenAI’s products and services across clouds and regions. The team’s work spans L3, L4, and L7—from IP connectivity, NAT, and transport behavior to service proxies and application request routing.
You’ll bring depth in part of this stack and curiosity about how the whole path works. Projects may include building gateways and control planes, improving cross-region connectivity, diagnosing packet loss or connection exhaustion, and making routing changes safer and easier to operate.
This role combines software engineering with production ownership. You’ll turn ambiguous networking problems into durable improvements, working closely with service owners, infrastructure teams, Security, and cloud providers.
Roles and responsibilities
- Design, build, and operate ingress, egress, and service-to-service connectivity across clusters, regions, and clouds.
- Develop proxies, gateways, controllers, and automation for routing, load balancing, failover, and traffic management.
- Build and evolve cloud networking infrastructure, including private connectivity, NAT, and network isolation.
- Diagnose failures and performance bottlenecks across application, proxy, transport, and cloud networking layers; work with cloud providers when issues extend into their infrastructure.
- Build telemetry and diagnostic tools that explain traffic paths, identify failing components, and help engineers take effective action.
- Partner with Security to implement and validate traffic-path protections, including secure service communication, access controls, egress restrictions, and DDoS defenses.
- Improve latency, throughput, availability, and network efficiency through measurement, testing, and careful production rollouts.
- Create clear interfaces and safe defaults for service teams, participate in on-call, and turn operational lessons into changes that prevent recurring failures and reduce manual work.
Skills required
Top skills
- cloud networking
- Kubernetes networking
- load balancing
- proxies and gateways
All skills (8)
- TCP/UDP
- DNS
- NAT
- TLS
- HTTP/gRPC
- Go, Rust, C++ or Python
- Envoy, NGINX, Istio or Cilium
- service meshes
Qualifications
- Have 5+ years of experience building production infrastructure or distributed systems, including substantial work on networking or traffic infrastructure.
- Have depth in one or more areas such as cloud networking, Kubernetes networking, proxies and gateways, service meshes, load balancing, or global traffic routing.
- Understand networking fundamentals and can reason about how IP routing, TCP/UDP, DNS, NAT, TLS, and HTTP/gRPC affect connectivity and performance.
- Have hands-on experience building or operating systems such as Envoy, NGINX, Istio, Cilium, or comparable networking infrastructure.
- Write production software in Go, Rust, C++, Python, or a similar language, and use software and automation to solve operational problems.
- Can investigate unfamiliar failures using evidence, test hypotheses, and follow problems through to a verified resolution.
- Take ownership of design, implementation, rollout, and ongoing reliability, and communicate clearly across teams when a problem crosses ownership boundaries.
- Care about making infrastructure secure and understandable for the engineers who depend on it.
We value deep expertise and the willingness to learn across boundaries. You do not need prior experience with every technology or networking layer listed above.
Other details
This role is based in San Francisco, CA or Seattle, WA.
Company info
About OpenAI
OpenAI is an AI research and deployment company that builds AI systems and deploys them to the world through its products. Its customers and businesses use these AI products across their operations, with support from its sales, solutions, and support teams.