Skip to content

Senior Infrastructure Engineer

CrusoeSunnyvale, CA - USOn-Site

Estimated salary, not published by the employer: Est. $155k–232k/yr

Needs a free Superjobs account. You'll finish on Crusoe's Ashby page.

Skill score

Summary

This Senior Software Engineer builds the internal tools, automation, test frameworks and data platforms that let hardware engineers debug, validate and support GPU and CPU infrastructure across the hardware lifecycle. It suits engineers with strong Python and systems programming skills who have experience with infrastructure automation, provisioning and telemetry, and who enjoy working closely with hardware and firmware teams.

Function
Development
Estimated salary
Est. $155k–232k/yr
Estimated for a senior role, ~5 yrs experience, United States. Not published by the employer.
Work mode and location
On-Site, Sunnyvale, CA - US
Experience
5+ yrs
Employment type
Full-time

Job description

Overview

We are seeking a Software Engineer to join Crusoe’s Hardware Systems Engineering team and build the tools, automation, and data platforms that let our hardware engineers debug, validate, and support high-performance compute systems at scale. In this role, you will own the software that supports the full hardware lifecycle, from prototype bring-up through large-scale production, accelerating issue resolution and improving reliability across Crusoe Cloud’s GPU- and CPU-based infrastructure.

About the team

You will work closely with hardware engineers to understand their debugging and validation workflows, then turn them into automatable workflows. You will also work with cross-functional teams to integrate tools with the production environment. A particular focus will be provisioning, hardware health monitoring, test framework, and data collection. Your work will directly improve Crusoe’s ability to deploy and operate sustainable, AI-first compute systems with world-class performance and reliability.

Roles and responsibilities

  • Design, build, and maintain software tools and frameworks that support the hardware development and sustaining lifecycle, including bring-up, validation, deployment, and ongoing production support.
  • Develop automated test, diagnostics, and health-monitoring frameworks that run across fleets of servers, enabling continuous reliability improvements.
  • Build tooling, monitoring and logging systems that help hardware engineers triage and root-cause issues across different hardware platforms.
  • Create automated validation and characterization workflows for GPU, CPU, and high-performance compute platforms, including result collection, analysis, and reporting.
  • Build and operate data pipelines, dashboards, and analytics that surface hardware failure trends, performance regressions, and reliability metrics.
  • Support E2E integration and solution testing by developing test harnesses and CI/CD workflows that ensure Crusoe Cloud products meet performance, reliability, and scalability expectations.
  • Evaluate and introduce new tools, testing methods, and automation approaches that improve engineering efficiency and support Crusoe’s sustainability goals.
  • Provide data-driven insights from tooling and telemetry to influence Crusoe’s hardware roadmap and reliability strategy.

Skills required

Top skills

  • Python
  • Go, C/C++, or Rust
  • Shell scripting

All skills (9)

  • Test automation frameworks
  • BMC, Redfish, IPMI
  • Firmware update automation
  • Kubernetes, Ansible, Terraform
  • Data pipelines and telemetry
  • Observability tooling
  • GPU cluster diagnostics
  • NVIDIA DCGM and NVML
  • Linux systems internals

Qualifications

  • 5+ years of professional software engineering experience, ideally building internal tools, infrastructure software, provisioning, test automation, or systems software.
  • Strong proficiency in Python and at least one systems language (Go, C/C++, or Rust), plus Shell scripting.
  • Experience designing and implementing automation and test frameworks, including workflow engines, for hardware or large-scale infrastructure.
  • Experience with BMC/Redfish/IPMI, firmware update automation, or out-of-band management.
  • Experience with fleet management, provisioning, or large-scale automation tools (Kubernetes, Ansible, Terraform, etc.).
  • Experience building data pipelines, logging, telemetry, or observability tooling to analyze system behavior at scale.
  • Experience working across hardware, firmware, and software teams in multidisciplinary environments.
  • Strong analytical and problem-solving skills with a data-driven approach.
  • Excellent communication and collaboration skills, with the ability to gather requirements from engineers and external partners and translate them into usable tools.
  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience.

Nice to have

  • Experience building tooling for GPU clusters, including GPU-to-GPU communication diagnostics (NCCL tests, NVLink monitoring, etc.).
  • Familiarity with PCIe, InfiniBand, and NVMe/storage concepts and tooling (e.g., lspci, ibstat, nvme-cli, perftest, fio), with the curiosity to go deeper.
  • Working knowledge of Linux systems, including kernel interfaces, drivers, device tooling, and low-level system diagnostics.
  • Familiarity with NVIDIA tooling such as DCGM, NVML, and fabric management software.
  • Experience supporting both ARM and x86 server architectures.
  • Background in factory test, manufacturing test software, or hardware qualification workflows.

Other details

Compensation will be paid in the range of $170,000 - $205,000. Restricted Stock Units are included in all offers. Compensation to be determined by the applicants knowledge, education, and abilities, as well as internal equity and alignment with market data.

Company info

As the only vertically integrated AI infrastructure company built from the ground up, we own and operate each layer of the stack — from electrons to tokens — to power the world's most ambitious AI workloads.

More jobs at Crusoe