Skip to content

Machine Learning Infrastructure Engineer, Technology

Point72New York, NYOn-Site

Estimated salary, not published by the employer: Est. $120k–180k/yr

Needs a free Superjobs account. You'll finish on Point72's Greenhouse page.

Skill score

Summary

This person designs, builds, and operates high-performance infrastructure and distributed systems that support large-scale generative AI and machine learning training, inference, and deployment, and optimizes GPU and CPU compute for cost and reliability. It suits an engineer with several years of scalable compute or ML infrastructure experience who enjoys systems-level work and mentoring others.

Function
Data Science
Estimated salary
Est. $120k–180k/yr
Estimated for a mid-level role, ~3 yrs experience, United States. Not published by the employer.
Work mode and location
On-Site, New York, NY
Experience
3–7 yrs

Job description

Roles and responsibilities

  • Design and implement high-performance infrastructure to support large-scale generative AI and machine learning workloads, enabling faster model iteration and real business impact
  • Design and operate distributed systems for model training, hyperparameter tuning, inference, and data preprocessing pipelines to deliver reliable end-to-end machine learning (ML) workflows
  • Collaborate with ML researchers and engineers to produce models, optimizing compute utilization, training throughput, and inference latency
  • Develop and automate deployment, orchestration, and CI/CD pipelines for models and data workflows using container orchestration and infrastructure-as-code (IaC)
  • Implement observability, monitoring, and cost-management strategies for GPU and accelerator compute environments to maintain predictable performance and spend
  • Evaluate, integrate, and benchmark emerging hardware and software technologies across cloud and on-prem environments to improve scalability and throughput
  • Drive security, compliance, and operational runbooks for GenAI infrastructure including access controls, secrets management, and incident response procedures
  • Troubleshoot, profile, and optimize performance across GPU and CPU compute stacks to remove bottlenecks and increase reliability
  • Document architecture, operational practices, and mentor engineers to expand team capability and accelerate adoption of production-ready GenAI infrastructure

Skills required

Top skills

  • Distributed systems
  • Kubernetes
  • AWS
  • Google Cloud Platform

All skills (8)

  • Azure
  • MLflow
  • Ray
  • Airflow
  • Kubeflow
  • Terraform
  • Reinforcement learning
  • Python

Qualifications

  • Bachelor's or master's degree in computer science, electrical engineering, or a related technical field
  • 3–7 years of experience building and maintaining scalable compute or machine learning infrastructure systems
  • Deep understanding of distributed systems, container orchestration (Kubernetes), and public cloud platforms such as AWS, Google Cloud Platform, or Azure
  • Hands-on experience with machine learning operations and infrastructure tools such as MLflow, Ray, Airflow, Kubeflow, and Terraform
  • Strong understanding of reinforcement learning concepts and their infrastructure implications
  • Proficiency in Python and systems-level programming in one or more languages such as Go, C++, or Rust
  • Strong debugging, performance profiling, and optimization skills across GPU and CPU compute stacks
  • Experience implementing monitoring, observability, and cost-optimization for GPU/accelerator-based compute environments
  • Excellent collaboration and communication skills with a systems-thinking mindset
  • Commitment to the highest ethical standards

Other details

We invest in our people, their careers, their health, and their well-being. When you work here, we provide:

  • Fully-paid health care benefits
  • Generous parental and family leave policies
  • Mental and physical wellness programs
  • Volunteer opportunities
  • Non-profit matching gift program
  • Support for employee-led affinity groups representing women, minorities and the LGBT+ community
  • Tuition assistance
  • A 401(k) savings program with an employer match and more

Compensation

The annual base salary range for this role is $180,000-$300,000 (USD) , which does not include discretionary bonus compensation or our comprehensive benefits package. Actual compensation offered to the successful candidate may vary from posted hiring range based upon geographic location, work experience, education, and/or skill level, among other things.

Company info

Point72 is a leading global alternative investment firm led by Steven A. Cohen. Building on more than 30 years of investing experience, Point72 seeks to deliver superior returns for its investors through fundamental and systematic investing strategies across asset classes and geographies.

More jobs at Point72