Skip to content

Senior Data Platform Engineer

Komodo Health Inc.San Francisco, CAOn-Site

Estimated salary, not published by the employer: Est. $163k–245k/yr

Needs a free Superjobs account. You'll finish on Komodo Health Inc.'s Greenhouse page.

Skill score

Summary

The Senior Data Platform Engineer designs, builds, operates, and improves the large-scale pipelines and data platform behind Komodo Health's Healthcare Map, working hands-on with complex healthcare data at scale. This role suits experienced data engineers who can own production pipelines, make storage and performance decisions, and communicate trade-offs across teams.

Function
Data Science
Estimated salary
Est. $163k–245k/yr
Estimated for a senior role, ~6 yrs experience (typical for the level), United States. Not published by the employer.
Work mode and location
On-Site, San Francisco, CA

Job description

Overview

Join Komodo Health’s Data Foundations team and play a critical role in shaping the core data products that fuel our Healthcare Map. You’ll transform massive, complex healthcare datasets into performant, trustworthy data assets that power customer-facing products, internal innovation, and AI/ML use cases. By building and scaling our foundational data systems, you’ll directly enable the transparency and efficiency required to drive better health outcomes across the industry.

The Senior Data Platform Engineer will design, build, operate, and improve the large-scale pipelines and foundational data platform behind Komodo’s Healthcare Map. This is a hands-on engineering role focused on processing complex healthcare data at scale, improving reliability and performance, and contributing to the technical direction of core data systems.

Roles and responsibilities

  • Build, operate, and optimize large-scale batch pipelines using Python, SQL, Spark, and Airflow on AWS
  • Make storage and data layout decisions (table formats, partitioning, file sizing, compaction) that keep large datasets fast to query and cost-efficient
  • Ingest data from many external sources and keep pipelines correct through frequent schema changes
  • Transform healthcare claims, EHR, and reference data into trusted, serving-ready data products for customers and internal teams
  • Strengthen reliability through data quality checks, validation, lineage, observability, and alerting
  • Debug complex data, system, and performance issues across compute-heavy workflows
  • Contribute to system design, code quality, testing, documentation, CI/CD, and rotational production support

AI-Augmented Engineering Expectations

  • You will be expected to leverage AI-augmented engineering tools, such as ChatGPT, Gemini, or Claude, to improve productivity and technical decision-making. This may include using AI to generate and refine code, accelerate documentation, automate test case creation, debug complex issues, explore unfamiliar technical concepts, and assess architectural trade-offs and risks.

Skills required

Top skills

  • Python
  • SQL
  • Apache Spark
  • Airflow

All skills (8)

  • AWS
  • Open table formats
  • Columnar storage formats
  • Data quality and observability
  • Docker
  • Kubernetes
  • Data governance and lineage
  • API data products

Qualifications

What you bring to Komodo Health

  • Strong hands-on experience building, owning, and debugging production data pipelines at multi-terabyte scale
  • Advanced Python, including performant, memory-efficient code for large-scale data processing, plus strong SQL
  • Deep production experience with Airflow, including operating and scaling it, not just writing DAGs
  • A solid understanding of how data is physically stored: columnar vs. row formats, and open table formats like Iceberg, Delta Lake, or Hudi (updates, compaction, small files, partitioning)
  • Experience with Spark or a comparable distributed processing framework
  • Proven experience designing and operating data systems in AWS
  • Strong instincts for data correctness, root-cause analysis, and production troubleshooting
  • The ability to communicate technical trade-offs clearly with engineering, product, and data partners
  • Comfort using AI-assisted engineering tools for coding, debugging, documentation, and technical exploration

Nice to have

Additional skills and experience we’d prioritize (nice to have)…

  • Containers and orchestration (Docker, Kubernetes)
  • Strong core software engineering fundamentals and experience in more than one language
  • Data governance and lineage experience
  • Experience delivering external-facing data products through APIs, serving layers, or customer access patterns
  • Experience applying AI or agentic workflows to engineering, data quality, delivery, or operations
  • Success in high-growth or ambiguous environments

No healthcare background required. You’ll build that domain expertise here.

Other details

  • Architectural Advancement: Delivered high-impact technical initiatives that improve pipeline performance, scalability, and system efficiency.
  • Platform Hardening: Improved the reliability, observability, and cost-efficiency of core Data Foundations systems.
  • Healthcare Data Innovation: Built deep domain expertise and contributed new approaches to challenges such as patient journey mapping and identity resolution.
  • Cross-Functional Delivery: Partnered with Data Product and Engineering teams to ship scalable, production-grade data solutions.
  • Architecture Partnership: Raised the bar across the team through mentorship, design reviews, and engineering best practices.

Benefits

The pay range for each job posting reflects a minimum and maximum range of annual base pay that we reasonably expect to pay for this position within the US. We carefully consider multiple business-related factors when determining compensation, including job-related skills, work experience, geographic work location, relevant training and certifications, business needs and market demands.

The starting annual base pay for this role is listed below. This position may be eligible for performance-based bonuses as determined in the Company’s sole discretion and in accordance with a written agreement or plan. This role may also be eligible for equity awards. In addition, this role is eligible for benefits including, but not limited to, comprehensive health, dental, and vision insurance; flexible time off and holidays; 401(k) with company match; disability insurance and life insurance; and leaves of absence in accordance with applicable state and local laws and regulations and company policy.

Compensation

San Francisco Bay Area and New York City

$196,000—$230,000 USD

All Other US Locations

$170,000—$200,000 USD

Where You’ll Work

Komodo Health has a hybrid work model with hubs in San Francisco, New York City, and Chicago. Roles vary — some can be performed from anywhere in the country, others are scoped to a specific region, and some are based near one of our hubs. For hub-based Dragons, we're building intentional in-office rhythms alongside the flexibility that's core to how we work. Whatever your setup, expectations will always be clear before you join.

Company info

About Komodo Health Inc.

Komodo Health provides healthcare data, validated healthcare AI, and purpose-built workflows through its Marmot platform, which combine real-world patient journey data to give answers on disease incidence, treatment patterns and health outcomes. Its customers are Life Sciences companies and healthcare organizations that use these insights for decision-making.

More jobs at Komodo Health Inc.