Engineering Manager/Tech Lead Manager - Runtime Engineering
SnowflakeUS-CA-Menlo Park, US-WA-BellevueRemote
Needs a free Superjobs account. You'll finish on Snowflake's Ashby page.
Skill score
Summary
This engineering manager leads a team of about 5 to 8 engineers building Spark compiler and runtime integration on Snowflake, setting technical direction and staying hands-on in architecture and critical code reviews. It suits a technical leader who can both grow people and debug complex correctness and performance issues in query-processing systems.
- Function
- Development
- Estimated salary
- Est. $125k–187k/yr
- Estimated for a manager role, ~2 yrs experience, United States. Not published by the employer.
- Work mode and location
- Remote, US-CA-Menlo Park, US-WA-Bellevue
- Experience
- 2+ yrs
- Employment type
- Full-time
Job description
Overview
Location: Bellevue, WA or Menlo Park, CA
About the team
The Spark Runtime Engineering Team brings Snowflake’s performance, efficiency, and reliability to Spark workloads. Our mission is to help customers scale data processing while preserving the familiar Spark APIs and semantics they rely on. We build the compiler and runtime integration that translate Spark workloads into efficient execution on Snowflake’s cloud-native query engine. This includes tackling complex challenges in compiler infrastructure, query-plan lowering, Spark compatibility, execution integration, and end-to-end observability to deliver faster, more cost-efficient data processing at scale.
We are seeking a hands-on Engineering Manager who combines deep technical expertise with strong people leadership. You will shape the team’s technical direction, stay actively engaged in architecture and critical engineering decisions, and hire, mentor, and grow a high-performing engineering team to advance the future of Spark on Snowflake.
Role Overview
You will lead a team of approximately 5–8 engineers building production compiler and runtime capabilities for Spark workloads on Snowflake. You will guide architectural decisions, review critical designs and code, and help investigate complex correctness, performance, and reliability issues. In partnership with compiler, query engine, runtime, and product teams, you will turn customer needs into a focused roadmap and measurable engineering outcomes.
Roles and responsibilities
- Set technical direction for Spark query compilation and runtime integration, including intermediate representations, type resolution, semantic compatibility, query-plan transformations, and efficient SQL generation.
- Improve end-to-end workload performance and cost-efficiency through profiling, compilation-latency reduction, metadata-access improvements, and collaboration with query-engine teams.
- Establish strong correctness and compatibility practices, including differential testing against Apache Spark, regression coverage, and clear handling of unsupported behavior.
- Own the production quality of the team’s components, including observability, incident response, fault recovery, and safe rollout practices.
- Hire, coach, and develop engineers; provide actionable feedback, manage performance, and support career growth across experience levels.
- Partner with senior technical leaders and Product Management to prioritize investments, manage dependencies, and deliver a realistic roadmap.
- Validate changes against representative customer workloads and track measurable improvements in compatibility, latency, reliability, and cost-efficiency.
Skills required
Top skills
- Engineering management
- Compiler architecture
- Relational query processing
- Scala
All skills (8)
- Java
- C++
- Systems fundamentals
- Apache Spark internals
- Catalyst
- Spark Connect
- SQL generation
- Query optimization
Qualifications
- 2+ years of direct engineering management experience, with demonstrated success developing engineers and delivering production systems.
- 5+ years of hands-on software engineering experience, including substantial work on compilers, query-processing systems, or runtime infrastructure.
- Deep expertise in at least one relevant area, such as compiler architecture and IR transformations, relational query processing, language semantics and type systems, or runtime integration.
- Proficiency in Scala, Java, C++, or a comparable implementation language, with the ability to review production code and guide technical decisions.
- Strong systems fundamentals, including concurrency, memory behavior, and performance analysis, together with experience debugging complex production issues.
- Ability to translate technical and customer requirements into engineering priorities and collaborate effectively across teams and locations.
Nice to have
- Experience with Apache Spark internals, Catalyst, Spark Connect, or DataFrame APIs.
- Experience with relational algebra, SQL generation, query optimization, or database execution systems.
- Experience with Scala/JVM performance, native runtime functions, metadata caching, or compilation-performance optimization.
- Experience building compatibility-test frameworks, differential testing, performance benchmarks, or production observability for data systems.
- Experience leading systems through customer adoption, production hardening, and staged releases.
- A degree in Computer Science, Computer Engineering, or a related field, or equivalent practical experience.
Other details
How do you want to make your impact?
Compensation
For jobs located in the United States, please visit the job posting on the Snowflake Careers Site for salary and benefits information: http://careers.snowflake.com
Company info
About Snowflake
Snowflake provides an AI Data Cloud that supports AI, data engineering, applications, and analytics for enterprises. The postings also describe building generative AI products that help enterprises migrate legacy systems and rewrite the logic of their data applications.