Skip to content

Spark Developer

InfraCloudPune, Maharashtra, IndiaRemote

Estimated salary, not published by the employer: Est. ₹8–12 LPA

Needs a free Superjobs account. You'll finish on InfraCloud's site.

Skill score

Summary

This Senior Software Engineer works on Apache Spark internals and distributed data processing, including contributing fixes to the open-source Spark project and keeping it compatible with newer releases. The role suits engineers with deep Spark, JVM and open-source experience who can debug complex performance issues and work independently.

Function
Development
Estimated salary
Est. ₹8–12 LPA
Estimated for a mid-level role, ~3 yrs experience (typical for the level), India. Not published by the employer.
Work mode and location
Remote, Pune, Maharashtra, India
Employment type
Full-time

Job description

Overview

We are looking for a Senior Software Engineer with strong expertise in Apache Spark and distributed systems. The role involves working on Spark internals, contributing to the Apache Spark open-source community, and building scalable data processing solutions aligned with the platform requirements.

Roles and responsibilities

  • Contribute fixes and enhancements to the Apache Spark open-source project.
  • Upgrade and maintain compatibility with newer Spark releases.
  • Optimize Spark internals for performance, scalability, and reliability.
  • Design and develop distributed data processing solutions.
  • Debug complex Spark-related performance and stability issues.
  • Collaborate with product and platform teams on architecture and technical initiatives.

Skills required

Top skills

  • Apache Spark
  • Spark internals
  • Distributed systems
  • Java

All skills (8)

  • Scala
  • Query execution
  • Performance optimization
  • Open-source contribution
  • Debugging
  • Kubernetes
  • Cloud-native environments
  • JVM tuning

Qualifications

  • Strong experience with Apache Spark internals and distributed systems.
  • Hands-on experience contributing to open-source projects.
  • Strong Java and/or Scala programming skills.
  • Expertise in query execution, distributed processing, and performance optimization.
  • Strong debugging and problem-solving abilities.
  • Ability to work independently and drive technical initiatives.

Nice to have

  • Experience with Kubernetes and cloud-native environments.
  • Knowledge of JVM tuning and system optimization.
  • Contributions to Apache or other open-source communities.
  • Experience with large-scale analytics or data platforms.

Company info

InfraCloud delivers Kubernetes and infrastructure automation projects for clients in regulated industries. The sources do not name the specific customers or the full range of services beyond this.

More jobs at InfraCloud