Skip to content

Senior Spark QA Engineer

InfraCloudPune, Maharashtra, IndiaRemote

Estimated salary, not published by the employer: Est. ₹7–11 LPA

Needs a free Superjobs account. You'll finish on InfraCloud's site.

Skill score

Summary

The Senior Spark QA Engineer performs manual and automated functional, scalability, and performance testing of Spark jobs, Spark SQL, and ETL pipelines, and sets up Spark clusters across several platforms. The role suits an experienced QA engineer with hands-on Apache Spark and distributed systems knowledge who can also lead QA work and mentor others.

Function
Testing
Estimated salary
Est. ₹7–11 LPA
Estimated for a senior role, ~5 yrs experience, India. Not published by the employer.
Work mode and location
Remote, Pune, Maharashtra, India
Experience
5+ yrs
Employment type
Full-time

Job description

Overview

Job Description - We are looking for a Senior Spark QA Engineer with strong expertise in functional and performance testing of Apache Spark applications and distributed data platforms.

Roles and responsibilities

  • Perform manual and automated testing of Spark jobs, Spark SQL queries, and ETL pipelines.
  • Execute functional, scalability, and performance testing for Spark workloads.
  • Set up and manage Spark clusters on Standalone, YARN, Kubernetes, Mesos, Databricks, EMR, and Dataproc.
  • Conduct benchmarking, validation, and performance analysis of Spark applications.
  • Identify bottlenecks and troubleshoot distributed system issues.
  • Lead QA initiatives and mentor team members.

Skills required

Top skills

  • Apache Spark
  • Spark SQL
  • ETL pipelines
  • Functional testing

All skills (8)

  • Performance testing
  • Distributed systems
  • Kubernetes
  • Automation frameworks
  • CI/CD pipelines
  • Databricks
  • Python
  • Java

Qualifications

  • 5+ years of QA/testing experience with strong hands-on expertise in Apache Spark.
  • Experience in functional and performance testing of distributed systems.
  • Strong understanding of Spark architecture and optimization techniques.
  • Experience with Kubernetes and cloud-based Spark environments.
  • Proficiency in Python or Java.
  • Experience with automation frameworks and CI/CD pipelines.

Other details

Location: RemoteExperience: 5+ Years

Company info

InfraCloud delivers Kubernetes and infrastructure automation projects for clients in regulated industries. The sources do not name the specific customers or the full range of services beyond this.

More jobs at InfraCloud