Senior Spark QA Engineer
InfraCloudPune, Maharashtra, IndiaRemote
Needs a free Superjobs account. You'll finish on InfraCloud's site.
Skill score
Summary
The Senior Spark QA Engineer performs manual and automated functional, scalability, and performance testing of Spark jobs, Spark SQL, and ETL pipelines, and sets up Spark clusters across several platforms. The role suits an experienced QA engineer with hands-on Apache Spark and distributed systems knowledge who can also lead QA work and mentor others.
- Function
- Testing
- Estimated salary
- Est. ₹7–11 LPA
- Estimated for a senior role, ~5 yrs experience, India. Not published by the employer.
- Work mode and location
- Remote, Pune, Maharashtra, India
- Experience
- 5+ yrs
- Employment type
- Full-time
Job description
Overview
Job Description - We are looking for a Senior Spark QA Engineer with strong expertise in functional and performance testing of Apache Spark applications and distributed data platforms.
Roles and responsibilities
- Perform manual and automated testing of Spark jobs, Spark SQL queries, and ETL pipelines.
- Execute functional, scalability, and performance testing for Spark workloads.
- Set up and manage Spark clusters on Standalone, YARN, Kubernetes, Mesos, Databricks, EMR, and Dataproc.
- Conduct benchmarking, validation, and performance analysis of Spark applications.
- Identify bottlenecks and troubleshoot distributed system issues.
- Lead QA initiatives and mentor team members.
Skills required
Top skills
- Apache Spark
- Spark SQL
- ETL pipelines
- Functional testing
All skills (8)
- Performance testing
- Distributed systems
- Kubernetes
- Automation frameworks
- CI/CD pipelines
- Databricks
- Python
- Java
Qualifications
- 5+ years of QA/testing experience with strong hands-on expertise in Apache Spark.
- Experience in functional and performance testing of distributed systems.
- Strong understanding of Spark architecture and optimization techniques.
- Experience with Kubernetes and cloud-based Spark environments.
- Proficiency in Python or Java.
- Experience with automation frameworks and CI/CD pipelines.
Other details
Location: RemoteExperience: 5+ Years
Company info
About InfraCloud
InfraCloud delivers Kubernetes and infrastructure automation projects for clients in regulated industries. The sources do not name the specific customers or the full range of services beyond this.