Staff Quality Engineer ( Python , AI )
Arctic WolfBengaluru, INDOn-Site
Needs a free Superjobs account. You'll finish on Arctic Wolf's site.
Skill score
Summary
The Staff Quality Engineer builds and extends automated test frameworks, CI/CD pipelines, and evaluation pipelines for GenAI and AI/ML applications within a large-scale security operations platform. The role suits a senior quality engineer with 8+ years of experience who enjoys distributed systems, cloud testing, and driving high software quality.
- Function
- Development
- Estimated salary
- Est. ₹18–28 LPA
- Estimated for a staff-level role, ~8 yrs experience, India. Not published by the employer.
- Work mode and location
- On-Site, Bengaluru, IND
- Experience
- 8+ yrs
- Employment type
- Full-time
Job description
Overview
About the Role
The Arctic Wolf security operations platform ingests and processes upwards of 600 billion events a day from a wide variety of on-premise devices and cloud platforms. The security pipeline is a distributed system of loosely-coupled microservices that constitute our Realtime analysis and threat detection systems. These services distil the incoming events into actionable intelligence that our Concierge Security Teams use to protect customers.
We are looking for experienced quality engineers to join our pack and work with us to build and expand the capabilities of our testing platform.
Roles and responsibilities
Create and extend software frameworks and tools to run, monitor, and report on automated tests. Have experience building and maintaining Automation frameworks and CI/CD pipeline.
Review testing strategies, approaches, and test plans and provide insight to development teams.
Architect, design and build software to automate a variety of testing methods (e.g. API validation, performance/load testing, fuzzing, etc.)
Develop and maintain test frameworks for GenAI-based and AI/ML applications, including model validation, LLM prompt-response consistency, hallucination detection, and regression testing for AI inference APIs.
Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability.
Work as part of a team of highly skilled software professionals.
Continuously learn and expand your technical horizons
Skills required
Top skills
- Python
- Test automation frameworks
- CI/CD pipelines
- Cloud platforms
All skills (9)
- Functional, load and fuzz testing
- Selenium
- Playwright
- Docker
- Kubernetes
- AWS
- LangChain
- LLM evaluation frameworks
- Distributed systems and microservices
Qualifications
Our Technology Stack: Python , Selenium, Playwright, Docker, Kubernetes, AWS (Bedrock, Lambda, SQS, S3, etc.), LangChain, LLM evaluation frameworks (e.g., Ragas), OpenAPI, Postgres, Linux.
You
Are excited to work at the intersection of AIML, Big Data and the Cybersecurity problem space
Have 8+ years of experience shipping quality software
Love driving high software quality
Have experience deploying services on cloud computing platforms (e.g, AWS, Azure, GCP)
Are an expert using common tools for executing functional, load and fuzz testing (e.g. Locust, CATS)
Nice to have
Have worked on distributed systems and microservices architecture (preferred)
Company info
About Arctic Wolf
At Arctic Wolf, we’re on a mission to end cyber risk. We are a global leader in security operations, helping organizations stay resilient against evolving cyber threats through industry-leading security operations, threat intelligence, and a people-first approach to cybersecurity. More than 3,000 Pack members across the world work together every