QA Engineer, AI Verification Systems
Pramaana LabsBengaluruOn-Site
Needs a free Superjobs account. You'll finish on Pramaana Labs's Ashby page.
Skill score
Summary
The QA/SDET engineer tests every stage of Pramaana's rules-to-proof pipeline, from rule input through formal specs, prover output and proof artifacts to customer-facing APIs and proof viewers. The role suits someone with test automation experience and logical rigor who can turn dense rule text into precise test cases and clear bug reports.
- Function
- Testing
- Estimated salary
- Est. ₹5–7 LPA
- Estimated for a mid-level role, ~3 yrs experience, India. Not published by the employer.
- Work mode and location
- On-Site, Bengaluru
- Experience
- 3+ yrs
- Employment type
- Full-time
Job description
Overview
QA/SDET (Software Development Engineer in Test) for a rules-to-proof product. You test every stage of the pipeline, from rule input through formal specs, prover output and proof artifacts to the customer-facing APIs and proof viewers. You raise clear, reproducible defects and verify fixes.
Roles and responsibilities
Focus areas: Corner cases and security risks, including exceptions, thresholds, conflicting rules, unsatisfiable inputs, malformed or malicious input, and access and data-handling issues.
Long-term goal: Automate these tests so problems are flagged without manual intervention.
What You'll Do
- Test the different parts of the product for functionality, from rule input through formal specs, prover output and proof artifacts to the customer-facing APIs and proof viewers. Raise clear, reproducible defects and verify fixes.
- Cover corner cases and potential security issues, including exceptions, thresholds, conflicting rules, unsatisfiable inputs, malformed or malicious input, and access and data-handling risks.
- As time goes on, work on automating these tests so that these are flagged without manual intervention.
Skills required
Top skills
- QA testing
- SDET
- Test automation
- Python
All skills (12)
- Non-deterministic systems testing
- LLM testing
- ML pipelines
- Rules engines
- pytest
- CI/CD
- GitHub Actions
- Jenkins
- LLM evaluation
- Benchmark design
- Property-based testing
- API testing
Qualifications
- 3+ years in QA, SDET or ML/LLM evaluation, hands-on test automation experience (Python preferred)
- Experience testing non-deterministic or data-heavy systems (LLMs, ML pipelines, rules engines).
- Automation and CI/CD experience (pytest or similar, GitHub Actions or Jenkins).
- Logical rigor: edge cases, constraints, counterexamples.
- Ability to turn dense rule-based text into precise test cases, and to write clear bug reports.
Nice to have
- LLM eval and benchmark design.
- Tax, law or compliance background.
- Property-based testing and API testing.
Company info
About Pramaana Labs
Pramaana Labs is a frontier AI lab building the verification layer for AI. Founded in 2025 and headquartered in Palo Alto, we turn complex human knowledge, including tax codes, legal rules, clinical guidelines and security protocols, into a formal representation, so every AI answer can be traced, challenged, and proved.