Skip to content

MTS - Research (Cybersecurity)

Collinear AISunnyvale, California, San Francisco, CA, Bengaluru, IndiaRemote

Estimated salary, not published by the employer: Est. ₹5.5–8.5 LPA

Needs a free Superjobs account. You'll finish on Collinear AI's Ashby page.

Skill score

Summary

This role builds cybersecurity environments, tasks, reference solutions, and verifiers that test whether frontier AI agents can find, fix, and investigate security problems. It suits engineers with hands-on security depth, strong Python and systems-language skills, and an interest in evaluating AI agents, and AI experience is not required.

Estimated salary
Est. ₹5.5–8.5 LPA
Estimated for a mid-level role, ~3 yrs experience (typical for the level), India. Not published by the employer.
Work mode and location
Remote, Sunnyvale, California, San Francisco, CA, Bengaluru, India
Employment type
Full-time

Job description

Overview

You will own work from the initial security scenario through the runnable environment, task instructions, reference solution, and verifier. We are looking for hands-on security knowledge, strong programming skills, and curiosity about how AI agents fail.

Roles and responsibilities

  • Build cybersecurity environments. Create isolated, reproducible environments with real repositories, applications, services, logs, and access controls. Make them straightforward to launch, reset, and evaluate at scale.
  • Turn security work into tasks. Design scenarios around vulnerability discovery and remediation, application and API security, authentication and authorization, incident investigation, and system hardening. Define what the agent knows, which tools it can use, and what it must accomplish.
  • Develop reference solutions and verifiers. Reproduce the underlying issue, implement a valid solution, and write checks that distinguish a real fix from a superficial workaround. Verify that attacks fail after remediation while legitimate behavior continues to work.
  • Test the tests. Challenge graders with incomplete fixes, disabled features, hard-coded answers, and other shortcuts. Keep hidden solutions and test data out of the agent's environment, and separate genuine model failures from broken infrastructure.
  • Run and analyze agents. Evaluate frontier models, inspect their tool calls and code changes, and explain where their security reasoning or execution breaks down. Use those findings to improve task coverage and difficulty.
  • Contribute to benchmarks and research. Work with researchers and engineers to turn strong environments into evaluation suites and training data. Review other contributors' tasks and help document results for future releases.

Skills required

Top skills

  • Cybersecurity
  • Vulnerability research
  • Application security
  • Python

All skills (11)

  • C/C++, Go, Java, JavaScript/TypeScript, or Rust
  • Linux
  • Git
  • Containers
  • Automated testing
  • Technical writing
  • Fuzzing
  • Static analysis
  • Dynamic analysis
  • Reverse engineering
  • CWE and OWASP

Qualifications

Deep cybersecurity expertise is enough to get started—you do not need prior AI or machine-learning experience. If you know how to investigate vulnerabilities, reason about security failures, and verify that a fix works, we want to hear from you. We will teach you our AI tooling and evaluation workflows.

  • Practical depth in at least one area of cybersecurity, such as application security, vulnerability research, penetration testing, systems security, cloud security, or incident response. Evidence can come from internships, research, open-source work, bug bounties, CTFs, or independent projects.
  • The ability to read unfamiliar code, reproduce a security issue, understand its root cause, and implement or assess a fix.
  • Strong programming skills in Python and at least one language used in the systems you investigate, such as C/C++, Go, Java, JavaScript/TypeScript, or Rust.
  • Comfort with Linux, Git, containers, debugging, and automated testing.
  • Clear technical writing and careful judgment about what an evaluation does and does not demonstrate. You can explain why a task is realistic and why its grading is trustworthy.
  • Curiosity about applying your cybersecurity expertise to AI, and a willingness to learn how to evaluate tool-using agents. Prior experience with LLMs is not expected.

Nice to have

  • Disclosed vulnerabilities, accepted security patches, strong CTF results, or useful security tools and write-ups.
  • Experience with fuzzing, static or dynamic analysis, reverse engineering, or building security labs.
  • Familiarity with CWE and OWASP classifications and how they relate to concrete software failures.
  • Experience building agent evaluations, adversarial tests, prompt-injection defenses, or reinforcement-learning environments.

Other details

Recent graduates and early-career engineers or researchers are encouraged to apply. A PhD, professional certification, or previous role at an AI lab is not required. We value demonstrated ability and the quality of your work.

  • A repository audit where an agent must discover and repair an authorization flaw without being told where it is.
  • A small service environment where an agent investigates suspicious activity from logs and configuration, then applies and verifies a remediation.
  • An LLM application where an agent must repair a prompt-injection or tool-permission weakness while preserving legitimate functionality.

Hiring process

*When applying, include a project, code sample, security write-up, or research artifact that shows how you investigate a problem and establish that your solution works.

Company info

Collinear AI builds realistic RL environments, verifiers, and training data used by frontier AI labs to improve their models on hard tasks. Its work serves AI teams that need trustworthy feedback and high-quality data for model training.

More jobs at Collinear AI