Skip to content

Research Intern - AI Evaluations

KaryaBengaluruOn-Site

Estimated salary, not published by the employer: Est. ₹1.5–2.5 LPA

Needs a free Superjobs account. You'll finish on Karya's Greenhouse page.

Skill score

Summary

The research intern applies social science research methods to evaluate language technologies built for Indian communities, and studies how these systems affect rural and low-resource users. It suits social science students or researchers who are curious about AI and want to bring their disciplinary training into a technical team.

Estimated salary
Est. ₹1.5–2.5 LPA
Estimated for an internship, India. Not published by the employer.
Work mode and location
On-Site, Bengaluru
Employment type
Internship

Job description

Overview

At Karya, we're building AI evaluation systems that measure and understand whether these systems actually work for the communities they're meant to serve. We're looking for a research intern who can bring a social science lens into this work, specifically around evaluating language technologies (speech, text, and translation systems) built for and with Indian communities.

About the team

You'll be embedded with the Evaluations team within Karya's tech team, which means you'll get a front-row seat to the full arc of AI work happening in India today from how models are built, to how they're tested, to how they land in the hands of rural and economically underprivileged communities. You'll be expected to stay current on AI evaluation science itself, and use your disciplinary training to ask sharper questions about what these systems are actually doing, and to whom.

This role is well suited to someone who's curious about tech and wants to put their social science training into practice. You'll be working alongside engineers, bringing a rigorous footing and a social science researcher's lens into a technical space. If you're a social science student or researcher who's been eyeing the AI/tech space and wondering how to get in, this is that entry point. You'll work on live evaluation pipelines, with communities across India, on low- and high-resource language technologies, alongside a team that treats social science expertise as core to the work.

Roles and responsibilities

  • Applying social science research methods (qualitative and/or quantitative) to the evaluation of AI/ML systems, particularly language technologies
  • Contribute to developing AI evaluation and testing methodologies
  • Investigating how these technologies interact with and affect the communities they're deployed among, especially in rural and low-resource contexts in India
  • Working closely with the Evaluations team to understand both the "build" and "evaluate" sides of AI systems

Skills required

Top skills

  • Written and verbal communication
  • Field research
  • Socio-technical systems
  • Language technologies

All skills (8)

  • Social science research methods
  • AI/ML conceptual understanding
  • AI evaluation methodologies
  • Focus group discussions
  • Qualitative research
  • Quantitative research
  • Indian language proficiency
  • Computational social science

Qualifications

Education

  • Currently pursuing or recently completed an undergraduate or master's degree in a social science discipline (Sociology, Anthropology, Development Studies, Gender Studies, Political Science, Economics, or Science and Technology Studies (STS)
  • No technical degree required, but demonstrated interest in and conceptual understanding of AI/ML systems is expected. E.g., through self-directed learning, coursework, or prior projects at the intersection of technology and society

Skills and Competencies

  • Strong grounding in social science research methods qualitative, quantitative, or mixed (not a hard requirement, but research training expected)
  • Comfort conducting or supporting focus group discussions (FGDs) and field visits
  • Conceptual understanding of AI/ML systems - applied AI/ML literacy - enough to engage meaningfully with concepts like model evaluation, human-in-the-loop systems, and language technologies (you don't need to code, but you should be comfortable with how these systems are built and tested)
  • Familiarity with socio-technical systems thinking (i.e., understanding technology and society as mutually shaping, not separate concerns)

Nice to have

  • Multilingual proficiency in Indian languages is a strong plus
  • Background in computational social science is a plus, not a requirement
  • Strong written and verbal communication skills
  • Comfort working in ambiguous, early-stage research settings

Other details

People matter at Karya and these are some of the perks and benefits we created for our team:

  • Flexible vacation and leave policy
  • Flexible work options
  • Insurance as per industry standards
  • Access to industry stalwarts and networking opportunities

Company info

Karya’s mission is to leverage the AI revolution to create dignified earning and learning opportunities for low-income communities across the world. In India, our smartphone-based digital work platform has enabled over 120,000 people to build language datasets and evaluate AI models while earning fair wages. With pilots in Kenya and

More jobs at Karya