Senior Engineering Manager, Experiments
DuolingoNew York, NY; Pittsburgh, PAOn-Site
Needs a free Superjobs account. You'll finish on Duolingo's site.
Skill score
Summary
The Senior Engineering Manager leads and grows the Experiments Team, overseeing Duolingo's in-house A/B testing platform and expanding its capabilities, scale, and statistical methods. This role suits an experienced engineering manager who can build teams and partner closely with product and platform groups.
- Function
- Development
- Estimated salary
- Est. $176k–264k/yr
- Estimated for a manager role, ~7 yrs experience (typical for the level), United States. Not published by the employer.
- Work mode and location
- On-Site, New York, NY; Pittsburgh, PA
Job description
Overview
As the manager and team lead of the Experiments Team, you will oversee the A/B testing system that powers Duolingo's product development lifecycle. Experiments play an essential role at Duolingo, with almost all product changes going through some form of test. You will manage our in-house Experiment Platform that is responsible for defining experiments, executing them in the app, and measuring their outcome. While the role is platform-focused, you will remain highly connected to the product in all parts of Duolingo, shaping how we use A/B testing to build the best possible experience for our learners.
Roles and responsibilities
- Expand the capabilities on our Experiment Platform to support more sophisticated types of A/B tests and statistical methods.
- Empower teams to confidently evaluate their key metrics and easily gate access to new functionality.
- Help shape the future of the accelerated feature shipping at Duolingo by enabling improved experiment automation and backend-based control of the learner experience.
- Scale the Experiment Platform to be able to handle dramatically increased experiment velocity in a statistically sound and cost-efficient manner.
- Partner with product teams to devise unique approaches to measuring complex product scenarios and to advise on experiment strategy.
- Shape the future of the Duolingo product lifecycle through A/B testing.
Skills required
Top skills
- Engineering team management
- A/B testing
- Scalable infrastructure
- Large datasets
All skills (5)
- Cross-functional leadership
- High-speed product development
- Experiment platform
- Hypothesis testing statistics
- Experiment automation
Qualifications
- Experience leading, managing, and building a team of software engineers, with demonstrated ability to hire, develop, and retain talent.
- A track record of building scalable infrastructure and working with large datasets.
- Experience with A/B testing, either via supporting experiment infrastructure or using A/B tests in product development.
- Strong cross‑functional leadership and communication skills, especially between product and platform teams.
- The ability to work from or relocate to Pittsburgh, PA or New York, NY.
Nice to have
- Prior experience building an experimentation platform or A/B testing-related tooling.
- Experience operating in a high-speed product development environment.
- Comfort with the statistical methods behind hypothesis testing.
Other details
The offered salary is dependent upon several factors, including work experience, skills, and internal peer comparisons. The posted range is subject to change in the future. For this role, base salary is supplemented by equity compensation. We encourage you to talk with your recruiter for more information related to compensation for this role!
Salary Range
$204,000—$306,000 USD
Benefits
Benefits: Take a peek at how we care for our employees' holistic well-being with our benefits here.
Job Alerts: Sign up for job alerts here.
Company info
About Duolingo
Duolingo offers a free language-learning app that teaches languages through game-like lessons. Its half a billion learners around the world use the app to study languages.