Skip to content

Senior Machine Learning Engineer, Voice Agents - EMEA Remote

Hugging FaceNot specifiedRemote

Estimated salary, not published by the employer: Est. ₹16–24 LPA

Needs a free Superjobs account. You'll finish on Hugging Face's site.

Skill score

Summary

The senior engineer owns large parts of the open-source speech-to-speech library and builds hf-voice, a developer product for deploying realtime voice agents, covering architecture, the streaming API, GPU serving and production reliability. It suits an autonomous senior engineer with realtime systems and open-source Python experience who wants to work in public.

Function
Data Science
Estimated salary
Est. ₹16–24 LPA
Estimated for a senior role, ~6 yrs experience (typical for the level). Not published by the employer.
Work mode and location
Remote, Not specified
Employment type
Full-time

Job description

Overview

We are building the open voice-agent stack for Hugging Face, and we are looking for a senior engineer to own a large part of it.Two things sit at the centre of this role. The first is speech-to-speech, our open-source library for realtime voice agents. The second is hf-voice, a new product that will let any developer build and deploy voice agents with their Hugging Face account.

The library already powers the Reachy Mini fleet and there is a public demo running on Spaces, so you won't start from a blank page. But almost everything about how this becomes a product developers rely on is still open, and you will have a direct say in it.

Roles and responsibilities

- Own the Open-Source Library

  • Take architectural ownership of large parts of speech-to-speech: pipeline design, latency budget, and the reliability of the realtime loop.
  • Integrate new ASR, TTS and end-to-end speech models as they land, and keep the abstractions clean while the model landscape keeps moving.
  • Review community PRs, triage issues, cut releases, and grow the group of contributors around the project.

- Ship hf-voice

  • Design the developer API and the streaming protocol: session lifecycle, transport (WebSockets/WebRTC), authentication, error semantics, versioning.
  • Build the serving side: realtime inference on GPU, concurrency, autoscaling, observability, and cost per session.
  • Work with the Hub and inference teams so that a working voice agent is easy to integrate into products and demos.
  • Take the product from demo to production: load testing, SLOs, graceful degradation when a model or a network path misbehaves.

- Work in the Open

  • Write the docs, examples and templates that get a developer from zero to a running agent in minutes.
  • Support the deployments already relying on the stack, starting with the Reachy Mini fleet.
  • Talk about the work publicly if you enjoy it: blog posts, demos, conference talks. We cover the travel and the prep time.

Skills required

Top skills

  • Python
  • Async Python
  • Distributed systems
  • WebSockets

All skills (8)

  • WebRTC
  • Realtime streaming
  • LLMs in production
  • Open-source contribution
  • Voice-agent frameworks
  • GPU serving
  • Quantization
  • Audio pipelines (VAD, barge-in)

Qualifications

What we're looking for

  • Senior engineer, able to own a substantial part of an architecture and drive it forward autonomously.
  • Experience building developer-facing infrastructure at an AI or developer-tools company: inference APIs, agent infrastructure, or something comparable.
  • Substantial open-source contributions to a Python library. Comfortable with async Python and distributed systems, including their failure modes.
  • You have shipped something realtime: streaming, WebSockets or WebRTC, audio or video pipelines, live inference.
  • Practical experience with LLMs or multimodal models in production. Clear written communication and a habit of collaborating async and in public.
  • Motivated by voice and conversational AI.

Nice to have

  • Contributions to a voice-agent framework such as speech-to-speech, pipecat, LiveKit Agents, Vocode or TEN.
  • Contributions to llama.cpp or another low-level inference runtime.
  • Hands-on work with ASR, TTS or end-to-end speech models, including evaluation of latency and quality trade-offs.
  • GPU serving, quantization, or on-device inference experience.
  • Audio pipeline knowledge: VAD, echo cancellation, jitter buffers, barge-in and turn detection.
  • Experience shipping to embedded or robotics targets.
  • A public track record: talks, blog posts, demos.

Other details

If you're interested in joining us, but don't tick every box above, we still encourage you to apply! We're building a diverse team whose skills, experiences, and backgrounds complement one another. We're happy to consider where you might be able to make the biggest impact.

Hiring process

At Hugging Face we believe great AI shouldn't require a massive cluster, we build for everyone, especially the GPU-poor. And because we read every application, here's a small sign that you read this one too: start your answer to the first application question with the words “GPU-poor and proud 🤗”. No trick, no catch, it just tells us a real person is on the other side.

Benefits

We value development. You will work with some of the smartest people in our industry. We are an organization that has a bias for impact and is always challenging ourselves to continuously grow. We provide all employees with reimbursement for relevant conferences, training, and education.

We care about your well-being. We offer flexible working hours and remote options. We offer health, dental, and vision benefits for employees and their dependents. We also offer parental leave and flexible paid time off.

We support our employees wherever they are. While we have office spaces in NYC and Paris, we're very distributed and all remote employees have the opportunity to visit our offices. If needed, we'll also outfit your workstation to ensure you succeed.

Compensation

We want our teammates to be shareholders. All employees have company equity as part of their compensation package. If we succeed in becoming a category-defining platform in machine learning and artificial intelligence, everyone enjoys the upside.

We support the community. We believe major scientific advancements are the result of collaboration across the field. Join a community supporting the ML/AI community.

Company info

We are building the fastest growing platform for AI builders with over 11 million users who collectively shared over 4 million models, 1 million datasets & 1.5 million Gradio apps. Our open-source libraries have more than 700,000 stars on Github.

More jobs at Hugging Face