Senior Applied Research Scientist - Foundation Models
Ambient.aiRedwood City Remote
Needs a free Superjobs account. You'll finish on Ambient.ai's Ashby page.
Skill score
Summary
The Senior Applied Research Scientist builds and optimizes multimodal vision-language foundation models for physical security, covering pre-training, fine-tuning, compression for edge deployment, and integration with engineering and product teams. This suits a hands-on ML researcher with a PhD or strong Master's background, deep learning experience, and comfort with startup pace and ambiguity.
- Function
- Development
- Estimated salary
- Est. $163k–245k/yr
- Estimated for a senior role, ~6 yrs experience (typical for the level), United States. Not published by the employer.
- Work mode and location
- Remote, Redwood City
- Employment type
- Full-time
Job description
Overview
About the role
Ambient.ai is hiring a Senior Applied Research Scientist to build the next generation of foundation models for computer vision. You will join a team responsible for building multimodal models with state-of-the-art performance on real-world vision benchmarks. In this role, you’ll own full-cycle model development: from pre-training and fine-tuning on image-language data to applying distillation and compression techniques for deployment. This is a hands-on, cross-functional role where your work will directly impact our mission of preventing every security incident possible.
Roles and responsibilities
- Develop & Optimize VLMs: Design and optimize transformer-based vision-language models to understand images, videos, and text, and optimize for real-time inference.
- Pre-training & Fine-tuning: Own the full training pipeline—from pre-training on image-text data to fine-tuning for Ambient.ai’s physical security domain and use cases.
- Model Compression & Optimization: Apply techniques like distillation, quantization, and pruning to reduce model size and latency, enabling efficient edge deployment.
- Leverage Open-Source & Innovate: Use and extend state-of-the-art open-source models. Prototype new architectures and training methods to advance Ambient.ai’s multimodal AI research.
- Cross-Team Collaboration: Work with engineering and product teams to integrate models into the platform. Iterate based on real-world feedback and deployment data to improve performance.
- Research and Experimentation: Stay current with vision, NLP, and multimodal AI research. Design experiments to test new algorithms and continually enhance our core AI systems.
Skills required
Top skills
- Python
- C++
- PyTorch
- Quantization
All skills (8)
- Large-scale training pipelines
- Vision-language models
- Transformers
- Vision Transformers (ViT)
- CNNs
- Model distillation
- TensorFlow
- Foundation models
Qualifications
- Ph.D. or Master’s in CS, EE, or related field, with a strong foundation in AI/ML (Ph.D. preferred or Master’s with strong experience)
- Proficient in Python/C++ and deep learning frameworks like PyTorch or TensorFlow. Comfortable with large-scale training pipelines
- Hands-on experience with CNNs, Transformers, and Vision Transformers (ViT). Strong understanding of vision-language models and how to fine-tune or adapt them
- Proven skills in model training and optimization, including fine-tuning on large datasets and applying distillation, quantization, or similar techniques. Experience with foundation or multimodal models is a plus.
- Strong problem-solving ability: quick prototyping, diagnosing failure cases, and iterating on solutions
- Startup experience preferred: Comfortable with ambiguity, fast iteration, and owning projects end-to-end
Other details
- Regular Full-time employees receive stock options for the opportunity to share ownership in the success of our company
- Comprehensive health + welfare package (Medical, Dental, Vision, Life, EAP, Legal Services, 401k plan)
- We offer flexible time off to rest and recharge, including Winter Break (time off between Christmas and New Year’s for most roles, depending on customer demand)
- You’ll receive everything you need to hit the ground running, including cutting-edge equipment and branded gear
We’ve found that in-person time meaningfully supports collaboration, creativity, and team alignment. Our talent, engineering, product, design, and marketing teams work from our Redwood City office three days a week. All other Bay Area employees join on Fridays to stay connected and close out the week together.
Company info
About Ambient.ai
Ambient.ai is the category creator and leader in Agentic Physical Security. Powered by Ambient Pulsar, the first reasoning Vision-Language Model purpose-built for physical security, our platform seamlessly integrates with existing security cameras and physical access control systems to unify monitoring, access control, threat assessment, response, and investigations through an always-on