The Opportunity
Do you want to build and deploy cutting-edge AI technology to help people get unparalleled value from meetings and conversations? Join our core AI team responsible for ML and work alongside industry-veteran scientists and engineers. As a Machine Learning Engineer, you’ll play a critical role in scaling and optimizing our ML systems—transforming innovative research into production-ready features that power Otter’s summarization and conversational intelligence products.
Your Impact
- Build, optimize, and deploy robust SID/ASR/NLP/LLM pipelines powering summarization, chat, and other core product experiences.
- Implement and scale training, fine-tuning, and inference for large language models (LLMs) using PyTorch or JAX.
- Collaborate with research scientists to operationalize experimental models and bring cutting-edge ideas into production.
- Own the reliability, latency, and scalability of AI-based systems and ensure they meet production standards.
- Contribute to model monitoring, evaluation, and continuous improvement efforts using real-world conversational data.
- Develop tools, infrastructure and data pipeline for automated training, evaluation, and deployment of ML models in a cloud environment.
We're looking for someone who
- Bachelors or Masters degree + 3 years of relevant industry experience or Ph.D. degree in computer science
- Has hands-on experience building, deploying, and maintaining ML systems at scale, particularly using transformer-based models like LLaMA2, GPT, or similar.
- Experience with deep learning frameworks such as PyTorch or JAX, and familiar with model training, fine-tuning, and inference optimization.
- Understands distributed systems, cloud infrastructure (e.g., AWS, GCP), and ML model serving technologies.
- Experience with implementation of algorithms and infrastructures using programming languages such as Python, C++
- Comfort working in a Linux environment.
- Brings a strong software engineering mindset to machine learning development—emphasizing testing, performance, and maintainability.
About Otter.ai
We are in the business of shaping the future of work. Our mission is to make conversations more valuable.
With over 1B meetings transcribed, Otter.ai is the world’s leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.
Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are dedicated to inclusivity.
Salary range
Salary Range: $155,000 to $185,000 USD per year.
This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package.
