Senior Applied Scientist, Fauna
Posted 29 days ago
Job Description
We are seeking an Applied Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. In this role, you will focus on designing how we measure, stress-test, and improve robot behavior across a wide range of real-world tasks. Your work will play a critical role in shaping how policies are validated and how high-quality datasets are generated to accelerate system performance.
You will operate at the intersection of robotics, machine learning, and human-in-the-loop systems, building the infrastructure and methodologies that connect teleoperation, evaluation, and learning. This includes developing evaluation policies, defining task structures, and contributing to operator-facing interfaces that enable scalable and reliable data collection.
The ideal candidate is highly experimental, systems-oriented, and comfortable working across software, robotics, and data pipelines, with a strong focus on turning ambiguous capability goals into measurable and actionable evaluation systems.
Key job responsibilities
- Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios
- Develop task definitions, success criteria, and benchmarking methodologies that enable consistent and reproducible evaluation of policies
- Create and refine data collection protocols that generate high-quality, task-relevant datasets aligned with model development needs
- Build and iterate on teleoperation workflows and operator interfaces to support efficient, reliable, and scalable data collection
- Analyze evaluation results and collected data to identify performance gaps, failure modes, and opportunities for targeted data collection
- Collaborate with engineering teams to integrate evaluation tooling, logging systems, and data pipelines into the broader robotics stack
- Stay current with advances in robotics, evaluation methodologies, and human-in-the-loop learning to continuously improve internal approaches
- Lead technical projects from conception through production deployment
- Mentor junior scientists and engineers
You will operate at the intersection of robotics, machine learning, and human-in-the-loop systems, building the infrastructure and methodologies that connect teleoperation, evaluation, and learning. This includes developing evaluation policies, defining task structures, and contributing to operator-facing interfaces that enable scalable and reliable data collection.
The ideal candidate is highly experimental, systems-oriented, and comfortable working across software, robotics, and data pipelines, with a strong focus on turning ambiguous capability goals into measurable and actionable evaluation systems.
Key job responsibilities
- Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios
- Develop task definitions, success criteria, and benchmarking methodologies that enable consistent and reproducible evaluation of policies
- Create and refine data collection protocols that generate high-quality, task-relevant datasets aligned with model development needs
- Build and iterate on teleoperation workflows and operator interfaces to support efficient, reliable, and scalable data collection
- Analyze evaluation results and collected data to identify performance gaps, failure modes, and opportunities for targeted data collection
- Collaborate with engineering teams to integrate evaluation tooling, logging systems, and data pipelines into the broader robotics stack
- Stay current with advances in robotics, evaluation methodologies, and human-in-the-loop learning to continuously improve internal approaches
- Lead technical projects from conception through production deployment
- Mentor junior scientists and engineers
Amazon
174 jobs posted
About the job
Posted on
Apr 13, 2026
Apply before
May 13, 2026
Job typeFull-time
Location
US, NY
Similar Jobs
25d
Senior Applied Scientist
Amazon
US, CASenior Applied Scientist
Amazon
US, CA25d15d
Senior Applied Scientist
Crunchyroll
$185K - $230KSan Francisco, CALos Angeles, California, United StatesSenior Applied Scientist
Crunchyroll
$185K - $230KSan Francisco, CALos Angeles, California, United States15d11d
Senior Applied Scientist
Amazon
US, WASenior Applied Scientist
Amazon
US, WA11d12d
Applied Scientist
Adobe
$121K - $239KSan Jose, CAApplied Scientist
Adobe
$121K - $239KSan Jose, CA12d1d
Senior Applied Scientist, Credit Risk
Ramp
$166K - $228KNew York, NYSenior Applied Scientist, Credit Risk
Ramp
$166K - $228KNew York, NY1d4d
Applied Scientist - Perception (SLAM/VIO), Fauna
Amazon
US, NYApplied Scientist - Perception (SLAM/VIO), Fauna
Amazon
US, NY4d26d
Principal Applied Scientist
Amazon
US, WAPrincipal Applied Scientist
Amazon
US, WA26d23d
Applied Scientist, Controls
Amazon
US, MAApplied Scientist, Controls
Amazon
US, MA23d15d
Lead Applied Scientist
Salesforce
$173K - $260KCalifornia - Palo AltoLead Applied Scientist
Salesforce
$173K - $260KCalifornia - Palo Alto15d15d
Applied Scientist II
Amazon
US, MAApplied Scientist II
Amazon
US, MA15d
AI jobs in your inbox
Get the latest AI jobs delivered to your inbox every week. Free, no spam.