Senior Manager, Generative AI Test Engineering

665 Clyde Avenue, Mountain View, CA, USA

Full-time

Job Description

Lab Summary:

We focus on developing speech recognition, advanced speech personalization, and state-of-the-art natural language understanding technology. We are dedicated to creating an advanced AI platform that handles seamless conversations across a variety of devices, as well as democratizing AI by allowing developers and IoT manufacturers to add new capabilities to Bixby.

Position Summary:

We’re seeking a Senior Manager for our Generative AI Test Engineering team–which will join our Quality Insights team. You will be responsible for managing a small team and for designing and implementing testing strategies and frameworks to evaluate the performance, accuracy, robustness, and safety of AI models and systems. You will collaborate closely with research teams to understand new model capabilities and translate them into robust testing plans and scenario. You will drive development and maintenance of automated testing frameworks and tools for efficient AI validation and system-level testing.

Position Responsibilities:

Lead of small team of Data Scientists and QA Engineers
Act as a player/coach and utilize test results data to guide product development, identify opportunities, predict challenges, and inform strategic decisions
Measure product success through metrics, identifying areas for improvement, and effectively communicating insights to stakeholders
Work closely with other functions, such as engineering, product, design, and others

Required Skills:

Bachelor’s degree in Computer Science, Computer Engineering, or equivalent combination of education, training, and experience
12+ years of professional software development testing experience, including test automation frameworks and tools building
2+ years of people management experience
Experience with LLMOps, model monitoring, or ML observability platforms
Proficiency in Python, SQL, and data visualization tools for model analytics
Strong knowledge of QA methodologies, test automation, and CI/CD integration
Experience as a mentor, tech lead or leading an engineering team

Special Attributes:

Hands-on experience with LangChain, OpenAI API, Hugging Face models, or RAG pipelines
Knowledge of cloud platforms (AWS/GCP/Azure) for data workflows and ML deployment
Familiarity with human-in-the-loop QA or AI-assisted testing workflows

Our total rewards programs are designed to motivate and engage exceptional talent. The base pay range for roles at this level is listed below, but may be higher or lower in other states due to geographic differentials in the labor market. Within the base pay range, individual rates depend on a number of factors—including the role’s function and location as well as the individual’s knowledge, skills, experience, education and training. This is part of our comprehensive compensation package with annual bonus eligibility and generous benefits to help you live life well.

Base Pay Range

$197,800—$296,600 USD

Additional Information

Disclosure of Trade Secrets

Samsung has a strict policy on trade secrets. In applying to Samsung and progressing through the recruitment process, you must not disclose any trade secrets of a current or previous employer.

Essential Job Functions

This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, and frequently operate standard office equipment, such as telephones and computers.

Samsung Research America is committed to complying with all Federal, State and local laws related to the employment of qualified individuals with disabilities. If you are an individual with a disability and would like to request a reasonable accommodation as part of the employment selection process, please contact the recruiter or email sratalent@samsung.com.

Equal Employment Opportunity

At Samsung, we believe that innovation and growth are driven by an inclusive culture and a diverse workforce. We aim to create a global team where everyone belongs and has equal opportunities, inspiring our talent to be their true selves. Together, we are building a better tomorrow for our customers, partners, and communities.

Samsung Research America is committed to employing a diverse workforce, and provide Equal Employment Opportunity for all individuals regardless of race, color, religion, gender, age, national origin, marital status, sexual orientation, gender identity, status as a protected veteran, genetic information, status as a qualified individual with a disability, or any other characteristic protected by law.

For more information regarding protection from discrimination under Federal law for applicants and employees, please refer to this link: Pay Transparency

Please mention that you found this job on MoAIJobs, this helps us grow. Thank you!