Technical Program Manager, Human Data Annotation (Code) - Paris/London

Full-time

Job Description

About Mistral

At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life.

We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise needs, whether on-premises or in cloud environments. Our offerings include le Chat, the AI assistant for life and work.

We are a dynamic, collaborative team passionate about AI and its potential to transform society.

Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited.

Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact. See more about our culture on https://mistral.ai/careers.

Role Summary

We are seeking a highly skilled and motivated Technical Program Manager to join our Science team, with a focus on human data annotations for our coding research team. The role is pivotal in accelerating research at Mistral AI and would be responsible for building and driving human data annotation programs and processes. You would be a critical link between our research, product, engineering, and annotation teams.

What you will do

• Collaborate closely with the coding research team to define campaign requirements, including task guidelines, timeline, budget, and success metrics

• Establish and maintain strong relationships with vendors and contractor teams to generate high quality data, spanning phases across sourcing, contracts, onboarding / training, performance monitoring, etc.

• Run end-to-end annotation campaigns, from scoping, training and calibration, to tracking progress to completion

• Develop and drive both manual and automated data quality audits and product evaluations, producing synthesized feedback and recommendations for key stakeholders, with a strong focus on coding use cases

About you

• 5+ years of relevant experience, including technical program management and software engineering

• Proficient in Python and/or Typescript and at least one related web framework (FastAPI, Django, React...)

• Excellent project management skills, with the ability to manage multiple projects simultaneously

• Experience with operations around data collection, annotation, and/or quality assurance

• Great communication and stakeholder management skills are also essential

• Highly organized, detail-oriented, and able to work well under pressure

• An autonomous and proactive problem-solver with a continuous improvement mindset

• Low ego and team spirit mindset

• Embraces hands-on, operational work

Nice to have:

• Experience with vendor and/or contractor management