Technical Program Manager at Mistral AI managing human data annotation operations for model development. Oversee contractor teams, data collection campaigns, and quality metrics across eval and training datasets.
By applying, you agree to our Applicant Privacy Policy.
We’re seeking an exceptional technical program manager to push the boundaries of our model capabilities across priority verticals. You will be responsible for building the human data operation for model development, from eval to training, and for closing the gap between the complexity of the real world use cases and our model capabilities.
Partner closely with science / product teams to build datasets that accelerate progress on important model capabilities, skills, and behaviors
Manage highly functional contractor teams and vendor relationships to support both agile and scaled data collection campaigns with subject matter experts - spanning phases from sourcing / contracts, onboarding, training, and performance monitoring
Oversee and track the progress of collection campaigns, building dashboards for throughput, budget, and quality
Collaborate closely and own communications with cross-functional teams to ensure that risks are anticipated and addressed, data needs are met, and that tooling is in place to enable efficient annotation and data delivery/ingestion
Experience: Minimum of 3 years' experience in managing technical programs in a research or data related field
Operations: Strong understanding of contractor / vendor management and data collection operations
Analytics: Proficiency in Python (SQL appreciated too)
Other skills: Excellent project management skills, with the ability to manage multiple projects simultaneously. Great communication and stakeholder management skills are also essential.
Personal attributes: Highly organized, detail-oriented, and able to work well under pressure. A proactive problem-solver with a continuous improvement mindset