Job Description
Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:
ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.
Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.
Role Purpose
Owns client-specific quality programs, performance metrics, and escalations while leading team development and cross-functional coordination. Shared accountability for client outcomes and team performance with the Ops Manager
Key Responsibilities
· Set client QA strategies (sampling design, audit methods, acceptance thresholds) and adapt to scope/volume changes.
· Run root-cause analyses; drive CAPA plans with owners, timelines, and effectiveness checks.
· Plan training & certification for raters/annotators and coordinators; track completion and impact.
· Maintain dashboards (throughput, accuracy, productivity, cost) and convert insights into actions.
· Manage client escalations; present options, trade-offs, and recovery paths.
· Standardize SOPs, templates, and checklists; remove bottlenecks.
· Pilot small automations (macros, templates, RPA/API handoffs) with Ops Tech; scale wins.
· Coach P1s and C2–C3 on tools, workflows, and QA craft.
· Ensure compliance/security across data handling and platform access.
Requirements
Education
· Bachelor’s degree or equivalent experience in Business, Operations, Quality, or Data/Engineering.
Experience
· 2+ years in quality/ops with hands-on QA and workforce/training coordination.
· 1+ years leading people/pods (formal or informal).
Skills
· Multi-project planning and stakeholder management.
· Clear client communications and governance cadence participation.
· Strong spreadsheets, PM/task boards, and basic BI; ETL familiarity is a plus.
· Capacity planning with vendors; confident escalation/negotiation.
· Effective in global, distributed teams.
Additional Qualifications
· Near-native English with strong writing and editorial skills.
· Hands-on with generative AI tools (text/voice/video).
· Background in QA testing, rubric design, or AI safety/ethics evaluation.
· Familiarity with data-annotation platforms and model-evaluation tools.
· Ability to interpret code/datasets/workflows at a conceptual level (no coding required).
· Works independently and manages workflows effectively in a remote setup.
· Multilingual ability beyond English.
Scope & Autonomy
· Leads quality, training, and performance tracks across several projects; independent within guardrails.
· Shared accountability for client results and team performance with Ops Manager.
Job Reference: #LI-JC1
Role Purpose
Owns client-specific quality programs, performance metrics, and escalations while leading team development and cross-functional coordination. Shared accountability for client outcomes and team performance with the Ops Manager
Key Responsibilities
· Set client QA strategies (sampling design, audit methods, acceptance thresholds) and adapt to scope/volume changes.
· Run root-cause analyses; drive CAPA plans with owners, timelines, and effectiveness checks.
· Plan training & certification for raters/annotators and coordinators; track completion and impact.
· Maintain dashboards (throughput, accuracy, productivity, cost) and convert insights into actions.
· Manage client escalations; present options, trade-offs, and recovery paths.
· Standardize SOPs, templates, and checklists; remove bottlenecks.
· Pilot small automations (macros, templates, RPA/API handoffs) with Ops Tech; scale wins.
· Coach P1s and C2–C3 on tools, workflows, and QA craft.
· Ensure compliance/security across data handling and platform access.
Requirements
Education
· Bachelor’s degree or equivalent experience in Business, Operations, Quality, or Data/Engineering.
Experience
· 2+ years in quality/ops with hands-on QA and workforce/training coordination.
· 1+ years leading people/pods (formal or informal).
Skills
· Multi-project planning and stakeholder management.
· Clear client communications and governance cadence participation.
· Strong spreadsheets, PM/task boards, and basic BI; ETL familiarity is a plus.
· Capacity planning with vendors; confident escalation/negotiation.
· Effective in global, distributed teams.
Additional Qualifications
· Near-native English with strong writing and editorial skills.
· Hands-on with generative AI tools (text/voice/video).
· Background in QA testing, rubric design, or AI safety/ethics evaluation.
· Familiarity with data-annotation platforms and model-evaluation tools.
· Ability to interpret code/datasets/workflows at a conceptual level (no coding required).
· Works independently and manages workflows effectively in a remote setup.
· Multilingual ability beyond English.
Scope & Autonomy
· Leads quality, training, and performance tracks across several projects; independent within guardrails.
· Shared accountability for client results and team performance with Ops Manager.
Job Reference: #LI-JC1
Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:
ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.
Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.
Welocalize
5 jobs posted
About the job
Similar Jobs
NVIDIA
23 days agoProduct Manager, Generative AI Data
RemoteUS, CA$148K - $224K/yrView detailsWelocalize
4 days agoProject Manager - Generative AI Data Operations
MexicoView detailsKodiak
8 days agoApplied AI Engineer – Generative AI
San Francisco, CA$150K - $250K/yrView detailsWelocalize
23 days agoSenior Project Manager Generative AI
MexicoView detailsVisa
18 days agoDirector- Generative AI Platform and Hub
Austin, TX$215K - $343K/yrView detailsTikTok
6 days agoTech Lead, Research Scientist, Generative AI
San Jose, CAView detailsAMD
12 days agoApplied ML researcher, Generative AI - Advanced Graphics Programs
Bellevue, WashingtonView detailsCode and Theory
13 days agoSenior Machine Learning Engineer (Multimodal Generative AI)
Bengaluru, Karnataka, IndiaView detailsAMD
11 days agoApplied ML researcher, Generative AI - Advanced Graphics Programs
Bangalore, IndiaView detailsDeepMind
12 days agoResearch Engineer, Multimodal Generative AI (Image/Video)
KirklandSeattle$166K/yrView details
Looking for something different?
Browse all AI jobsNever miss a new AI job
Get the latest AI jobs delivered to your inbox every week. Free, no spam.