Agentic Audio Specialist - Freelance AI Trainer Project
Posted 18 days ago
Job Description
A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases.
Responsibilities
Responsibilities
- Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including:
- Flight bookings and travel support
- Financial services
- Telecommunications and technical support
- Contribute to the development of diverse and representative datasets used to assess conversational audio agents.
- Evaluate model performance across a standardized set of qualitative and quantitative metrics.
- Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow.
Evaluation Metrics
Model performance is assessed using a combination of conversational, technical, and audio-specific criteria, including but not limited to:
- Task completion accuracy and efficiency
- Conversational naturalness (tone, flow, and coherence)
- Audio comprehension and response quality
- Instruction adherence and contextual understanding
- Basic computer programming literacy, including:
- Understanding of JSON structures
- Familiarity with functions and methods
- Ability to reason about structured data and simple logic
- Technical communication clarity when handling support-style problem-solving
Technical & Equipment Requirements
- Strong verbal communication skills in a simulated customer support context
- English proficiency including fluency across all language skills: reading, listening, writing, and speaking.
- Access to a high-quality microphone to ensure clean, reliable audio input during evaluations
- Comfort working with structured prompts, evaluation rubrics, and technical guidelines
- Device capable of running audio recording software and opening large technical documentation
We offer a pay range of $11-to- $30.65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.
Employment type: Contract
Workplace type: Remote
Seniority level: Mid‑Senior Level
Apply for this position
Please mention that you found this job on MoAIJobs, this helps us grow. Thank you!
Invisible
26 jobs posted
About the job
Similar Jobs
- 24d
GenAI / Agentic AI Sales Manager, AWS Global Sales, Specialist
Amazon
JapanGenAI / Agentic AI Sales Manager, AWS Global Sales, Specialist
Amazon
Japan24d - 8d
Senior Technical Support Specialist (Enterprise Agentic AI)
Ema
IndiaSenior Technical Support Specialist (Enterprise Agentic AI)
Ema
India8d - 22d
Lead Agentic AI Designer
Mastercard
$150K - $254KPurchaseLead Agentic AI Designer
Mastercard
$150K - $254KPurchase22d - 10d
Software Engineer, Agentic AI
Neuralink
$151K - $261KAustinSouth San FranciscoSoftware Engineer, Agentic AI
Neuralink
$151K - $261KAustinSouth San Francisco10d - 28d
Agentic AI - Senior Software Engineer
Mastercard
Dublin, IrelandAgentic AI - Senior Software Engineer
Mastercard
Dublin, Ireland28d - 22d
Director- Agentic AI Architect & AI Designer
Mastercard
$179K - $305KPurchaseDirector- Agentic AI Architect & AI Designer
Mastercard
$179K - $305KPurchase22d - 21d
Manager, Solutions Operations - Agentic AI
Mastercard
CA$109K - CA$158KToronto, CanadaManager, Solutions Operations - Agentic AI
Mastercard
CA$109K - CA$158KToronto, Canada21d - 15d
Principal Product Manager, Agentic AI
Paypal
$218K - $324KSan Jose, CaliforniaPrincipal Product Manager, Agentic AI
Paypal
$218K - $324KSan Jose, California15d - 15d
Manager, Visual Design - Agentic AI
Mastercard
CA$109K - CA$158KToronto, CanadaManager, Visual Design - Agentic AI
Mastercard
CA$109K - CA$158KToronto, Canada15d - 12d
Senior Engineering Manager, Agentic AI
Robinhood
$298K - $350KBellevue, WAMenlo Park, CanadaSenior Engineering Manager, Agentic AI
Robinhood
$298K - $350KBellevue, WAMenlo Park, Canada12d