World Wide - Remote•Worldwide - Remote
Remote
Senior
Full Time
💰$6 - $65/hour
freelanceremoteAI evaluationaudio specialist
Requirements
- •Professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation
- •Native or bilingual proficiency in the target language with fluency in reading, listening, writing, and speaking
- •Strong analytical and verbal communication skills for simulated customer support role-plays
- •Basic computer programming literacy including understanding of JSON structures, functions, methods, and simple logic
- •Meticulous, detail-oriented approach to working with structured prompts, evaluation rubrics, and technical guidelines
- •Access to a high-quality microphone for clean, reliable audio input
What You'll Do
- •Creating and executing complex, role-play-based evaluation scenarios simulating realistic customer service interactions
- •Evaluating AI model performance across qualitative and quantitative metrics focusing on task completion accuracy, conversational naturalness, and audio comprehension
- •Assessing AI model's understanding of JSON structures, functions, methods, and reasoning about structured data
- •Contributing to the development of diverse, high-quality audio datasets reflecting real customer expectations
Benefits
- •Freelance / Independent Contractor engagement
- •Remote workplace
About Invisible Agency
Clients give us complex business problems and we become their operations, automation, and AI partner to deliver operational breakthroughs.
San Francisco, CA, US
250 - 500
IT Services