World Wide - Remote•Worldwide - Remote
Remote
Senior
Full Time
💰$6 - $65/hour
freelanceremoteAI evaluationaudio evaluationPortuguese language
Requirements
- •Professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation
- •Native or bilingual proficiency in Portuguese with fluency in reading, listening, writing, and speaking
- •Strong analytical and verbal communication skills
- •Basic computer programming literacy including understanding JSON structures, functions, methods, and simple logic
- •Detail-oriented approach to working with structured prompts, evaluation rubrics, and technical guidelines
- •Access to a high-quality microphone for audio input
What You'll Do
- •Design complex evaluation frameworks
- •Create and execute role-play-based evaluation scenarios simulating customer service interactions
- •Evaluate AI model performance using qualitative and quantitative metrics
- •Assess AI model's programming literacy including JSON and logic
- •Generate diverse, high-quality audio datasets reflecting real customer expectations
Benefits
- •Freelance / Independent Contractor engagement
- •Remote work
About Invisible Agency
Clients give us complex business problems and we become their operations, automation, and AI partner to deliver operational breakthroughs.
San Francisco, CA, US
250 - 500
IT Services