Invisible Agency logo
    I

    Quality Specialist - AI Trainer

    Invisible Agency
    World Wide - Remote•Worldwide - Remote
    Remote
    Senior
    Full Time
    💰$8 - $65/hour
    contractremoteAI trainingquality assurance

    Requirements

    • •Prior experience in AI training or evaluation
    • •Solid understanding of QA methodologies
    • •Strong analytical skills
    • •Attention to detail
    • •Ability to clearly communicate findings

    What You'll Do

    • •Evaluate AI-generated outputs for accuracy, consistency, and compliance with guidelines
    • •Apply QA best practices to assess data quality
    • •Identify systematic issues and provide actionable feedback
    • •Review and audit AI-generated outputs
    • •Flag errors and inconsistencies
    • •Conduct spot checks across diverse datasets
    • •Document reproducible failure points
    • •Collaborate with training and evaluation teams to refine quality standards
    • •Enhance guidelines and strengthen model evaluation metrics

    Nice to Have

    • •Familiarity with annotation platforms
    • •Experience with workflow management
    • •Experience with linguistic or technical evaluation

    Benefits

    • •Remote work
    • •Contract position

    About Invisible Agency

    Clients give us complex business problems and we become their operations, automation, and AI partner to deliver operational breakthroughs.

    San Francisco, CA, US
    250 - 500
    IT Services