World Wide - Remote•Worldwide - Remote
Remote
Senior
Full Time
independent contractorremoteconsultingsubject matter expertAI evaluation
Requirements
- •Advanced degrees (PhD, MD, JD) or equivalent industry-recognized status
- •Operate as an independent consultant or freelancer with own workflows and equipment
- •Ability to articulate reasoning process clearly in writing
- •Properly registered to operate as independent contractor in country of residence
What You'll Do
- •Review and advise on the quality criteria used to evaluate AI outputs
- •Create, edit, or certify benchmark examples of perfect prompts and responses
- •Analyze model failures and provide technical breakdowns
- •Consult on the difficulty and nuance of specific prompts
Nice to Have
- •Prior experience in AI evaluation
Benefits
- •Project-based and non-exclusive engagements
- •Flexibility in how to complete deliverables
- •Scope, timelines, and compensation defined in advance
- •Remote work
- •Flexible revenue stream supplementing primary consulting business
About Invisible Agency
Clients give us complex business problems and we become their operations, automation, and AI partner to deliver operational breakthroughs.
San Francisco, CA, US
250 - 500
IT Services