Productive Playhouse is building a talent pool of Hindi speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with various AI models.

As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights will directly inform model development and optimization.

Responsibilities

• Testing and evaluating AI chatbots or language models through structured conversations.
• Voice-based interactions with AI models, with sessions recorded for evaluation.
• Submitting deliverables in the specified format.

Requirements

• Native or expert-level fluency in Hindi.
• Strong English reading, writing, and communication skills.
• Hands-on experience using AI models.
• Ability to pass a language proficiency and technical literacy assessment.
• Responsive communicator.
• Able to start within 48 hours.

Benefits

• Work from home.
• Flexible hours and task selection.
• Opportunity to improve AI understanding of your language.