Video Game Analyst | Remote | $20/hr

Position: Domain Expert Video Games

Type: Contractor

Compensation: $20/hr (Average time taken: 3 hours)

Location: Remote

Commitment: 30-40 hrs/week

Role Responsibilities

• Create advanced prompts covering game development, esports, gaming platforms, game design, publishers, and gaming communities.
• Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
• Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
• Develop benchmark datasets and adversarial test cases to evaluate AI model performance.
• Provide clear, evidence-based feedback supported by reliable references.
• Collaborate with AI researchers and project teams to improve AI model performance.
• Maintain high annotation quality and consistent documentation standards.

Requirements

• Hold a Master's degree or higher in Video Games, Game Design, Interactive Media, Computer Science, or a related field.
• Have 3+ years of professional, research, or teaching experience in a field related to video games.
• Possess excellent written English communication and analytical skills.
• Demonstrate strong attention to detail with the ability to identify subtle factual and logical issues.
• Have strong knowledge of video games, including game development, esports, platforms, game design, publishers, and gaming communities.
• Experience with LLMs, Generative AI, prompt engineering, or AI evaluation is preferred.

Application Process

• Apply via Easy Apply
• Check email for next steps