Job Description

Job Description

Job Description

Project Timeline

• Start Date: Immediate
• Duration: 5 6 weeks
• Commitment: Part-time, ~20 hours/week (flexible)
• Schedule: Fully remote and asynchronous

• Evaluate AI-generated data analyses for quality, correctness, and clarity.
• Understand dataset context and apply statistical analysis and modeling for both specific and open-ended prompts.
• Design prompts and create clear, detailed rubrics for reward modeling and evaluation.
• Produce gold-standard responses: data visualizations, explanatory text, and executable Python notebooks (.ipynb).
• Translate data-science reasoning and decisions into gradable criteria for AI agents.

• Education: Bachelor's, Master's, or PhD in Data Science, Machine Learning, or a related field.
• Experience: 2+ years in industry data-science roles.
• Technical Skills: Proficient in Python and common data libraries (pandas, numpy, scikit-learn).
• Data Expertise: Strong understanding of statistical analysis, modeling, and visualization; ability to identify patterns and communicate insights.
• Communication: Excellent analytical and data-driven writing skills; able to distill complex findings into clear, concise recommendations.

1. Submit Resume

2. AI Interview & A short, 25-minute technical interview which will assess conceptual project-based questions and a Google Co-Lab data analysis exercise

3. Work trial

   • 6 lessons on rubric-writing fundamentals

   • Short comprehension quizzes (non-evaluative)

   • A final quiz and 1–2 hour prompt-writing exercise

   • Total time: ~3 hours

Job Tags

Similar Jobs