Become an Expert Contributor today!

Snorkel is at the forefront of AI development, building high-quality datasets that leverage the strengths of Large Language Models (LLMs) in language understanding and data processing. While LLMs have excelled in tasks like language generation and pattern recognition, advancing their reasoning capabilities is the next frontier. Our goal is to push the boundaries of AI by designing and scaling datasets that will shape new AI technologies focused on complex reasoning tasks across a multitude of domains.

Project Overview: Data annotation is the process of labeling or curating data to train, tune, and/or evaluate AI models. The main task for this project includes generating field-specific multiple-choice questions (and answers) to support AI models that depend on high-quality labeled data for accuracy.

Role Overview: As an Expert Contributor (EC), you will play a pivotal role in creating, curating, and reviewing reasoning tasks for a groundbreaking AI benchmark. You'll help bridge the gap between what LLMs excel at now and the advanced reasoning capabilities we aim to achieve. Contributors will collaborate within a cohort environment, engaging in live learning sessions and leveraging shared incentives tied to achieving project milestones.

Job Title: Expert Contributor

Topic: Medical Specialties

Location: This remote role allows for flexible, task-based work, providing opportunities for those who are self-motivated and efficient with their time to make a significant impact while controlling their earning potential.

Hours: You make your schedule. We're targeting experts to dedicate ~5+ hours of work per week, completely self-paced and time-flexible.

Pay: We use a task-based structure that ranges from $10-$80 per high quality submission - depending on factors such as quality of work, project complexity, education level, background/experience (e.g. higher rates for specific fields of study).

Basic pay level: $80/accepted question and $10/peer review performed. You will be paid a minimum of $20 for every question you submit. This enables you to easily make a base rate of $80+/hr, with many contributors making considerably more.

Required Qualifications:

• Completed Doctorate of Medicine (MD) or Doctor of Osteopathic Medicine (DO).
• Must be in 2nd year of Residency at a minimum.
• Must be based in the U.S. No international profiles accepted at this time.
• The ability to work in U.S. without sponsorship. Must have TIN/EIN or SSN.
• The ability to contribute an average of 5 hours per week, or more for the duration of the project (estimate 3 months).

Previous experience in data annotation, question generation, or educational content creation is a plus!

Why Join Us?

You want to contribute to a groundbreaking open-source benchmark advancing AI frontiers and the chance to tackle rewarding challenges in a collaborative environment. You'll gain recognition for shaping the future of AI data.

Apply today!