Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
English LLM Evaluator- AI Output Review image - Rise Careers
Job details

English LLM Evaluator- AI Output Review

Join Project Hermes 2.0, a global initiative focused on enhancing LLM output across a range of domains!


We’re looking for contributors to take part in a fast-paced evaluation task. In this role, you'll review pairs of inputs and AI-generated outputs, then assess the quality of those outputs based on accuracy, relevance, and clarity—following the project’s established guidelines. Your evaluations will directly support improvements to model performance and help shape the future of responsible AI development.


Key Responsibilities:


- Review input-output pairs, assessing AI-generated responses for quality and accuracy

- Evaluate content based on criteria such as clarity, tone, relevance, and alignment with intent

- Provide structured responses to evaluation questions to support model improvement

- Maintain high attention to detail and quality across all assigned tasks


Requirements:


- Native or near-native fluency in English

- Strong reading comprehension and writing skills

- Minimum commitment of 20 hours per week

- Bachelor’s degree or relevant work experience in content evaluation, writing, linguistics, or a related field

- High attention to detail and ability to follow detailed guidelines

- Comfortable reviewing content that may include sensitive or potentially harmful material


Slots are filling up fast, and early starters will have the best chance to secure their spot and begin earning sooner!


This role is a project-based opportunity with CrowdGen, where you will join the CrowdGen Community as an Independent Contractor. If selected, you will receive an email from CrowdGen regarding the creation of an account using your application email address. You will need to log in to this account and reset the password, complete the setup requirements, and proceed with your application for this project-based role.

 

Make an impact on the future of AI – apply today and start contributing from the comfort of your home.


$3.67 - $3.67 one-time
This is a pay-per-unit task, with the pay rate based in USD.

Average salary estimate

$3.67 / YEARLY (est.)
min
max
$3.67K
$3.67K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User

Become a crucial part of Project Babel by helping enhance AI language understanding as an AI Translation Rater for native Chinese speakers.

Photo of the Rise User
Posted 13 days ago

Become a crucial evaluator for Project Spearmint, where your insights on LLM outputs will shape the future of AI language development.

Photo of the Rise User

Join Northwestern Medicine's General Cardiology Department as a Nurse Practitioner or Physician Assistant, delivering exceptional outpatient care and support.

Photo of the Rise User
Posted 6 days ago

Join Qualtrics as a Senior Physical Security Analyst in Provo, where your expertise will enhance the security framework for our global operations.

Photo of the Rise User
Posted 3 days ago
Photo of the Rise User

A leading healthcare network in Reno invites a Registered Nurse CVOR to deliver exceptional peri-operative care and collaborate with multidisciplinary teams.

Photo of the Rise User
Posted 14 days ago

Join Greenlife Healthcare Staffing as a Licensed Nursing Assistant to deliver compassionate care in a skilled nursing environment.

Photo of the Rise User
Chipotle On-Site New York, NY, USA
Posted yesterday
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony
Customer-Centric
Social Impact Driven
Rapid Growth
Passion for Exploration
Dare to be Different
Reward & Recognition
Empathetic
Take Risks
Growth & Learning
Open Door Policy
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Onsite Child Care
Family Medical Leave
Paternity Leave
Fully Distributed
Snacks
Social Gatherings
Company Retreats
Fitness Stipend
Family Coverage (Insurance)
Health Savings Account (HSA)
Flexible Spending Account (FSA)
Conferences Stipend
Learning & Development
Bias Training

Experienced Respiratory Care Practitioner wanted at St. Francis Medical Center to provide specialized respiratory therapeutic and diagnostic care.

Photo of the Rise User
Inclusive & Diverse
Growth & Learning
Mission Driven
Diversity of Opinions

Provide compassionate, telephonic care management for behavioral health and substance use patients while collaborating with multidisciplinary teams at Included Health.

Posted 10 days ago

Become an integral part of Florida Atlantic University's Sports Medicine team as an Assistant Athletic Trainer, providing essential care and support to our student-athletes.

Join MEDS as an Emergency Medicine Nurse Practitioner, providing high-quality care in a supportive, community-focused environment in Maryville, IL.

Photo of the Rise User

UChicago Medicine AdventHealth seeks a Pediatric Otolaryngology Physician to join their established practice offering competitive salary and excellent benefits in Hinsdale, IL.

Photo of the Rise User
Raley's On-Site West Sacramento, CA, USA
Posted 7 hours ago

Symbria Rx Services seeks a skilled PRN Immunization Nurse in Woodridge, IL, offering flexible hours and a rewarding role in community immunization.

Established in 1996 and headquartered in New South Wales, Australia, Appen provides data used for the development of machine learning and artificial intelligence products.

160 jobs
MATCH
Calculating your matching score...
FUNDING
DEPARTMENTS
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Contract, remote
DATE POSTED
June 17, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!