Persian LLM Evaluator
Join Project Spearmint, a multilingual AI response evaluation project reviewing large language model (LLM) outputs in different languages, focused on either Tone or Fluency. Native-level fluency in a target language, along with strong English comprehension, is required.
As an evaluator, you will review short, pre-segmented datasets and assess model-generated replies based on specific quality dimensions. Your input will help validate evaluation frameworks and establish baseline quality metrics for future model development.
Key Responsibilities:
- Evaluate model replies in your native language based on either Tone or Fluency.
- Assess the overall quality, correctness, and naturalness of responses.
- Read the user prompt and two model replies, then rate each using a five-point scale.
- Provide brief rationales for any extreme ratings.
Project Breakdown:
Batch 1 – Tone: Determine whether replies are helpful, insightful, engaging, and fair. Flag formality mismatches, condescension, bias, or other tonal issues.
Batch 2 – Fluency: Assess grammatical accuracy, clarity, coherence, and natural flow.
This is a project-based opportunity with CrowdGen, where you will join the CrowdGen Community as an Independent Contractor. If selected, you will receive an email from CrowdGen regarding the creation of an account using your application email address. You will need to log in to this account, reset your password, complete the setup requirements, and proceed with your application for this role.
Make an impact on the future of AI – apply today and contribute from the comfort of your home.
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Become a crucial part of Project Babel by helping enhance AI language understanding as an AI Translation Rater for native Chinese speakers.
Help shape the future of AI by evaluating translations as an AI Translation Rater for Project Babel.
Join Fox Rent A Car as a Revenue Pricing Analyst and lead data-driven pricing strategies to outsmart the competition and maximize revenue.
Become a critical analyst at Visa, where your insights will shape our innovative product strategies in the payments industry.
As a Mid-Level Data Analyst in Marketing Analytics at Rover, you will build impactful data solutions that optimize marketing performance.
The Comptroller’s Office seeks a dedicated Business Analyst to enhance IT initiatives and foster better integration of business processes.
Become an Analyst at Philips and play a key role in optimizing logistics and distribution processes for better healthcare outcomes.
Join our Audit Analytics team at American Express, where you’ll apply data analytics to transform business processes and enhance risk management.
Become a pivotal part of American Express as a Senior Manager for Enterprise Control Management, leading data analytics and risk reporting efforts.
Lead analytics and data automation initiatives for media performance as Senior Manager at a leading global marketing firm.
An exciting opportunity to contribute as a Power Market Modeling Analyst at 174 Power Global, driving price forecasting and energy market insights.
Become a vital part of Theoria Medical as a Lead Data Analyst, leading our analytics strategy and optimizing healthcare delivery through data.
Become a key player at COUNTRY Financial as a Business Analyst focusing on enhancing processes and supporting strategic initiatives.
Become an integral part of Huron as a Business Analyst - IRB Application Specialist, focusing on improving compliance in medical research through effective strategies.
Join Constellation Technologies as a Junior Level Analyst specializing in TechSIGINT, bringing your expertise in signals analysis to a dynamic team.
Established in 1996 and headquartered in New South Wales, Australia, Appen provides data used for the development of machine learning and artificial intelligence products.
160 jobsSubscribe to Rise newsletter
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
