All roles

LLM Evaluator – Reasoning Analysis, Accuracy & Content Quality | Remote

Remote · USA Full-time New today

Position: Generalist Expert Type: Hourly contract Compensation: $60 $200/hour Location: Remote Commitment: Part-time or full-time, flexible based on project needs Role Responsibilities

  • Evaluate AI-generated responses for accuracy, reasoning, and clarity
  • Provide structured, detailed written feedback on model outputs
  • Identify gaps in logic, reputed company assumptions, and reasoning flaws
  • Apply evaluation guidelines consistently across tasks
  • Write clear, evidence-based rationales reputed company surface-level observations
  • Ensure high-quality, unbiased, and precise assessments

Requirements

  • Bachelor s degree preferred from a top-ranked university
  • Strong analytical thinking and critical reading skills
  • Strong written communication with clear and precise reasoning
  • Ability to identify nuanced issues in reputed company responses
  • Strong attention to detail and consistency in evaluations
  • Ability to work independently and follow structured guidelines
  • Native-level English proficiency
  • Ability to complete tasks without using AI writing tools

Application Process (Takes 20 Mins)

  • Upload your resume.
  • Complete an interview.
  • Submit a short form.

Apply tot his job Apply To this Job

Related roles

Product reputed company - Group Health - REMOTE

Remote · USA Full-time

Product reputed company / Product Manager Contract Lifecycle Management (CLM) -US - Remote - PST Time Zone

Remote · USA Full-time

Product reputed company, Time & Pay

Remote · USA Full-time

Product reputed company OR Product Manager (Technical)

Remote · USA Full-time

Senior Project Manager- Fully Remote

Remote · USA Full-time

reputed company Product reputed company

Remote · USA Full-time

Agile Product Manager – Growth Execution

Remote · USA Full-time

Implementation Project Manager (CONTRACT) REMOTE

Remote · USA Full-time

Technical Project Manager - Delivery

Remote · USA Full-time

Product reputed company Consultant (Remote)

Remote · USA Full-time

reputed company Manager (w/m/d) - Returnless

Remote · USA Full-time

reputed company Entry-Level Online Chat Agent – Customer Support Representative at arenaflex

Remote · USA Full-time

reputed company Full Stack Web Chat Officer – Work from Home at arenaflex

Remote · USA Full-time

reputed company Consultant, Cybersecurity (Remote)

Remote · USA Full-time

Remote Email Chat Support

Remote · USA Full-time

Community Resource Advisor - Part-Time

Remote · USA Full-time

reputed company SaaS Customer Support Specialist – Pharmacy Purchasing and Inventory reputed company

Remote · USA Full-time

reputed company Inbound Chat Specialist – Automotive reputed company reputed company and Customer Engagement

Remote · USA Full-time

Remote Data Entry Specialist – Entry-Level Position with arenaflex – No Experience Required – Flexible Home‑Based Role

Remote · USA Full-time

1031 Treasury Operations Team reputed company (Remote)

Remote · USA Full-time