Critical Reviewer Fully Remote Job at Mercor, New York, NY

citzN1dyVmJVLzh2U2Eyb0RqeWI0NlRuU0E9PQ==
  • Mercor
  • New York, NY

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey .

Position: Generalist Expert

Type: Contract

Compensation: $100/hour

Location: Remote

Role Responsibilities

  • Evaluate AI-generated responses to enhance reasoning and rigor in model outputs .
  • Provide structured written feedback to improve training data quality and downstream performance.
  • Develop clear precise and well-evidenced written rationales beyond surface-level observations.
  • Collaborate with AI research teams to ensure consistency and coverage across datasets.
  • Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

  • Bachelors degree from a top-100 globally ranked university preferred.
  • Strong analytical and written communication skills.
  • Ability to work independently and follow detailed task guidelines.
  • Strong critical reading skills with the ability to identify nuance implicit meaning and gaps in reasoning.
  • Ability to write clear precise and well-evidenced written rationales.
  • Consistent and honest judgment including the ability to give critical assessments.
  • Strict attention to detail and accurate application of structured evaluation guidelines.
  • Ability to work entirely without AI writing tools .
  • Native English fluency required.

Preferred

  • Candidates based in the United States United Kingdom Canada Australia or New Zealand .

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Job Tags

Full time, Contract work, Summer work, Remote work

Similar Jobs

The Arcadia Family of Companies

Maintenance Services I - Arcadia Job at The Arcadia Family of Companies

 ...5 Craigside Arcadia Adult Day Care and Day Health Center Arcadia Home Health and Home Care Services Arcadia at Home Hale Ola Kino by Arcadia Arcadia Family of Companies is an Equal Opportunity Employer Employment decisions are made without regard to race... 

Southland Holdings

Pipe laborer Job at Southland Holdings

 ...AZ Southland Holdings company is currently hiringPipe Layers & Pipe Laborers: Requirements: Construction Experience laying sanitary sewer, utilities, pipeline, RCP storm drain, Wastewater Treatment plants and waterline. Must be physically capable of... 

SGS Consulting

Cybersecurity Awareness Specialist Job at SGS Consulting

Job Responsibilities: ~Develop and deliver engaging cybersecurity awareness and training programs for employees across the organization ~Create and deliver engaging presentations to communicate cybersecurity concepts, initiatives, and awareness content (virtual and...

AAA Plus Transportation Service

Team Member Job at AAA Plus Transportation Service

 ...LOOKING TO HIRE Full time/ Part-Time TEAM MEMBER TO WORK FOR SMOOTHIE KING Job Details: No Experience is needed. Working...  ...Our company has been around since 2017, helping Patients and Senior citizens to take them TO and FROM home to clinic and dialysis. Come Join... 

Merck & Co.

Principal Scientist, Biologics Analytical R&D Job at Merck & Co.

Job DescriptionThe Biologics Analytical Research & Development department of our Company's Research Laboratories Division is seeking applicants for a Principal Scientist position available at its Rahway, New Jersey research facility. The Principal Scientist is a highly...