New! Be one of the first to apply
AI Evaluation Specialist-Generalist
Mercor is looking for an AI Evaluation Specialist-Generalist in United Kingdom
Job description
About The JobMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Mercor Generalist
Type: Independent Contractor
Compensation: $20–$30/hour
Location: Remote
Duration: 1–3 months typical
Commitment: 10–20 hours/week, with potential to increase
Role Responsibilities
- Evaluate AI-generated outputs for accuracy, clarity, and alignment with real-world reasoning.
- Contribute written assessments and structured feedback on model performance.
- Identify conceptual, logical, and stylistic strengths and weaknesses in AI responses.
- Collaborate asynchronously with Mercor’s research and operations teams to maintain quality and consistency across evaluations.
- Ensure strong analytical judgment, precise communication, and consistent application of evaluation criteria.
Must-Have
- Strong English fluency and written communication skills.
- Sharp attention to detail and ability to identify subtle errors or inconsistencies.
- Analytical and critical thinking skills across a wide range of topics.
- No formal educational background or specific degree required—curiosity, clarity, and reasoning skill are key.
- Based in USA.
- Immediate opportunities available; applications reviewed on a rolling basis.
- Independent contractor arrangement.
- Daily payments via Stripe Connect.
- Upload resume
- AI interview based on your resume
- Submit form
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: support@mercor.com
,
Extra information
- Status
- Closed
- Education Level
- Secondary School
- Location
- United Kingdom
- Type of Contract
- Casual / Part Time Jobs
- Full UK/EU driving license preferred
- No
- Car Preferred
- No
- Must be eligible to work in the EU
- No
- Cover Letter Required
- No
- Languages
- English
Get similar vacancies sent to your mailbox
Fill in below which area you are searching in for a similar function and don't forget your e-mail address!