Expert Talent Pool Feedback and Alignment
- India
- Full Time
- Posted 4 days ago
Role details
About the Role
Join a remote expert network as a senior rater and reviewer, evaluating complex AI model outputs and helping calibrate other graders. Your work supports the development of high-quality, trustworthy AI systems across specialized fields.
What You’ll Do
Rank and rate expert-level model answers using detailed rubrics and write clear rationales.
Evaluate steps in model reasoning across fields such as mathematics, coding, law, medicine, and finance.
Fact-check complex claims against primary sources and verify accuracy.
Assess answers against content policies, style guides, and edge cases.
Review other raters’ work, calibrate standards, and develop or refine grading guidelines.
Assess search relevance and provide feedback in live sessions.
What We’re Looking For
At least 5 years of professional experience in rating, review, editing, fact-checking, trust and safety, or a relevant professional domain.
Native or near-native written English proficiency.
Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.
Experience leading or reviewing other raters, such as as a QA lead, rubric owner, or reviewer of reviewers.
An advanced degree, professional license, or deep working expertise in the domain you grade.
Hands-on AI data annotation experience, search-quality rating, or experience writing and maintaining grader guidelines is a plus.
Compensation & Benefits
Compensation is $50 to $120 per hour, depending on the project, field, and expertise level. Payment is based on hours worked.
Location
Fully remote. Projects typically run from one week to several months.
Please mention the word **UPLIFTING** and tag RNDUuMTk5LjEzOS4yOQ== when applying to show you read the job post completely (#RNDUuMTk5LjEzOS4yOQ==). This is a beta feature to avoid spam applicants. Companies can search these words to find applicants that read this and see they’re human.
Skills required
- quality assurance
- finance
- math
- exec
- content writing
- senior
How to apply on FDJobs
- 1
Create your free account
Register with your name, e-mail and a password. It takes less than a minute.
- 2
Complete your profile
Add your mobile number, city, qualification, skills and upload your resume (PDF, DOC or DOCX).
- 3
Find a job and apply
Open any FDJobs opening, read the details and press Apply with FDJobs. Add a short message if you like.
- 4
Track your application
Follow the status in your dashboard: Applied, Shortlisted, Rejected or Hired. We also e-mail you.
New to FDJobs? Read the full guide. Applying is free. Never pay money to anyone for a job, and read our safety tips.
Job details
Apply for this job
Posted on RemoteOK
This job is listed on another website. You will apply there. FDJobs does not receive your application, so keep track of it in your dashboard.
Share this job
More openings
Other jobs you may like
- Location : India
- Company : IterativehealthLocation : India
- Location : Remote (Remote)
