Search Quality Evaluator

Search Quality Evaluator (AI Training)
About The Role
What if your everyday internet savvy could directly influence how AI delivers information to millions of people? We're looking for Search Quality Evaluators to assess search engine results, AI-generated answers, and content recommendations - helping ensure that the AI systems people rely on are accurate, relevant, and genuinely useful.
This is a fully remote, flexible contract role open to anyone with a sharp eye for quality and a knack for critical thinking. No technical background or prior AI experience required - just strong judgment and a reliable internet connection.
Organization: Alignerr
Type: Hourly Contract
Location: Remote
Commitment: 10-40 hours/week
What You'll Do
Evaluate search engine results for relevance, accuracy, and overall usefulness to the user
Rate AI-generated answers and content recommendations using structured evaluation rubrics
Compare multiple results and rank them by quality, helpfulness, and trustworthiness
Provide clear, concise written explanations to support your ratings
Work through task-based assignments independently and at your own pace
Cover a broad range of topics - from everyday queries to complex informational searches
Who You Are
Comfortable using search engines and navigating the web with confidence
Able to assess content relevance and quality objectively and consistently
Detail-oriented with a systematic, methodical approach to evaluation
Clear and concise written communicator in English
Self-motivated and reliable when working independently
No AI, tech, or professional research background required
Nice to Have
Background in research, journalism, editing, or information science
Experience with content evaluation, quality assurance, or fact-checking
Familiarity with AI tools, search platforms, or content rating workflows
Broad general knowledge across a wide range of subjects
Why Join Us
Work on cutting-edge AI projects alongside leading research labs
Fully remote and flexible - work when and where it suits you
Freelance autonomy with the structure of meaningful, task-based work
Contribute directly to AI development that shapes how the world finds information
Potential for ongoing work and contract extension as new projects launch