Conversation Quality Analyst

About the Role

What if your instinct for natural conversation could directly shape how AI communicates with millions of people? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they sound human, feel helpful, and actually make sense.

This is a fully remote, flexible contract role open to anyone with strong communication instincts and a sharp eye for quality. No AI background, linguistics degree, or technical experience required — just a genuine feel for how good conversation works.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Read and evaluate AI-generated conversations across a wide range of topics and contexts
• Assess responses for naturalness, helpfulness, tone, and conversational flow
• Identify awkward phrasing, off-topic replies, logical inconsistencies, or unhelpful responses
• Compare multiple conversation paths and rank them by overall quality
• Provide structured, detailed feedback using clear evaluation rubrics
• Work independently and asynchronously on your own schedule

Who You Are

• Strong reading comprehension and a natural feel for how conversations flow
• Able to assess dialogue quality objectively and articulate your reasoning
• Detail-oriented and consistent — you apply the same standard across every evaluation
• Comfortable working through large volumes of conversational content
• Self-motivated and reliable when working independently
• No AI, linguistics, or prior content evaluation experience required

Nice to Have

• Background in writing, editing, communications, or customer-facing roles
• Experience with quality assurance, content review, or critical analysis
• Familiarity with AI tools or chatbots as an end user

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Directly influence how AI converses with people around the world
• Potential for ongoing work and contract extension as new projects launch