Andromeda Sadiradra - Audio Rater - Generalist - English (United State)

Welo is a data and AI services company focused on improving conversational AI systems. They work with teams building voice agents and other AI-driven applications by gathering human feedback on model quality.

For the Andromeda Sadiradra project, Welo Data is bringing on audio raters to evaluate interactions between users and AI voice agents. This is a freelance position working remotely in the United States, starting as soon as possible.

Your work will involve

• Listening to recorded conversations where people interact with AI voice agents
• Scoring each agent response on two separate 1 to 5 scales covering content quality and prosody
• Assessing content by judging whether responses are helpful, relevant, and contextually appropriate
• Evaluating prosody by rating how natural, well-paced, and expressive the agent's voice sounds
• Writing brief, specific explanations to support each score you assign

You'll need strong listening skills and the ability to make consistent, thoughtful judgments across multiple dimensions. Attention to detail matters here—you're catching nuances in both what the AI says and how it sounds. You should be comfortable writing clear, concise rationales for your ratings and able to maintain focus through multiple evaluations. Reliable availability for approximately 10 hours per week is essential.

What we offer

• Hourly rate of $26.33
• Flexible remote work from anywhere in the United States
• Roughly 10 hours per week of work
• Contractor position with immediate start available

This is straightforward, focused work if you have a good ear for conversation quality and enjoy detailed assessment tasks.