Andromeda Sadiradra - QA Audio Rater - English (Australia)

Welo is an AI services company focused on data quality and training datasets. The Welo Data team is launching an audio rating program and needs experienced quality assurance support during its critical early phase. As a QA Audio Rater, you'll work remotely to maintain rating consistency and catch calibration problems before they scale across the production pool.

Your core responsibility is auditing roughly 30% of all output generated during the pilot phase. You'll review rater submissions, identify where scoring diverges from guidelines or lacks consistency, and flag calibration drift early. When you spot issues, you'll provide raters with specific, actionable feedback that helps them adjust. You'll also complete your onboarding and training before the larger production team launches, ensuring you're ready to hit the ground running.

To succeed here, you need a sharp eye for detail and the ability to maintain consistent judgment across many audio files. Pattern recognition matters—you'll spot where raters are drifting from standards and be able to explain exactly what's wrong and why. This is early-stage work, so comfort working independently and handling ambiguity during a pilot is important. Experience in QA, auditing, or similar rating roles is valuable background.

The position runs 10 hours per week at 38 Australian dollars per hour, starting as soon as possible. It's a freelance contractor role based fully remote, and you'll work in Australian English throughout.

Nice to have

• Background in audio evaluation or similar technical rating work
• Experience training or mentoring other raters
• Familiarity with calibration techniques and quality benchmarking