Job Description

Responsibilities: Manage offshore annotation contractors as main liaison; Write and maintain annotation guidelines; Annotate data yourself, especially early on; Track quality metrics (agreement rate, accuracy, rework) and drive improvement; Cut cost, boost throughput, without sacrificing quality; Partner with engineering to automate annotation via LLMs/agents. Requirements: Experience managing offshore/distributed teams; ML annotation/training data pipeline knowledge; Extremely detail-oriented, strong written/verbal communication; SQL and spreadsheet/BI skills; Comfort turning ambiguous decisions into clear rules. Nice to have: Python, annotation UI/UX design, taxonomy classification experience, LLM/agent automation experience.