Key Responsibilities
Annotate text, image, audio, and video data for NLP and computer vision tasks; execute RLHF comparisons and preference ranking; perform prompt evaluation and judge LLM outputs for correctness, safety, and style; conduct content safety labeling and policy application; run named entity recognition (NER), sentiment, intent, and topic tagging; create and follow detailed annotation guidelines; perform QA evaluation, gold set creation, and spot checks; document edge cases and escalate ambiguity; collaborate with model trainers to improve training data quality and model performance; contribute to large language model evaluation studies and A/B tests.



