Highest Paying STEM Jobs India — AI/ML Data Annotation Specialist
Title: Highest Paying STEM Jobs India — AI/ML Data Annotation Specialist Date: 25-02-2026 Company: Rexzone Country: US Remote Type: Remote Employment Type: FULL_TIME Experience Level: Mid-Senior Industry: Technology Job Function: Engineering Skills: RLHF, data labeling, QA evaluation, prompt evaluation, named entity recognition, computer vision annotation, content safety labeling, LLM training pipelines Salary Currency: USD Salary Min: 63360 Salary Max: 126720 Pay Period: YEAR You will design and execute high-accuracy data labeling and LLM evaluation tasks that improve training data quality for production AI systems. Work includes RLHF preference ranking, prompt evaluation, QA evaluation, content safety labeling, and adherence to annotation guidelines compliance. You will collaborate with engineers and program leads to identify error patterns, reduce ambiguity in labeling instructions, and support model performance improvement through clear feedback loops. Typical pipelines include NER, text classification, summarization grading, safety policy enforcement, and computer vision annotation where needed. This role is remote and full-time via Rex.zone and may support AI labs, tech startups, BPOs, and annotation vendors. Responsibilities: • Perform RLHF preference ranking and rationale writing to support large language model evaluation • Execute data labeling tasks across NLP and multimodal datasets, including named entity recognition and computer vision annotation • Run QA evaluation checks, measure inter-annotator agreement, and drive training data quality improvements • Conduct prompt evaluation and response grading for helpfulness, harmlessness, and policy compliance • Maintain annotation guidelines compliance and propose guideline revisions when edge cases recur • Triage quality issues, document failure modes, and communicate insights for model performance improvement Qualifications: • Mid-Senior experience in data labeling, QA evaluation, or ML data operations • Strong understanding of RLHF concepts, evaluation rubrics, and scalable labeling workflows • Familiarity with NLP tasks (classification, NER, summarization) and content safety labeling • Comfort with ambiguity, policy interpretation, and consistent decision-making under guidelines How You Will Be Evaluated: • Accuracy and consistency in labeling and evaluation • Guideline adherence, edge-case handling, and QA defect reduction • Clear written rationales that improve reviewer and model feedback loops Apply: • Visit Rex.zone and submit your application for this remote, full-time role



