Data Annotation Specialist (RLHF, NLP, CV, Content Safety)

Rex.zone is hiring data annotation specialists to create and evaluate high-quality training data for AI/ML systems. This role is an entity-level fit for data labeling experts who execute RLHF (Reinforcement Learning from Human Feedback), prompt evaluation, QA evaluation, named entity recognition (NER), computer vision annotation, and content safety labeling to power LLM training pipelines. You’ll help improve model performance and ensure annotation guidelines compliance across real-world workflows. Opportunities span AI labs, tech startups, BPOs, and annotation vendors through the Rex.zone platform. Roles available include remote, contract, freelance, full-time, entry-level, and senior.

Job Image

Key Responsibilities

Perform text, image, audio, and video annotation across NLP, computer vision, and content safety tasks. Execute RLHF and LLM evaluation workflows such as pairwise preference ranking, rubric-based scoring, and prompt evaluation. Apply detailed annotation guidelines and maintain high inter-annotator agreement with rigorous QA checks. Contribute feedback to improve taxonomies, labeling rubrics, and edge-case handling. Collaborate with project leads to monitor data quality metrics (consistency, coverage, and ambiguity) and drive model performance improvement.

Required Qualifications

Proficiency in data labeling concepts, annotation guidelines, and QA evaluation. Familiarity with LLM behavior, prompt writing, and preference ranking. Experience with at least one toolset (e.g., Label Studio, Prodigy, Scale Rapid, SuperAnnotate, Amazon SageMaker Ground Truth). Strong attention to detail, ability to follow complex instructions, and maintain throughput with accuracy. Effective written English; additional languages are a plus for multilingual datasets.

Preferred Experience

Background in NER, sentiment analysis, entity linking, and dialogue safety labeling. Experience in computer vision annotation (bounding boxes, polygons, keypoints, segmentation). Exposure to RLHF loops, red-teaming, content taxonomy mapping, and safety policy application. Familiarity with quality frameworks (gold sets, audit sampling, inter-annotator agreement, issue taxonomies). Basic scripting for data handling is a plus but not required.

Workflows You’ll Support

LLM evaluation (Elo-style ranking, pairwise comparisons, rubric scoring), prompt evaluation and adversarial testing, content safety labeling (hate, harassment, self-harm, sexual content, violence), NER and classification for NLP pipelines, and computer vision tasks for detection and segmentation. You’ll support training data quality at scale to feed continuous model improvement cycles.

Tools & Platforms

Rex.zone project workspace and QA dashboards; leading annotation tools such as Label Studio, Prodigy, SuperAnnotate, Scale Rapid, or custom vendor platforms; collaboration via Jira/Asana; documentation in Confluence/Notion; optional scripting with Python/Sheets for data reviews.

Work Arrangements

Openings across remote, full-time, part-time, contract, temporary, and freelance. Entry-level and senior tracks available. Projects may run in shifts depending on domain and SLA. Employer types include AI labs, tech startups, BPOs, and annotation vendors partnering through Rex.zone.

Compensation

Competitive and project-based; varies by domain, language coverage, seniority, and region. Rates disclosed per project. Performance bonuses may be available on select engagements tied to quality metrics.

How to Apply

Submit your profile on Rex.zone, highlight domain strengths (NLP, CV, content safety), language skills, and tools experience. Short skills assessments may be required for project matching. Apply now to join active and upcoming projects.

Quick Facts & Apply

  • Q: What is this role about?

    This role involves data annotation and AI training tasks. Visit Rex.zone to learn more about the data-annotation-job position.

  • Q: Is this remote?

    Yes, most positions are remote with flexible scheduling options.

  • Q: What skills are needed?

    Attention to detail, guideline adherence, and basic understanding of AI/ML concepts.

230+Domains Covered
120K+PhD, Specialist, Experts Onboarded
50+Countries Represented

Industry-Leading Compensation

We believe exceptional intelligence deserves exceptional pay. Our platform consistently offers rates above the industry average, rewarding experts for their true value and real impact on frontier AI. Here, your expertise isn't just appreciated—it's properly compensated.

Work Remotely, Work Freely

No office. No commute. No constraints. Our fully remote workflow gives experts complete flexibility to work at their own pace, from any country, any time zone. You focus on meaningful tasks—we handle the rest.

Respect at the Core of Everything

AI trainers are the heart of our company. We treat every expert with trust, humanity, and genuine appreciation. From personalized support to transparent communication, we build long-term relationships rooted in respect and care.

Ready to Shape the Future of Data Annotation & Labeling?

Apply Now.