Data Labeling Part-Time Job (Remote)

Rex.zone is hiring part-time Data Labeling specialists to create high-quality training data for AI/ML systems. This role is an entity-level data annotation job tied to real LLM training pipelines, including RLHF (Reinforcement Learning from Human Feedback), prompt evaluation, QA evaluation, named entity recognition, computer vision annotation, and content safety labeling. You will improve training data quality through annotation guidelines compliance, rigorous review, and large language model evaluation that drives model performance improvement for AI labs, startups, and vendors on Rex.zone. Ideal for remote, contract, or freelance contributors across NLP, computer vision, and safety domains, from entry-level to senior raters experienced with LLM training workflows.

Job Image

Key Responsibilities

Label and review text, image, and short-form video data for NLP and computer vision tasks; perform named entity recognition, sentiment and intent tagging, entity linking, bounding boxes and segmentation; execute RLHF workflows such as pairwise ranking, A/B comparisons, and critique generation; conduct prompt evaluation and red-teaming for content safety; follow detailed annotation guidelines and contribute to updates; perform QA evaluation, spot checks, and conflict resolution to maintain training data quality; document edge cases and escalate ambiguities; provide actionable feedback that enables model performance improvement across large language model evaluation tasks.

Required Qualifications

Strong attention to detail and ability to follow complex instructions; excellent written English; familiarity with AI/ML concepts, LLM behavior, and common annotation taxonomies; reliable internet and modern laptop/desktop; ability to meet SLAs for throughput and accuracy; comfort working in remote, part-time, contractor or freelance arrangements. Entry-level candidates are welcome; senior raters and QA leads encouraged to apply.

Preferred Skills

Experience with NER, summarization, classification, and evaluation rubrics; knowledge of RLHF, DPO, and evaluation frameworks; prior work in content safety labeling and policy enforcement; multilingual skills; background in linguistics, data annotation, psychology, or ML; familiarity with inter-annotator agreement and calibration techniques; exposure to LLM training pipelines and model evals.

Tools & Platforms

Work in Rex.zone task queues and common annotation tools such as Label Studio, Prodigy, LightTag, SuperAnnotate, and CVAT; use quality dashboards, gold data checks, and guideline repositories; collaborate via tickets and issue trackers when needed.

Domains & Workflows

NLP (instruction following, summarization, NER), computer vision (classification, detection, segmentation), content safety (policy alignment, risk triage), LLM evaluation (pairwise ranking, rubric scoring, adversarial prompts), QA evaluation (gold tasks, audits, calibrations), and continuous improvement loops for annotation guidelines compliance.

Compensation & Scheduling

Competitive per-task or hourly pay depending on project; flexible part-time hours with weekly throughput targets; tasks available across time zones; short-term sprints and ongoing contract streams are available.

Who You’ll Support

AI labs, tech startups, BPOs, and annotation vendors using Rex.zone to scale trustworthy training data and evaluation for production AI systems.

How to Apply

Create your profile on Rex.zone, complete a brief skills check, pass guideline comprehension tasks, and join active queues. High performers may unlock senior/QA tracks.

Frequently Asked Questions

  • Q: What does a part-time data labeler do at Rex.zone?

    You annotate and evaluate text, images, and short videos for NLP, computer vision, and content safety tasks. Work includes RLHF ranking, prompt evaluation, guideline adherence, and QA checks to improve model performance.

  • Q: Is this role remote and contract-friendly?

    Yes. Roles are primarily remote and offered as part-time contractor or freelance engagements. High performers may be invited to longer-term or full-time tracks on select projects.

  • Q: What skills are required to get started?

    Strong written communication, attention to detail, and the ability to follow instructions. Familiarity with AI/ML, LLM behavior, or prior annotation experience is a plus but not strictly required.

  • Q: What domains will I work in?

    NLP (classification, NER, summarization), computer vision (classification, bounding boxes, segmentation), content safety (policy rating, red-teaming), and LLM evaluation (pairwise ranking, rubric scoring).

  • Q: How is quality measured?

    Your performance is tracked using accuracy on gold tasks, inter-annotator agreement, calibration tests, and adherence to annotation guidelines. Feedback loops help maintain consistent training data quality.

  • Q: Which tools will I use?

    Rex.zone task queues and industry tools like Label Studio, Prodigy, SuperAnnotate, and CVAT, plus simple spreadsheets and QA dashboards.

  • Q: Do I need programming experience?

    No. Programming is not required for most labeling tasks. Familiarity with AI concepts and LLM capabilities helps you progress faster.

  • Q: How do I apply?

    Sign up on Rex.zone, complete profile and skill checks, read the guidelines, and start on qualification tasks. Successful candidates gain access to paid queues.

230+Domains Covered
120K+PhD, Specialist, Experts Onboarded
50+Countries Represented

Industry-Leading Compensation

We believe exceptional intelligence deserves exceptional pay. Our platform consistently offers rates above the industry average, rewarding experts for their true value and real impact on frontier AI. Here, your expertise isn't just appreciated—it's properly compensated.

Work Remotely, Work Freely

No office. No commute. No constraints. Our fully remote workflow gives experts complete flexibility to work at their own pace, from any country, any time zone. You focus on meaningful tasks—we handle the rest.

Respect at the Core of Everything

AI trainers are the heart of our company. We treat every expert with trust, humanity, and genuine appreciation. From personalized support to transparent communication, we build long-term relationships rooted in respect and care.

Ready to Shape the Future of Data Annotation & Labeling?

Apply Now.