Data Labeling & Annotation Specialist

Data Labeling & Annotation Specialist at Rex.zone is a core AI/ML training role focused on training data quality for LLMs and vision models. You will follow annotation guidelines, perform QA evaluation and prompt evaluation, execute named entity recognition, computer vision annotation, and content safety labeling to drive model performance improvement across RLHF and LLM training pipelines. This role supports large language model evaluation and end‑to‑end workflows. We hire remote, full-time, contract, and freelance contributors globally. Join Rex.zone to build reliable datasets that power AI labs, tech startups, BPOs, and annotation vendors.

Job Image

Key Responsibilities

• Create and refine high-quality training datasets for NLP and computer vision models. • Apply annotation guidelines compliance across tasks: NER, sentiment, intent, classification, bounding boxes, polygons, segmentation, OCR, audio transcription. • Conduct QA evaluation, spot checks, inter-annotator agreement (IAA), error taxonomy, and remediation. • Perform RLHF workflows: rank responses, judge instruction following, rate safety/harms, and conduct large language model evaluation. • Execute prompt evaluation and adversarial testing for LLM safety and robustness. • Document edge cases, update labeling SOPs, and provide feedback to improve model performance. • Collaborate with project managers, ML engineers, and QA leads via Rex.zone tooling.

Required Qualifications

• Proven attention to detail and consistency in annotation. • Fluency in English; additional languages a plus. • Ability to follow written guidelines and resolve ambiguity. • Comfort with web-based labeling tools and spreadsheets. • Reliable internet and ability to meet throughput and accuracy targets. • Eligibility to work as remote contractor or full-time employee depending on region.

Preferred Experience

• Prior work in data annotation, content moderation, or quality assurance. • Experience with NER, CVAT/Label Studio/SuperAnnotate, LightTag, or similar tools. • Background in RLHF rater programs, LLM prompt evaluation, or red teaming. • Domain expertise (e.g., healthcare, finance, e-commerce, safety) for specialized datasets. • Familiarity with metrics: training data quality, guideline adherence, IAA, and error reduction. • Basic data handling (CSV/JSON), and comfort reading simple instructions or schemas.

Workflows & Tools

• Rex.zone platform for project intake, labeling, QA, and reporting. • Label Studio, CVAT, SuperAnnotate, Diffgram, and custom Rex.zone tools. • QA checklists, calibration sessions, stratified sampling, consensus audits. • LLM evaluation harnesses for instruction-following and safety tests. • Processes focused on training data quality, annotation guidelines compliance, and model performance improvement.

Employment Types & Modifiers

• Open roles: remote, contract, freelance, full-time, part-time, entry-level, senior. • Domains: NLP, computer vision, content safety, LLM training, multilingual labeling. • Employers served via Rex.zone: AI labs, tech startups, BPOs, annotation vendors.

Compensation & Benefits

• Competitive pay with per-task or hourly rates for contractors; salary options for full-time. • Performance bonuses tied to accuracy and throughput. • Flexible schedules for remote contributors; training and calibration provided.

How to Apply

• Submit your profile on Rex.zone and complete a short skills assessment. • If shortlisted, you will receive guidelines and a paid calibration task. • Successful candidates are onboarded to live projects across NLP, CV, and content safety.

About Rex.zone

Rex.zone is an AI training platform connecting skilled annotators with teams building production-grade machine learning systems. We standardize workflows, improve data quality, and accelerate model performance across enterprise and research use cases.

Frequently Asked Questions

  • Q: Is this a remote role?

    Yes. Most data labeling projects on Rex.zone are remote, with global participation and flexible hours.

  • Q: What domains are available?

    NLP (NER, sentiment, intent), computer vision (bounding boxes, segmentation), content safety, and LLM evaluation including RLHF.

  • Q: Do you hire entry-level annotators?

    Yes. We provide guidelines, calibration, and QA feedback. Accuracy and consistency are key.

  • Q: What tools will I use?

    Rex.zone platform plus common tools like Label Studio, CVAT, SuperAnnotate, and project-specific interfaces.

230+Domains Covered
120K+PhD, Specialist, Experts Onboarded
50+Countries Represented

Industry-Leading Compensation

We believe exceptional intelligence deserves exceptional pay. Our platform consistently offers rates above the industry average, rewarding experts for their true value and real impact on frontier AI. Here, your expertise isn't just appreciated—it's properly compensated.

Work Remotely, Work Freely

No office. No commute. No constraints. Our fully remote workflow gives experts complete flexibility to work at their own pace, from any country, any time zone. You focus on meaningful tasks—we handle the rest.

Respect at the Core of Everything

AI trainers are the heart of our company. We treat every expert with trust, humanity, and genuine appreciation. From personalized support to transparent communication, we build long-term relationships rooted in respect and care.

Ready to Shape the Future of Data Annotation & Labeling?

Apply Now.