Remote Data Annotation Jobs in Los Angeles

Rex.zone is hiring for remote data annotation jobs in Los Angeles focused on training data creation and evaluation for modern AI systems. As a Data Annotation Specialist, you will label and review text, images, audio, and conversations used in LLM training pipelines, RLHF workflows, and model evaluation. Your work improves training data quality, annotation guidelines compliance, and model performance improvement across NLP, computer vision annotation, content safety labeling, and prompt evaluation. This is a full-time remote role aligned to real production workflows used by AI labs, tech startups, and annotation vendors—apply through Rex.zone to join a distributed data operations team.

Job Image

Job Opening: Remote Data Annotation Specialist (Los Angeles)

Title: Remote Data Annotation Specialist (Los Angeles) Date: 25-02-2026 Company: Rex.zone Country: US Remote Type: Remote Employment Type: FULL_TIME Experience Level: Mid-Senior Industry: Technology Job Function: Engineering Skills: data annotation, data labeling, RLHF, LLM evaluation, prompt evaluation, QA evaluation, annotation guidelines compliance, named entity recognition, computer vision annotation, content safety labeling, training data quality Salary Currency: USD Salary Min: 63360 Salary Max: 126720 Pay Period: YEAR

About the Role

You will produce high-quality labeled datasets and evaluation signals that support large language model training pipelines. Tasks include text and chat annotation, prompt evaluation, QA evaluation, content safety labeling, and structured labeling such as named entity recognition. You will follow detailed annotation guidelines, document edge cases, and collaborate with QA to reduce disagreement rates and improve labeling consistency across projects used by AI labs, tech startups, BPOs, and annotation vendors.

What You Will Do

Core responsibilities include: (1) Perform data labeling for NLP, computer vision annotation, and multimodal tasks (text-image). (2) Execute RLHF-style ranking and preference judgments to improve model alignment and response quality. (3) Run LLM evaluation tasks including rubric-based scoring, prompt-response grading, and error categorization. (4) Apply content safety labeling policies for toxicity, self-harm, harassment, and sensitive attributes. (5) Conduct QA evaluation: audit samples, compute issue rates, and propose guideline clarifications. (6) Track annotation guidelines compliance and escalate ambiguous cases with clear examples.

Workflow and Tools

You will work in web-based annotation platforms and internal tooling typical of AI data operations teams. You will use task instructions, gold-standard examples, and calibration sets; maintain review notes for disagreements; and support continuous improvement of training data quality. Familiarity with labeling taxonomies, rubric design, inter-annotator agreement, and dataset versioning is helpful.

Required Qualifications

Mid-Senior experience in structured data annotation, data labeling, QA evaluation, or model evaluation. Strong attention to detail with consistent decision-making under guidelines. Ability to read and apply labeling policies for content safety labeling and sensitive content. Comfort working with ambiguity and documenting edge cases. Reliable remote work habits, including time management and clear written communication.

Preferred Qualifications

Experience with RLHF or preference ranking tasks; LLM evaluation and prompt evaluation; named entity recognition (NER) or taxonomy-based labeling; computer vision annotation (bounding boxes, segmentation, keypoints); and quality programs such as auditing, calibration sessions, and disagreement analysis. Exposure to AI/ML training pipelines, dataset curation, and model performance improvement loops is a plus.

Why Rex.zone

Rex.zone connects qualified remote annotators with real AI production work across domains like NLP, computer vision, LLM training, and content safety. You will contribute to measurable improvements in training data quality and model evaluation outcomes while working full-time in a remote-first environment.

How to Apply

Apply via Rex.zone with a resume highlighting annotation experience, QA evaluation work, and any RLHF, LLM evaluation, named entity recognition, computer vision annotation, or content safety labeling projects. Include examples of guideline-driven decision-making, audit/review experience, and training data quality improvements.

Frequently Asked Questions

  • Q: Are these remote data annotation jobs in Los Angeles fully remote?

    Yes. The role is explicitly Remote and can be performed from Los Angeles while collaborating with distributed teams through Rex.zone.

  • Q: Is this job full-time or contract/freelance?

    This posting is FULL_TIME. Rex.zone may also list contract and freelance roles on the platform, but this specific opening is full-time remote.

  • Q: What types of annotation tasks are included?

    Common tasks include data labeling for NLP and LLM training, RLHF preference ranking, prompt evaluation, QA evaluation and auditing, named entity recognition, computer vision annotation, and content safety labeling.

  • Q: What does RLHF mean in this role?

    RLHF (Reinforcement Learning from Human Feedback) involves collecting human preference signals—such as ranking outputs or selecting better responses—to improve model alignment and response quality during LLM training pipelines.

  • Q: How is quality measured for training data?

    Quality is measured through annotation guidelines compliance, calibration performance, disagreement rates, audit accuracy, and downstream signals like model performance improvement on evaluation sets.

  • Q: Do I need an AI/ML degree to apply?

    An AI/ML degree is not required. Demonstrated experience with data annotation, data labeling, evaluation workflows, and careful guideline-based decision-making is most important.

  • Q: What domains might I work on?

    Projects commonly span NLP, computer vision, content safety, and LLM evaluation. Employer types can include AI labs, tech startups, BPOs, and annotation vendors.

  • Q: Is this role entry-level or senior?

    The listed Experience Level is Mid-Senior. Rex.zone may host entry-level and senior roles as separate postings, but this specific posting targets experienced annotators.

230+Domains Covered
120K+PhD, Specialist, Experts Onboarded
50+Countries Represented

Industry-Leading Compensation

We believe exceptional intelligence deserves exceptional pay. Our platform consistently offers rates above the industry average, rewarding experts for their true value and real impact on frontier AI. Here, your expertise isn't just appreciated - it's properly compensated.

Work Remotely, Work Freely

No office. No commute. No constraints. Our fully remote workflow gives experts complete flexibility to work at their own pace, from any country, any time zone. You focus on meaningful tasks - we handle the rest.

Respect at the Core of Everything

AI trainers are the heart of our company. We treat every expert with trust, humanity, and genuine appreciation. From personalized support to transparent communication, we build long-term relationships rooted in respect and care.

Ready to Shape the Future of AI Data Operations?

Apply Now.