Remote AI Data Annotation Jobs Vancouver

Remote AI data annotation jobs in Vancouver on Rex.zone focus on creating high-quality training data for NLP, computer vision, and large language model evaluation. You will label and review text, images, audio, and conversational outputs using annotation guidelines compliance, QA evaluation workflows, and RLHF-style preference ranking to improve model performance and reduce hallucinations. This full-time remote role supports real AI/ML training pipelines used by AI labs, tech startups, and annotation vendors, with emphasis on training data quality, content safety labeling, and prompt evaluation.

Job Image

Remote AI Data Annotation Jobs Vancouver

Date: 25-02-2026 Company: Rex.zone Country: US Remote Type: Remote Employment Type: FULL_TIME Experience Level: Mid-Senior Industry: Technology Job Function: Engineering Skills: AI data annotation, data labeling, RLHF evaluation, LLM evaluation, prompt evaluation, QA evaluation, annotation guidelines compliance, named entity recognition, computer vision annotation, content safety labeling Salary Currency: USD Salary Min: 63360 Salary Max: 126720 Pay Period: YEAR

About the Role

You will perform remote AI data annotation and evaluation tasks supporting model training and post-training workflows. Typical work includes data labeling for NLP and computer vision, prompt evaluation for conversational agents, RLHF-style ranking of model outputs, QA evaluation for training data quality, and structured feedback that enables model performance improvement. You will follow annotation guidelines compliance, handle edge cases consistently, and collaborate asynchronously with cross-functional teams across AI labs, tech startups, BPOs, and annotation vendors.

What You Will Do

Core responsibilities include: - Create and review labeled datasets for NLP tasks (classification, summarization, intent, named entity recognition) - Perform RLHF evaluation via preference ranking and rubric-based scoring for large language model evaluation - Conduct prompt evaluation and response grading for helpfulness, truthfulness, and instruction-following - Execute computer vision annotation (bounding boxes, polygons, segmentation, keypoints) when needed - Apply content safety labeling for policy categories (hate, harassment, self-harm, sexual content, violence) - Run QA evaluation checks, identify guideline gaps, and provide actionable issue reports to improve training data quality - Maintain consistency across batches, resolve ambiguity, and document edge-case decisions

Required Qualifications

Minimum qualifications: - Experience in AI data annotation, data labeling, QA evaluation, or large language model evaluation - Strong English reading comprehension and ability to follow annotation guidelines compliance precisely - Demonstrated judgment in edge cases and ability to write concise rationales for labels and rankings - Familiarity with common NLP concepts (intent, entities, sentiment) and evaluation rubrics - Comfortable working remotely with productivity, versioning, and auditability expectations

Preferred Qualifications

Nice-to-have qualifications: - Hands-on exposure to RLHF pipelines, preference data, or prompt evaluation programs - Experience with named entity recognition, taxonomy design, or rubric development - Familiarity with computer vision annotation formats and QA sampling methodologies - Background in content safety labeling or policy enforcement workflows - Experience supporting multiple employer types (AI labs, tech startups, BPOs, annotation vendors)

Tools and Workflows

You may work with: - Web-based annotation tools (task queues, audit trails, reviewer workflows) - Quality systems (gold sets, inter-annotator agreement checks, sampling plans) - Clear rubrics for LLM evaluation, prompt evaluation, and content safety labeling - Structured output formats (JSON fields, tags, spans) to support downstream training pipelines

How Success Is Measured

Success metrics include: - Training data quality and annotation accuracy on gold-standard benchmarks - Annotation guidelines compliance and consistency across reviewers - QA evaluation pass rates and low rework volume - Clear rationales that improve model performance improvement initiatives - Throughput that meets SLA without sacrificing correctness

Why Rex.zone

Rex.zone connects qualified remote contributors with real AI/ML data operations work across domains including NLP, computer vision, and content safety. You will see consistent workflows, transparent task expectations, and opportunities to support end-to-end large language model evaluation and training data programs.

How to Apply

Apply through Rex.zone and complete the required assessments. Your results may be used to match you to projects such as RLHF evaluation, prompt evaluation, named entity recognition, computer vision annotation, and content safety labeling.

Frequently Asked Questions

  • Q: Are these truly remote AI data annotation jobs for Vancouver candidates?

    Yes. The role is marked Remote and can be performed from Vancouver while supporting US-based programs via Rex.zone, subject to project-specific onboarding and eligibility requirements.

  • Q: Is this job full-time or contract/freelance?

    This posting is FULL_TIME. Some Rex.zone programs may also offer contract or freelance tasks, but the role details here remain full-time.

  • Q: What kinds of tasks are included in AI data annotation?

    Tasks commonly include data labeling for NLP and computer vision, named entity recognition, QA evaluation for training data quality, content safety labeling, prompt evaluation, and large language model evaluation including RLHF-style preference ranking.

  • Q: What is RLHF evaluation in practice?

    RLHF evaluation often involves comparing two or more model responses, ranking them using a rubric, and writing brief rationales. This preference data helps optimize model behavior and supports model performance improvement.

  • Q: Do I need prior machine learning engineering experience?

    No, but you should have mid-senior proficiency in structured evaluation work, strong guideline adherence, and comfort with quality processes. Familiarity with AI/ML concepts and LLM evaluation rubrics is beneficial.

  • Q: What domains can I expect (NLP, computer vision, content safety)?

    Projects may span NLP labeling (classification, summarization, named entity recognition), computer vision annotation, and content safety labeling, depending on program needs and your assessment fit.

  • Q: How is quality ensured in remote annotation work?

    Quality is maintained through annotation guidelines compliance, gold sets, reviewer audits, inter-annotator agreement checks, QA evaluation sampling, and clear escalation paths for ambiguous cases.

  • Q: What employer types use these datasets?

    Datasets are commonly used by AI labs, tech startups, BPOs, and annotation vendors to train and evaluate large language models and other AI systems.

230+Domains Covered
120K+PhD, Specialist, Experts Onboarded
50+Countries Represented

Industry-Leading Compensation

We believe exceptional intelligence deserves exceptional pay. Our platform consistently offers rates above the industry average, rewarding experts for their true value and real impact on frontier AI. Here, your expertise isn't just appreciated - it's properly compensated.

Work Remotely, Work Freely

No office. No commute. No constraints. Our fully remote workflow gives experts complete flexibility to work at their own pace, from any country, any time zone. You focus on meaningful tasks - we handle the rest.

Respect at the Core of Everything

AI trainers are the heart of our company. We treat every expert with trust, humanity, and genuine appreciation. From personalized support to transparent communication, we build long-term relationships rooted in respect and care.

Ready to Shape the Future of AI Data Operations?

Apply Now.