[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"job-senior-data-annotation-jobs-san-francisco":3},{"Ques":4,"Slug":28,"Header":29,"job_category":53},{"title":5,"content":6},"Frequently Asked Questions",[7,10,13,16,19,22,25],{"A":8,"Q":9},"Yes. The roles are explicitly Remote while targeting candidates aligned to the San Francisco job market and AI ecosystem.","Are these senior data annotation jobs in San Francisco remote?",{"A":11,"Q":12},"Typical work includes data labeling, QA evaluation, RLHF preference ranking, prompt evaluation, content safety labeling, and building or validating gold-standard datasets for LLM training pipelines.","What kind of work is included in senior data annotation?",{"A":14,"Q":15},"It is strongly preferred. Senior-level performance often requires comfort with RLHF, large language model evaluation, and structured critique workflows that improve model behavior.","Do I need experience with RLHF and LLM evaluation?",{"A":17,"Q":18},"These roles can span NLP (including named entity recognition), computer vision annotation, and content safety labeling depending on project needs.","What domains are supported: NLP, computer vision, or content safety?",{"A":20,"Q":21},"Yes, it is FULL_TIME. The listed annual range is USD 63360 to USD 126720 with Pay Period: YEAR.","Is this a full-time role and what is the pay range?",{"A":23,"Q":24},"Senior data annotation work commonly supports AI labs, tech startups, annotation vendors, and BPO-style data operations teams that deliver training data quality at scale.","What employers does this work typically support?",{"A":26,"Q":27},"Emphasize senior data annotation, data labeling, RLHF, LLM evaluation, prompt evaluation, QA evaluation, annotation guidelines, and named entity recognition, along with examples of training data quality and model performance improvement outcomes.","What skills should I emphasize to match the role?","senior-data-annotation-jobs-san-francisco",{"desc":30,"title":31,"content":32},"Senior data annotation jobs in San Francisco at Rex.zone focus on producing high-quality training data for AI\u002FML systems through data labeling, RLHF (Reinforcement Learning from Human Feedback), LLM evaluation, prompt evaluation, and QA review. You will apply rigorous annotation guidelines compliance to improve model performance, reduce hallucinations, and strengthen content safety in real-world LLM training pipelines across NLP and computer vision. These remote, full-time roles support AI labs, tech startups, and annotation vendors by delivering training data quality that scales, with measurable impact on model evaluation, named entity recognition, and policy-based labeling outcomes. Explore and apply on Rex.zone.","Senior Data Annotation Jobs in San Francisco",[33,35,38,41,44,47,50],{"h2":31,"desc":34},"Date: 25-02-2026 | Company: Rex.zone | Country: US | Remote Type: Remote | Employment Type: FULL_TIME | Experience Level: Mid-Senior | Industry: Technology | Job Function: Engineering | Skills: Senior data annotation, data labeling, RLHF, LLM evaluation, prompt evaluation, QA evaluation, annotation guidelines, named entity recognition | Salary Currency: USD | Salary Min: 63360 | Salary Max: 126720 | Pay Period: YEAR",{"h2":36,"desc":37},"About the Role","You will lead and execute complex data annotation workflows for LLM and multimodal model training, including RLHF preference ranking, prompt-response evaluation, content safety labeling, and structured data labeling for NLP tasks such as named entity recognition and intent classification. You will produce gold-standard labels, conduct QA evaluation, calibrate with other annotators, and help maintain annotation guidelines compliance so training data quality consistently supports model performance improvement.",{"h2":39,"desc":40},"Key Responsibilities","You will deliver high-accuracy labels across NLP, computer vision annotation, and content moderation datasets; perform RLHF ranking and critique to improve helpfulness, harmlessness, and honesty; run prompt evaluation to detect policy violations, unsafe outputs, and low-quality generations; execute QA review cycles (spot checks, inter-annotator agreement checks, adjudication); document edge cases and propose guideline updates that reduce ambiguity; collaborate with data operations and engineering to refine labeling tools, taxonomies, and sampling strategies; track metrics tied to training data quality, annotation throughput, and defect rates; support model evaluation sets and offline benchmarks used for large language model evaluation.",{"h2":42,"desc":43},"Required Qualifications","Demonstrated experience with data annotation or data labeling at scale; strong understanding of annotation guidelines compliance and QA evaluation practices; familiarity with RLHF, preference data, or human feedback workflows; ability to apply consistent judgment on ambiguous content for content safety labeling; strong written communication for documenting decisions, edge cases, and rationale; comfort working in remote, production-driven environments with measurable quality targets.",{"h2":45,"desc":46},"Preferred Qualifications","Hands-on experience with LLM training pipelines, prompt evaluation, and large language model evaluation; exposure to named entity recognition, sentiment, toxicity, or instruction-following datasets; experience with computer vision annotation (bounding boxes, polygons, keypoints) and multimodal evaluation; experience with annotation tooling, audit sampling, and inter-annotator agreement methodologies; background supporting AI labs, tech startups, BPOs, or annotation vendors with strict turnaround and quality requirements.",{"h2":48,"desc":49},"What Success Looks Like","Consistent delivery of high-quality labeled data with low defect rates; measurable improvements in training data quality and model performance improvement signals; clear documentation that reduces guideline ambiguity and improves annotation consistency; reliable QA evaluation practices that catch policy issues and mislabeled samples early; strong calibration outcomes across projects involving RLHF, prompt evaluation, and content safety labeling.",{"h2":51,"desc":52},"How to Apply","Apply via Rex.zone and be ready to complete a short labeling or evaluation exercise covering annotation guidelines compliance, QA review, and prompt evaluation. Your application should highlight relevant data labeling, RLHF, LLM evaluation, and training data quality experience aligned to senior data annotation jobs in San Francisco.","AI Data Operations"]