[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"job-senior-data-annotation-jobs-austin":3},{"Ques":4,"Slug":25,"Header":26,"job_category":54},{"title":5,"content":6},"Frequently Asked Questions",[7,10,13,16,19,22],{"A":8,"Q":9},"These roles are explicitly marked Remote. The Austin keyword aligns the job with the Austin market, but day-to-day work is performed remotely within the US.","Are these senior data annotation jobs in Austin remote or onsite?",{"A":11,"Q":12},"Senior scope includes higher ownership of training data quality, QA evaluation, calibration leadership, edge-case documentation, and consistent rubric application across RLHF and prompt evaluation workflows.","What does “senior” mean for data annotation in this role?",{"A":14,"Q":15},"Tasks include data labeling, named entity recognition, prompt evaluation, RLHF preference judgments, QA evaluation audits, and (depending on project) computer vision annotation and content safety labeling.","What kinds of tasks are included?",{"A":17,"Q":18},"RLHF (Reinforcement Learning from Human Feedback) uses human preference labels and structured evaluations to guide model behavior. In practice, it involves ranking responses, scoring against rubrics, and providing feedback signals used in LLM training pipelines.","What is RLHF and why is it part of data annotation?",{"A":20,"Q":21},"You do not need to be a software engineer, but you should be comfortable with structured processes, quality measurement, and collaborating with engineering teams on labeling tools, workflow improvements, and dataset requirements.","Do I need engineering experience to apply if Job Function is Engineering?",{"A":23,"Q":24},"The role can include NLP and large language model evaluation as the core, with optional coverage of computer vision annotation and content safety labeling depending on the dataset and client needs.","Which domains does the job cover: NLP, computer vision, or content safety?","senior-data-annotation-jobs-austin",{"desc":27,"title":28,"content":29},"Senior data annotation jobs in Austin at Rex.zone focus on building and evaluating training data for AI\u002FML systems, including LLM training pipelines, RLHF, data labeling, and QA evaluation. In this full-time remote role, you will apply annotation guidelines compliance, prompt evaluation, and content safety labeling to improve model performance improvement across NLP and computer vision workflows. You will partner with engineers and AI teams to deliver training data quality, accurate named entity recognition, and consistent rubric-based scoring that supports reliable large language model evaluation and safer deployments.","Senior Data Annotation Jobs in Austin",[30,33,36,39,42,45,48,51],{"h2":31,"desc":32},"Job Heading: Senior Data Annotation (Austin)","Title: Senior Data Annotation (Austin)\nDate: 25-02-2026\nCompany: Rex.zone\nCountry: US\nRemote Type: Remote\nEmployment Type: FULL_TIME\nExperience Level: Mid-Senior\nIndustry: Technology\nJob Function: Engineering\nSkills: Senior data annotation, data labeling, RLHF, QA evaluation, prompt evaluation, named entity recognition, computer vision annotation, content safety labeling, LLM training pipelines, annotation guidelines compliance, training data quality, large language model evaluation\nSalary Currency: USD\nSalary Min: 63360\nSalary Max: 126720\nPay Period: YEAR",{"h2":34,"desc":35},"About the Role","You will lead end-to-end data annotation and evaluation workflows used in AI\u002FML training, including RLHF preference labeling, prompt-response evaluation, and rubric-based scoring for large language model evaluation. Your work will directly impact training data quality, model performance improvement, and safety outcomes by producing consistent labels, QA reviews, and clear feedback on annotation guidelines compliance.",{"h2":37,"desc":38},"What You Will Do","Core responsibilities include:\n- Execute and review data labeling tasks for NLP and computer vision datasets\n- Perform RLHF evaluations (preference ranking, pairwise comparisons, and structured scoring)\n- Conduct QA evaluation audits for accuracy, consistency, and policy alignment\n- Perform prompt evaluation on model outputs for helpfulness, correctness, and safety\n- Apply named entity recognition tagging and taxonomy mapping where required\n- Support content safety labeling (policy-based classification, sensitive content handling)\n- Write and refine annotation guidelines, edge-case notes, and decision logs\n- Track dataset health metrics (agreement rate, defect density, rework rate) and propose fixes\n- Collaborate with engineering on tooling feedback for labeling UI, workflow automation, and sampling strategy",{"h2":40,"desc":41},"Required Qualifications","We are looking for candidates with:\n- Experience in data annotation, data labeling, or QA evaluation for AI\u002FML systems\n- Familiarity with RLHF concepts and large language model evaluation methodologies\n- Ability to follow and improve annotation guidelines compliance under ambiguity\n- Strong attention to detail and comfort making consistent judgment calls using rubrics\n- Experience with NLP tasks such as classification, summarization evaluation, and named entity recognition\n- Professional communication skills for documenting edge cases and explaining labeling decisions",{"h2":43,"desc":44},"Preferred Qualifications","Nice to have:\n- Experience with computer vision annotation (bounding boxes, polygons, segmentation masks)\n- Prior work on content safety labeling, trust & safety, or policy-driven evaluation\n- Exposure to dataset sampling, inter-annotator agreement, and evaluation design\n- Experience with annotation platforms, internal tooling, or vendor\u002Fqueue management\n- Comfort working with product and engineering partners in an AI training pipeline context",{"h2":46,"desc":47},"Work Model and Location","This is a full-time Remote role for candidates in the US, aligned to Austin hiring intent. You will collaborate asynchronously with distributed teams and participate in scheduled calibration sessions to maintain training data quality and rubric consistency.",{"h2":49,"desc":50},"Compensation","Salary Range: 63360 to 126720 USD per year, based on experience level, evaluation scope, and QA ownership. This role remains explicitly Remote.",{"h2":52,"desc":53},"How to Apply","Apply through Rex.zone and include:\n- A short summary of your data annotation, RLHF, and QA evaluation experience\n- Examples of annotation guidelines you have followed or improved (describe, no confidential data)\n- The task domains you have worked in (NLP, computer vision annotation, content safety labeling)\n- Your availability for full-time Remote work in the US","AI Data Operations"]