[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"job-senior-data-annotation-jobs-chicago":3},{"Ques":4,"Slug":25,"Header":26,"job_category":54},{"title":5,"content":6},"Frequently Asked Questions",[7,10,13,16,19,22],{"A":8,"Q":9},"This Rex.zone role is Remote and aligned to Chicago\u002FUS hiring requirements. The day-to-day work is performed remotely using annotation tools, QA workflows, and documentation standards.","Are these senior data annotation jobs in Chicago remote or onsite?",{"A":11,"Q":12},"Senior data annotation typically includes leading labeling operations, writing and enforcing annotation guidelines, running QA evaluation (audits, gold sets, agreement analysis), and improving training data quality for NLP, computer vision, and LLM training pipelines.","What does senior data annotation mean in an AI\u002FML context?",{"A":14,"Q":15},"Yes. The role covers RLHF-style preference ranking, rubric-based grading, prompt evaluation, and other LLM evaluation tasks that support model performance improvement.","Does the role include RLHF and LLM evaluation tasks?",{"A":17,"Q":18},"Common domains include NLP (named entity recognition, classification), computer vision annotation (bounding boxes, segmentation), and content safety labeling, plus dataset QA and evaluation design.","What domains are commonly covered in this job?",{"A":20,"Q":21},"Yes. Employment Type is FULL_TIME and Experience Level is Mid-Senior, matching the senior data annotation job intent while keeping the provided defaults unchanged.","Is this position full-time and what is the experience level?",{"A":23,"Q":24},"Highlight senior data annotation, data labeling, training data quality, annotation guidelines compliance, QA evaluation, RLHF, prompt evaluation, named entity recognition, computer vision annotation, content safety labeling, and experience supporting LLM training pipelines.","What skills should I highlight to be competitive?","senior-data-annotation-jobs-chicago",{"desc":27,"title":28,"content":29},"Senior data annotation jobs in Chicago focus on building and evaluating training datasets for modern AI systems, including LLM training pipelines, RLHF, and multimodal annotation. On Rex.zone, you will lead data labeling workflows that improve training data quality, annotation guidelines compliance, and model performance improvement across NLP, computer vision, and content safety labeling. This remote, full-time role partners with engineers and QA teams to deliver consistent ground truth, conduct prompt evaluation and LLM response rating, and run rigorous QA evaluation so models learn reliably at scale.","Senior Data Annotation Jobs in Chicago",[30,33,36,39,42,45,48,51],{"h2":31,"desc":32},"LinkedIn Job Metadata","Title: Senior Data Annotation Jobs in Chicago | Date: 25-02-2026 | Company: Rex.zone | Country: US | Remote Type: Remote | Employment Type: FULL_TIME | Experience Level: Mid-Senior | Industry: Technology | Job Function: Engineering | Skills: Senior data annotation, Data labeling, RLHF, QA evaluation, Prompt evaluation, Named entity recognition, Computer vision annotation, Content safety labeling, LLM training pipelines | Salary Currency: USD | Salary Min: 63360 | Salary Max: 126720 | Pay Period: YEAR",{"h2":34,"desc":35},"About the Role","You will own end-to-end senior data annotation workflows for AI\u002FML model development, with a strong focus on training data quality and repeatable labeling operations. The work includes NLP labeling (classification, summarization, named entity recognition), RLHF-style preference ranking, prompt evaluation, and LLM output evaluation, along with computer vision annotation such as bounding boxes, polygons, segmentation, and keypoints. You will help design and enforce annotation guidelines, calibrate raters, run sampling plans, analyze disagreement, and partner with engineering to ship datasets that measurably improve model performance.",{"h2":37,"desc":38},"What You Will Do","Plan and lead data labeling projects across NLP, CV, and content safety labeling; execute RLHF and LLM evaluation tasks including pairwise ranking and rubric-based grading; create and iterate annotation guidelines with clear edge cases and decision rules; run QA evaluation programs (gold sets, audits, inter-annotator agreement) to ensure annotation guidelines compliance; investigate label noise and perform error analysis tied to model performance improvement; collaborate with engineering on tooling, schema design, and dataset versioning for LLM training pipelines; mentor annotators, conduct calibration sessions, and drive consistent labeling outcomes across distributed teams; document dataset limitations, bias risks, and safety considerations to support responsible AI development.",{"h2":40,"desc":41},"Required Qualifications","3+ years in data annotation, data labeling, or AI evaluation with measurable QA ownership; experience with RLHF, prompt evaluation, or LLM response rating; strong knowledge of annotation guidelines design and annotation guidelines compliance; hands-on understanding of training data quality metrics (agreement, precision\u002Frecall sampling, error taxonomies); familiarity with NLP tasks (NER, intent, sentiment, classification) and\u002For computer vision annotation (boxes, polygons, segmentation); comfort working in remote workflows with ticketing, documentation, and dataset version control practices; ability to communicate clearly with engineering and stakeholders and translate model errors into labeling improvements.",{"h2":43,"desc":44},"Preferred Qualifications","Experience with content safety labeling (policy-based decisions, harm categories, sensitive content triage); background in evaluation design for LLMs (rubrics, test sets, adversarial prompts); exposure to annotation platforms and QA tooling (review queues, audit trails, consensus workflows); ability to write basic scripts or queries for analysis (e.g., Python or SQL) to support QA evaluation; experience supporting AI labs, tech startups, annotation vendors, or BPO delivery models while maintaining consistent quality.",{"h2":46,"desc":47},"Work Location and Remote Setup","This is a Remote, FULL_TIME position aligned to Chicago and US hiring requirements. You will collaborate with cross-functional teams across time zones using standardized labeling operations, documentation, and QA evaluation processes. Remote roles must remain Remote, and this role is explicitly Remote.",{"h2":49,"desc":50},"Compensation","Salary range is USD 63360 to 126720 per YEAR, depending on scope, domain complexity (NLP, computer vision, content safety), and demonstrated leadership in training data quality and QA evaluation.",{"h2":52,"desc":53},"How to Apply on Rex.zone","Apply through Rex.zone with a resume highlighting senior data annotation leadership, RLHF or prompt evaluation experience, and examples of training data quality improvements. Include notes on annotation guidelines you authored, QA evaluation methods you ran, and the types of LLM training pipelines or computer vision annotation projects you supported.","AI Data Operations"]