[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"job-senior-data-labeling-jobs-madrid":3},{"Ques":4,"Slug":22,"Header":23,"job_category":48},{"title":5,"content":6},"Frequently Asked Questions",[7,10,13,16,19],{"A":8,"Q":9},"These roles are explicitly marked Remote and remain Remote. The page targets the senior data labeling jobs Madrid keyword while offering remote work through Rex.zone.","Are these senior data labeling jobs Madrid remote or on-site?",{"A":11,"Q":12},"Typical tasks include data labeling, QA evaluation, annotation guideline creation, calibration, named entity recognition, computer vision annotation, content safety labeling, and LLM evaluation such as RLHF evaluation and prompt evaluation.","What kinds of tasks are included in senior data labeling work?",{"A":14,"Q":15},"RLHF evaluation commonly includes ranking model outputs, scoring responses against rubrics, identifying failure modes, and providing structured preference data that improves large language model evaluation and training outcomes.","What does RLHF evaluation involve in this role?",{"A":17,"Q":18},"Quality is measured through annotation guidelines compliance, gold set performance, inter-annotator agreement, blind review pass rates, error taxonomy trends, and the impact of labeling changes on model performance improvement.","How is quality measured in training data quality programs?",{"A":20,"Q":21},"Yes, Employment Type is FULL_TIME. The salary range is USD 63360 to USD 126720 per year, as listed in the job metadata.","Is this job full-time and what is the salary range?","senior-data-labeling-jobs-madrid",{"desc":24,"title":25,"content":26},"Senior data labeling jobs Madrid: Lead end-to-end data labeling and LLM evaluation workflows that improve training data quality, annotation guidelines compliance, and model performance improvement for AI\u002FML systems on Rex.zone. You will oversee RLHF evaluation, prompt evaluation, named entity recognition, computer vision annotation, and content safety labeling across large language model evaluation pipelines, partnering with engineering and QA to drive measurable dataset accuracy, inter-annotator agreement, and production-ready training data for AI labs, tech startups, and annotation vendors.","Senior Data Labeling Jobs Madrid",[27,30,33,36,39,42,45],{"h2":28,"desc":29},"LinkedIn Job Metadata — Senior Data Labeling Jobs Madrid","Title: Senior Data Labeling Jobs Madrid | Date: 25-02-2026 | Company: Rex.zone | Country: US | Remote Type: Remote | Employment Type: FULL_TIME | Experience Level: Mid-Senior | Industry: Technology | Job Function: Engineering | Skills: Senior data labeling, RLHF evaluation, data labeling, QA evaluation, prompt evaluation, named entity recognition, computer vision annotation, content safety labeling, LLM training pipelines | Salary Currency: USD | Salary Min: 63360 | Salary Max: 126720 | Pay Period: YEAR",{"h2":31,"desc":32},"About the Role","As a Senior Data Labeling professional, you will lead labeling operations for AI\u002FML training workflows, ensuring training data quality across NLP and computer vision datasets. You will translate product and research goals into annotation guidelines, run calibration sessions, and manage QA evaluation to reduce label noise and improve downstream model metrics. You will support RLHF evaluation and prompt evaluation for large language model evaluation, coordinate edge-case handling, and enforce content safety labeling policies to ensure safe and reliable model behavior.",{"h2":34,"desc":35},"What You Will Do","Own annotation guidelines compliance, including taxonomy design, labeling instructions, and rubric creation for NLP and CV tasks. Lead RLHF evaluation and prompt evaluation queues, including preference ranking, response grading, and safety checks for LLM training pipelines. Run QA evaluation programs: gold set creation, blind review, inter-annotator agreement tracking, and root-cause analysis of disagreements. Partner with engineering to operationalize labeling tooling, audit trails, and dataset versioning for repeatable production workflows. Triage edge cases (ambiguity, multilingual content, policy conflicts) and update guidelines to improve consistency and throughput. Report weekly on training data quality, defect rates, and model performance improvement signals linked to labeling changes.",{"h2":37,"desc":38},"Required Qualifications","Experience leading data labeling programs for AI\u002FML, with demonstrated ownership of training data quality and QA evaluation. Strong familiarity with RLHF evaluation, prompt evaluation, and large language model evaluation concepts. Hands-on experience with named entity recognition and\u002For computer vision annotation, including guideline development and reviewer calibration. Ability to design quality metrics (accuracy, consistency, coverage) and implement annotation guidelines compliance processes. Clear written communication for policy-driven labeling, including content safety labeling and escalation protocols.",{"h2":40,"desc":41},"Preferred Qualifications","Experience supporting multilingual datasets and locale-specific annotation standards, including Spanish-language evaluation. Familiarity with dataset governance practices: versioning, sampling strategies, and error taxonomy design. Prior work with AI labs, tech startups, BPOs, or annotation vendors delivering production datasets. Exposure to automated QA heuristics, model-assisted labeling, and active learning workflows.",{"h2":43,"desc":44},"Work Setup","Remote role marked Remote, full-time, supporting distributed labeling and evaluation operations. You will collaborate with cross-functional stakeholders across engineering, research, and quality teams, using structured queues and documented rubrics to manage throughput and accuracy. This job is aligned with senior data labeling jobs Madrid search intent while remaining remote and available through Rex.zone.",{"h2":46,"desc":47},"How to Apply on Rex.zone","Apply through Rex.zone by submitting your resume and a short overview of the labeling programs you have led, including QA evaluation methods, guideline examples, and any RLHF evaluation or prompt evaluation work. If applicable, include brief summaries of named entity recognition, computer vision annotation, and content safety labeling projects, along with metrics that demonstrate training data quality and model performance improvement.","AI Data Operations"]