Senior AI Data Annotation Jobs in Miami

Senior AI data annotation jobs in Miami focus on expert data labeling and large language model evaluation that directly improves training data quality, annotation guidelines compliance, and model performance improvement. At Rex.zone, you will support AI/ML training workflows across RLHF, prompt evaluation, QA evaluation, and content safety labeling, partnering with AI labs, tech startups, and annotation vendors. This remote, full-time role emphasizes rigorous rubric-based judgment, dataset curation, and end-to-end LLM training pipelines, including NLP and computer vision annotation where needed. If you are seeking remote senior roles tied to real-world production model development, explore and apply through Rex.zone.

Senior AI Data Annotation Jobs in Miami

About the Role

You will deliver high-precision annotations and evaluations for AI/ML systems, with a focus on large language model evaluation and RLHF-style preference judgments. Work includes applying detailed rubrics, resolving ambiguous edge cases, writing clear rationales, and auditing training data quality to reduce label noise. You will support production LLM training pipelines by improving annotation guidelines compliance, identifying failure modes, and partnering with QA to drive model performance improvement.

What You Will Do

Core workflows include: (1) Perform data labeling for NLP tasks such as named entity recognition, classification, summarization quality checks, and instruction-following evaluation, (2) Conduct RLHF evaluations including pairwise ranking, preference labeling, and feedback rationales, (3) Execute prompt evaluation and QA evaluation for helpfulness, correctness, and policy adherence, (4) Run content safety labeling for sensitive content, toxicity, and policy violations, (5) Contribute to dataset curation by flagging low-quality sources, duplicates, and leakage risks, (6) Validate annotation guidelines compliance and propose rubric improvements based on recurring errors, (7) Collaborate with cross-functional teams to align labeling targets with model training objectives.

Domains You May Support

Projects may span: NLP evaluation, LLM instruction tuning support, retrieval-augmented generation checks, content safety labeling, multilingual evaluation, and computer vision annotation (bounding boxes, segmentation, attribute tagging) when required. You may also support prompt-response grading for factuality, groundedness, hallucination detection, and style/format adherence.

Requirements

You should have mid-senior experience in data annotation or AI evaluation, strong attention to detail, and the ability to apply consistent judgments under complex rubrics. Familiarity with RLHF concepts, prompt evaluation, training data quality practices, and QA evaluation methods is expected. You must communicate clearly in written form, document edge cases, and maintain high throughput without sacrificing accuracy.

Preferred Qualifications

Experience with LLM evaluation rubrics, policy-based content safety labeling, and dataset curation for instruction tuning. Exposure to named entity recognition guidelines, ambiguity resolution, inter-annotator agreement, and calibration sessions. Familiarity with computer vision annotation tools or multimodal evaluation is a plus.

How Success Is Measured

Success metrics include annotation accuracy, consistency (agreement and calibration), adherence to annotation guidelines compliance, quality of rationales, speed with sustained training data quality, and contributions that measurably support model performance improvement in downstream evaluations.

Remote Work and Collaboration

This is a Remote, FULL_TIME role based in the US market and aligned with Miami talent demand. You will collaborate asynchronously with reviewers, QA, and project leads, participate in calibration sessions, and follow secure data handling requirements.

Apply via Rex.zone

To explore this Senior AI Data Annotation role and related remote, contract, freelance, entry-level, and senior opportunities across NLP, computer vision, content safety, and LLM training pipelines, apply through Rex.zone and keep your profile updated with relevant evaluation and data labeling experience.

Frequently Asked Questions

Q: What does a senior AI data annotation professional do day to day?
Daily work includes data labeling and QA evaluation using strict rubrics, RLHF preference judgments, prompt evaluation, content safety labeling, and training data quality audits. You may also document edge cases, suggest rubric updates, and support dataset curation for LLM training pipelines.
Q: Is this role remote even though it targets Miami?
Yes. The Remote Type is Remote. The Miami modifier reflects hiring demand and search intent, while the work is performed remotely within the US context.
Q: What skills best match senior AI data annotation jobs in Miami?
Keyword-aligned skills include AI data annotation, data labeling, RLHF, LLM evaluation, prompt evaluation, QA evaluation, training data quality, annotation guidelines compliance, named entity recognition, content safety labeling, computer vision annotation, and dataset curation.
Q: What kinds of AI teams hire for these roles through Rex.zone?
Common employer types include AI labs, tech startups, enterprise AI teams, BPOs, and annotation vendors running large-scale LLM training pipelines and evaluation programs.
Q: Do I need prior RLHF experience?
It is strongly preferred for senior roles. If you have related experience in rubric-based evaluation, pairwise ranking, or high-stakes QA evaluation, you can often ramp into RLHF workflows through calibration and guideline training.
Q: What is included in the compensation range?
The listed salary range is USD 63360 to USD 126720 per YEAR for this FULL_TIME role. Specific offers depend on experience level, evaluation complexity, and performance expectations.

230+Domains Covered

120K+PhD, Specialist, Experts Onboarded

50+Countries Represented

Industry-Leading Compensation

We believe exceptional intelligence deserves exceptional pay. Our platform consistently offers rates above the industry average, rewarding experts for their true value and real impact on frontier AI. Here, your expertise isn't just appreciated - it's properly compensated.

Work Remotely, Work Freely

No office. No commute. No constraints. Our fully remote workflow gives experts complete flexibility to work at their own pace, from any country, any time zone. You focus on meaningful tasks - we handle the rest.

Respect at the Core of Everything

AI trainers are the heart of our company. We treat every expert with trust, humanity, and genuine appreciation. From personalized support to transparent communication, we build long-term relationships rooted in respect and care.

Ready to Shape the Future of AI Data Operations?

Apply Now.