Create high-quality, function-level algorithm problems across core data structures and algorithms. Write precise, bilingual (Chinese and English) problem statements; design robust test datasets and validators; perform difficulty grading and quality assessment; and participate in cross-reviews to ensure fairness and scientific rigor. Compensation: USD $120–150 per day, based on skills and experience.
This remote role focuses on designing function-level algorithm challenges that accurately evaluate implementation skill, logical reasoning, and robustness. You will define unambiguous specifications, build comprehensive test suites that include edge and adversarial cases, and author reference solutions and automatic validation logic. Your work will contribute to fair, reliable benchmarking for both human developers and AI-assisted code generation.
• Design and develop algorithm problems at the function level, spanning basic to advanced data structures and algorithms. • Write clear, precise, and bilingual (Chinese and English) problem statements, including exact input/output formats and constraints. • Build comprehensive test datasets with edge cases, extreme scenarios, and adversarial samples to prevent shortcuts and cheating. • Implement reference solutions and automatic validators; assign difficulty levels and assess quality. • Participate in cross-reviews to ensure scientific validity, fairness, and innovation of benchmarks. • Maintain consistency, reproducibility, and documentation for each problem and dataset.
• Demonstrated experience participating in or creating problems for programming competitions (e.g., ACM/ICPC, Codeforces). • Strong algorithms and data structures expertise, with specialization in at least one area (e.g., graph theory, dynamic programming, string algorithms). • Proficiency in Python or C/C++ for efficient algorithm implementations and validator tooling. • Excellent problem abstraction skills: transform vague ideas into unambiguous, testable function-level problems. • Ability to write bilingual (Chinese and English) specifications with consistent terminology and precise constraints.
• Background in Computer Science, Software Engineering, Mathematics, Artificial Intelligence, or similar. • Experience as an Algorithm Engineer or Software R&D Engineer (algorithm-focused) is highly relevant. • Experience evaluating code generation models is a plus, but not mandatory.
• Understanding capability boundaries and common pitfalls of major Code LLMs. • Experience writing algorithm blogs or teaching courses. • Contributions to benchmark design or open-source Online Judge (OJ) systems. • Skill in designing complex problems that rigorously test logical reasoning in AI models.
USD $120–150 per day, commensurate with skills, specialization depth, and demonstrated problem-setting quality. Rates reflect the expected professional standard for algorithm design, bilingual specifications, and robust validation work.
• Remote, with asynchronous collaboration. • Cross-review cadence agreed within the team to ensure timely quality checks. • Deliverables are scoped per assignment to balance depth (problem quality, validator strength) and breadth (coverage across topics).
• Programming: Python, C/C++ (for solutions and validators). • Version control and collaboration: Git-based workflows. • Testing: Unit and property-based testing approaches; deterministic and randomized dataset generation. • Optional: Exposure to OJ platforms, CI pipelines, and static/dynamic analysis tools.
We prioritize scientific rigor, fairness, and reproducibility. Problems must be clearly specified, validators must catch common exploits, and test suites should cover typical, edge, and adversarial cases. Cross-reviews ensure consistency in difficulty grading, correctness, and innovation.
Problems are defined at the function level with precise signatures, constraints, and I/O formats. You author the specification, reference solution, and validators so submissions can be evaluated deterministically and fairly.
Proficiency in Python or C/C++ is required for writing efficient reference solutions and validation logic. Familiarity with both is beneficial.
Yes. Problem statements must be written clearly and consistently in both Chinese and English, including exact I/O formats, constraints, and terminology.
Yes. Experience participating in or creating problems for competitions such as ACM/ICPC or Codeforces is required to ensure appropriate rigor and clarity.
Difficulty is assigned based on algorithmic complexity, implementation depth, and potential pitfalls. Quality is reviewed through cross-reviews, validator robustness, and coverage of typical, edge, and adversarial cases.
A broad range is covered, with specialization in at least one area (e.g., graph theory, dynamic programming, string algorithms). Additional topics like greedy, combinatorics, geometry, and data structure design are commonly included.
Not required. It is a plus if you understand capability boundaries and common pitfalls of major Code LLMs, especially for designing robust anti-cheating validators.
USD $120–150 per day, determined by proven expertise, specialization depth, and the quality of problem design, bilingual specifications, and validation logic.
'%20stroke-width='1.1184'/%3e%3cline%20x1='13.9799'%20y1='14.5392'%20x2='13.9799'%20y2='0.000106738'%20stroke='url(%23paint1_linear_5108_6545)'%20stroke-width='1.1184'/%3e%3cline%20y1='-0.559198'%20x2='29.0783'%20y2='-0.559198'%20transform='matrix(-1%208.74228e-08%208.74228e-08%201%2029.0781%20136.539)'%20stroke='url(%23paint2_linear_5108_6545)'%20stroke-width='1.1184'/%3e%3cline%20y1='-0.559198'%20x2='14.5391'%20y2='-0.559198'%20transform='matrix(1.31134e-07%201%201%20-1.31134e-07%2014.5391%20122)'%20stroke='url(%23paint3_linear_5108_6545)'%20stroke-width='1.1184'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5108_6545'%20x1='29.0781'%20y1='-0.499878'%20x2='-0.000152544'%20y2='-0.49988'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%23666666'/%3e%3cstop%20offset='0.336538'%20stop-color='white'/%3e%3cstop%20offset='0.495192'%20stop-color='white'/%3e%3cstop%20offset='0.653846'%20stop-color='white'/%3e%3cstop%20offset='1'%20stop-color='%23666666'/%3e%3c/linearGradient%3e%3clinearGradient%20id='paint1_linear_5108_6545'%20x1='15.0391'%20y1='14.5392'%20x2='15.0391'%20y2='0.000106877'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%23585858'/%3e%3cstop%20offset='0.745192'%20stop-color='white'/%3e%3cstop%20offset='1'%20stop-color='white'/%3e%3c/linearGradient%3e%3clinearGradient%20id='paint2_linear_5108_6545'%20x1='0'%20y1='0.5'%20x2='29.0783'%20y2='0.5'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%23666666'/%3e%3cstop%20offset='0.336538'%20stop-color='white'/%3e%3cstop%20offset='0.495192'%20stop-color='white'/%3e%3cstop%20offset='0.653846'%20stop-color='white'/%3e%3cstop%20offset='1'%20stop-color='%23666666'/%3e%3c/linearGradient%3e%3clinearGradient%20id='paint3_linear_5108_6545'%20x1='0'%20y1='0.5'%20x2='14.5391'%20y2='0.5'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%23585858'/%3e%3cstop%20offset='0.745192'%20stop-color='white'/%3e%3cstop%20offset='1'%20stop-color='white'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e)
We believe exceptional intelligence deserves exceptional pay. Our platform consistently offers rates above the industry average, rewarding experts for their true value and real impact on frontier AI. Here, your expertise isn’t just appreciated—it's properly compensated.
No office. No commute. No constraints. Our fully remote workflow gives experts complete flexibility to work at their own pace, from any country, any time zone. You focus on meaningful tasks—we handle the rest.
AI trainers are the heart of our company. We treat every expert with trust, humanity, and genuine appreciation. From personalized support to transparent communication, we build long-term relationships rooted in respect and care.
Ready to shape the future of code annotation?
Apple below.