AI Trainer Jobs in Brazil
About The Role As an AI Trainer, you will improve large language models by producing high-quality training signals through data labeling, RLHF preference rankings, and rubric-based evaluations. You will support end-to-end LLM training pipelines with consistent, well-documented decisions that improve instruction following, reasoning quality, and content safety outcomes.
What You Will Do
- Perform data labeling for NLP tasks (intent classification, summarization checks, factuality review, named entity recognition)
- Execute RLHF work: pairwise ranking, rubric-based scoring, and short rationales
- Conduct prompt evaluation and response quality scoring using detailed rubrics
- Run QA evaluation, track error categories, and contribute to guideline updates
- Support content safety labeling for policy-sensitive topics
- Collaborate with engineering partners on edge cases, sampling strategies, and quality thresholds
Core Workstreams
- LLM evaluation (instruction following, reasoning quality, refusal behavior)
- Training data quality audits (spot checks, adjudication, gold set creation)
- Annotation operations (calibration sessions, reviewer alignment)
- Occasional multimodal evaluation or computer vision annotation when required
Qualifications
- Mid-senior experience in data operations, evaluation, QA, or applied AI workflows
- Strong written communication and ability to produce consistent decision rationales
- Attention to detail with rubric-based scoring and annotation guidelines compliance
- Familiarity with NLP concepts, LLM behavior, and training data quality practices
Employment Details Remote, full-time role with Rex.zone. Compensation: $30–$50 per hour (USD), depending on scope and assignment. How To Apply Apply on Rex.zone via the AI Trainer jobs in Brazil page. Apply To This Job