AI Trainer
Role: AI Trainer
Measures the ability to review AI model outputs, spot factual and logical errors, apply rubrics consistently and communicate clear technical feedback. Suited for AI trainer, senior annotator and model quality evaluator roles.
Sample questions
Taken from the template itself. Questions with a recorded answer key are left out, so reading this page cannot help anyone pass the test.
As the candidate sees it
AI Trainer
- 1.Short text
What is the name of the technique in which humans compare or rate model responses to produce a reward signal used to fine-tune that model?
Answer with the name or the acronym.
- 2.Short text
Which statistic is commonly used to measure agreement between two annotators while accounting for agreement expected by chance?
- Shown once you copy the template
- Shown once you copy the template
- Shown once you copy the template
6 more questions in the full template.
How this template was made, and what you can check
Are these the real questions?
Yes. The questions on this page are the questions a candidate gets. They are not samples written for the site: they come from the template itself, word for word.
Why are some questions missing from this page?
Any question with a recorded answer key is left out, so that reading this page cannot help anyone pass. The count of what is missing is shown; the questions themselves appear once you copy the template.
Which language does the candidate see?
Every template exists in English and Portuguese. The candidate answers in theirs and you read in yours.
Will this template work on my plan?
Question types are checked against your plan by the database itself, so a template never promises a type your plan cannot run. Building assessments and collecting answers is free; automatic scoring starts on the Starter plan.
Can I change the questions?
Once you copy it, the template is yours: change the wording, drop a question, add your own. None of this is fixed.
How fast can I send it?
Create a free account, copy the template and share the link. The candidate opens it in the browser, with nothing to install.
Use this template on your next opening
Copy the template, change what you want, send a link. Assessly marks each answer, scores it and explains the score.
What comes back to you
Short text
What is the name of the technique in which humans compare or rate model responses to produce a reward signal used to fine-tune that model?
Answer
Score
Why this score
The question is real. The answer and the score are drawn as an example of what a review looks like.