Lawyers and legal professionals grade AI answers on legal questions: sources, jurisdiction, caveats. 325 tasks are open now, sized for 5 to 15 hours a week.
AI Evaluator: Legal tasks are small enough to fit around a full-time job. Typical examples:
Legal Answer Rating: Rates AI answers on legal questions: accuracy, jurisdiction and caveats.
Citation and Authority Check: Verifies cited cases and statutes actually exist and say what is claimed.
Contract Clause Review by AI: Reviews AI-drafted or AI-summarised clauses for accuracy and risk.
Jurisdiction Sensitivity Test: Tests whether answers change correctly across states or countries.
Legal Prompt Authoring: Writes realistic questions a client or business user might ask a lawyer.
Reference Memo Writing: Writes the model legal answer for grading.
Unauthorised Practice Safety Review: Checks AI handling of advice limits, disclaimers and referral to a lawyer.
At a glance
Levels
Senior, Manager, Director
Formats
AI expert review
Usual tools
client annotation portal, Google Sheets
Also searched as
ai trainer legal, model evaluation lawyer, rlhf legal, legal reasoning
Who does this work
Professionals whose day jobs match this role.
Employment Lawyer
Questions about AI Evaluator: Legal work
How much does a part-time AI Evaluator: Legal earn?
In the United States the typical Deftridge rate for a senior AI Evaluator: Legal is $110 an hour; the median published task rate in dollars is $134. At five hours a week that is about $2,380 a month.
How many hours a week does it take?
Typical load for this role is 5-15 hours a week, about one to two hours on a working day. The platform cap across all your tasks is 15 hours a week.
Do I need a licence or a particular tool?
Usual tools are client annotation portal and Google Sheets. No licence is required.
Which formats are offered?
This role is offered as ai expert review. Pay for each format is shown below, and you choose what suits your week.
This site keeps a few essentials in your browser so it can work. Google Analytics and the Tawk.to chat widget load on every visit; there are no advertising trackers. Details are in the cookie policy.