AI quality and evaluation analyst
Before a system goes live it sits a test on the client’s own calls or files, and it goes live only if it passes. You build those tests, run them, and write up what failed and why.
The work
- Build test sets from a client’s past calls, messages or documents.
- Run a system against them and score the results against the agreed pass mark.
- Make test calls and read transcripts, and record each miss with its cause.
- Rerun the same test after every change, and report whether it got better or worse.
What you bring
- Careful, repeatable work, and notes someone else can follow.
- Comfort with spreadsheets; some scripting helps.
- Honesty about results: a miss is reported, not explained away.
How the contract works
- A written scope
- Every project starts from a written scope: what is to be delivered and by when.
- Your rate, by the hour
- You are paid by the hour at a rate agreed before you start, and you invoice for the hours worked.
- Your own business
- You are an independent contractor. You use your own tools, decide how the work gets done, and look after your own taxes.
- Project by project
- A contract covers one project. It is not a promise of further work, and you are free to work for others.
- Client data stays put
- Work happens in the client’s own accounts, with the least access the task needs, under a confidentiality agreement.