The mission
Build the evidence loop that shows how Kai performs on real calls and what must improve next.
What you will own
- Sample and review real calls under privacy rules.
- Maintain rubrics for accuracy, intent capture, latency, tone, transfer, consent, and outcome.
- Distinguish genuine business intent from demos and test traffic.
- Report failure clusters and partner with engineering on remediation.
What success looks like
- Representative weekly evaluation sets span verticals and languages.
- Reviewers calibrate consistently on the same calls.
- Serious complaints receive source, transcript, audio, and metadata review.
- Evaluation findings produce measurable product improvements.
What we are looking for
- Exceptional listening and analytical judgment.
- Experience in QA, conversation review, trust and safety, or applied AI evaluation.
- Evidence-backed writing and careful handling of sensitive data.
- Comfort working with imperfect data.
Helpful, not mandatory
- Professional Spanish.
- Contact-center QA.
- Speech or LLM evaluation.
- Basic data analysis.
Compensation
The base salary range is $70,000-$100,000 USD for a US-remote employee. Final compensation will reflect role level, location policy, experience, benefits, variable compensation where applicable, and equity. Contractor arrangements are scoped separately.
How we evaluate
We use the same core evidence for every candidate: comparable outcomes, ownership, customer judgment, role skill, communication, and learning velocity. The process normally includes a short screen, a paid and bounded work sample, structured interviews, and reference checks.
Example paid work sample: Score five redacted calls, identify rubric weaknesses, separate real intent from test traffic, and recommend one product change.
Your first 90 days
- First 30 days: Calibrate against known good and bad calls.
- By 60 days: Run the weekly evaluation program.
- By 90 days: Demonstrate one meaningful quality improvement tied to the evidence.
How to apply
Email kai@kaicalls.com with the role title in the subject line. Include your resume or LinkedIn profile.