Neon Health
AI Quality Engineer
SF Office$93k–$186kfulltimemidAdded 1 month ago
About this role
Monitor and improve the quality of Neon's AI automation agents that handle healthcare workflows by reviewing agent outputs, identifying errors, and providing actionable feedback to enhance performance. This role bridges quality assurance and product improvement in a fast-paced healthcare AI startup.
What you'll do
- Review AI agent call transcripts and recordings to assess performance quality
- Identify, label, and document issues encountered during agent interactions
- Analyze root causes of problems to understand why errors occurred
- Provide detailed improvement recommendations for agent refinement
- Scale quality reviews while maintaining high attention to detail
- Feed insights back to product and engineering teams for continuous improvement
What they're looking for
- Attention to detail
- Problem analysis and root cause investigation
- Quick execution and decision-making
- Technical system understanding
- Communication and documentation
- Critical thinking and rigor
- Adaptability in ambiguous environments
- Healthcare or insurance domain knowledge (preferred)
Benefits
- Mission-driven work improving patient access to life-saving medications
- Early-stage opportunity at a hypergrowth, profitable startup
- Work with experienced founding team and elite VC backing
- Opportunity to directly impact AI quality at scale
- Collaborative environment with experienced engineers
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Neon Health
Neon Health builds AI agent systems that automate healthcare workflows and improve patient access to medications. The company is hiring for systems engineers to develop production AI infrastructure and quality specialists to monitor and improve agent performance.
- Website
- neonhealth.com
Likely interview questions
- Walk us through a time you caught a subtle error or quality issue that others missed. How did you identify it, and what did you do about it?
- Describe your experience reviewing AI or automation outputs. What types of errors have you encountered, and how did you document and communicate them?