RN Clinical Data Annotation Specialist

Accountabilities: Evaluate AI-generated clinical interactions: Review recorded and simulated conversations across a range of healthcare scenarios, applying clinical judgment to assess response accuracy, safety, appropriateness, and relevance. Annotate and score performance: Use structured evaluation rubrics to assess AI responses against evidence-based protocols, clinical practice guidelines, and established quality standards. Identify safety risks: Detect potentially harmful recommendations, clinical inaccuracies, inappropriate guidance, edge cases, and weaknesses in clinical reasoning. Provide actionable feedback: Document clear, detailed, and constructive written feedback to help clinical and product teams improve AI agent performance. Support continuous improvement: Contribute clinical insights that strengthen the reliability and quality of AI-driven healthcare interactions. Participate in reviewer calibration: Join periodic calibration sessions with other clinical reviewers to maintain consistent interpretation of evaluation criteria and annotation standards. Maintain quality and productivity: Work independently, pay close attention to detail, and complete reviews within expected turnaround times. Requirements Active nursing license: Hold an active, unrestricted Registered Nurse (RN) license in the United States. A multistate compact license is preferred. Clinical experience: Have at least five years of hands-on clinical experience in areas such as bedside nursing, case management, clinical quality, utilization review, clinical nurse education, or a comparable role. Strong clinical judgment: Demonstrate the ability to assess clinical scenarios, identify potential risks, and apply evidence-based protocols and established practice guidelines. Review and evaluation skills: Be comfortable reviewing written transcripts, assessing clinical content, and applying structured scoring rubrics consistently. Attention to detail: Accurately identify discrepancies, safety concerns, and subtle issues in clinical recommendations and documentation. Written communication: Communicate clinical findings, corrections, and recommendations clearly and concisely in writing. Independent work style: Be organized, self-directed, and able to meet deadlines and expected turnaround times in a remote working environment. Preferred experience: Experience in clinical quality assurance, utilization review, or case review is an advantage. Documentation expertise: Familiarity with chart audits or clinical documentation review is beneficial. Digital health familiarity: Experience with AI-assisted clinical tools or digital health platforms is a plus, but not required. Benefits Remote flexibility: Work fully remotely from the United States. Flexible scheduling: Arrange your schedule flexibly within the expected commitment of 20–40 hours per week. Contract engagement: Work on a 1099 independent contractor basis. Hourly compensation: Receive hourly pay commensurate with your experience. Meaningful clinical impact: Apply your nursing expertise to help improve the safety and quality of AI-driven clinical interactions. Healthcare innovation: Gain exposure to the evolving intersection of clinical practice, artificial intelligence, and digital health. Collaborative environment: Work with clinical reviewers and product teams to help refine technology designed to support healthcare delivery.