Government Subject Matter Expert (SME) - AI Model Evaluation

Accountabilities: Evaluate AI-generated responses to complex government-related scenarios, assessing accuracy, completeness, reasoning quality, and compliance with relevant regulations and policies. Apply specialized professional knowledge to determine whether AI-generated conclusions are appropriate, defensible, and supported by authoritative sources. Identify inaccurate interpretations, flawed assumptions, missing information, inconsistencies, unsupported conclusions, and potential regulatory or compliance risks. Research and validate findings against applicable federal, state, and local statutes, regulations, agency guidance, policies, and professional standards. Develop and refine evaluation benchmarks, reference responses, assessment criteria, and examples of sound professional reasoning. Provide clear, actionable feedback explaining identified issues and recommending improvements to AI-generated content. Follow project-specific evaluation guidelines and participate in quality reviews to promote consistency, reliability, and accuracy. Contribute expertise in one or more specialized areas, including government policy, public records, privacy compliance, program eligibility, administrative decision-making, procurement, contracting, and vendor evaluation. Requirements: At least 2 years of relevant professional experience in government operations, public administration, regulatory compliance, government procurement, or a closely related field. Demonstrated subject matter expertise in at least one relevant specialization, such as government policy, public records and disclosure requirements, privacy protection, government programs and eligibility, procurement, contracts, or vendor evaluation. Experience interpreting, evaluating, auditing, or applying government policies, regulations, administrative requirements, or professional standards. Strong analytical and critical-thinking skills, with the ability to identify errors, assess complex information, and recognize unsupported reasoning. Excellent written communication skills, including the ability to explain complex findings and professional judgments clearly, concisely, and logically. Ability to conduct independent research and verify information using authoritative sources. Strong attention to detail and the ability to apply structured evaluation criteria consistently. Comfort using digital platforms, online research tools, and project-specific evaluation guidelines. Ability to work independently in a remote, project-based environment and meet assignment deadlines. Current U.S. residency and authorization to undertake the relevant independent-contractor engagement. Experience in roles such as government policy or program analyst, regulatory or compliance analyst, government auditor, quality assurance specialist, public records or privacy compliance officer, procurement or contracting specialist, RFP evaluator, eligibility analyst, public-sector consultant, or regulatory advisor is particularly valuable. Previous experience evaluating AI models, working with large language models (LLMs), conducting research, or performing structured quality assessments is beneficial but not required. Willingness to complete a skills-based assessment evaluating subject matter expertise, analytical reasoning, and the ability to follow project guidelines. Benefits: Hourly compensation: USD $35–$40 per hour, depending on relevant experience and project requirements. Remote flexibility: Work from anywhere within the United States. Project-based engagement: Independent-contractor assignments with schedules determined by project needs and deadlines. Meaningful impact: Help improve the accuracy, reliability, and quality of AI-generated information used in complex government-related contexts. Expertise-driven work: Apply your professional knowledge in a new and emerging field without needing a background in AI. Specialized assignments: Opportunities to contribute in areas aligned with your existing government, regulatory, compliance, or procurement expertise. Potential future projects: Additional engagements may become available based on project availability and performance. Flexible scheduling needs: Assignments may require weekday or weekend availability, depending on project requirements. Important engagement details: The initial engagement is a short-term pilot. Working hours, project duration, and future assignments are not guaranteed. Payment is subject to completing assigned work in accordance with project instructions and quality standards. Benefits clarification: This is a project-based independent-contractor opportunity; traditional employee benefits such as health insurance, paid leave, or retirement contributions are not specified.