Senior Efficacy Research and Psychometrics Analyst, Khan Kids (24 months fixed-term)

Accountabilities:: Serve as the primary technical point of contact for external psychometric research partners, supporting study design, data sharing, analysis, and interpretation. Extract, clean, validate, and securely share assessment data with research partners on recurring schedules. Analyze psychometric findings, including item difficulty, score distributions, growth analyses, concurrent validity, and Item Response Theory (IRT)-based scoring. Translate research findings into actionable product improvements, including potential changes to scoring models and assessment discontinuation rules. Collaborate with research partners to develop technical documentation, including technical manuals for assessments. Recruit and onboard school and district research sites, execute MOUs, align on consent and participant incentive procedures, and coordinate site visits for direct child assessment data collection. Partner with legal and external organizations to develop and negotiate data-sharing agreements involving pseudonymized and identified data. Coordinate participation in ongoing efficacy studies and contribute to the design and planning of future research initiatives. Own and maintain the product KPI dashboard in partnership with engineering, including integrations with App Store Connect and Google Play Console. Ensure analytics dashboards remain useful for marketing, school partnerships, philanthropy, and other internal teams. Lead recurring app performance reporting, including monthly and quarterly business reviews and periodic target-setting activities. Respond to ad hoc data requests by developing SQL queries and analyses to support initiatives such as district outreach and grant reporting. Coordinate multiple external partners, recurring deliverables, data-sharing schedules, and research activities while maintaining strong attention to detail. Requirements: Advanced degree, such as a PhD or Master’s, in psychometrics, educational measurement, quantitative methods, or a related discipline, or equivalent applied experience. Strong knowledge of psychometric methods, including item analysis, reliability and validity evidence, growth modeling, and Item Response Theory (IRT). Proficiency with SQL and a statistical programming language such as R or Python for data extraction, cleaning, analysis, and visualization. Experience with, or willingness to learn, business intelligence tools such as Looker, along with experience building dashboards and data pipelines. Familiarity with responsible data-sharing practices in education research, including student privacy considerations such as FERPA and COPPA and the use of pseudonymized or deidentified data. Strong ability to communicate complex quantitative and psychometric findings clearly to technical and non-technical audiences, including product teams, funders, and school partners. Excellent project management and organizational skills, with the ability to coordinate external partners, research activities, recurring deliverables, and multiple priorities. Strong analytical thinking, attention to detail, and commitment to data quality and research rigor. Demonstrated cross-cultural competency, self-awareness, and ability to contribute to inclusive and collaborative working environments. Ability to translate research evidence into practical recommendations that influence product or program decisions. Strong interest in using data, research, and technology to improve learning outcomes for young children. Experience with early childhood education or assessment of young learners is a plus. Experience designing quasi-experimental studies in school or program settings is advantageous. Experience with Spanish-language assessment or dual-language learner measurement is a plus. Benefits: $137,871–$155,105 USD annual compensation range for candidates based in the United States. $186,306–$209,595 CAD annual compensation range for candidates based in Canada. Competitive total rewards package, with compensation based on relevant skills, experience, qualifications, internal equity, and market data. Remote-first culture with flexibility designed to accommodate different time zones. Generous paid time off and 8 pre-scheduled Wellness Days in 2026. Generous parental leave. 401(k) plan with 4% employer matching. Comprehensive medical, dental, vision, and life insurance. Opportunities to participate in affinity, ally, and social groups. Wellness and professional growth and development programs. Opportunity to contribute quantitative and research expertise to high-impact education products used by children, families, and educators. Collaboration with interdisciplinary teams spanning research, product, engineering, design, and education. 24-month fixed-term opportunity focused on psychometrics, efficacy research, analytics, and evidence-based product improvement.