Efficacy Portfolio
Short Answer is committed to measuring and sharing our product’s efficacy. The portfolio below reflects our efforts to continually understand how, why, and if our product is improving learning. We believe a portfolio best captures Short Answer’s efficacy as our product continues to grow and develop. Taken together, we believe this collection below speaks to Short Answer’s ESSA Tier 4 Evidence of efficacy.
1. Theory of Change
Short Answer grew out of our cofounder’s master’s capstone in Stanford GSE’s Learning Design and Technology (LDT) program during the 2021–2022 school year, where our theory of change was first developed. This theory explains how and why Short Answer’s research-backed interventions are designed to produce meaningful learning outcomes.
2. Initial Learner Study
In late summer and fall of the ’22–’23 school year, Short Answer ran an initial pilot and survey with 20 teachers nationwide, including teacher interviews and teacher and student surveys. Among the findings, 81.9% of students reported that Short Answer positively impacted their understanding of content.
3. 2023-2024 Educator Experience Case Study
This case study examined how educators experienced Short Answer during the ’23–’24 school year using a mixed-methods approach that included interviews, NPS surveys, and an end-of-year experience survey. Findings showed strong educator reception (average NPS of 82) and evidence that Short Answer supports critical thinking and engagement, alongside noted interface and time-constraint challenges, informing recommendations for future development.
4. 2024-2025 Educator Experience Case Study
This case study examined educator experiences with Short Answer during the ’24–’25 school year using a mixed-methods approach that included interviews, in-app NPS surveys, and an end-of-year educator survey. Findings indicate that educators view Short Answer as a highly engaging tool for improving student writing and fostering feedback-rich classrooms, with many reporting increased participation from reluctant writers. At the same time, challenges related to time constraints, grading integration, and revision workflows were identified, informing recommendations for continued product and research development.