Efficacy Portfolio
Short Answer is committed to measuring and sharing our product’s efficacy. The portfolio below reflects our efforts to continually understand how, why, and if our product is improving learning. We believe a portfolio best captures Short Answer’s efficacy as our product continues to grow and develop. Taken together, we believe this collection below speaks to Short Answer’s ESSA Tier 4 Evidence of efficacy. Click each icon at left to view each portfolio item.
1. Theory of Change
Short Answer grew from our cofounder’s masters capstone work in the Learning Design and Technology (LDT) program at The Stanford Graduate School of Education during the 2021-2022 school year. It was in LDT that Short Answer first developed our theory of change. Our theory of change outlines how and why the specific interventions used within our platform are expected to lead to desired learning outcomes in an educational setting, including the research supporting those interventions.
2. Initial Learner Study
In the late summer and fall of the 2022-2023 school year, Short Answer conducted an initial survey and pilot with 20 teachers across the United States. This learner study included interviews with teachers and surveys of teachers and students. Amongst other findings, 81.9% of students surveyed indicated that Short Answer had a positive impact on their understanding of content.
3. 2023-2024 Educator Experience Case Study
This case study was our effort to understand how users experienced Short Answer over the course of the ‘23-’24 school year in the United States. A mixed-methods approach combined user interviews, net promoter score (NPS) surveys, and an end-of-year educator experience survey to assess Short Answer’s effectiveness. Key findings revealed that Short Answer fosters critical thinking and engagement and has had a positive reception from educators, evidenced by an average NPS of 82. Interface issues and time constraints were also noted. The study concludes with recommendations for further development of Short Answer.
4. 2024-2025 Educator Experience Case Study
This case study was our effort to understand how teachers experienced Short Answer during the ‘24-’25 school year in the United States. Teacher interviews, net promoter score (NPS) surveys, and an end-of-year educator experience survey were compared to assess Short Answer’s effectiveness. Key findings include that Shrot Answer led to increased student engagement, greater use of peer and feedback-driven writing practice, and improved writing across multiple subject areas. Several areas for growth were also noted.
