Pulse Checks: A Tool to Fuel Rapid Learning

When the pandemic hit, youth organizations reimagined programs to deliver on our missions. In the case of Boys & Girls Club, we pivoted from a 3-hour, 5 day a week in-person model to 1-hour virtual classes 4 days a week. Our goals were were the same — foster strong relationships, create a sense of belonging, and provide quality social, emotional, and academical support.

But how would we know virtual classes were delivering results, when we had no track record of running programs online? Past data around the quality of in-person programs was irrelevant.

We needed a way to learn, and fast. Enter the pulse check.

Since we were trying something new, we didn’t want to wait 8 or 12 weeks to gather survey data via our usual comprehensive student survey. Our Impact & Evaluation and Program teams collaborated to create a short 3-item survey that was easily deployed using Google Forms to collect information from students during virtual classes once a week. Two questions were asked every week, and a third question varied from week to week to give a chance to show progress or change over time.

As a result of pulse checks, we can confidently say:

• 96% of students enjoy virtual classes
• 83% of students use what they learn in school