OE-004 Outcome Evaluation
Using pre and post surveys
A practical guide for youth workers on designing, running and interpreting pre and post surveys responsibly, with ethics and plain reporting tips.
Entry checked on
Q.A facilitator holding two stacks of survey papers, one labeled before and one after, in a classroom.
What are pre and post surveys actually measuring?
A pre and post survey asks participants the same or closely matched questions before a program or session and again afterwards. The difference between the two sets of answers is used as a signal of change in knowledge, attitudes, confidence or reported behavior. That signal is only as good as the questions, the timing and the honesty of the answers.
It helps to be clear about what you are not measuring. A single pre and post pair rarely proves that your program caused a change. Young people grow, attend school, talk to friends and face many influences between your first and second survey. Treat the results as one useful piece of evidence, not a verdict.
This matters because positive youth development work is meant to recognize and build on young people's strengths, not to sort them into winners and losers (youth.gov). Surveys should serve that same purpose.
How should you decide what to ask?
Start from your program's goals, then ask only what you can act on. If your goal is that participants leave able to name three trusted adults, ask exactly that. If your goal is confidence in a skill, ask about confidence in that skill.
A short decision checklist can keep you from over-collecting:
| Question to ask yourself | If yes | If no |
|---|---|---|
| Does this item connect to a stated program goal? | Keep it | Drop it or rewrite the goal |
| Could we change our program based on the answer? | Keep it | Consider dropping it |
| Is the wording clear to a 13 year old? | Pilot it | Simplify before use |
| Does the item risk labeling or shaming youth? | Reframe it | Keep it |
| Do we have a plan for storing answers safely? | Proceed | Pause collection |
| Do we know who will see the results? | Proceed | Decide first |
Use the same wording at both points, unless you are deliberately testing comprehension. Changing wording between pre and post makes the comparison hard to defend. If you need to compare across groups, keep the core items identical.
When and where should you collect responses?
Collect the pre survey before any program content begins, ideally in the same setting where the program will run. Collect the post survey as close to the end as possible, while the experience is fresh.
The setting shapes the answers. A young person filling out a form at a table surrounded by peers may answer differently than one completing it privately. Decide deliberately. Anonymity often improves honesty, but it blocks you from matching individual pre and post responses. A coded identifier, chosen by the participant and not derived from personal details, can allow matching while protecting identity.
Avoid collecting surveys during high-energy activities or at the very end of a session when everyone is packing up. Give clear instructions and time to think. Explain that participation is voluntary and that not answering will not affect their place in the program.
How do you interpret the results without overclaiming?
Look at the pattern, not the drama. Report how many people answered, what changed on average, and which items moved most. Percentages are usually easier for non-specialist audiences than long scales.
Be cautious with small groups. Ten responses can suggest a direction, but they cannot support confident claims. If a change is small or mixed, say so. A program that reports no change honestly is more trustworthy than one that inflates a result.
Keep the improvement purpose front of mind: ask what you will change next cycle, not only whether the number went up.
Also watch for ceiling effects. If most participants already rated themselves highly before the program, there is little room to show change. In that case, consider asking about specific behaviors or scenarios instead of broad confidence.
What ethical issues need attention?
Informed consent, assent for minors, and clear data protection are baseline requirements. Check your organization's current policies and any applicable official guidance before collecting data, especially if you work with minors or sensitive topics. This article is not legal or clinical advice, and requirements vary by setting and jurisdiction.
Other practical ethics questions:
- Who sees the raw answers, and how long are they stored?
- Will participants ever be identifiable in reports?
- Could a question cause distress, and who would respond if it did?
- Are you collecting more than you need?
- Will you share results back with participants?
Sharing findings back with youth is often overlooked. It treats them as partners rather than subjects, which aligns with positive youth development principles (youth.gov). For related guidance, see our article on ethical considerations in evaluating youth.
How can you use the findings to improve the program?
Turn results into decisions. If confidence in a skill rose but reported use of the skill did not, the gap itself is useful information. Perhaps the practice was too short, or the setting did not support using the skill.
A simple improvement loop works well:
- Review the pre and post results with the delivery team.
- Identify one or two items with the weakest movement.
- Choose one change to test next cycle.
- Keep the survey items stable so the next comparison is meaningful.
- Report the change and the result to stakeholders.
When reporting, keep names and small-group details out. Combine items into short themes. Our guide on reporting evaluation results to stakeholders covers formats that work for funders, families and partners.
If you are building a wider measurement plan, see choosing outcome indicators for youth programs and pair surveys with other methods such as collecting feedback from youth participants.
What are the common mistakes to avoid?
- Writing leading questions such as "How much did you enjoy this amazing program?"
- Asking too many items and losing attention.
- Changing wording between pre and post.
- Collecting data with no plan for using it.
- Reporting results publicly with identifiable details.
- Treating a small, self-reported change as proof of long-term impact.
Pre and post surveys are a modest, practical tool. Used with clear goals, fair wording, informed consent and honest reporting, they help youth programs learn and improve. Used carelessly, they waste young people's time and can mislead the people funding the work. The difference is mostly in the planning, not the statistics.
Before you launch, check current official guidance on data protection and evaluation practice in your context, and adapt the checklist here to your setting.
