Surveys are a great method for hearing directly from learners about what they think and how they’re finding things. With adult learners, who often come from all sorts of backgrounds and have different reasons for learning, it’s important to tailor your surveys.
Whilst the Programme’s Running
Introduce some short, snappy surveys at key points, like after the first module or halfway through the course. These little “pulse checks” can flag up problems early doors, meaning you can sort things out quickly. Ask about how clear the content is, if it’s easy to get around, if they’re enjoying the activities, and if any tech issues are popping up. Mix up your questions:
Likert scales
Questions such as “On a scale of 1-5, how clear was this lesson?” are great for getting a measurable sense of satisfaction.
Open-ended questions
Questions such as “What was most helpful about this module?” or “What challenges did you face?” can give you deeper, qualitative insights.
Quick polls
You can use quick polls embedded within modules to check understanding or preferences on specific topics.
Once the Programme’s Finished
A full end-of-programme survey gives you the whole picture. Focus on whether the programme actually helped them achieve their learning goals, the quality of their learning and the support they received, if the content was relevant to their work or personal life, and what the overall learning environment was like.
Encourage honest feedback – enable it to be anonymous if that helps. Ask about:
- What they actually learned: Did they get what they came for?
- Content relevance and real-world use: Can they actually use what they’ve learned?
It is important to gain a deep understanding of how the learners are doing and any barriers to their learning to create and maintain the quality of programmes. It’s not enough to take what they say at face value, but to compare their responses with what other data reveal.
Unpacking Participation Data
Participation isn’t just about logging in; it’s about active engagement. Delving into this data can tell you a lot about the health of your programme.
| What to Look For: | How to Act on It: |
| Login Frequency and Patterns: Are learners logging in regularly, or are there long gaps? A sudden drop-off could indicate a challenging module, a technical glitch, or waning motivation. Irregular patterns might suggest that the content isn’t fitting well with busy adult lives. Forum and Discussion Board Activity: Don’t just count posts; analyse the quality and depth of interactions. Are discussions rich and collaborative, or are learners just posting the minimum to tick a box? High-quality engagement suggests stimulating prompts and a supportive environment. Low engagement might point to poor discussion prompts, lack of moderation, or learners feeling shy. Resource Access: Which materials are learners viewing or downloading the most? And conversely, which are hardly touched? If a key reading or video is consistently ignored, perhaps it’s not well-integrated, easily found, or perceived as valuable. Activity Submission Rates: Are learners attempting optional activities? What about mandatory ones? A dip in submission rates for particular assignments might signal a lack of clarity in instructions, overwhelming workload, or content that’s too difficult. | If engagement is low: Re-evaluate discussion prompts – make them more open-ended and relevant to real-world problems. Consider varying activity types to cater to different learning styles. Introduce more collaborative tasks. If certain resources are ignored: Promote them more effectively, integrate them directly into activities, or reconsider their necessity. If login patterns are sporadic, offer more flexible deadlines or break down content into smaller, more manageable chunks. |
Deciphering Completion Rates
Completion rates are often seen as the ultimate measure of programme success. A high completion rate suggests learners found the programme valuable and achievable.
| What to Look For: | How to Act on It: |
| Overall Completion Rate: This is your headline figure. While 100% is unrealistic, consistently low rates are a red flag. Module-Specific Drop-Offs: Where are learners quitting? Pinpointing specific modules or points in the programme where completion rates significantly dip is crucial. This often indicates a bottleneck: content that’s too challenging, a confusing assessment, or a sudden increase in workload. Time to Completion: For self-paced programmes, how long are learners taking? Are some rushing through, or others taking an unusually long time? This can highlight issues with pacing or the need for more guidance on time management. | For low overall completion: Re-examine the programme’s value proposition – is it truly meeting learner needs? Is the onboarding clear? Is there enough support? For module-specific drop-offs: Conduct a deep dive into that module’s content, activities, and assessments. Is the prerequisite knowledge clearly established? Is the workload manageable? Are instructions unambiguous? Consider adding extra support materials or a brief “check-in” activity before that module. If pacing is an issue: Provide clearer guidelines on expected time commitments per module or consider breaking down very large modules into smaller units. |
Analysing Assessment Results
Assessments are not just for grading; they’re powerful diagnostic tools for programme improvement.
| What to Look For: | How to Act on It: |
| Common Misconceptions: Are a significant number of learners making the same mistakes on particular assessment questions? This strongly suggests that the content related to that concept isn’t clear enough, needs re-explanation, or perhaps requires different teaching methods. Performance Trends: Are learners consistently performing worse in certain types of assessments (e.g., essays vs. multiple-choice questions)? This could indicate issues with the assessment design itself, or that learners need more support in developing specific skills (e.g., academic writing). Discrepancies Between Confidence and Performance: If surveys show learners feel confident about a topic, but assessment results are poor, there’s a disconnect. This might mean the learning activities aren’t truly reinforcing understanding, or the assessment isn’t accurately measuring what was taught. | Address common errors: Revise content, add supplementary materials (videos, examples), or include more practice opportunities for challenging concepts. Adjust assessment design: If a specific assessment type is problematic, consider alternative methods or provide more scaffolding (e.g., rubrics, example answers). Bridge the confidence-performance gap: Ensure learning activities directly align with assessment criteria and provide opportunities for self-assessment or formative feedback to help learners gauge their true understanding. |
By meticulously analysing these data points, you can move beyond guesswork, pinpointing exactly where your online learning programmes can be refined, leading to a better and more effective experience for adult learners. It is then important that you act upon the monitoring data. to actually make improvements.