Data Collection & Analysis
Evaluation is the key to program improvement
Inherent in Project IDEAL’s experimental approach to implementing and maintaining distance learning programs is the need for ongoing evaluation of distance learning programs and student progress. Project IDEAL helps member states identify the specific issues they wish to evaluate and create mechanisms to allow them to gather the necessary data. We work with states to collect and analyze the data and provide assistance with reporting writing.
States measure program success with indicators such as contact hours, persistence and achievement. In addition, qualitative data can provide additional insights into best practices in distance education. At the Support Center, we aggregate and analyze data across member states to yield a more comprehensive picture of distance learning nationwide. Project IDEAL encourages member states to use annual data as a key component of planning for future improvement and growth of their distance programs.
Distance Student Tracker
The Support Center, working closely with member states, developed a key accountability measure: "Proxy Contact Hours” as a way to quantify contact hours for students working at a distance. (The concept and ways to measure student "seat time" are described in Measuring Contact Hours and Educational Progress in Distance Education Programs.) The Distance Student Tracker is an online gradebook that distance teachers can use to record student work. The Tracker calculates the appropriate proxy hours, based on clearly defined formulas. Member states using the Distance Student Tracker receive monthly data reports from the Project IDEAL Support Center that can be used to monitor distance education within the state.
Learner Intake Survey
Not every adult is suited to study at a distance. This online survey is completed jointly by an adult who is considering studying at a distance and a distance learning teacher. The questions serve as talking points, helping the teacher explore with learners whether they have the tools, discipline and support to study on their own. As part of a larger data collection effort, the results can be linked with subsequent learner performance data to provide insights into the characteristics of successful distance learners.
Learner Satisfaction Survey
This end-of-program survey assesses learners' satisfaction with the program. It examines the type of course students took, communication with their distance teacher, the ease of tasks associated with distance learning, learning from the course and preference for distance or classroom based courses. Results are summarized for each center and each state to use in evaluating their program.
Teacher Survey
This end-of-year survey assesses teachers' reactions to their state's distance program and asks them to identify areas needing improvement. Teachers respond to questions about recruiting and supporting distance learners, professional development, curricula, and other important distance education issues. Results are summarized for each state for its annual program review.
Custom Surveys & Focus Groups
When states try out a new approach to program delivery the Center works with them to develop a custom survey or a series of focus groups tailored to the innovation to assess how well it is working and to identify areas for improvement.
Aggregate Data Analysis
In addition to working with individual states to collect and analyze their data, the Center also aggregates and analyzes data across states to yield a more comprehensive picture of distance learning nationwide. This helps member states look at their distance education programs from a wider perspective.
