Performance Measurement

Windwalker creates award-winning workplace simulations that put users right inside the very environment for which they are being trained. Users complete the training with the required knowledge and skills to immediately apply what they have learned to their work.

Windwalker’s innovative instructional design teams work hand-in-hand with cutting edge programmers and the best in video, audio and graphic arts production to create virtual worlds that are familiar to the user and where navigation is intuitive.
The learning simulations contain complex scoring processes and an online mentor that guides learners through job tasks, provides feedback on performance, and offers encouragement through difficult scenarios.

Windwalker’s clients include federal and state government agencies and private sector organizations. We provide a diverse set of clients with a wide range of evaluation services to meet their needs for evidence of effective and efficient programs and products.

Our evaluation services range from research design and development of data collection instruments to data collection, data analysis, and preparation of reports targeted to both professional and general audiences.
Windwalker uses both quantitative and qualitative research methods. We have made extensive use of survey research as well as case study methodology. We have also worked extensively in the areas of student assessment, training evaluation, and education program evaluation.

Assessment

We have extensive experience in the recruitment of school districts and schools to participate in national student assessment studies. These studies include the National Assessment of Educational Progress (NAEP), the National Indian Education Study, the Trends in International Mathematics and Science Study (TIMSS), and the Early Childhood Longitudinal Study – Kindergarten Cohort (ECLS-K). We have developed training plans and materials and delivered training to field staff to help them recruit districts and schools to participate in national data collection efforts.

Training Evaluation

We have planned and conducted comprehensive evaluations of management training programs for federal government agency managers and supervisors. These evaluations included development of data collection instruments, design of data collection plans, development of data analysis plans, analyses of the data, and preparation of high quality evaluation reports. An example of this work has been our evaluation of the U.S. Geological Survey’s (USGS) Supervisory and Management Development Program. For this evaluation, Winwalker developed pre- and post-surveys of program participants, and their supervisors, co-workers, and staff.

Program Evaluation

For the U.S. Department of Education’s Magnet Schools Program, we conducted extensive analyses of grantee-reported data relating to student academic achievement and minority group isolation. We also provided technical assistance to the magnet school program grantees in rigorous evaluation techniques. This included assistance in experimental design, development of data collection instruments, sampling, random assignment to treatment and control groups, data collection, and data analysis and reporting.

Survey Research

• Large-scale and small-scale survey research
• Survey development
• Database development and management
• Data collection including paper-based, mail, and web-based survey administration
• Data analysis using quantitative and qualitative statistical software
• Results interpretation and reporting

National Data Collection Efforts

• Recruitment planning and materials development
• Training development for recruitment activities
• Recruitment of study participants through telephone, regular mail, and e-mail
• Detailed database tracking of recruitment progress

Data Collection Methods

• Surveys and questionnaires
• Interviews
• Focus groups
• Observation
• Secondary data

Data Analysis

• Quantitative analysis including descriptive statistics, inferential statistics, and advanced modeling techniques
• Qualitative analysis