- an evaluator guidance
- a self-evaluation questionnaire
- interview guidance
- a lesson observation form
- a template report
Besides these materials, we also improved the framework by adding the possibility to add notes and a column in which scores can be assigned to each indicator. Also the framework now contains clues about the sources that can be used to find evidence about a specific indicator. In another post I will elaborate more in the framework itself.
The evaluator guidance contains all kinds of practical information and helps the local evaluator in setting up the visit and in making appropriate chices before, during and after the visit. This document gives tips about making observations, about documenting evidence and about writing and referencing the school report.
Prior to each visit a self-evaluation questionnaire should be filled in by the school that is going to be visited. This questionnaire should be made available to the evaluators before the visit. It contains questions about hardware, vision and policies. The schools are also requested to send policy briefs etc to the evaluators. This information helps making the visit more efficient (as no time is lost during the visit itself to gather this info) and effective (as the visit is more focussed on themes and hypotheses that were identified based on the materials).
The interview guidances help the evaluators during the school visit. There are three guidances: one for teachers, one for management and one for pupils. As part of the methodology, interviews should be scheduled with each of these groups. The questions are directly derived from the quality indicators and evidence pointers in the framework, thus helping the evalutor in making informed decisions.
An essential part of each school visist are the lesson observations. Each evaluator makes notes on a lesson observation form, on which also appropriate boxes can be checked about the subject, type of ICT used, type of classroom etc.
After the visit the local inspector writes a report. In this report he/she elaborates on the scores, providing strengths and weaknesses for each Quality Area. A template report is provided, with a clear format that is linked to the framework.
To an inspector or someone familiar with inspections, most of the above is not radically new. What is new however that we try to develop this toolkit specifically for ICT, aimed at transnational use and building on the body of knowledge and expertise of inspectors in several countries. During our first trials it proved that sometimes a small adjustment in wording, in the order of criteria or in the guidance was needed to prevent confusion on part of the school or the evaluators. The iterative process of the school visits will mean that by the summer of 2008 we will have a toolkit that has passed its practical test.
by Bert Jaap van Oel (originally posted on the P2V Blog-Inspection)
Last changed: Thursday, 26 February 2009