CANCELLED - Replication in educational interventions at scale: a framework for developing a tool to measure and promote fidelity

Status: This talk is in preparation - details may change
Status: This talk has been cancelled

We are very sorry to announce that due to the University strike action we have to cancel our HT Week 6 seminar, which was to be given on Tuesday 21th of February, by Professor Gabriel Stylianides, University of Oxford, Department of Education. Introducing the school intervention ‘Working Memory Plus Arithmetic’, Gabriel was going to give a talk on the replication in educational interventions at scale, and present a framework for developing a tool to measure and promote fidelity. We very much hope that we will be able to welcome Gabriel to our seminar series another time. Please note that you can learn more about the strike here and read some Oxford-specific resources and FAQs here . With all best wishes, Katharina (on behalf of the CDL group)

Many interventions lose their impact during the scaling up process; low fidelity of implementation (i.e., delivering an intervention but not as it was intended) may explain why. In this paper we introduce, discuss, and exemplify the use of a framework for developing fidelity tools that aim to measure and to promote fidelity of implementation. The framework includes four stages that are typical of the development of new psychological and educational measures: conception, piloting and revising, implementation, and evaluation. In order to exemplify the use of this framework, we describe the activities carried out in each stage to develop a tool to assess and promote fidelity in the scaling up of the intervention Improving Working Memory Plus Arithmetic (IWM+A). Scaling up was achieved through a train-the-trainer model in a large RCT involving 201 schools. Teacher leaders (N=12), trained by the program developers, trained teaching assistants (the end users), who delivered the intervention to children in the intervention schools (N=100). We describe the intervention, the training model, and the process of developing, piloting, implementing, and evaluating the tool. We also discuss implications that derive from the framework.