3E: evidence-based evaluation of EdTech

The 3E project aims to develop a comprehensive framework for conducting evidence-based evaluation of Education Technology (EdTech) tools. The framework will help determine the effectiveness of these tools and under what conditions they work best.

What’s meant by EdTech?

EdTech refers to digital tools, platforms, and programs designed to enhance education. While new EdTech tools emerge every day, we often lack clarity on their effectiveness—or whether they are effective at all. Many tools fail to contribute to meaningful learning outcomes and, in some cases, disrupt classroom dynamics instead of improving them.

Need for EdTech evaluation

Educational institutions are increasingly adopting EdTech solutions, while EdTech providers are equally keen to offer their innovations. However, institutions face challenges in selecting tools that are both effective and tailored to their specific needs. Similarly, EdTech companies struggle to provide compelling evidence of their tools' effectiveness.

As a result, institutions often select tools based on marketing, peer recommendations or popularity, rather than solid evidence of their impact on learning and teaching. There is an urgent need for a structured, evidence-based approach to evaluate EdTech tools. While countries like Australia, the US, and the UK have developed frameworks for this purpose, the Netherlands lacks a comparable approach to evaluate Edtech tools in its educational context.

A Framework for Evidence-based Evaluation of EdTech

In collaboration with national Npuls program, senior researcher Manika Garg and Professor Theo Bakker are developing the 3E framework. This framework will establish an evidence-driven process for EdTech evaluation in the Netherlands. It will employ a three-tier badge rating system—Gold, Silver, and Bronze—to indicate the level of effectiveness demonstrated by an EdTech tool.

Project Timeline and Development

The project started in November 2024 and the first results are expected in spring 2025. Subsequent phases will include piloting the framework and refining it based on feedback and outcomes.

Possible Outcomes

The framework will not only assess whether the tool works but also what works, for whom, and under what circumstances. This will enable educational institutions to make better-informed decisions and provide EdTech providers with a roadmap to improve their tools based on objective evaluation criteria. It will also enhance transparency about the effectiveness of EdTech products.

More information

For more details or to participate in this research, please contact dr. Manika Garg at [email protected]