A comprehensive monitoring and evaluation framework for evidence to policy networks

Tanja Kuchenmüller; Evelina Chapman; Ryoko Takahashi; Louise Lester; Marge Reinap; Moriah Ellen; Michelle M. Haby

doi:10.1016/j.evalprogplan.2022.102053

A comprehensive monitoring and evaluation framework for evidence to policy networks

Tanja Kuchenmüller^*, Evelina Chapman, Ryoko Takahashi, Louise Lester, Marge Reinap, Moriah Ellen, Michelle M. Haby

^*Corresponding author for this work

Departamento de Ciencias Químico-Biológicas

Research output: Contribution to journal › Article › peer-review

Abstract

Objective: To describe the development of a framework for monitoring and evaluating knowledge translation (KT) networks. Method: The framework was developed using mixed methods over four phases, including i) a targeted literature review of KT networks, activities and indicators, ii) two scoping reviews to further enhance the set of indicators, iii) peer-reviews by international KT experts and an online expert consultation, and iv) piloting. Results: A comprehensive theory of change (ToC) and indicators, both for the Network Secretariat and its participating member countries, were identified to develop the monitoring and evaluation framework. The framework includes (i) a ToC, including three key indicator domains across the results chain (outputs, short term outcomes, intermediate outcomes), and (ii) indicators for the three key domains, that can be selected depending on the stage of network maturity, along with suggested data collection methods. The three key indicator domains are 1) KT capacity and skill building; 2) network (structure, governance and leadership); and 3) KT/evidence-informed policy value and culture. Conclusion: The monitoring and evaluation framework that links KT activities with policy and health outcomes fills an important gap in optimizing KT procedures, generating lessons learned and increasing accountability of major multipartner KT networks.

Original language	English
Article number	102053
Journal	Evaluation and Program Planning
Volume	91
DOIs	https://doi.org/10.1016/j.evalprogplan.2022.102053
State	Published - Apr 2022

Bibliographical note

Funding Information:
Networks, such as the Evidence-informed Policy Network (EVIPNet) Europe, use a systems thinking approach ( Willis, Riley, Best, & Ongolo-Zogo, 2012 ) and play a critical role in facilitating KT processes ( Mendizabal, 2006; Perkin & Court, 2005 ). Other examples of KT networks include the global multi-year programme, Building Capacity to Use Research Evidence (BCURE). The BCURE programme developed organizational knowledge brokering projects in 12 low- and middle-income countries between 2013 and 2017 spanning beyond health. In addition, the Partnership for Evidence and Equity in Responsive Social Systems (PEERSS), funded by the International Development and Research Center (IDRC) and the William and Flora Hewlett Foundation, is aiming to advance evidence-informed policy-making (EIP) in the social systems. While these initiatives are multisectoral in nature, the Regional East African Community Health Policy Initiative (REACH-PI) ( Campbell, 2013; East African Community, 2006 ) is a subregional KT network that bridges the gap between health research and policy and decision making through the establishment of Knowledge Translation Platforms (KTPs) in Kenya, Tanzania and Uganda. As a result of the similar mandate, REACH-PI and EVIPNet established a close interaction. The establishment of EVIPNet Africa was inspired by the preparatory work undertaken by REACH-PI, which then became a part of the EVIPNet Africa as a subregion ( Lavis & Panisset, 2010 ). EVIPNet Africa also explicitly supported the REACH-PI’s Rapid Response Service in Uganda, which was then rolled out into other countries within the African region and in other regions ( World Health Organization, 2016 ).

Publisher Copyright:
© 2022

Keywords

Evidence-informed policy
Knowledge translation
Monitoring and evaluation framework
Network

Access to Document

10.1016/j.evalprogplan.2022.102053

Cite this

@article{21ca81c6a6d5496da723ff6dce56bb18,

title = "A comprehensive monitoring and evaluation framework for evidence to policy networks",

abstract = "Objective: To describe the development of a framework for monitoring and evaluating knowledge translation (KT) networks. Method: The framework was developed using mixed methods over four phases, including i) a targeted literature review of KT networks, activities and indicators, ii) two scoping reviews to further enhance the set of indicators, iii) peer-reviews by international KT experts and an online expert consultation, and iv) piloting. Results: A comprehensive theory of change (ToC) and indicators, both for the Network Secretariat and its participating member countries, were identified to develop the monitoring and evaluation framework. The framework includes (i) a ToC, including three key indicator domains across the results chain (outputs, short term outcomes, intermediate outcomes), and (ii) indicators for the three key domains, that can be selected depending on the stage of network maturity, along with suggested data collection methods. The three key indicator domains are 1) KT capacity and skill building; 2) network (structure, governance and leadership); and 3) KT/evidence-informed policy value and culture. Conclusion: The monitoring and evaluation framework that links KT activities with policy and health outcomes fills an important gap in optimizing KT procedures, generating lessons learned and increasing accountability of major multipartner KT networks.",

keywords = "Evidence-informed policy, Knowledge translation, Monitoring and evaluation framework, Network",

author = "Tanja Kuchenm{\"u}ller and Evelina Chapman and Ryoko Takahashi and Louise Lester and Marge Reinap and Moriah Ellen and Haby, {Michelle M.}",

note = "Publisher Copyright: {\textcopyright} 2022",

year = "2022",

month = apr,

doi = "10.1016/j.evalprogplan.2022.102053",

language = "Ingl{\'e}s",

volume = "91",

journal = "Evaluation and Program Planning",

issn = "0149-7189",

publisher = "Elsevier Ltd",

}

TY - JOUR

T1 - A comprehensive monitoring and evaluation framework for evidence to policy networks

AU - Kuchenmüller, Tanja

AU - Chapman, Evelina

AU - Takahashi, Ryoko

AU - Lester, Louise

AU - Reinap, Marge

AU - Ellen, Moriah

AU - Haby, Michelle M.

PY - 2022/4

Y1 - 2022/4

N2 - Objective: To describe the development of a framework for monitoring and evaluating knowledge translation (KT) networks. Method: The framework was developed using mixed methods over four phases, including i) a targeted literature review of KT networks, activities and indicators, ii) two scoping reviews to further enhance the set of indicators, iii) peer-reviews by international KT experts and an online expert consultation, and iv) piloting. Results: A comprehensive theory of change (ToC) and indicators, both for the Network Secretariat and its participating member countries, were identified to develop the monitoring and evaluation framework. The framework includes (i) a ToC, including three key indicator domains across the results chain (outputs, short term outcomes, intermediate outcomes), and (ii) indicators for the three key domains, that can be selected depending on the stage of network maturity, along with suggested data collection methods. The three key indicator domains are 1) KT capacity and skill building; 2) network (structure, governance and leadership); and 3) KT/evidence-informed policy value and culture. Conclusion: The monitoring and evaluation framework that links KT activities with policy and health outcomes fills an important gap in optimizing KT procedures, generating lessons learned and increasing accountability of major multipartner KT networks.

AB - Objective: To describe the development of a framework for monitoring and evaluating knowledge translation (KT) networks. Method: The framework was developed using mixed methods over four phases, including i) a targeted literature review of KT networks, activities and indicators, ii) two scoping reviews to further enhance the set of indicators, iii) peer-reviews by international KT experts and an online expert consultation, and iv) piloting. Results: A comprehensive theory of change (ToC) and indicators, both for the Network Secretariat and its participating member countries, were identified to develop the monitoring and evaluation framework. The framework includes (i) a ToC, including three key indicator domains across the results chain (outputs, short term outcomes, intermediate outcomes), and (ii) indicators for the three key domains, that can be selected depending on the stage of network maturity, along with suggested data collection methods. The three key indicator domains are 1) KT capacity and skill building; 2) network (structure, governance and leadership); and 3) KT/evidence-informed policy value and culture. Conclusion: The monitoring and evaluation framework that links KT activities with policy and health outcomes fills an important gap in optimizing KT procedures, generating lessons learned and increasing accountability of major multipartner KT networks.

KW - Evidence-informed policy

KW - Knowledge translation

KW - Monitoring and evaluation framework

KW - Network

UR - http://www.scopus.com/inward/record.url?scp=85126133392&partnerID=8YFLogxK

U2 - 10.1016/j.evalprogplan.2022.102053

DO - 10.1016/j.evalprogplan.2022.102053

M3 - Artículo

C2 - 35217289

AN - SCOPUS:85126133392

VL - 91

JO - Evaluation and Program Planning

JF - Evaluation and Program Planning

SN - 0149-7189

M1 - 102053

ER -

A comprehensive monitoring and evaluation framework for evidence to policy networks

Abstract

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this