Forgotten your password? 

15 November 2018
Evidence-Based Research has Impact Print
Friday, 28 August 2015 13:12

Measuring the impact of Research Uptake interventions is a tricky business, particularly given the lead-time between activities and the potential impact. It is often difficult to unpack the impact of a particular event or project from other factors that may have played a role. Establishing evidence of impact is important however, not only to justify specific programme outcomes but also to inform your overall theory of change.

Within the broader context of Research Uptake, there is particular interest in encouraging governments to use research evidence when developing or revising policy. Although it is acknowledged that this evidence is only one of a large number of considerations in the policy process, there is some consensus that policy, which is informed by evidence, is stronger and more effective.

Researchers and research organisations (universities, think tanks, local and international aid organisations as well as science councils) have therefore engaged in re-purposing academic research findings into research uptake activities such as knowledge translation, communication and dissemination, knowledge transfer or exchange, meetings and use of media outlets as intermediaries, in order to connect with policy-makers and influence policy.

 

GDNet/CIPPEC Toolkits

Evaluating the effectiveness of  change interventions is a tricky process for a variety of reasons – it is difficult to establish cause and effect when, for example, policy development is influenced by so many factors. Defining what you mean by impact and how you plan to measure  impact is a process that can result in using indicators that  you can associate with numerical values rather than broader, less quantifiable impact. 

Nevertheless organisations do need to try and evaluate their research uptake activities, in order to monitor their success and improve future efforts. GDNet and CIPPEC have produced these helpful toolkits addressing the various steps of the monitoring and evaluation process of policy influence.

"The toolkits are particularly useful in that they provide an overview of the M&E process as a whole, including how the evaluation feeds back into future activities"

Each toolkit profiles different aspects:


Toolkit Nº 1. Why should we monitor and evaluate policy influence?

Toolkit Nº 2. Where are we and where do we want to go?

Toolkit Nº 3. Establishing the basis for the M&E strategy

Toolkit Nº 4. Defining how to measure short, medium and long term results

Toolkit Nº 5. Data collection methods

Toolkit Nº 6. Using knowledge to improve policy influence.

 

They also provide links to a range of additional online sources, including reports, journal articles and videos.

These toolkits provide a useful base from which to work. Understanding why you are evaluating policy influence helps to define how you will measure impact and what indicators you need to use. The toolkits are particularly useful in that they provide an overview of the M&E process as a whole, including how the evaluation feeds back into future activities (Toolkit 6).

The importance of seeing M&E as an on-going process that needs to inform not just future activities but also future strategic direction can be seen from the experience in Zimbabwe of the STEPS Centre which was the second prize-winner of the Economic and Social Research Council (ESRC) Celebrating Impact Prize for Outstanding International Impact.

“key to sustaining impact is engaging others in new research, and building the capacity to do this. Only when a wider body of research is developed that confirms, extends and sometimes challenges new findings, will debate shift”

In it for the long haul

Impact assessment goes beyond evaluating specific uptake activities or the uptake of any specific piece of research. It requires a long term strategy and on-going analysis such as that taken by the ESRC Funded Social, Technological and Environmental Pathways to Sustainability (STEPS) Centre, based at the Institute of Development Studies (IDS), University of Sussex.

The ESRC has been funding research on land and agrarian issues in Zimbabwe since the early 2000s. Using an array of outputs including a weekly blog, video’s and booklets, as well as academic articles, STEPS has disseminated research findings on various aspects of land reform and contributed to debate and dialogue on these issues.

But, according to Ian Scoones, the Director of STEPS, “key to sustaining impact is engaging others in new research, and building the capacity to do this. Only when a wider body of research is developed that confirms, extends and sometimes challenges new findings, will debate shift”.

 

Building Local Research Capacity

For this reason STEPS included support of local research capacity through a small grants programme in its multi-year research programme.  Implemented with local partners including the University of Zimbabwe,  this allowed the debate on land reform to be informed by a range of research findings that contributed to a body of evidence that the impact of land reform in Zimbabwe is neither a great success, nor an unmitigated disaster. Research findings recorded both successes, especially among small-scale farmers, and failures, especially on the larger-scale farms.

M&E processes to eventually assess impact can be a challenge to develop and implement but it is worth it. Their value lies not only in having the information to evaluate the outcomes of activities and projects but also in guiding and influencing the  policy environment.


Alison Bullen, DRUSSA, Website Content Manager alison.bullen@drussa.net

 

...Back

Comments


David Phipps said on 2015-09-28 18:03:16:
Sarah Morton (U Edinburgh) recently published on her contribution analysis as a framework for assessing the contributions of research to impacts beyond the academy. I found this a very interesting article and wrote it up in my knowledge mobilization journal club at:

https://researchimpact.othree.ca/forums/journalclub/progressing_research_impact_assessment_a_contributions_approach
Meeniwo9471 said on 2018-07-16 05:10:30:
longchamp
christian louboutin mens shoes
louboutin shoes
pandora rings
nike soccer cleats
red bottom shoes for women
north face coats
pandora charms
cheap nfl jerseys china
ugg boots for women
skechers shoes
adidas yeezy boost
new jordans
clarks shoes for women
under armour clearance
michael kors
coach factory outlet
kyrie 3
longchamp handbags
ralph lauren factory store
timberland boots for men
timberland shoes
yeezy boost
pandora rings
jordan 11 win like 82
cheap air max 95
coach bags
win like 96
swarovski jewelry
pandora charms sale
michael kors canada
fake yeezy
celine
oakley outlet
gym red 11
coach handbags
reebok outlet
kd shoes
balenciaga shoes
pandora jewelry
pandora charms
vans
supremenewyork
nike vapor max plus
yeezy boost 350 v2
canadian goose
nike clearance
rihanna fenty puma
adidas soccer cleats
pandora
jordan shoes
coach outlet
nike outlet
curry 4
nike shox for men
louboutin shoes
pandora jewelry
longchamp bags
red bottoms
yeezy boost 350 v2
salvatore ferragamo
polo outlet
polo ralph lauren outlet
coach purses
polo shirts
michael kors outlet
nike kyrie 4
ray ban sunglasses
yeezy shoes
wholesale jerseys china
kobe bryant shoes
vapor max
air max 97 silver bullet
pandora jewelry
nike cortez
ecco shoes for men
north face jackets
nike outlet store online
yeezy boost 350 v2
nike vapor max
cheap nfl jerseys
timberland outlet stores
coach outlet online
uggs official site
pandora jewelry outlet
kate spade handbags
nike air vapormax
adidas ultra boost
pandora uk
adidas yeezy
ray ban sunglasses sale
ultra boost
timberland outlet
yeezy zebra
lacoste outlet
pandora canada
polo ralph lauren outlet
pandora charms
pandora rings
supreme clothing
adidas yeezy
calvin klein underwear
nike clearance
yeezy boost
uggs official site
air max plus
longchamp uk
fitflops
pandora canada
ferragamo shoes
off white vapormax
nike outlet store
swarovski crystal
goyard bags
uptempo
pandora bracelet
pandora rings
nike air max 95
pandora charm
pandora charms
coach outlet store
golden goose sneakers
pandora bracelet
adidas outlet
lebron 15
oakley sunglasses
fitflops sale clearance
louboutin outlet
coach
ray-ban
skechers boots
salvatore ferragamo shoes
nike outlet store
puma shoes
coach outlet
yeezy beluga 2.0
pandora necklace
celine handbags
pandora rings
pandora
nike factory
pandora bracelets clearance
kd 10 shoes
swarovski outlet
michael kors canada
replica rolex
red bottom
ralph lauren outlet
converse outlet
kevin durant shoes
jordan 11 red
michael kors canada
clarks shoes for women
louboutin mens
yeezy boost 350 v2
pandora bracelets clearance
curry 4 shoes
yeezy boost 350 v2
pandora earrings
nike presto
pandora jewelry official site
birkenstock outlet
pandora charms
jordan retro
adidas yeezy
louboutin
jimmy choo shoes
birkenstock sandals
balenciaga sneakers
calvin klein outlet
longchamp handbags
air vapormax
tommy hilfiger outlet
jordan 11 red
pandora charms
pandora charms
red bottom shoes
pandora ring
soldier 11
michael kors outlet
balenciaga shoes
polo outlet online
nike air max 270
nike vapor max
longchamp bags
canada goose sale
lebron soldier
pandora canada
mbt shoes clearance
2018-0716y