However, a realist approach has not been widely conducted in international
development, although some cases are found in a type of systematic reviews,
e.g. Betts (2013). This meta-analysis is one such attempt. Quite unlike the conditions in making laboratory type experiments possible (“closed system”), critical
realism acknowledges that the world is an “open system” consisting of things
possessing causal powers (and also their potentialities) situated within many layers
of structures (Bhaskar 2008). And because the world that people live in is an open
system, it tells us that, unlike natural science, social science cannot predict things or
present the world with successionist, cause-and-effects sequences.
The realist approach pays close attention to “contextual conditions” and how
they influence mechanisms that generate (different) outcomes. It is a continuous,
not a one-off, process of identifying specific contexts that may trigger some
generative mechanisms to generate an outcome. Realist approach is thus about
hypothesizing, selecting and refining so-called CMO (Context + Mechanism ¼
Outcome) configurations.
13.4 Meta-analysis Conducted
The structure of the evaluations of the nine CCA programmes is based on the four
evaluation criteria, i.e. relevance, efficiency, effectiveness and sustainability.
Within this analysis framework, these criteria are considered as “outcomes” that
lead to the ultimate CCA programme objectives. Within each outcome, there are
several important intermediate outcomes (IOs) identified through the metaanalysis. Each IO is reported to have been influenced by a number of interventions
on the ground.
According to Weiss (1997), a theory of change consists of two kinds of theories,
i.e. implementation theory and programme theory. Implementation theory mainly
pertains to programme activities or interventions themselves. It represents the
assumptions that if certain interventions are implemented as planned, they are
thought to generate desired results. Programme theory on the other hand represents
the “ideas and assumptions [that] link the programme’s inputs to attainment of the
desired ends” (Weiss 1997). It is not just what the programme activities are
expected to achieve, but also how. The essence of such interventions and
programme theories can be considered as a generative mechanism according to
the realist approach and within CMO configurations.
The authors first extracted every single evaluative remark of these evaluations,
each of which is categorized either ‘positive’ or ‘negative’. It altogether resulted in
a total of 577 remarks gleaned out of the nine evaluations. Each of these remarks
belonged to one or multiple evaluation criteria (i.e. relevance, efficiency, effectiveness, and sustainability). These remarks were then clustered according to: the
240
T. Miyaguchi and J.I. Uitto
development, although some cases are found in a type of systematic reviews,
e.g. Betts (2013). This meta-analysis is one such attempt. Quite unlike the conditions in making laboratory type experiments possible (“closed system”), critical
realism acknowledges that the world is an “open system” consisting of things
possessing causal powers (and also their potentialities) situated within many layers
of structures (Bhaskar 2008). And because the world that people live in is an open
system, it tells us that, unlike natural science, social science cannot predict things or
present the world with successionist, cause-and-effects sequences.
The realist approach pays close attention to “contextual conditions” and how
they influence mechanisms that generate (different) outcomes. It is a continuous,
not a one-off, process of identifying specific contexts that may trigger some
generative mechanisms to generate an outcome. Realist approach is thus about
hypothesizing, selecting and refining so-called CMO (Context + Mechanism ¼
Outcome) configurations.
13.4 Meta-analysis Conducted
The structure of the evaluations of the nine CCA programmes is based on the four
evaluation criteria, i.e. relevance, efficiency, effectiveness and sustainability.
Within this analysis framework, these criteria are considered as “outcomes” that
lead to the ultimate CCA programme objectives. Within each outcome, there are
several important intermediate outcomes (IOs) identified through the metaanalysis. Each IO is reported to have been influenced by a number of interventions
on the ground.
According to Weiss (1997), a theory of change consists of two kinds of theories,
i.e. implementation theory and programme theory. Implementation theory mainly
pertains to programme activities or interventions themselves. It represents the
assumptions that if certain interventions are implemented as planned, they are
thought to generate desired results. Programme theory on the other hand represents
the “ideas and assumptions [that] link the programme’s inputs to attainment of the
desired ends” (Weiss 1997). It is not just what the programme activities are
expected to achieve, but also how. The essence of such interventions and
programme theories can be considered as a generative mechanism according to
the realist approach and within CMO configurations.
The authors first extracted every single evaluative remark of these evaluations,
each of which is categorized either ‘positive’ or ‘negative’. It altogether resulted in
a total of 577 remarks gleaned out of the nine evaluations. Each of these remarks
belonged to one or multiple evaluation criteria (i.e. relevance, efficiency, effectiveness, and sustainability). These remarks were then clustered according to: the
240
T. Miyaguchi and J.I. Uitto