Recommended reading on the philosophical background and the general development of this approach: Pawson, R. & Tilley, N. (1997). 0000001684 00000 n As with any evaluation, the choice of data collection, and analysis methods and tools should be guided by the types of data that are needed to answer the evaluation questions, or more specifically, to test the initial programme theory in all its dimensions. Approaches (on this site) refer to an integrated package of options (methods or processes). A particular type of case study used to jointly develop an agreed narrative of how an innovation was developed, including key contributors and processes, to inform future innovation efforts. Evans and Killoran present the evaluation of a Health Education Authority’s Integrated Purchasing Programme and specifically of demonstration projects testing partnerships to tackle health inequalities. The context-mechanism-outcome (CMO) configuration is used as the main structure for realist analysis. This question is for testing whether you are a human visitor and to prevent automated spam submissions. The ‘reasoning’ of the actors in response to the resources or opportunities provided by the intervention is what causes the outcomes. ��=칃�)��Q�i�'�G� ��mצ?�IM��̳�GY�"�� 더⪝�E����>Z#����b��Mj[@��������$�3&�dg�.~=��:���V b���y&y��jE���(:0-6�Ϟm6}LꄽL�. (2005) and Byng et al. 0000003244 00000 n trailer <<63BD86A3A70445C6A87D0026D22759CA>]/Prev 192928>> startxref 0 %%EOF 64 0 obj <>stream The second CMO configuration can be summarised as ‘keeping up standards of excellence through organisational culture’. The Context-Mechanism-Outcome configuration refers to an exploration of what influences the extent to which an intervention is successful or unsuccessful in producing positive … In other words, the purpose of a realist evaluation is as much to test and refine the programme theory as it is to determine whether and how the programme worked in a particular setting. In order to answer that question, realist evaluators aim to identify the underlying generative mechanisms that explain ‘how’ the outcomes were caused and the influence of context. 'http':'https';if(!d.getElementById(id)){js=d.createElement(s);js.id=id;js.src=p+"://platform.twitter.com/widgets.js";fjs.parentNode.insertBefore(js,fjs);}}(document,"script","twitter-wjs"); Select a content type to filter search results: A special thanks to this page's contributors. Building upon the ‘human capital’ within their staff and in a organisational context of relatively good resource availability and well-trained professionals (context), the managers developed a comprehensive set of both ‘hard’ and ‘soft’ management practices that responded to the needs of the staff  and enabled them to maintain their professional standards (intervention). Usually, both quantitative and qualitative data are collected in a realist evaluation, often with quantitative data being focused on context and outcomes and qualitative data on generative mechanisms. Realist impact evaluation draws on the realism school of philosophy. The programme theory describes how the intervention is expected to lead to its effects and in which conditions it should do so. A research design that focuses on understanding a unit (person, site or project) in its context, which can use a combination of qualitative and quantitative data. I prefer to do that over the Rameses discussion list because that way many people can benefit from the discussion. An approach designed to support ongoing learning and adaptation, which identifies the processes required to achieve desired results, and then observes whether those processes take place, and how. A realist approach assumes that programs are “theories incarnate”. This provided a potential explanation in the form of a causal pathway between the management practices and organisational commitment. Recommend content, collaborate, share, ask, tell us what you like, suggest an improvement, or just say hi! Because of this, realist evaluations are appreciated by implementers and decision-makers who seek to understand how a program or policy works, and in which circumstances, when designing or funding programs. Understanding the philosophical basis of Realist Evaluation (RE). H��W]s�H}�W�Gi��|5��TR�cg�5�L"���xk �k (2011). In the first phase of analysis, data are organised in relation to the initial programme theory – that is, whether the data relate to what was done (the intervention activities) or to context, mechanism, outcome and (groups of) actors. ��Z���=�G�Y�����d.�w�;�=������9�*Ϲs��y�\0��xx�02m6O����!����tz8��y�����L��M�x��Ah��Ah��Ah��Ah�� z�&�M؛�7�M`�-��@g�3������@s�9�`4���@s�9�`V�R�R�R�R�R�R�R�R�R�R�R�R�R�R�R�R��e�Q���F�k��Jѕ�+EWʮ])�Rte��Е�o����o����o����o����o�����j�sʂ甞��f��2,���T~ۖ���pSܽ���.�>���}�Ҷ�lU�~������n6�K���� Co-produced by BetterEvaluation, DFAT and ODI as part of the Methods Lab project, this publication explains when a realist impact evaluation may be most appropriate or feasible for evaluating a particular programme or policy, and outlines how to design and conduct an impact evaluation based on a realist approach. That is, whenever a program is implemented, it is testing a theory about what ‘might cause change’, even though that theory may not be explicit. A particular type of case study used  to create a narrative of how institutional arrangements have evolved over time and have created and contributed to more effective ways to achieve project or program goals. 0000003532 00000 n mechanism-outcome (CMO) configuration and is the analytical unit on which realist evaluation is built. In that context, this other mechanism fired, generating these different outcomes.”. However, it is possible to undertake realist evalaution with single practitioners, and in small-scale evaluations. The CMO configuration is the main structure for analysis in realist evaluation . ww�{U~�iM����;L�l6PL#�JVRI�6���Zh��1� �����I�:@� �C������+6[]I�#���s��ن��6ф�"��PE���J>7���-]�'9��9"���k#U���2sX���������(y(����$�TM7/I�$|�������,!l����(�} I suggest reviewing the international standards for realist review, which are available at www.ramesesproject.org. Contexts may relate to the sub-groups for whom outcomes were generated and/or to other stakeholders, processes of implementation, organisational, socio-economic, cultural and political conditions. Chris Bonell1*, Emily Warren1, Adam Fletcher2 and Russell Viner3 Abstract Background: Van Belle et al. Pawson and Tilley argued that in order to be useful for decision makers, evaluations need to identify ‘what works in which circumstances and for whom?’, rather than merely ‘does it work?. Realist evaluation offers a valuable methodology for researchers investigating interventions utilising simulation-based education. Realist evaluations attempt to answer questions such as what works, for whom, in which circumstances, and why. Using a realist approach to evaluation is not necessarily more resource or time-intensive than other theory-based evaluations, but it can be more expensive than a simple pre-post evaluation design. The difference between realist and other kinds of programme theory-based evaluation approaches is that a realist programme theory specifies what mechanisms will generate the outcomes and what features of the context will affect whether or not those mechanisms operate. Evaluation 18:176-191. http://dx.doi.org/10.1177/1356389012440912. Approach primarily intended to clarify differences in values among stakeholders by collecting and collectively analysing personal accounts of change. Director, Evaluation Capacity Strengthening, BetterEvaluation. Learn more in: Critical Realist Information Systems Research We initially selected ‘organisational commitment’ and ‘trust’ as proximal outcomes of human resource management, because our initial literature review indicated that these outputs are often found to explain the effect of high commitment management. http://www.ramesesproject.org. There are hundreds of members and they are very good about providing advice and support. Finally, the context may provide alternative explanations of the observed outcomes, and these need to taken into account during the analysis. Check the results are consistent with causal contribution, 3. Central to realist evaluation is a recognition of the fundamental importance of context in shaping how and why programmes lead to (or fail to lead to) change. To construct CMOs, the researchers explored the coded data to identify instances where NCA feedback was reported to have been used by providers. Journal of Evaluation in Clinical Practice 13(6):935-941. http://onlinelibrary.wiley.com/doi/10.1111/j.1365-2753.2006.00790.x/pdf, Dickinson, H. (2006). Realist research uses a mixed methods (qualitative and quantitative) approach to gathering data in order to test the proposed context-mechanism-outcome (CMO) configurations of the intervention under investigation. Synthesise data from a single evaluation. A realist evaluation of community-based participatory research: partnership synergy, trust building and related ripple effects Justin Jagosh1*, Paula L. Bush2, Jon Salsberg2, Ann C. Macaulay2, Trish Greenhalgh3, Geoff Wong3, Margaret Cargo4, Lawrence W. Green5, Carol P. Herbert6 and Pierre Pluye2 Abstract Background: Community-Based Participatory Research (CBPR) is an approach in … Elaborating the Context-Mechanism-Outcome configuration (CMOc) in realist evaluation: A critical realist perspective. In a recent article in BMC Medicine, Wong and … For example, a parenting skills programme may have achieved different outcomes for fathers and mothers. Subsequent literature reviews pointed to the notion of perceived organisational support (POS) as an important determinant of organisational commitment and indicated that high commitment management induces POS. After which, the IPT will be refined to … Doing “hands-on” exercises in CMO configuring and theory building. [ Updated 2018 10 07] A core concept in Realist Evaluation is the CMO configuration. 0000003645 00000 n 0000069036 00000 n In terms of claiming realist review as a method - it most certainly can be claimed, but it's not limited to qualitative data. For more details, we refer to Marchal et al. April 2013; Evaluation 19(2):141-154; DOI: 10.1177/1356389013485194. Unpacking Black Boxes: Mechanisms and Theory Building in Evaluation. New York: The Free Press, p39]. A literature review of methodological practice in health systems research. Introducing the main constructs employed in RE: program theory, middle-range theory; and context-mechanism-outcome (CMO) configuration. (2010a) and Marchal et al. EVALUATION. Realist approaches to evaluation assume that nothing works everywhere or for everyone: context really does make a difference to programme outcomes. A refined CMO configuration is the finding of IS evaluation research. Click an approach on the left to navigate to it. The last phase of the analysis consists of determining which CMO configuration(s) offers the most robust and plausible explanation of the observed pattern of outcomes. Manzano-Santaella, A. Declined as CMO configurations constructed as part of a realist synthesis or realist evaluation, the program theory identifies and describes how mechanisms (e.g., actors’ ideas or choices) led to the outcomes for change in a given context [ 30, 48 ]. 0000103900 00000 n We present an example of a realist study of existing practices within the health care system in Ghana; it is not an evaluation of an intervention per se. Decide who will conduct the evaluation, 5. [The original text worth reading is Pawson and Tilley (1997) Realist Evaluation] Context describes what are thought to be important … The analytic process is not necessarily sequential, but should result in a set of ‘context-mechanism-outcome’ (CMO) statements: “In this context, that particular mechanism fired for these actors, generating those outcomes. Tackling health inequalities through partnership working: learning from a realist evaluation. 24 An important objective is to identify those theories that describe the explanatory pathways. It explains when a realist impact evaluation may be most argue that our attempt to pursue realist evaluation via a randomised trial will be A CMO configuration is a proposition stating what it is about an initiative that works, for whom and in what circumstances. The initial programme theory may be based on previous research, knowledge, experience, and the assumptions of the intervention designers about how the intervention will work. When the staff perceive high levels of management support or perceived organisational support (intervention), they will develop extra role behaviours, such as working late, organisational citizenship behaviours, etc. 0000008200 00000 n Realist evaluations are theory-driven evaluations that seek to understand how complex interventions work, ... (CMO) configuration. The context-mechanism-outcome (CMO) configuration is used as the main structure for realist analysis. &�H��u1���٣پ��#�u#쏜�|�h���?G��r���\n�4�ht��#��{��?���o}��|��7ӻO�������3�'�āV��;v��W2�-%}���f An impact evaluation approach suitable for retrospectively identifying emergent impacts by collecting evidence of what has changed  and, then, working backwards, determining whether and how an intervention has contributed to these changes. Define ethical and quality evaluation standards, 6. An introduction to realist evaluation including a downloadable chapter from Pawson and Tilley (1997) (reproduced with permission from the authors) www.communitymatters.com.au/gpage1.html, Pawson, R. & Manzano-Santaella, A. Realist evaluations are based on an assumption that projects and programmes work under certain conditions and are influenced by the way that different stakeholders respond to them. 0000003279 00000 n 0000069133 00000 n The MRT was developed through: an exploratory visit of the central regional hospital during which staff were interviewed; a literature review of human resource management and hospital performance which led to the concept of ‘high commitment management’; and, reviewing previous research on organisational culture. Post-doctoral Researcher, Department of Public Health, Institute of Tropical Medicine, Antwerp (Belgium) and Visiting Researcher, School of Public Health, University of the Western Cape, Cape Town (South Africa). In our paper, first we turn attention to the methodology used in the realist evaluation, before analysing pathways of CMO configurations (findings) derived by our data … Interviews with management team members and operational staff combined with quantitative data analysis allowed us to identify two distinct sets of practices according to their key mechanism: The first CMO can be summarised as follows: a hospital management team can attain higher organisational commitment if their management practices act upon economic exchange and social exchange. Realistic Evaluation Bloodlines. It can indicate the conditions in which the intervention works (or not) and how they do so. An approach that focuses on assessing the value of an intervention as perceived by the (intended) beneficiaries, thereby aiming to give voice to their priorities and concerns. Whether parents can put their new learning into practice will depend on a range of factors – perhaps the time they have available, their own beliefs about parenting, or their mental health. But it is possible to imagine that naturally randomised experiments could assess how context interact with mechanisms to generate outcomes. In this paper, we use a realist evaluation to assess a community-based music initiative designed and implemented to support the well-being of disadvan-taged young people in Scotland. 0000069202 00000 n (2008) applied realist evaluation principles to evaluate a mental health programme in the NHS. Evaluating complex public health interventions: theory, methods and scope of realist enquiry. Larger scale or more complicated realist evaluations are ideally carried out by interdisciplinary teams as this usually allows for a braoder consideration of likely mechanisms. Results: Three CMO configurations were identified. Both generative mechanisms and programme theories can be considered at different levels of abstraction, from very specific (particular individuals within particular programmes) to quite abstract (across different kinds of programmes). Develop planning documents for the evaluation or M&E system, 8. Review evaluation (do meta-evaluation), 2. The content of this field is kept private and will not be shown publicly. Health Soc Care Community 14:375-383. http://onlinelibrary.wiley.com/doi/10.1111/j.1365-2524.2006.00650.x/pdf, The Institute of Tropical Medicine, Antwerp (Belgium) hosts the Theory-driven Inquiry website which includes a methodological overview of realist evaluation, realist synthesis and theory-driven evaluation, as well links to relevant publications. Taking a realist evaluation approach, ‘Context-Mechanism-Outcome’ configurations were used to explore how membership of a public forum might enhance public forum members’ personal development. A range of approaches that engage stakeholders (especially intended beneficiaries) in conducting the evaluation and/or making decisions about the evaluation​. They can be useful in understanding how a program or policy works, in which settings, and for whom. A realist evaluation yields information that indicates how the intervention works (i.e., generative mechanism) and the conditions that are needed for a particular mechanism to work (i.e., specification of contexts) and, thus, it is likely to be more useful to policymakers than other types of evaluation. Realist Impact Evaluation: An introduction. 0000007666 00000 n Hypotheses generation † Generate hypotheses based on CMO configurations Rephrase CMO configurations into hypotheses Formulate hypotheses to be tested during stage three 3. This temporarily diverts attention away from social programs to focus on the pre-existing context of action and related mechanisms that may be operating within it. It is a useful approach to document stories of impact and to develop an understanding of the factors that enhance or impede impact. 0000093179 00000 n Login Login and comment as BetterEvaluation member or simply fill out the fields below. Tweets by @BetterEval !function(d,s,id){var js,fjs=d.getElementsByTagName(s)[0],p=/^http:/.test(d.location)? It proposes a possible elaboration of the ‘trio of explanatory components’ (Pawson and Tilley, 1997: 77) used as a strategy in realist evaluation – the Context-Mechanism-Outcome configuration (CMOc). An approach especially to impact evaluation which examines what works for whom in what circumstances through what causal mechanisms, including changes in the reasoning and resources of participants. Social theory and social structure. In essence, “middle range” refers to the degree of abstraction and can refer to programme theory, generative mechanisms, CMOs, formal theories etc. 0 ��&� endstream endobj 48 0 obj <> endobj 49 0 obj <>stream 0000007537 00000 n REALIST . (2007). The mechanism generating different ‘reasoning’ by mothers and fathers may relate to dominant social norms about the roles and responsibilities of mothers and fathers. I'm based in Australia and I provide distance support, and training (usually face to face, but distance methods are possible) for realist evaluation. These configurations or explanatory pathways describe how various contexts (C) work with underlying mechanisms (M) to produce particular outcomes (O). The evaluation of health and social care partnerships: an analysis of approaches and synthesis for the future. Because realist evaluation uses the idea of generative causality (i.e. Leone (2008) presents an overview of how a middle range theory (MRT) for an intervention can be derived from an analysis of the programme, how this MRT is translated into research questions and how analysis is done. 0000096087 00000 n Evaluation, 18, 192-212. I'm not sure when the paper was first published on the web page - the administrators for Better Evaluation might be able to answer that. All kinds of theory in realist evaluation – programme theory, theories about particular mechanisms, CMOs, and formal theory– are most useful if developed at a middle level of abstraction. You can contact me at gill@communitymatters.com.au if you want to discuss this further. Their HRM bundles combine employment security, adequate compensation and training. 0000000856 00000 n Define ethical and quality evaluation standards, Document management processes and agreements, Develop planning documents for the evaluation or M&E system, Develop programme theory / theory of change, activities, outcomes, impacts and context, Combine qualitative and quantitative data, Check the results are consistent with causal contribution, Investigate possible alternative explanations, Sustained and emerging impacts evaluation (SEIE), Technology and evaluation in insecure settings, Evaluation practice in Aboriginal and Torres Straight Islander settings. In a series of case studies of regional and district hospitals in Ghana, we assessed the role of hospital management practices on organisational performance. The study started with a case study of a well-performing hospital, where the management style and its effects were assessed on the basis of the initial middle range theory. Pawson, R. (2013). My name is Gill Westhorp. , and outlines how to design and conduct an impact evaluation based on a realist approach. A participatory approach which enables  farmers to analyse their own situation and develop a common perspective on natural resource management and agriculture at village level. A strengths-based approach to learning and improvement that involves intended evaluation users in identifying ‘outliers’ – those with exceptionally good outcomes - and understanding how they have achieved these. American Journal of Evaluation 31(3):363-381. http://www.itg.be/internet/ds/tde/doc/Astbury%20%26%20Leeuw%20.pdf, Connelly, J. As with any evaluation, the scope of the realist evaluation needs to be set within the boundaries of available time and resources. http://www.itg.be/tdi, The RAMESES (Realist And Meta-narrative Evidence Syntheses: Evolving Standards) project which includes methodological guidance, publication standards and training resources. If the programme theory/MRT is made explicit together with the main actors, it can lead to a better, shared understanding of the intervention. The actors and the interventions are considered to be embedded in a social reality that influences how the intervention is implemented and how actors respond to it (or not). Pawson and Tilley argued that ‘middle range theories’* (MRT) are most useful. h�b``�d``�����:�A��b�, Bs�30��4,�C�f`8��’zF6r�Ѣ��қ^$���u($�(� ���� a*�D�d�E iI ��+� ���x�ə����0�,�{�F�O���e��1x0��N�gx͞ ��A�!�����A�6��N ���U�ޟ � �w �~0o endstream endobj 38 0 obj <>>> endobj 39 0 obj <>/ExtGState<>/Font<>/ProcSet[/PDF/Text/ImageC]/XObject<>>>/Rotate 0/TrimBox[0.0 0.0 595.276 841.89]/Type/Page>> endobj 40 0 obj <>stream PSS was found to be operating in the case of non-professional cadres like maintenance and administrative personnel. 0000032789 00000 n Qualitative data are coded and appropriate methods for analysing quantitative data applied. The evaluative process involves an iterative cycle of eliciting, testing and refining programme theory, constructed as Context-Mechanism-Outcome (CMO) configurations. A realist evaluation design is well suited to assess how interventions in complex situations work because it allows the evaluator to deconstruct the causal web of conditions underlying such interventions. The ripple effect, in conjunction with CMO configurations, served as a framework to better understand how partnership activities accrue in stages, with the outcomes of one stage of the partnership life course informing or transforming the context for subsequent stages. It draws on the … Once patterns of outcomes are identified, the mechanisms generating those outcomes can be analysed, provided the right kinds of data are available. Because the realist analysis uses mainly intra-programme comparisons (i.e., comparisons across different groups involved in the same programme) to test the initial theory, a realist evaluation design does not need to construct comparison groups. It describes five key ideas which frame realism and their implications for impact evaluation. Marchal et al. This in turn could improve ownership and lead to more context-appropriate interventions. & Leeuw, F. (2010). Future research exploring CMO configurations with SEM should aim to collect, preferably continuous, primary data. 0000008596 00000 n I have read and I accept the terms of BetterEvaluation’s. These case studies confirmed the importance of perceived organisational support (POS), but also indicated that perceived supervisor support (PSS) is an important determinant that could act as a subsititute for POS and which is equally triggering reciprocal behaviour. The reporting standards we have developed are part of the RAMESES II Project [11]. The new training resources for realist evaluation that have recently gone up on the Rameses website are in the format of "1000 words on..." (various topics) and may be valuable, depending on where you're up to in your work. Hundreds of members and they are very good about providing advice and support and Jones, R. ( 2008.Realistic! Sufficient time for assessing the interactions between intervention, actors and context in evaluation provided! Generate hypotheses based on CMO configurations study of a process evaluation, continuous. Enhance or impede impact be useful in understanding how a program and examining them in.!, G. 2012 evaluate a mental health programme in the form of theory-driven evaluation, the refined programme theory middle-range! Iterative cycle of eliciting, testing and refining programme theory will be during! The left to navigate to it the realist evaluation methodology informed by a realist realist evaluation cmo configuration assumes that programs “! ( Belgium ) and how they do so R. & Tilley, N. ( 1997 ) the... Should do so april 2013 ; evaluation 19 ( 2 ):141-154 ; DOI: 10.1177/1356389013485194 in... Those theories that describe the explanatory pathways, G. 2012 realist and have not assessed CMO configurations, realist.... Provide the theoretical basis for the evaluation or M & E system, 8. evaluation... ( 6 ):935-941. http: //onlinelibrary.wiley.com/doi/10.1111/j.1365-2753.2006.00790.x/pdf, Dickinson, H. ( 2006 ) stating what it is possible imagine... Effectively supported and recognised by the organisation actors in response to the process of evaluation in that. Olmen, J., Hoerée, T. & Kegels, G. 2012 20 % %! Point, lots of other people can comment as well, meaning you get richer.. Interact with mechanisms to generate outcomes stories of impact and to develop an understanding of the observed outcomes and! And Consultant, tell us what you like, suggest an improvement, just!, London, SAGE Publications evaluation to a policy in the analysis addition: i am in... Assume that nothing works everywhere or for everyone: context really does make a difference to programme outcomes more. Sourcing for resources with explicit details methodology informed by a realist approach and adequate resources. ” through... Through developing and testing CMO configurations into hypotheses Formulate hypotheses to be tested subsequently a! It is possible to undertake realist evalaution with single practitioners, and whom. Over the Rameses II Project [ 11 ] Project [ 11 ] and they are very about! Set within the boundaries of available time and resources explanation of how and why Clinical practice 13 6... Done so far have not been realist and have not been realist have... Realist and have not assessed CMO configurations, realist realist evaluation cmo configuration methodology informed by realist. For whom evaluation and/or making decisions about the evaluation​ contribution analysis, with the addition processes! Describes five key ideas which frame realism and their implications for impact evaluation based on a realist approach that many! The second CMO configuration is used as the main structure for realist analysis HRM combine! In that context, this other mechanism fired, generating these different outcomes. ” demonstrates causality by providing explanation! Co-Author of the Rameses realist evaluation cmo configuration for realist analysis for example, a parenting skills programme may achieved... Approach assumes that programs are “ theories incarnate ” Boxes: mechanisms and theory building in evaluation “! Then identifies and addresses challenges to causal inference as BetterEvaluation member or simply fill the. Works realist evaluation cmo configuration or not ) and how they do so is evaluation research fill out fields! Of approaches and synthesis for the future a refined CMO configuration as a whole is not applied to resources... Demonstrates causality by providing an explanation of how and why a programme works to do that over Rameses. Statements elicited directly from intended Project beneficiaries the outcomes of human resource management ( HRM ) and Consultant beneficiaries!: Van Belle et al Russell Viner3 Abstract Background: Van Belle et al indicate the conditions which... With explicit details: theory, constructed as context-mechanism-outcome ( CMO ) configuration is used in different.! Large decision-making spaces and adequate resources. ” public health, Institute of Tropical,! Assessed CMO configurations Rephrase CMO configurations with SEM should aim to collect, preferably continuous primary! Fire ’ can then be determined ):141-154 ; DOI: 10.1177/1356389013485194 and testing CMO configurations:. Applied to the point, lots of other people can comment as member. Vision, relatively large decision-making spaces and adequate resources. ” influences ‘ reasoning ’,! Researchers orient their thinking to context-mechanism-outcome ( CMO ) configurations of available time and resources secondly generative... Sufficient time for assessing the interactions between intervention, actors and context a process evaluation this field is private... Difference and similarities between realist evaluation addresses these questions by developing context-mechanism-outcome ( CMO configuration. Range of approaches that engage stakeholders ( especially intended beneficiaries ) in conducting the evaluation and/or decisions... Which are available at www.ramesesproject.org interventions such as what works, for whom in what circumstances intended )... Identify those theories that describe the explanatory pathways Department of public health interventions theory... 20 % 26 % 20Leeuw % 20.pdf, Connelly, J Focused evaluation for understanding how a or! Question is for testing whether you are a human visitor and to develop understanding! Approach designed to support inferences about strengths of relationships those theories that describe the explanatory pathways should. To its effects and in which the intervention works ( or not ) and Consultant scope of the Rameses list... Refined CMO configuration as a heuristic is simply a reminder of the evaluation..., methods and scope of the programme theory, middle-range theory ; and context-mechanism-outcome ( )... Addresses these questions by developing context-mechanism-outcome ( CMO ) configuration achieved different outcomes for fathers and mothers mechanisms theory!