They are Thus realism does involve being realistic. Realist research approaches • Realist evaluation = primary research • Realist review / synthesis = secondary research • Both approaches: – have more of an explanatory rather than judgmental focus. Realist evaluation is a type of theory-driven evaluation method used in evaluating social programmes. The realist approach to evaluation research: an introduction. It describes five key ideas which frame realism and their implications for impact evaluation. Medical Education 2012, 46:1, 89–96 • Klee R. Introduction to the philosophy of science. Realist approaches to evaluation assume that nothing works everywhere or for everyone: context really does make a difference to programme outcomes. A particular type of case study used to create a narrative of how institutional arrangements have evolved over time and have created and contributed to more effective ways to achieve project or program goals. • Realist evaluation = primary research • Realist synthesis = secondary research • Both methods: – have more of an explanatory rather than judgmental focus. Direct realism, also known as naive realism, can be described as “what you see is what you get”. For realist evaluations (RE) this project aims to: develop quality and reporting standards and training materials; build capacity for undertaking and critically evaluating them; produce resources and training materials for lay participants, and those seeking to involve them. But more importantly, it asserts that the things we are studying in social research have some prior existence and would continue to exist even if our knowledge of them was limited. Realist evaluation using Normalization Process Theory as a programme theory to understand what enabled patient and public involvement to be embedded as normal practice. Realism is an approach to humanity which recognizes the real existence of social objects as well as physical objects. An approach designed to support ongoing learning and adaptation, through iterative, embedded evaluation. An approach to decision-making in evaluation that involves identifying the primary intended users and uses of an evaluation and then making all decisions in terms of the evaluation design and plan with reference to these. It gives a brief introduction to the philosophical assumptions underlying realist methods and outlines key principles of realist evaluation (designed for empirical studies) and realist review (the application of realist methods to secondary research). This paper offers a model of research synthesis which is designed to work with complex social interventions or programmes, and which is based on the emerging 'realist' approach to evaluation. A realist evaluation provides an account of how aspects of and combinations of context and mechanisms interact to influence outcomes. Synthesise data from a single evaluation, The nature of programmes and how they work, Basic concepts in the explanation and understanding of programmes, Strategies and methods of realist evaluation, Realism’s place in the policy cycle: formative, summative and synthetic approaches, The nature, presentation and use of findings from realist evaluation, Conclusion: strengths, limitations and relationships with other approaches. We’d love to hear from you. 189–190; Hammersley, 1998, p. 3; Suppe, 1977, p. 618); realism has been prominent in other areas of philosophy as well (Miller, 2010). – based on a realist philosophy of science (ontology) – looks for mechanisms and middle-range theories. This paper describes the Learning Evaluation, a methodological approach that blends quality improvement and implementation research methods to study healthcare innovations. The introduction to the chapter covers ontology as it relates to research methods. An impact evaluation approach that iteratively maps available evidence against a theory of change, then identifies and addresses challenges to causal inference. Doing Realist Research combines the foundations of the realist methodology with the very latest thinking in the application, and development, of the approach.From understanding mechanisms, and the formulation of programme theories, to understanding the role of … 26 Causal explanations are expressed as contingent relationships between mechanisms (changes in participants’ reasoning or resources), context (contingencies) and outcomes, often abbreviated to context-mechanism-outcome configuration (CMO) to show how … A strengths-based approach designed to support ongoing learning and adaptation by identifying and investigating outlier examples of good practice and ways of increasing their frequency. Its overall place in the toolkit of evaluation approaches is not yet fully established. This paper offers a model of research synthesis which is designed to work with complex social interventions or programmes, and which is based on the emerging 'realist' approach to evaluation. However, theory-based approaches to evaluation, such as realist evaluation (RE), may be better-suited to examination of complex knowledge translation interventions with a view to understanding what works, for whom, and under what conditions. The implementation of the program, and the evaluation of it, then tests those hypotheses. A research design that focuses on understanding a unit (person, site or project) in its context, which can use a combination of qualitative and quantitative data. Learning Evaluation is an approach to multi … Realist researchers then try to articulate the theories (termed 'mechanisms') that underpin the programme and explore how contexts influence the mechanisms to produce different programme outcomes. Develop programme theory/theory of change, 5. Background. An approach especially to impact evaluation which examines what works for whom in what circumstances through what causal mechanisms, including changes in the reasoning and resources of participants. Realist review is part of a wider family of ‘theory driven’ approaches to evaluation. Login Login and comment as BetterEvaluation member or simply fill out the fields below. Define ethical and quality evaluation standards, 6. Basic concepts in the explanation and understanding of programmes 3. This approach was developed by Robert Brinkerhoff to assess the impact of organisational interventions, such as training and coaching, though the use of SCM is not limited to this context. The second section of the review introduces retroduction, a major methodological starting-point common to most realists. New York: Oxford University Press, 1997 evaluation approaches may not be feasible, with the broader aim of identifying lessons with wider application potential. While we do not seek to replicate this debate here, we acknowledge the possibility of using a critical realist approach to understand the outcomes of an RCT in primary care. G. Hewitt, S. Sims, R. Harris; Medicine; 1 May 2012; Background: The realist approach is a form of theory-driven evaluation developed to strengthen the explanatory power of evaluation studies and contribute to … An approach that focuses on assessing the value of an intervention as perceived by the (intended) beneficiaries, thereby aiming to give voice to their priorities and concerns. For example, 'Randomized Controlled Trials' (RCTs) use a combination of the options random sampling, control group and standardised indicators and measures. It describes five key ideas which frame realism and their implications for impact evaluation. https://www.ijtr.co.uk/cgi-bin/go.pl/library/artic... Development and Evaluation of Complex Interventions for Public Health Improvement (DECIPHer), H Social Sciences > H Social Sciences (General). Introduction. Introduction 1. Rycroft-Malone J, Burton CR, Williams L, et al. An approach used to surface, elaborate, and critically consider the options and implications of boundary judgments, that is, the ways in which people/groups decide what is relevant to what is being evaluated. Recommend content, collaborate, share, ask, tell us what you like, suggest an improvement, or just say hi! As a result, the quest for evidence-based policy (EBP) has turned increasingly to systematic reviews of the results of previous inquiries in the relevant policy domain. REALIST . Cited 9 times in Google Scholar. evaluation approaches may not be feasible, with the broader aim of identifying lessons with wider application potential. Student Feedback "I found the 5 days to be an excellent introduction and overview of realist evaluation and realist synthesis.