{"id":13807,"date":"2022-12-14T13:06:26","date_gmt":"2022-12-14T11:06:26","guid":{"rendered":"https:\/\/www.sciencespo.fr\/research\/cogito\/home\/?p=13807"},"modified":"2022-12-15T10:50:05","modified_gmt":"2022-12-15T08:50:05","slug":"making-public-policy-evaluation-accessible","status":"publish","type":"post","link":"https:\/\/www.sciencespo.fr\/research\/cogito\/home\/making-public-policy-evaluation-accessible\/?lang=en","title":{"rendered":"Making Public Policy Evaluation Accessible"},"content":{"rendered":"<p><a href=\"https:\/\/scienceetbiencommun.pressbooks.pub\/evaluationanthologie\/\"><img decoding=\"async\" loading=\"lazy\" class=\"alignleft wp-image-13584\" src=\"https:\/\/www.sciencespo.fr\/research\/cogito\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-07-at-16-47-43-Evaluation-350x497.jpg-Image-JPEG-350-\u00d7-497-pixels.png\" alt=\"\" width=\"300\" height=\"426\" srcset=\"https:\/\/www.sciencespo.fr\/research\/cogito\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-07-at-16-47-43-Evaluation-350x497.jpg-Image-JPEG-350-\u00d7-497-pixels.png 350w, https:\/\/www.sciencespo.fr\/research\/cogito\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-07-at-16-47-43-Evaluation-350x497.jpg-Image-JPEG-350-\u00d7-497-pixels-211x300.png 211w, https:\/\/www.sciencespo.fr\/research\/cogito\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-07-at-16-47-43-Evaluation-350x497.jpg-Image-JPEG-350-\u00d7-497-pixels-103x146.png 103w, https:\/\/www.sciencespo.fr\/research\/cogito\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-07-at-16-47-43-Evaluation-350x497.jpg-Image-JPEG-350-\u00d7-497-pixels-35x50.png 35w, https:\/\/www.sciencespo.fr\/research\/cogito\/wp-content\/uploads\/2022\/11\/Screenshot-2022-11-07-at-16-47-43-Evaluation-350x497.jpg-Image-JPEG-350-\u00d7-497-pixels-53x75.png 53w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a>What is the purpose of public policy evaluation? How are evaluations produced? How can the issues be shared with a wide audience in order to strengthen democracy?\u00a0 These are the questions addressed in the book\u00a0<a href=\"https:\/\/scienceetbiencommun.pressbooks.pub\/evaluationanthologie\/\"><i>Evaluation: foundations, controversies, and perspectives<\/i><\/a> (\u00c9ditions \u2018Science and Common Good\u2019, 2021), coordinated by Anne Revillard, director of the Laboratory for Interdisciplinary Evaluation of Public Policies (LIEPP) and researcher at the Centre for Research on Social Inequalities (CRIS) at Sciences Po, in collaboration with Agathe Devaux-Spatarakis, Thomas Delahais, and Val\u00e9ry Ridde. Presentation.<\/p>\n<h3>A \u2018Transdiscipline\u2019 That is Still Too Little Known<\/h3>\n<p>The evaluation of public policies consists of mobilising social science methods to assess the operation and effects of public or public-interest interventions, while ensuring the usefulness of the knowledge thus produced. It covers a variety of practices carried out by a wide range of actors: researchers\u2009\u2013\u2009who have laid the methodological foundations of evaluation\u2009\u2013\u2009as well as administrations, consultants, international organisations, and non-governmental organisations.Over the past fifty years, these practices have led to the international development of a new body of interdisciplinary methods and theories discussed in specialised journals<span class=\"footnote_referrer\"><a role=\"button\" tabindex=\"0\" onclick=\"footnote_moveToReference_13807_1('footnote_plugin_reference_13807_1_1');\" onkeypress=\"footnote_moveToReference_13807_1('footnote_plugin_reference_13807_1_1');\" ><sup id=\"footnote_plugin_tooltip_13807_1_1\" class=\"footnote_plugin_tooltip_text\">(1)<\/sup><\/a><span id=\"footnote_plugin_tooltip_text_13807_1_1\" class=\"footnote_tooltip\">For example <a href=\"https:\/\/journals.sagepub.com\/home\/evi\">Evaluation<\/a>,<a href=\"https:\/\/journalhosting.ucalgary.ca\/index.php\/cjpe\">\u00a0<\/a> <a href=\"https:\/\/journals.sagepub.com\/home\/aje\">American Journal of evaluation<\/a>, <a href=\"https:\/\/journalhosting.ucalgary.ca\/index.php\/cjpe\">Canadian Journal of Program Evaluation<\/a>,\u00a0\u00a0<a href=\"http:\/\/journals.sfu.ca\/jmde\/index.php\/jmde_1\">Journal of MultiDisciplinary Evaluation<\/a>,<a href=\"https:\/\/journals.sagepub.com\/home\/erx\">\u00a0Evaluation review<\/a>,<a href=\"https:\/\/onlinelibrary.wiley.com\/journal\/1534875x\">\u00a0New directions for evaluation<\/a>,<a href=\"https:\/\/aejonline.org\/index.php\/aej\">\u00a0African Evaluation Journal<\/a>,<a href=\"https:\/\/journals.sagepub.com\/home\/evj\">\u00a0Evaluation Journal of Australasia<\/a>.<\/span><\/span><script type=\"text\/javascript\"> jQuery('#footnote_plugin_tooltip_13807_1_1').tooltip({ tip: '#footnote_plugin_tooltip_text_13807_1_1', tipClass: 'footnote_tooltip', effect: 'fade', predelay: 0, fadeInSpeed: 200, delay: 400, fadeOutSpeed: 200, position: 'top right', relative: true, offset: [10, 10], });<\/script>. Sometimes referred to as a \u2018transdiscipline\u2019, this body of work is struggling to establish a foothold in universities: doctoral programs, for example, are rare, as are positions specifically targeting the requisite skills.<br \/>\nMostly in English, this body remains little known to the French-speaking audience that it is likely to interest: public actors, associations, and citizens. Among academics, it is very unevenly mobilised depending on the discipline. When it is, the methodological dimensions are emphasised more than other aspects, particularly regarding reflection on values and on the use of the knowledge produced. The growing international literature on evaluation is also marked by a conceptual inflation that makes it difficult to access, including for researchers adding these new references to the tools and analytical frameworks of their respective disciplines.<\/p>\n<h3>Democratising Evaluation<\/h3>\n<p>In this context, our book has two objectives. The first goal is to democratise evaluation in the sense of making it accessible to the widest possible audience: researchers, students, public actors, non-governmental organisations, administrative evaluators, evaluation consultants, etc., as well as citizens, since evaluation is an essential democratic issue, enabling judgment of the relevance, effectiveness, and coherence of public interventions.<br \/>\nThe desire to facilitate access to a French-speaking audience in France and around the world guided the decision to publish in French, with the translation of basic or recent texts initially published in English. This desire to make evaluation accessible is also reflected in the format of the publication, which favours short text excerpts accompanied by chapters written by the book\u2019s coordinators that provide theoretical reference points and contextualise the published texts to facilitate their appropriation. Finally, the objective of making evaluation accessible is reflected, more literally, in the choice of an open access publication in partnership with the Quebecois publisher \u2018Science and common good\u2019 (<i>Science et bien commun<\/i>).<\/p>\n<h3>The Complementary Views of Academics and Practitioners<\/h3>\n<p>A second objective of the book is to bring together different perspectives and practices in evaluation, particularly between professional and academic practices. The project team includes two researchers (Val\u00e9ry Ridde, public health researcher at CEPED\u2009\u2013\u2009UPC, and Anne Revillard, sociologist at Sciences Po\u2009\u2013\u2009CRIS-LIEPP) and two professional evaluators (Agathe Devaux-Spatarakis and Thomas Delahais, evaluators at the SCOP <i>Quadrant Counseil<\/i>). The different chapters were discussed with a variety of theoretical colleagues and evaluation practitioners.<br \/>\nThe exchanges that took place during the writing process underscored the complementarity of views, which is reflected in the themes addressed in the chapters: while researchers are more likely to approach evaluation from the angle of its links with research and methodological and epistemological issues (\u2018<a href=\"https:\/\/scienceetbiencommun.pressbooks.pub\/evaluationanthologie\/chapter\/introduction-levaluation-est-elle-une-science\/\">Is evaluation a science?<\/a>\u201d \u2018Diverse paradigmatic approaches\u2019), practitioners introduce the issue of values, the practical organisation of evaluation, and usefulness of the knowledge (\u2018<a href=\"https:\/\/scienceetbiencommun.pressbooks.pub\/evaluationanthologie\/chapter\/introduction-evaluer-en-fonction-de-quelles-valeurs\/\">How to judge the value of interventions?\u2019<\/a>, \u2018Who evaluates and how?\u2019, \u2018<a href=\"https:\/\/scienceetbiencommun.pressbooks.pub\/evaluationanthologie\/chapter\/introduction-a-quoi-sert-levaluation\/\">What is the purpose of evaluation?\u2019<\/a>).<br \/>\nFor example, the notion of use can refer to the impact of the results of a given evaluation on public action (what changes were adopted as a result of an evaluation\u2019s findings?) But we can also consider in a broader way how the evaluation <i>process<\/i> itself encourages reflection among policy stakeholders and their knowledge-building about the evaluation process (beyond the specific case of the examined policy). Meanwhile, the question of evaluation criteria raises the question of what values guide the evaluation questions and the judgment calls on the interventions. In her article <a href=\"https:\/\/scienceetbiencommun.pressbooks.pub\/evaluationanthologie\/chapter\/levaluation-contribue-t-elle-au-bien-commun\/\">Does evaluation contribute to the common good?<\/a>, Sandra Mathison shows that beyond the terms set by a sponsor, it is important to think about evaluation criteria in terms of the common good, from the perspective of the most disadvantaged groups.<br \/>\nThe field of evaluation has thus given rise to original and particularly stimulating reflections on the role of values in the knowledge production process (notably through reflection on evaluation criteria), and on uses of the evaluation process and results. These are reflections that more academic research practices can also benefit from!<\/p>\n<p><b>Book coordinated by:<\/b><\/p>\n<ul>\n<li aria-level=\"1\"><b>Thomas Delahais<\/b>: evaluator and co-founder of the Quadrant Counseil cooperative. His work focuses on the evaluation of complex interventions and particularly on contribution analysis; the evaluation of transition initiatives; and the sociology of evaluation. He is a member of the editorial board of the <i>Evaluation<\/i> journal.<\/li>\n<li aria-level=\"1\"><b>Agathe Devaux-Spatarakis<\/b>: consultant and researcher for the Scop Quadrant Counseil. Agathe conducts public policy evaluation and methodological support missions for public organisations in France and abroad. A PhD in political science, she specialises in evaluation methods adapted to innovations and experiments, as well as the study of public decision-makers\u2019 use of the results.<\/li>\n<li aria-level=\"1\"><b>Anne Revillard<\/b>: associate professor of sociology at Sciences Po, member of the Centre for Research on Social Inequalities (CRIS), and director of the Laboratory for Interdisciplinary Evaluation of Public Policies (LIEPP).<\/li>\n<li aria-level=\"1\"><b>Val\u00e9ry Ridde<\/b>: research director at CEPED, a joint research unit between Universit\u00e9 Paris Cit\u00e9 and the Research Institute for Development (IRD). He is currently based at the Institute for Health and Development (ISED) at Cheikh Anta Diop University of Dakar (Senegal).<\/li>\n<\/ul>\n<div class=\"speaker-mute footnotes_reference_container\"> <div class=\"footnote_container_prepare\"><p><span role=\"button\" tabindex=\"0\" class=\"footnote_reference_container_label pointer\" onclick=\"footnote_expand_collapse_reference_container_13807_1();\">Notes<\/span><span role=\"button\" tabindex=\"0\" class=\"footnote_reference_container_collapse_button\" style=\"display: none;\" onclick=\"footnote_expand_collapse_reference_container_13807_1();\">[<a id=\"footnote_reference_container_collapse_button_13807_1\">+<\/a>]<\/span><\/p><\/div> <div id=\"footnote_references_container_13807_1\" style=\"\"><table class=\"footnotes_table footnote-reference-container\"><caption class=\"accessibility\">Notes<\/caption> <tbody> \r\n\r\n<tr class=\"footnotes_plugin_reference_row\"> <th scope=\"row\" class=\"footnote_plugin_index_combi pointer\"  onclick=\"footnote_moveToAnchor_13807_1('footnote_plugin_tooltip_13807_1_1');\"><a id=\"footnote_plugin_reference_13807_1_1\" class=\"footnote_backlink\"><span class=\"footnote_index_arrow\">&#8593;<\/span>1<\/a><\/th> <td class=\"footnote_plugin_text\">For example <a href=\"https:\/\/journals.sagepub.com\/home\/evi\">Evaluation<\/a>,<a href=\"https:\/\/journalhosting.ucalgary.ca\/index.php\/cjpe\">\u00a0<\/a> <a href=\"https:\/\/journals.sagepub.com\/home\/aje\">American Journal of evaluation<\/a>, <a href=\"https:\/\/journalhosting.ucalgary.ca\/index.php\/cjpe\">Canadian Journal of Program Evaluation<\/a>,\u00a0\u00a0<a href=\"http:\/\/journals.sfu.ca\/jmde\/index.php\/jmde_1\">Journal of MultiDisciplinary Evaluation<\/a>,<a href=\"https:\/\/journals.sagepub.com\/home\/erx\">\u00a0Evaluation review<\/a>,<a href=\"https:\/\/onlinelibrary.wiley.com\/journal\/1534875x\">\u00a0New directions for evaluation<\/a>,<a href=\"https:\/\/aejonline.org\/index.php\/aej\">\u00a0African Evaluation Journal<\/a>,<a href=\"https:\/\/journals.sagepub.com\/home\/evj\">\u00a0Evaluation Journal of Australasia<\/a>.<\/td><\/tr>\r\n\r\n <\/tbody> <\/table> <\/div><\/div><script type=\"text\/javascript\"> function footnote_expand_reference_container_13807_1() { jQuery('#footnote_references_container_13807_1').show(); jQuery('#footnote_reference_container_collapse_button_13807_1').text('\u2212'); } function footnote_collapse_reference_container_13807_1() { jQuery('#footnote_references_container_13807_1').hide(); jQuery('#footnote_reference_container_collapse_button_13807_1').text('+'); } function footnote_expand_collapse_reference_container_13807_1() { if (jQuery('#footnote_references_container_13807_1').is(':hidden')) { footnote_expand_reference_container_13807_1(); } else { footnote_collapse_reference_container_13807_1(); } } function footnote_moveToReference_13807_1(p_str_TargetID) { footnote_expand_reference_container_13807_1(); var l_obj_Target = jQuery('#' + p_str_TargetID); if (l_obj_Target.length) { jQuery( 'html, body' ).delay( 0 ); jQuery('html, body').animate({ scrollTop: l_obj_Target.offset().top - window.innerHeight * 0.2 }, 380); } } function footnote_moveToAnchor_13807_1(p_str_TargetID) { footnote_expand_reference_container_13807_1(); var l_obj_Target = jQuery('#' + p_str_TargetID); if (l_obj_Target.length) { jQuery( 'html, body' ).delay( 0 ); jQuery('html, body').animate({ scrollTop: l_obj_Target.offset().top - window.innerHeight * 0.2 }, 380); } }<\/script>","protected":false},"excerpt":{"rendered":"<p>What is the purpose of public policy evaluation? How are evaluations produced? How can the issues be shared with a wide audience in order to<span class=\"excerpt-hellip\"> [\u2026]<\/span><\/p>\n","protected":false},"author":3,"featured_media":13730,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[33,325,308],"tags":[79],"_links":{"self":[{"href":"https:\/\/www.sciencespo.fr\/research\/cogito\/home\/wp-json\/wp\/v2\/posts\/13807\/?lang=en"}],"collection":[{"href":"https:\/\/www.sciencespo.fr\/research\/cogito\/home\/wp-json\/wp\/v2\/posts\/?lang=en"}],"about":[{"href":"https:\/\/www.sciencespo.fr\/research\/cogito\/home\/wp-json\/wp\/v2\/types\/post\/?lang=en"}],"author":[{"embeddable":true,"href":"https:\/\/www.sciencespo.fr\/research\/cogito\/home\/wp-json\/wp\/v2\/users\/3\/?lang=en"}],"replies":[{"embeddable":true,"href":"https:\/\/www.sciencespo.fr\/research\/cogito\/home\/wp-json\/wp\/v2\/comments\/?lang=en&post=13807"}],"version-history":[{"count":3,"href":"https:\/\/www.sciencespo.fr\/research\/cogito\/home\/wp-json\/wp\/v2\/posts\/13807\/revisions\/?lang=en"}],"predecessor-version":[{"id":13811,"href":"https:\/\/www.sciencespo.fr\/research\/cogito\/home\/wp-json\/wp\/v2\/posts\/13807\/revisions\/13811\/?lang=en"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.sciencespo.fr\/research\/cogito\/home\/wp-json\/wp\/v2\/media\/13730\/?lang=en"}],"wp:attachment":[{"href":"https:\/\/www.sciencespo.fr\/research\/cogito\/home\/wp-json\/wp\/v2\/media\/?lang=en&parent=13807"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.sciencespo.fr\/research\/cogito\/home\/wp-json\/wp\/v2\/categories\/?lang=en&post=13807"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.sciencespo.fr\/research\/cogito\/home\/wp-json\/wp\/v2\/tags\/?lang=en&post=13807"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}