Institutional determinants and mechanisms of evaluation use in public sector organizations
This project deals with the problem of insufficient use of the findings from evaluation in the process of formulating and implementing public interventions (policies, programs, regulations). Years-long observations prove that all too often public sector organizations use evaluation only symbolically (i.e. they conduct studies not to actually use findings, but only to demonstrate that their decision making process is rational and based on evidence). Explaining and finding a solution to this phenomenon is of great practical importance, because the quality of policies and thus indirectly economic development or quality of life depends on the actual use of evaluation.
Previous studies focusing usualy on the perspective of a single evaluation study have not yielded conclusive findings. For several years, a new promising approach has been developed focusing on the overall perspective of the evaluation system, i.e. an organization that conduct a stream of studies and should use it, and the environment in which it functions.
The aim of this project is to verify how the public sector organization uses evaluation, including:
- external pressure from the environment in which the organization operates (e.g. pressure from funders, or general uncertainty about the future),
- internal propensity to evaluate related to the type of business / activity.
The main element of the research design is the quantitative analysis of a large sample of organizations conducting evaluation in public and non-government sectors, from five countries with different evaluation cultures: Austria, Danmark, Ireland, the Netherlands and Poland. The use of Qualitative Comparative Analysis (QCA) will hopefully lead to the identification of necessary and sufficient conditions for each of the possible types of evaluation use and non-use.
The main outcome of the study will be a theoretically grounded and empirically verified model explaining how the institutional context in which the organization operates and its internal characteristics affect the way of using evaluation at various stages of the development of its evaluation system. These results will contribute to the understanding of the phenomenon of using knowledge in the activities of public organizations, contributing to the development of public policy and public management disciplines.
- Kupiec Tomasz, Celińska-Janowicz Dorota (2023) Praktyka ewaluacji interwencji publicznych w miastach na prawach powiatu, Studia Regionalne i Lokalne. 4(94), ss. 66-82.
- Kupiec Tomasz (2022) Does Evaluation Quality Matter? Quantitative Analysis of the Use of Evaluation Findings in the Field of Cohesion Policy in Poland. Evaluation and Program Planning, Vol. 93, 102103.
- Kupiec Tomasz, Wojtowicz Dominika, Olejniczak Karol (2021) Structures and functions of complex evaluation systems: comparison of six Central and Eastern European countries. International Review of Administrative Sciences, August 2021.
- Kupiec Tomasz (2022) Jak profesjonalizować ewaluację? Krytyczne spojrzenie na inicjatywę PTE na rzecz stworzenia opisu kwalifikacji „Prowadzenie ewaluacji”. Polski Przegląd Ewaluacyjny, I/2022, pp. 103-134.
- Kupiec Tomasz, Celińska-Janowicz Dorota, Pattyn Valérie (2023) Understanding evaluation use from an organisational perspective: A review of the literature and a research agenda. Evaluation, 13563890231185164.
- Dotti Nicola Francesco, Colnot Louis, Walczyk Julia, Kupiec Tomasz, Pellegrin Julie (2024) Triggering policy learning via formal EU evaluation requirements in the case of Cohesion Policy. European Policy Analysis.
- Kupiec Tomasz, Wrońska Zuzanna (2024) Motivation to Adopt Evaluation Practice as a Determinant of Evaluation Use. American Journal of Evaluation.