Het evalueren van maatschappelijke relevantie is niet altijd vanzelfsprekend voor financiers of onderzoekers. Dit lijkt vaak te abstract of verheven. Met name onderzoekers zijn gewend om de effectiviteit van een interventie op een bepaald doel of een bepaalde doelgroep te meten, maar breiden hun bevindingen niet uit naar hoe dit relevant kan zijn voor het veld. Aan de hand van een praktijkvoorbeeld, het ZonMw-onderzoeksprogramma Suïcidepreventie, wordt besproken hoe de maatschappelijke relevantie is geëvalueerd en welke uitdagingen dit met zich mee brengt. Zo is er geen eenduidige objectieve manier om maatschappelijke relevantie te evalueren. Ook waren de onderzoeksmethoden van de projecten binnen het onderzoeksprogramma erg verschillend. De aanbevelingen vanuit dit project kunnen toekomstige onderzoekers helpen om de maatschappelijke relevantie van hun onderzoek te evalueren. Verdere ontwikkeling en implementatie van gestandaardiseerde methoden of tools die de complexiteit binnen en tussen projecten vastleggen en maatschappelijke relevantie kunnen beoordelen, zijn nodig.

In this feature authors discuss recent research findings that are of interest to readers of Beleid en Maatschappij.

Addressing a creeping crisis like climate change requires nothing less than a system transition. A system transition is very complex and hence its success depends to a large extent on feedback effects: mechanisms where an initial change reinforces itself or balances itself out. Urgent crises are more salient than creeping crises. However, it is possible to combine policies for both urgent and creeping crises, as can be seen in policies that aim for a green recovery. In this article, we conclude that up till now such policies have overlooked the relevance of feedback effects. We provide examples of corona recovery measures that simultaneously help to establish a system transition through feedback effects.

The government strives for a low-carbon energy supply, sustainable agriculture and a circular economy. These transitions require a long-term orientation, while the long term is surrounded by deep uncertainty. This challenge poses two dilemmas for public knowledge institutions such as PBL Netherlands Environmental Assessment Agency. First, they should pay more attention to the unpredictability of the future, while policymakers expected them to make the future more predictable. Second, they should support the use of foresight more, while policymakers operate in a context that discourages this. The dilemmas require that the knowledge institutions make more work of speculation, that they actively organise the use of foresight and that they seek to connect with formal policy processes. While doing this it’s important that the knowledge institutions maintain their core values of scientific excellence, policy orientation and independence and also propagate this.

In this feature authors discuss recent research findings that are of interest to readers of Beleid en Maatschappij.

The Dutch public sector wants to become more diverse and inclusive, which seems necessary for the legitimacy and confidence of the government. This explorative study took place within two Dutch national government departments and shows how scientific insights into diversity and inclusion are reflected in government practice. Four results can be derived from this study: (1) The sense of urgency around diversity and inclusion has a stimulating effect, but the embedding of the theme into both departments deserves attention. (2) There is a wealth of perspectives and interventions, but hardly any attention to the connection with society. (3) The themes of leadership and inclusion should be higher on the agenda. (4) Psychological security determines an inclusive culture.
Important conclusions and recommendations are:
- Formulate a clear vision of diversity and inclusion, and involve the entire organisation in the approach.
- Strengthen an inclusive culture, and invest in inclusive leadership.
- Promote diversity at the top of the organisation.

Notably, the influx of diversity in the workforce is still the priority of many public organisations. However, the flow and retention of these employees needs more attention. There lies an important task for executives. These conclusions and recommendations form a basis for organisations that want to move forward with policies and interventions on diversity and inclusion.

Policy makers who work on sustainability transitions are well informed by transition science. As many scientific disciplines transition science comprises several theories and schools of thought, with distinct concepts and logical frames. The implication is that we can distinguish – subtle and implicit – different normative assumptions about, e.g., role of government, theory of social change, object of policy and issues of power. Such normative assumptions could then translate into policy, often without a proper assessment. This article aims to make such normative assumptions in transition theories more explicit. I explore how these normative elements translate into actual transition policy in a case of Dutch policy for ‘regional energy strategies’. Revealing normative elements in transition policy (or any policy field) can help policy makers to avoid pitfalls of conceptual cherry picking, thus contributing to transition policy that is scientifically and normatively robust.

In this feature authors discuss recent research findings that are of interest to readers of Beleid en Maatschappij.

Governments around the world responded at roughly the same time but in several different ways to the emerging threat of COVID-19 in early 2020. This article sets out the nature of the different strategies that emerged over the course of the pandemic, focussing on the policy tools deployed. Some of these efforts were successful in containing the coronavirus while others were not, in some cases due to poor initial choices and in others due to poor implementation of the chosen strategy. Although the initial understanding each government had of the nature of the disease was the same, different state capacities and different levels of preparedness and effective leadership can be seen to have resulted over time in the emergence of six distinct approaches to the pandemic which, once deployed, proved difficult, although not impossible, to change as the pandemic unfolded.

The Dutch Tweede Kamer is unique among parliaments because here the agenda is actually determined in a public, plenary meeting of all MPs. In the Dutch Tweede Kamer 30 members of parliament (MPs) can request a plenary debate. Many opposition parties request these debates, but only 23% of these are actually held. We examine the question ‘under what conditions do political party groups cancel or maintain proposals for minority debates?’ as a way to gain insight into the black box of parliamentary agenda setting. We examine two complementary explanations: issue competition and parliamentary style. We trace all 687 minority debates that were proposed between 2012 and 2021 in the Netherlands. This allows us to see what proposals for debates MPs make and when they are retracted. We find strong evidence that anti-elitist parties maintain more debate proposals than do other parties

The impact of audit office reports has received little attention in the scientific literature. In this article, various forms of impact have been distinguished with the help of Public Administration literature and factors that promote the use of evaluations have been distinguished. This theoretical framework was subsequently used for empirical research into the effect of audit office research. The extent to which the recommendations have had an impact was investigated in 20 Dutch municipalities with the aid of impact reports from audit institutions. Out of 176 publications, 94% of the 1216 recommendations were adopted by the city council. This means that the procedural impact is high. Of the 731 recommendations that could be checked at 17 municipalities, the local audit offices report that 58% had been fully implemented, 19% partially and 15% not or not tackled differently. The three categories of success factors from the scientific literature were visible in the practice of the audit offices. This applies most strongly to impact factors related to evaluation quality, in particular the factors related to communications standards, clear recommendations, timeliness and relevance to the decision maker. As far as research and decision-making factors are concerned, the commitment of the organization and the political climate are the most important factors for audit institutions. Finally, the involvement of stakeholders promotes the impact as a catalyst. The article concludes with practical lessons for promoting the processing of audit reports.

This article assesses the size and diversity of Belgium’s interest group population by triangulating four data sources. Combining various sources allows us to describe which societal interests get mobilised, which interest organisations become politically active and who gains access to the policy process and obtains news media attention. Unique about the project is the systematic data collection, enabling us to compare interest representation at the national, Flemish and Francophone-Walloon government levels. We find that: (1) the national government level remains an important venue for interest groups, despite the continuous transfer of competences to the subnational and European levels, (2) neo-corporatist mobilisation patterns are a persistent feature of interest representation, despite substantial interest group diversity and (3) interest mobilisation substantially varies across government levels and political-administrative arenas.

The recent decentralization of many healthcare and welfare responsibilities from the national to the municipal level in the Netherlands was aimed at reducing unnecessary bureaucracy and giving discretion to the professional. However, this is not (yet) fully achieved. Therefore, calls have been made for more purpose-driven organizations. Pro-social rule breaking, which refers to acts of rule breaking motivated by the benefits that this creates for citizens, might be a way to make organizations more focused on their organizational purpose. Since little is known about the antecedents of pro-social rule breaking, this article looks at the possible effects of red tape and supportive leadership on pro-social rule breaking behavior of professionals. Based on a quantitative large-n study of professionals in the social domain, the results show that red tape significantly affects pro-social rule breaking. Stimulating leadership does not affect pro-social rule breaking behavior, which may be caused by the fact that intended leader support is not be perceived that way by the professional. The article concludes with a discussion on the desirability of rule breaking in a public sector context, followed by practical implications and further avenues for researchers.

Municipalities play an important role in the Dutch energy transition. Therefore, they are expected to deal both sufficiently and timely with their tasks. The question is whether they have the capacity to do so (governing capacity). This study aims to assess whether improving governing capacity can be used to improve the policy performance. We operationalized governing capacity and built a model to assess the relation between several conditions for governing capacity and policy performance for three domains of the energy transition: built environment, mobility and renewables. We found no direct relationship between perceived governing capacity and energy transition policy output. However, we found relationships between conditions for governing capacity, and the policy output. About 25 percent of the total variance in policy performance could be attributed to population size. This percentage levels up to 55 to 60 percent if the motivation of the local administration, cooperation between municipalities and other governmental organisations and the participation of citizens and businesses are also taken into account. This contradicts the idea that enlarging municipalities is the most important way to achieve a higher policy performance.

In this article we discuss the role and position of different types of low income households in Dutch renewable energy transition processes using the concept of energy poverty. We explore which benefits and/or (dis)advantages (unintentionally) result from energy policies and regulations. And to what extent the distribution of these (dis)advantages benefit the position of different types of households. To this end we present an analytical perspective that enables us to evaluate renewable energy transition policies and governance on procedural and distributional aspects: paying attention to issues of recognition, equity and justice. The perspective draws on ideas in environmental justice literature and on ideas in social resilience literature. Combining these ideas in a new analytical framework proved to be useful in articulating some major policy challenges in relation to energy poverty in the Netherlands today.

Een reflexieve kijk op beleidsonderzoek gaat uit van continue dynamiek tussen kennisontwikkeling en beleids- en uitvoeringspraktijken. Beleidsonderzoekers zoeken naar houvast om gedegen en relevant onderzoek te blijven doen, onderwijl inspelend op onzekerheden, onvoorspelbaarheid en kritische geluiden die kenmerkend zijn voor de huidige kennissamenleving. Via omgevingsbewust werken kunnen zij hun onderzoeksaanpak leren afstemmen op de kenmerken en maatschappelijke context van beleidsdossiers. Via kwaliteitsbewust werken kunnen zij leren inspelen op de verwachtingen rondom een bepaalde expertrol en onderzoeksaanpak binnen de eigen contexten van onafhankelijkheid en wetenschappelijke verantwoording.
Aan de hand van een casus – de lerende evaluatie van het Natuurpact, een innovatieve evaluatiestudie bij het Planbureau voor de Leefomgeving – laten we zien hoe een reflexieve aanpak helpt om onderzoek in de nabijheid van de dynamische beleidspraktijk uit te voeren. Doordat deze aanpak buiten de comfortzone van onderzoekers ligt, is omgevingsbewust en kwaliteitsbewust werken voor onderzoekers geen vanzelfsprekendheid. We roepen beleidsonderzoekers zelf, de organisaties waar ze werkzaam zijn en beleidsmedewerkers op om hun reflexieve vaardigheden verder te ontwikkelen via het inrichten van lerende processen, effectieve kennisdeling via Communities of Practice en leerwerktrajecten, en open en adaptieve kennis-beleidsarrangementen.

Recent research demonstrates that political parties in western Europe are generally structured along one dimension – and often take more or less similar ideological positions on the economic and cultural dimension – whereas the policy preferences of voters are structured two dimensionally; a considerable part of the electorate combines left-wing stances on one dimension with right-wing stances on the other. These ideologically ‘unserved’ voters are the main focus of this study. Using data from a large-scale survey in Flanders and Wallonia, we demonstrate how the salience of the two dimensions explains whether these unserved voters ultimately end up voting for a right-wing or a left-wing party. Specifically, we show that these voters elect a party that is ideologically closest on the dimension that they deem most important at that time. To summarise, the findings of this study confirm that salience is a key driver of electoral choice, especially for cross-pressured voters.

Participatory and responsive approaches to research strive to be democratic, inclusive and impactful. Participatory researchers share a commitment to epistemic justice and actively engage citizens and users as well as other stakeholders in the co-creation of knowledge for social change. While more and more researchers and policymakers feel attracted to these approaches in practice, the normative ideals of social inclusion and justice are sometimes hard to realize, because of established interests, power relations and system requirements. In this article I argue that participatory researchers and evaluators have a moral responsibility to do ‘ethics work’. This is more than just following ethical principles and codes of conduct. ‘Ethics work’ entails the labour and effort one puts into recognizing ethically salient aspects of situations, developing oneself as a reflexive practitioner, paying attention to emotions and relationships, collaboratively working out the right course of action and reflecting in the company of critical friends. In this article I present the theory and ethics of participatory approaches, illustrate ethical issues and ethics work related to collaboration, politics and power, and share lessons based on ten years of practice in the field of health and social well-being.

Vooraf

Participatief actieonderzoek en responsieve evaluatie staan volop in de belangstelling bij beleidsmakers en onderzoekers. Dit type beleidsonderzoek en -evaluatie beoogt democratisch, inclusief én impactvol te zijn. Het gaat om onderzoek mét in plaats van óver mensen. En het is actiegericht: onderzoek wil bijdragen aan concrete oplossingen door met betrokkenen gezamenlijke (verbeter)acties te ontwikkelen in de praktijk, en daarop te reflecteren en van te leren. Dit alles met het oog op sociale inclusie. Het zijn mooie idealen, maar wat betekent dit in de alledaagse, vaak weerbarstige onderzoekspraktijk?

Op 20 januari 2020 organiseerde prof. Abma daarover een symposium, getiteld ‘Responsive, Participatory Research: Past, Present and Future Perspectives’ (Vrije Universiteit, Amsterdam). De rode draad op het symposium was de vraag wat goed en ethisch verantwoord participatief onderzoek is, en wat dit vraagt van onderzoekers en beleidsmakers. Drie lezingen op deze conferentie zijn nadien omgewerkt tot essays om lezers van Beleidsonderzoek Online vanuit verschillende perspectieven beter kennis te laten maken met deze vorm van onderzoek:

Prof. Weerman en haar team focussen in hun bijdrage op het zich in de praktijk ontwikkelende onderzoeksdesign en het inzetten van creatieve methoden om participatie te bevorderen. Ze gaan na welke kwaliteitscriteria aan participatief actieonderzoek worden gesteld en hechten daarbij met name aan eisen ten aanzien van participatie, samen leren en verschil maken (zie BoO juli 2021). Ze benadrukken het belang van creativiteit en flexibiliteit.

Prof. Abma bespreekt in haar artikel de normatieve dimensies en de ethiek van participatief actieonderzoek (zie BoO september 2020). Ze illustreert met een voorbeeld uit de crisishulpverlening aan GGZ-cliënten dat participatief actieonderzoek niet slechts een methodisch-technische exercitie is, maar een sociaal-politiek proces waarbij bestaande machtsverhoudingen verschuiven om ruimte te geven aan nieuwe stemmen en kennis. Dit omvat het zien van en stilstaan bij ethisch saillante dilemma’s en morele reflectie.

De bijdrage van prof. Cook (zie BoO februari 2021) gaat over de weerbarstige praktijk van participatief actieonderzoek. Het doel is samen leren en voorbij geijkte oplossingen komen. Zij laat zien dat dit uitdagend is voor professionals die geconfronteerd worden met burgers die feedback geven en vragen om het (deels) loslaten van vaststaande professionele kaders. Er ontstaat dan ongemak en onzekerheid, maar zo beoogt en laat Cook overtuigend zien, deze ‘mess’ (niet meer goed weten wat goed en nodig is) is productief om te komen tot hernieuwde inzichten en innovaties.

(Introductietekst opgesteld door prof. T. Abma)