Het evalueren van maatschappelijke relevantie is niet altijd vanzelfsprekend voor financiers of onderzoekers. Dit lijkt vaak te abstract of verheven. Met name onderzoekers zijn gewend om de effectiviteit van een interventie op een bepaald doel of een bepaalde doelgroep te meten, maar breiden hun bevindingen niet uit naar hoe dit relevant kan zijn voor het veld. Aan de hand van een praktijkvoorbeeld, het ZonMw-onderzoeksprogramma Suïcidepreventie, wordt besproken hoe de maatschappelijke relevantie is geëvalueerd en welke uitdagingen dit met zich mee brengt. Zo is er geen eenduidige objectieve manier om maatschappelijke relevantie te evalueren. Ook waren de onderzoeksmethoden van de projecten binnen het onderzoeksprogramma erg verschillend. De aanbevelingen vanuit dit project kunnen toekomstige onderzoekers helpen om de maatschappelijke relevantie van hun onderzoek te evalueren. Verdere ontwikkeling en implementatie van gestandaardiseerde methoden of tools die de complexiteit binnen en tussen projecten vastleggen en maatschappelijke relevantie kunnen beoordelen, zijn nodig.

Governments around the world responded at roughly the same time but in several different ways to the emerging threat of COVID-19 in early 2020. This article sets out the nature of the different strategies that emerged over the course of the pandemic, focussing on the policy tools deployed. Some of these efforts were successful in containing the coronavirus while others were not, in some cases due to poor initial choices and in others due to poor implementation of the chosen strategy. Although the initial understanding each government had of the nature of the disease was the same, different state capacities and different levels of preparedness and effective leadership can be seen to have resulted over time in the emergence of six distinct approaches to the pandemic which, once deployed, proved difficult, although not impossible, to change as the pandemic unfolded.

Do citizens with a lower level of political representation evaluate political actors more negatively? While the literature has documented inequalities in political representation, less attention has been given to the extent to which different levels of representation affect citizens’ levels of political trust. We aimed to fill this gap by analysing whether Belgian citizens with a lower level of policy opinion congruence with their party’s legislators have lower levels of trust in the parliament. Our results show that policy opinion congruence has a positive impact on citizens’ political attitudes. Indeed, citizens with policy preferences closer to those of their political representatives tend to have higher levels of trust in the parliament. This rela‍tionship depends on political sophistication: policy opinion congruence affects political trust for most citizens except those who consider themselves to be ‘very interested’ in politics. Citizens with a very high level of interest in politics trust the parliament regardless of policy opinion congruence with their party’s legislators.

Peer assessment is a rather marginalised method in political research. This research note argues that the collective expertise of MPs can complement other data to contribute to more comprehensive evaluations of MPs’ parliamentary work. Yet, this method is potentially flawed by low survey participation and rater bias among MPs. The experience with a peer assessment survey among members of three Belgian parliaments shows that participation does not necessarily need to be problematic. However, the empirical analysis suggests that scholars should control for various forms of rater bias.

In this article I analyse whether differences in formal committee structures affect how parliamentary actors organise their work within them. I compare the allocation of members to specialised committees in the Dutch House of Representatives (Tweede Kamer) and the Belgian Chamber of Representatives (Kamer van Volksvertegenwoordigers/Chambre des Représentants) to test whether committee assignments are given more serious consideration when committees are strong. Despite many similarities, both parliaments differ in their internal institutional arrangements: committees in the Chamber of Representatives are, at least formally, considerably more powerful than those in the Dutch Lower House. The article uses the congressional theories of legislative organisation as heuristic devices to deduce several rationales of the assignment process. The role of parliamentary party groups is highlighted. The results indicate the presence of stable, reoccurring patterns in both parliaments. Even in the House of Representatives, where committees present lower opportunity structures, assignments are given due consideration.

In June 2020, the Flemish populist radical right party Vlaams Belang (VB) published the Corona Blunder Book (CBB; Coronablunderboek in Dutch), detailing the government’s mistakes in handling the COVID-19 crisis. Populist parties can ‘perform’ crisis by emphasising the mistakes made by opponents (Moffitt, 2015) and may use a specifically populist discursive style, consisting largely of aggressive and sarcastic language (Brubaker, 2017). This paper takes the CBB as a case study in the populist performance of crisis and the populist style, finding that the book is, first, a clear example of populist ‘everyman’ stylistics and the performance of crisis, and, second, that VB uses the book to shift the COVID-19 crisis from a public health crisis to a crisis of governance, seeking to blame Belgium’s federal structure for the government’s alleged mismanagement of the COVID-19 pandemic and hence arguing for Flemish independence, one of the party’s main agenda points.

Since January 2020, European countries have implemented a wide range of restrictions to contain the COVID-19 pandemic. Yet governments have also implemented democratic compensators in order to offset the negative impacts of restrictions. This article aims to account for the variation of their use between Belgium, the Netherlands and France. We analyse three drivers: the strength of counterpowers, the ruling parties’ ideological leanings and political support. Building on an original data set, our results distinguish between embedded and ad hoc compensators. We find that ad hoc compensators are championed mainly by counterpowers, but also by ideology of the ruling coalitions in Belgium and the Netherlands and used strategically to maintain political support in France. Evidence on the link between embedded compensators and counterpowers is more ambiguous.

The impact of audit office reports has received little attention in the scientific literature. In this article, various forms of impact have been distinguished with the help of Public Administration literature and factors that promote the use of evaluations have been distinguished. This theoretical framework was subsequently used for empirical research into the effect of audit office research. The extent to which the recommendations have had an impact was investigated in 20 Dutch municipalities with the aid of impact reports from audit institutions. Out of 176 publications, 94% of the 1216 recommendations were adopted by the city council. This means that the procedural impact is high. Of the 731 recommendations that could be checked at 17 municipalities, the local audit offices report that 58% had been fully implemented, 19% partially and 15% not or not tackled differently. The three categories of success factors from the scientific literature were visible in the practice of the audit offices. This applies most strongly to impact factors related to evaluation quality, in particular the factors related to communications standards, clear recommendations, timeliness and relevance to the decision maker. As far as research and decision-making factors are concerned, the commitment of the organization and the political climate are the most important factors for audit institutions. Finally, the involvement of stakeholders promotes the impact as a catalyst. The article concludes with practical lessons for promoting the processing of audit reports.

During electoral campaigns, the use of voting advice applications (VAAs) has become increasingly widespread. Consequently, scholars have examined both the patterns of usage and their effects on voting behaviour. However, existing studies lead to conflicting findings. In this article, we take a closer look at the effect of De Stemtest/Test électoral (a VAA developed by academics from the University of Louvain and the University of Antwerp, in partnership with Belgian media partners) on vote switching. More specifically, we divide this latter question into two sub-questions: (1) What is the impact of a (dis)confirming advice from the VAA on vote switching? (2) Do VAA users follow the voting advice provided by the VAA? Our study shows that receiving a disconfirming advice from the VAA increases the probability of users to switch their vote choice.

Participatory research is increasingly being perceived as a democratic and transformative approach to social situations by both academics and policymakers. The article reflects on what it means to do participatory research, what it contributes to broader knowledge building, and why mess may not only need to be present in participatory research but encouraged. The purposes of participation and mess as nourishment for critical enquiry and more radical learning opportunities are considered and illuminated using case study material from the Family Based Positive Support Project.

Vooraf

Participatief actieonderzoek en responsieve evaluatie staan volop in de belangstelling bij beleidsmakers en onderzoekers. Dit type beleidsonderzoek en -evaluatie beoogt democratisch, inclusief én impactvol te zijn. Het gaat om onderzoek mét in plaats van óver mensen. En het is actiegericht: onderzoek wil bijdragen aan concrete oplossingen door met betrokkenen gezamenlijke (verbeter)acties te ontwikkelen in de praktijk, en daarop te reflecteren en van te leren. Dit alles met het oog op sociale inclusie. Het zijn mooie idealen, maar wat betekent dit in de alledaagse, vaak weerbarstige onderzoekspraktijk?

Op 20 januari 2020 organiseerde prof. Abma daarover een symposium, getiteld ‘Responsive, Participatory Research: Past, Present and Future Perspectives’ (Vrije Universiteit, Amsterdam). De rode draad op het symposium was de vraag wat goed en ethisch verantwoord participatief onderzoek is, en wat dit vraagt van onderzoekers en beleidsmakers. Drie lezingen op deze conferentie zijn nadien omgewerkt tot essays om lezers van Beleidsonderzoek Online vanuit verschillende perspectieven beter kennis te laten maken met deze vorm van onderzoek:

Prof. Weerman en haar team focussen in hun bijdrage op het zich in de praktijk ontwikkelende onderzoeksdesign en het inzetten van creatieve methoden om participatie te bevorderen. Ze gaan na welke kwaliteitscriteria aan participatief actieonderzoek worden gesteld en hechten daarbij met name aan eisen ten aanzien van participatie, samen leren en verschil maken (zie BoO juli 2021). Ze benadrukken het belang van creativiteit en flexibiliteit.

Prof. Abma bespreekt in haar artikel de normatieve dimensies en de ethiek van participatief actieonderzoek (zie BoO september 2020). Ze illustreert met een voorbeeld uit de crisishulpverlening aan GGZ-cliënten dat participatief actieonderzoek niet slechts een methodisch-technische exercitie is, maar een sociaal-politiek proces waarbij bestaande machtsverhoudingen verschuiven om ruimte te geven aan nieuwe stemmen en kennis. Dit omvat het zien van en stilstaan bij ethisch saillante dilemma’s en morele reflectie.

De bijdrage van prof. Cook (zie BoO februari 2021) gaat over de weerbarstige praktijk van participatief actieonderzoek. Het doel is samen leren en voorbij geijkte oplossingen komen. Zij laat zien dat dit uitdagend is voor professionals die geconfronteerd worden met burgers die feedback geven en vragen om het (deels) loslaten van vaststaande professionele kaders. Er ontstaat dan ongemak en onzekerheid, maar zo beoogt en laat Cook overtuigend zien, deze ‘mess’ (niet meer goed weten wat goed en nodig is) is productief om te komen tot hernieuwde inzichten en innovaties.

(Introductietekst opgesteld door prof. T. Abma)

In this article we discuss the role and position of different types of low income households in Dutch renewable energy transition processes using the concept of energy poverty. We explore which benefits and/or (dis)advantages (unintentionally) result from energy policies and regulations. And to what extent the distribution of these (dis)advantages benefit the position of different types of households. To this end we present an analytical perspective that enables us to evaluate renewable energy transition policies and governance on procedural and distributional aspects: paying attention to issues of recognition, equity and justice. The perspective draws on ideas in environmental justice literature and on ideas in social resilience literature. Combining these ideas in a new analytical framework proved to be useful in articulating some major policy challenges in relation to energy poverty in the Netherlands today.

This Research Note investigates party advertising in newspapers and on social media (Facebook) during the 2019 general elections in Flanders, the largest region of Belgium. The 2019 elections saw a marked increase in the use of social media advertising by parties, whereas newspaper advertising saw a decline. Prior research that compares multiple types of advertising, particularly advertising on social and legacy media remains limited. As such, based on a quantitative content analysis we investigate not just the prevalence of party advertising on both types of media, but also compare the level of negativity, presidentialisation, and issue emphasis. Our analysis reveals substantial differences: we find that not only the type of advertisements varies across the platforms, but also that social media ads tend to be more negative. Finally, parties’ issue emphasis varies substantially as well, with different issues being emphasized in newspaper and Facebook advertisements.

Recently, studies have burgeoned on the link between populism and demands for democratic reforms. In particular, scholars have been debating the link between populist citizens or voters and support for referendums. In this article, we examine voters of populist parties (Vlaams Belang (VB) and Parti du Travail de Belgique-Partij van de Arbeid (PTB-PVDA)) in Belgium in 2019 and we look at their attitudes towards various types of democratic reforms. We find that voters of populist parties differ from the non-populist electorate in their support for different kinds of reforms of representative democracy. Voters of VB and PTB-PVDA have in common stronger demands for limiting politicians’ prerogatives, for introducing binding referendums and for participatory budgeting. While Vlaams Belang voters are not significantly different from the non-populist electorate on advisory referendums, citizens’ forums or technocratic reform, PVDA-PTB voters seem more enthusiastic.

This article digs into the relationship between voters’ political resentment and their electoral choice in 2019 by focusing on the respondents’ emotions towards politics. Using the RepResent 2019 voter survey, eight emotions are analysed in their relation to voting behaviour: four negative (anger, bitterness, worry and fear) and four positive (hope, relief, joy and satisfaction). We confirm that voters’ emotional register is at least two-dimensional, with one positive and one negative dimension, opening the possibility for different combinations of emotions towards politics. We also find different emotional patterns across party choices, and more crucially, we uncover a significant effect of emotions (especially negative ones) on vote choice, even when controlling for other determinants. Finally, we look at the effect of election results on emotions and we observe a potential winner vs. loser effect with distinctive dynamics in Flanders and in Wallonia.

Participatory and responsive approaches to research strive to be democratic, inclusive and impactful. Participatory researchers share a commitment to epistemic justice and actively engage citizens and users as well as other stakeholders in the co-creation of knowledge for social change. While more and more researchers and policymakers feel attracted to these approaches in practice, the normative ideals of social inclusion and justice are sometimes hard to realize, because of established interests, power relations and system requirements. In this article I argue that participatory researchers and evaluators have a moral responsibility to do ‘ethics work’. This is more than just following ethical principles and codes of conduct. ‘Ethics work’ entails the labour and effort one puts into recognizing ethically salient aspects of situations, developing oneself as a reflexive practitioner, paying attention to emotions and relationships, collaboratively working out the right course of action and reflecting in the company of critical friends. In this article I present the theory and ethics of participatory approaches, illustrate ethical issues and ethics work related to collaboration, politics and power, and share lessons based on ten years of practice in the field of health and social well-being.

Vooraf

Participatief actieonderzoek en responsieve evaluatie staan volop in de belangstelling bij beleidsmakers en onderzoekers. Dit type beleidsonderzoek en -evaluatie beoogt democratisch, inclusief én impactvol te zijn. Het gaat om onderzoek mét in plaats van óver mensen. En het is actiegericht: onderzoek wil bijdragen aan concrete oplossingen door met betrokkenen gezamenlijke (verbeter)acties te ontwikkelen in de praktijk, en daarop te reflecteren en van te leren. Dit alles met het oog op sociale inclusie. Het zijn mooie idealen, maar wat betekent dit in de alledaagse, vaak weerbarstige onderzoekspraktijk?

Op 20 januari 2020 organiseerde prof. Abma daarover een symposium, getiteld ‘Responsive, Participatory Research: Past, Present and Future Perspectives’ (Vrije Universiteit, Amsterdam). De rode draad op het symposium was de vraag wat goed en ethisch verantwoord participatief onderzoek is, en wat dit vraagt van onderzoekers en beleidsmakers. Drie lezingen op deze conferentie zijn nadien omgewerkt tot essays om lezers van Beleidsonderzoek Online vanuit verschillende perspectieven beter kennis te laten maken met deze vorm van onderzoek:

Prof. Weerman en haar team focussen in hun bijdrage op het zich in de praktijk ontwikkelende onderzoeksdesign en het inzetten van creatieve methoden om participatie te bevorderen. Ze gaan na welke kwaliteitscriteria aan participatief actieonderzoek worden gesteld en hechten daarbij met name aan eisen ten aanzien van participatie, samen leren en verschil maken (zie BoO juli 2021). Ze benadrukken het belang van creativiteit en flexibiliteit.

Prof. Abma bespreekt in haar artikel de normatieve dimensies en de ethiek van participatief actieonderzoek (zie BoO september 2020). Ze illustreert met een voorbeeld uit de crisishulpverlening aan GGZ-cliënten dat participatief actieonderzoek niet slechts een methodisch-technische exercitie is, maar een sociaal-politiek proces waarbij bestaande machtsverhoudingen verschuiven om ruimte te geven aan nieuwe stemmen en kennis. Dit omvat het zien van en stilstaan bij ethisch saillante dilemma’s en morele reflectie.

De bijdrage van prof. Cook (zie BoO februari 2021) gaat over de weerbarstige praktijk van participatief actieonderzoek. Het doel is samen leren en voorbij geijkte oplossingen komen. Zij laat zien dat dit uitdagend is voor professionals die geconfronteerd worden met burgers die feedback geven en vragen om het (deels) loslaten van vaststaande professionele kaders. Er ontstaat dan ongemak en onzekerheid, maar zo beoogt en laat Cook overtuigend zien, deze ‘mess’ (niet meer goed weten wat goed en nodig is) is productief om te komen tot hernieuwde inzichten en innovaties.

(Introductietekst opgesteld door prof. T. Abma)

Theorieën en methoden uit de gedragswetenschappen betreden steeds nadrukkelijker de beleidsscene. Gedragsinzichten en nudging beloven beleid te verrijken en te versterken. Het begin van deze gedragswetenschappelijke omslag of behavioural turn laat men doorgaans samenvallen met de publicatie van het boek Nudge van Richard Thaler en Cass Sunstein in 2008. In dit artikel plaatsen we nudging in perspectief en argumenteren we dat het concept zowel een zegen als een vloek betekent, en zowel een katalysator als een rem is voor de bredere toepassing en verankering van gedragsinzichten in beleid. Ondanks het aantrekkelijke narratief botst nudging op functionele limieten en ethische bezwaren. Om de gedragswetenschappelijke, experimentele en evidence-based beleidsbeloften alsnog in te lossen, zien we een strategie van steeds verdere verbreding. Het programma van de Behavioural Insights-beweging op basis van vijf pijlers leek in eerste instantie een oplossing te bieden, maar kampt door een eendimensionale interpretatie met interne spanningen. De nog bredere en ambitieuzere Behavioural Public Policy-agenda biedt nieuwe perspectieven, maar moet op functioneel en ethisch vlak nog verder onderbouwd worden.

The theoretical assumptions of deliberative democracy are increasingly embraced by policymakers investing in local practices, while the empirical verifications are often not on an equal footing. One such assertion concerns the stimulus of social learning among participants of civic democratic deliberation. Through the use of pre-test/post-test panel data, it is tested whether participation in mini-publics stimulates the cognitive and attitudinal indicators of social learning. The main contribution of this work lies in the choice of matching this quasi-experimental set-up with a natural design. This study explores social learning across deliberation through which local policymakers invite their citizens to participate in actual policymaking. This analysis on the District of Antwerp’s participatory budgeting demonstrates stronger social learning in real-world policymaking. These results inform a richer theory on the impacts of deliberation, as well as better use of limited resources for local (participatory) policymaking.

The Dutch central government has a long history in its search to meaningfully present policy effects. One of the instruments that was developed to this end is the Policy Conclusion (beleidsconclusie). This part of the annual report, which has been mandatory since 2013, should provide a judgement for every policy article on its results in the year 2017. To what extent has the Policy Conclusion been successful in its aims? And how do various governmental departments give substance to it? For this article, all policy conclusions that were composed for the most recent reporting year were examined. Among others, our analysis shows that departments differ greatly in their interpretation of what the Policy Conclusion should include, such as the usage of sources and the way in which intended results are (re)addressed. In addition, it was found in the Policy Conclusions that a tendency exists to put a strong focus on positive outcomes.

This article tackles the particular issue of split-ticket voting, which has been largely overlooked in Belgian election studies thus far. We contribute to the literature by answering two particular research questions: (1) to what extent and (2) why do voters cast a different vote in the elections for the provincial council as compared to their vote in the elections for the municipal council?
The article draws on survey data collected via an exit poll in the ‘Belgian Local Elections Study’, a research project conducted by an inter-university team of scholars.
Our analysis shows that nearly 45% of the total research population cast a split-ticket vote in the local elections of 2018. However, this number drops to one out of four if we only consider a homogenous party landscape at both levels by excluding the numerous votes for ‘local’ lists (which occur mostly at the municipal level). This finding underlines the importance of accounting for the electoral and institutional context of the different electoral arenas in research on split-ticket voting in PR systems. In the Belgian context, split-ticket voting in 2018 also differed between the different parties and regions. Furthermore, it was encouraged by a higher level of education and familiarity with particular candidates. This candidate-centred and strategic voting was matched by party identification and the urban municipal context favouring straight-ticket voting. Other factors such as region, a rural municipal context and preferential voting seemed more relevant to determine voting for local parties than using the instrument of split-ticket votes as such.