Category: Research Resources

Citizen Engagement Tools: Online Budget Simulations

Blog post by Whitney Afonso, Zach Mohr, and Scott Powell

Questions for Practitioners:

  • When (as in time of year) should you engage citizens in budget simulations?
  • Can I expect trust in our government to increase if we engage citizens in budget simulations?
  • How do starting budget conditions affect revenue and expenditure preferences, and what role do deficits, surpluses, and balanced conditions play in shaping these preferences?
  • In what ways can local government practitioners enhance the design of budget simulations based on the findings, and what considerations should they take into account when implementing such simulations to engage citizens in the budget process?

 

Introduction

In the rapidly evolving landscape of budget engagement, online budget simulations have gained prominence. This blog addresses the increasing use of these simulations, particularly in local governments, and emphasizes the need for a thoughtful evaluation of design choices. While previous studies focused on federal budgets, this blog delves into municipal budget simulations, posing the question: does beginning the simulation in balance, deficit, or surplus affect respondents’ engagement and budget preferences?

The blog post summarizes an article published in the journal Public Budgeting & Finance.  We also discuss findings that were not presented in the article that suggests that starting the simulations in deficit really does not affect trust. The blog is useful to anyone that is looking to think more deeply about how to set up an online budget simulation.  They may also be useful to those that want to do experiments in budget and finance settings, which have some important practical challenges.

The findings from the research are highly relevant to local government budget practitioners who wish to engage citizen to participate in the budget process. As budgeting preferences are shown to be a function of design, budgeteers should think critically about the design of their simulations.  Specifically, we think that starting from a small budget deficit position, such as the level of inflation, may be the best way to practically get more engagement with the budget simulation, but this may influence the budget outcomes from the simulation.  At any rate, a choice on how to start the simulation must be made.

Summary of the Article

While traditional in-person engagement has been the norm, the shift to online methods, accelerated by the COVID-19 pandemic, brings benefits such as broad accessibility to the simulation and speed to complete them (although this may also be a bit of a problem).  The article first traces the evolution of online budget simulations from national to local levels, emphasizing their growth in popularity and recognition as a best practice in public engagement, with examples of awards received by local governments. The newer “dynamic” simulations, allowing simultaneous adjustments to revenue and expenditures, are highlighted for their widespread adoption and relevance for both local governments and scholars interested in testing budget engagement theories.

Behavioral Model and Hypotheses

In the article, we discuss the impact of information presentation in budget simulations on participant engagement and budgetary preferences. Referring to previous studies, we establish that the way information is presented, especially concerning cost and performance, influences budget preferences. The model proposed suggests that starting a simulation with different budgetary conditions affects participant engagement and preferences. Unlike prior assumptions of intrinsic motivation, this research explores how the simulation structure influences engagement levels, potentially influencing other perceptions like trust in the government, which we discuss more below.

Research Design and Analysis

Participants engaged in the simulation as part of an online survey experiment. The study aimed to understand how starting conditions (balanced, a 5% deficit, or a 5% surplus) influenced participant engagement, preferences, and perceptions.

Due to local leaders’ concerns about public perception, the simulation had to be conducted in a controlled lab environment rather than in the field. This field-in-lab experiment involved randomly assigning participants to different budgetary conditions, mirroring those of a nearby local government. The participants were younger and more diverse than the general population, being students from the university, thus the specific policy preferences indicated in the simulation are not generalizable to the population.

The analysis focused on three main aspects: level of engagement, budgetary preferences, and final budgetary balance. Contrary to expectations, the time spent on the simulation did not significantly differ between deficit, surplus, and balanced conditions. However, the deficit treatment significantly reduced the number of participants completing the simulation, indicating potential difficulties. The deficit treatment increased the number of changes made to both expenditures and revenues, while the surplus treatment primarily influenced changes in revenues.

Starting conditions significantly affected both revenues and expenditures. Participants tended to maintain taxes when starting in balance, reduce them in surplus, and either maintain or increase them in deficit. Expenditure changes were idiosyncratic, with deficits leading to more significant cuts.

The results partially supported hypotheses related to the size of changes and the final budgetary balance. Participants starting in deficit made larger changes to expenditures, but the final balance was only significantly influenced by the surplus condition, aligning with anchoring and status quo bias. The study sheds light on how starting conditions in budget simulations impact participant behavior, providing valuable insights for both academic research and practical applications in local government budget engagement.

Discussion

The experiment demonstrates that different starting conditions significantly impact engagement and budgetary preferences. Two out of three engagement outcomes were influenced by starting conditions, indicating their substantial role in shaping participant behavior. The deficit condition particularly amplified cuts to services like the police, suggesting that unpopular services might be more vulnerable during financial downturns. Despite the expected increase in time spent on the simulation due to varied starting conditions, time was not significantly affected, potentially influenced by the participants’ choice to avoid difficult tasks.

The deficit condition reduced the likelihood of participants completing the simulation, highlighting cognitive limitations and avoidance of challenging situations. This finding has practical implications for practitioners, emphasizing the trade-off between obtaining more information through deficit starting conditions and the decrease in completions. Future research could explore predictors of completion, such as math literacy, to enhance engagement. Additionally, practitioners may need to consider when to run simulations, as participants’ responses could vary depending on the budget preparation cycle.

Observations of “chunking” behavior in deficit conditions, where participants made larger changes, suggest a dynamic relationship between engagement and budgetary preferences. The study encourages further behavioral theory development in the context of budget simulations.

The research contributes to understanding individual psychological processes like anchoring, loss aversion, and decisional inertia in budget engagement, offering insights for practitioners on designing effective simulations. Practical implications include adjusting starting conditions based on desired outcomes and considering the impact of performance information on budget engagement. The study advocates for more field experiments and “field-in-lab” experiments to refine the choice architecture of politically sensitive topics like budget simulations, enhancing the usability and effectiveness of engagement efforts. Overall, the findings underscore the importance of behaviorally informed changes in shaping public engagement and preferences in budget-related decision-making.

The Simulation’s Effect on Trust

One of the things that was particularly important to our local government partner that we were helping to test the effect of starting position was to make sure that this did not have an effect on citizen’s trust.  The city had carefully maintained its well earned reputation for being a good steward of taxpayers money and it did not want to see that reputation tarnished because citizens’ were asked to do a budget simulation that started in deficit.  This was a major reason that we ran the simulation on students where we could properly debrief them that the scenario was not real and we took out all mentions to this specific city in the simulation.

We also saw that it was an opportunity to test the effect of the simulation and the simulation starting position on the outcome of trust in local government.  So, we actually designed an experiment within the experiment that would look at the effect of seeing no simulation relative to seeing a simulation.  We also are able to see if the effect of the treatment of balance, deficit, and surplus had an effect on trust.  So, the experiment participants were first given a series of demographic questions and a question about trust in different levels in government, they were then randomly assigned into one of the four treatments shown in figure 1 and were asked to complete the simulation, and then the participants were asked about their level of trust in government again.  So, this can be treated as either a between subject or pre-post design.

Figure 1: The four treatment conditions

 

It really doesn’t matter, though, how we analyze the data because there was no statistically significant effect of the simulation on trust.  There was likewise no effect between the different starting treatments on the levels of trust between the treatments or the change in the trust.  Put simply, starting a budget in deficit is not going to influence the level of trust – at least as we measured it.  One of the things that we are doing with future surveys is looking at whether the simulations had effects on other perceptions about the government.

Conclusion

The results of the published study and the results that we are presenting here suggest that there are only minimal negative effects of starting a budget in deficit.  Most importantly it may modestly reduce the number of completions.  However, starting the budget simulation in a small deficit – such as the current rate of inflation – may lead the respondents that complete the budget to adjust more types of revenue and expenditure and provide budgeteers with more realistic information about how citizens would balance the budget.  Starting the budget simulation in deficit is also found not to reduce trust.  Future research is ongoing about the responses to different levels of deficit (2.5%, 5%, 7.5% or 10%) and effects on other perceptual outcomes.  We would invite the budget community to propose other types of experiments that they would like to see researchers address and the research community should continue to work with local governments to test their most promising behavioral changes to these simulations.

 

Citation to journal article:

Mohr, Zach, and Whitney Afonso. “Budget starting position matters: A “field‐in‐lab” experiment testing simulation engagement and budgetary preferences.” Public Budgeting & Finance (2023).

One Working Capital Management Strategic Tool: Interfund Transfers

By Michelle Lofton and Mikhail Ivonchyk

Working capital management is a managerial strategy that monitors and uses current assets (e.g., cash, accounts receivable, and inventory) and current liabilities (e.g., accounts payable and notes payable) to ensure smooth operations. The purpose is to maintain cash flows for liquidity to meet short-term operating expenses and obligations. This integral part of sound financial management uses a variety of strategic tools to manage cash flows. These can include the use of unrestricted cash, savings, interfund borrowing, interfund transfers, delaying payments, receivables, a line of credit, direct lending arraignments, and short-term debt. Yet, little academic research on governments has evaluated the process for selecting different tools, the policies governments have in place to implement them, and the consequences of using one tool over another.

Continue reading

Social Impact Bonds: A Magic Tool for Financing Innovation?

Have you heard about social impact bonds (SIBs) yet?  If not there are a lot of resources and discussion out there regarding this magical fix of financial woes of government.  While many have viewed these as too good of an opportunity to pass up (for example, see here and here), others have been slightly more skeptical.

Continue reading

A New Collection Available from an Old Resource

In this post, I wanted to share that the School of Government’s Knapp Library has a new collection for North Carolina’s assessment community. This is a short post because I anticipate most of the reading will occur as you explore the links in this post. In January, IAAO announced the availability of their new collection of informational books on assessment, Apendium.

Continue reading

Do cities and counties circumvent state policy? One potential mechanism.

Cities and counties are constructs of their respective states. Counties are almost always created by state constitutional decree. Cities are municipal corporations created by state legislative action. Regardless of the method of creation, states exercise significant control over what cities and counties can and cannot do. From the taxes levied to debt issuances to services that can or cannot be provided, the state determines the role of local governments within its borders. States have been pre-empting local policies at an increasing rate. The National League of Cities has documented a number of these actions. Popular targets are restrictions locally imposed minimum wages (24 states), paid leave (18 states), and public provision of broadband internet (17 states). Of these three, North Carolina is included in all. There are many other areas where states have been pre-empting local actions. This top-down view suggests that local governments have little ability to chart their own course. However, this isn’t quite right. There are many ways that cities and counties push back against state policy. In the news now, Sanctuary Cities in Texas are pushing back against new laws restricting their actions. This is a highly visible example; however, cities and counties often have other options that are less visible.

Continue reading

North Carolina’s County and Municipal Fiscal Analysis Tool: Research Review

Have you ever used the County and Municipal Fiscal Analysis tool that is housed on Treasurer’s website?  It allows municipalities and counties in the state to see how they are doing with regard to financial condition and compare their performance to peers.  It has recently become the focus of new research coming from colleagues at the University of South Dakota and Indiana University.  Ed Gerrish and Luke Spreen presented their research on our benchmarking tool earlier this month at the Public Management Research Conference and it is forthcoming at the Journal of Public Administration Research and Theory.  In this Research Review I am going to discuss their research and pull a few findings that are especially notable for those of you that work in budgeting and finance.

Continue reading

Crowdsourcing for Local Governments: Research Review

Research Review is a place for me to bring you academic research that I think might be of interest or relevant to you all.  It is not necessarily the Cliff notes of the paper, but it will present some key findings or insights from the paper.

Continue reading

Welcome!

Benjamin Frankin, (1706-1790) , North American printer, publisher, writer, scientist, inventor and statesman. Source: Wkipedia

Our new Constitution is now established, and has an appearance that promises permanency; but in this world nothing can be said to be certain, except death and taxes.

Benjamin Franklin, in a letter to Jean-Baptiste Leroy, 1789

Continue reading

© 2024 Copyright,
The University of North
Carolina at Chapel Hill.

Theme by Anders NorenUp ↑