Resilience assessment : a useful approach to navigate urban sustainability challenges

Cities and towns have become increasingly interested in building resilience to cope with surprises, however, how to do this is often unclear. We evaluated the ability of the Resilience Assessment Workbook to help urban areas incorporate resilience thinking into their planning practice by exploring how a resilience assessment process complemented existing planning in the local government of Eskilstuna, Sweden. We conducted this evaluation using participant observation, semistructured interviews, and a survey of the participants. Our findings show that the resilience assessment contributed to ongoing planning practices by addressing sustainability challenges that were not being addressed within the normal municipal planning or operations, such as local food security. It bridged longer term sustainable development and shorter term crisis management, allowing these two sectors to develop common strategies. Our study also highlighted that the Resilience Assessment Workbook could be made more useful by providing more guidance on how to practically deal with thresholds and trade-offs across scales, as well as on how to manage transdisciplinary learning processes. This is the first in-depth study of a resilience assessment process, and it demonstrates that the Resilience Assessment Workbook is useful for planning and that it merits further research and development.


INTRODUCTION
Cities and local governments have recently become interested in building resilience (Evans 2011, Wilkinson 2012a).Many local governments and cities have a history of planning for disasters and sustainability (UNISDR 2007, ICLEI 2013), however the financial shocks following 2008, rising energy prices, and an increased awareness of climate change impacts have increased interest in resilience as a mechanism to cope with surprise (Shaw 2012).Resilience theory has developed to address such situations where control is weak and uncertainty high (Holling 1986, Peterson et al. 2003a) and the concept refers to a system's longterm ability to cope with change and continue to develop (Stockholm Resilience Centre 2014).This interest in resilience has led to new initiatives targeting local governments and cities, ranging from the UN's campaign of "Making cities resilient" (UNISDR 2012), and Rockefeller Foundation's "100 resilient cities" (2015), to bottom-up initiatives, such as transition towns, focusing on building resilience of local communities (Hopkins 2011).There has also been a growing interest in resilience thinking within urban planning disciplines (Wilkinson 2012b).All this activity raises the question of how resilience approaches complement existing planning practices of local governments, and in what ways they help urban planners address contemporary challenges?We identify new insights on what a resilience approach can offer urban planning practice.
We focus our attention on the Resilience Assessment Workbook (Resilience Alliance 2010).The workbook was developed by the Resilience Alliance and synthesizes their earlier work on how to apply resilience thinking (Walker et al. 2002).It is the only socialecological research initiative that operationalizes resilience for practitioners, and following its first release in 2007 it has been applied in multiple contexts around the world (Resilience Alliance 2013).Although it was originally aimed at natural resource managers, the workbook is also relevant for planning.The three key ideas behind the workbook are: (1) that the systems we manage are interlinked social-ecological systems, (2) these systems are complex and adaptive, and (3) they interact across scales in space and time (Resilience Alliance 2010).These ideas are increasingly being embraced in urban planning, but urban planning lacks tools to analyze these issues.For example, the dynamics of complex systems are neither included in mainstream sustainable development (Lélé 1998, Walker andSalt 2006), nor disaster relief approaches (Walker and Westley 2011).This lack of practical approaches to social-ecological complexity in urban planning suggests that the Resilience Assessment Workbook has the potential to contribute new tools and ideas.
However, because the Resilience Assessment Workbook has been primarily applied in natural resource management contexts, there is a lack of examples and guidance for applying it to urban areas.In general, the social-ecological research community has focused on operationalizing resilience in ecosystem management (Peterson et al. 2003a, Bennett et al. 2005, Biggs et al. 2012), and there are few empirical studies of how a resilience approach could inform urban planning processes (Wilkinson 2012b).There are few published studies of resilience assessments in general (e.g., Haider et al. 2012, Mitchell et al. 2014), and the few scholars who have applied the workbook to urban contexts find both strengths in how it, for example, integrated diverse sectors in local government planning (Wilkinson 2012a), as well as difficulties, e.g., in applying threshold effects to complex urban systems (Liu 2011).Paul Ryan, an expert practitioner of resilience assessments, has found the method more difficult to use in urban regions (Paul Ryan, May 2012, personal communication).Furthermore, none of the limited research on resilience assessment has thoroughly evaluated how the resilience assessment complements and conflicts with existing planning approaches.http://www.ecologyandsociety.org/vol20/iss1/art43/To address this research need, we performed the first in-depth assessment of an initial application of the Resilience Assessment Workbook in the Swedish municipality of Eskilstuna.By identifying how the resilience assessment complemented ongoing municipal planning practices, we build on Wilkinson's (2012c) earlier work to adapt the resilience assessment process to a planning context.Eskilstuna is typical of most European municipalities in that it has trained staff that is engaged in a variety of state mandated planning and management activities.At the beginning of the resilience assessment, the initiators at the municipality expected it to partially overlap with their ongoing work on sustainable development and crisis management.Nevertheless, they expected the assessment to contribute new ideas.Therefore, Eskilstuna offered the opportunity to address the research question: How can a resilience assessment complement existing planning and management within a local government?Furthermore, to improve the usefulness of the workbook in urban planning settings we identified challenges that emerged when conducting the resilience assessment and propose possible ways the Resilience Assessment Workbook could be improved to address these challenges.

Planning in Eskilstuna municipality
Eskilstuna municipality is a middle-sized Swedish municipality that spans 1250 km² located between two of Sweden's largest lakes, Lake Mälaren and Lake Hjälmaren (Fig. 1).To the east, Lake Mälaren connects to the Baltic Sea through the Swedish capital, Stockholm, which is located about 100 km to the east.The biggest city in the municipality, with about two thirds of the municipality's 100,000 inhabitants, is also named Eskilstuna (Fig. 2).

Fig. 1.
Eskilstuna municipality in Sweden.The municipality borders Lake Mälaren to the north and Lake Hjälmaren to the west.The biggest city, also called Eskilstuna, is situated in the middle of the municipality.The grey areas are urban, whereas the rest of the municipality is a mix of forested and agricultural land.
We focus on two areas of municipal planning, which the planners thought overlapped with the resilience assessment: planning for sustainable development and crisis management.Eskilstuna's commitment to sustainable development is beyond the Swedish average.The municipality is a former center of heavy industry that has reinvented itself (Fig. 2).In 2012, Eskilstuna received an award for being the "Environmentally Best Swedish Municipality" of the year (Miljöaktuellt 2012).Although the municipality adopted a sustainable development policy in 2002 (Eskilstuna kommun 2002), it is still struggling with how to implement it.In practice, planning for sustainable development primarily occurs in two types of planning: strategic environmental planning and comprehensive planning.Strategic environmental planning deals with many sustainable development issues, but it is applied separately to different sectors and topics; for example, a traffic plan is separate from a climate change plan (see a list of official municipal documents in Appendix 1).Swedish municipalities are required to develop a comprehensive plan to guide physical planning and these plans are a key element of the Swedish planning system (Schulman and Böhme 2000).Eskilstuna's comprehensive plan better integrates different sectors within sustainable development (Eskilstuna kommun 2005), but is limited to issues related to land and water use.In Sweden, municipalities have the main responsibility for physical planning (Böhme 2001).Compared with the rest of Europe, local authorities have more power in Nordic countries.Municipal crisis management is compulsory by Swedish law (SFS 2006:544;Swedish Parliament 2006) and it requires preparedness for disasters, such as floods and infrastructure breakdowns, as well as disaster risk reduction.The focus is on maintaining critical societal functions in the face of these events.Crisis management functions across departments in the municipality, but at the time of this study there was no cooperation between crisis management and planning for sustainable development.However, the crisis manager could identify shared issues with sustainable

Eskilstuna's initial resilience assessment
Eskilstuna municipality prides itself on being a leader in environmental sustainability and part of being at the forefront involves always looking for ways to improve its environmental work.In this spirit, two of the municipality's environmental planners, Lars Wiklund and Lars-Erik Dahlin, pursued an interest in exploring how resilience could be applied in the municipality.In particular, they were concerned that conventional planning was not addressing how global threats, such as climate change, peak oil, financial crises, and the challenge of staying within planetary boundaries (Rockström et al. 2009), would affect local food and water supply, transport, and employment.In 2011, they contacted the Stockholm Resilience Centre to initiate a collaboration.
We address the first part of this collaboration, a process consisting of five planning meetings and an internal two-day workshop between August 2011 and February 2013.The two planners, together with Cathy Wilkinson and My Sellberg from Stockholm Resilience Centre, and Louise Hård af Segerstad, research communicator from Albaeco, formed the core planning team.This team used the Resilience Assessment Workbook and previous experience from resilience assessments to develop a workshop that addressed larger scale threats, as requested by the municipality, in a way that would be relevant for a planning context (Fig. 3).The team used Stockholm Resilience Centre's (2014) definition of resilience that includes both persistence and development as aspects of resilience, as does much resilience research (Holling 1986, Gunderson and Holling 2002, Walker and Salt 2006).During the planning meetings, the planners set the focal systems and specific threats (Fig. 3).In the workshop, the 23 participants were divided into working groups for each focal system (Fig. 4) and went through exercises to increase their understanding of the focal systems as dynamic systems and spark ideas on measures to increase their resilience.The workshop was a first step, in which only internal representatives from the different departments and units were invited to participate.Most of the attendants were from the municipal office or the city planning administration.See Appendix 2 for a more detailed project description.

Assessing the assessment
To evaluate Eskilstuna's resilience assessment we captured the participants' views of the process, rather than identifying policy changes, because of the limited scope of the study.Apart from contributions, challenges and limitations were also identified, where, e.g., a potential of the assessment was not realized.We did this by building upon Wilkinson's research on evaluating resilience in planning (Wilkinson 2012c).We adopted an in-depth case study design from interpretive policy analysis (Bevir and Rhodes 2006) that used textual analysis, participant observation, and in-depth interviews to provide a detailed understanding of beliefs of resilience assessment participants.Our data analysis was based on grounded theory, an inductive form of qualitative data analysis that enabled an ongoing dialogue between theory and the empirical world throughout the research process (Wagenaar 2011).My Sellberg collected the data and performed the majority of the analysis as a part of her master thesis (Sellberg 2013).

Participant observations
We participated in the five planning meetings and the final workshop, which took place in Eskilstuna and at Stockholm Resilience Centre.The participant observation allowed us to follow the process closely and gain a deeper understanding of the process outcomes and the reasons behind them.To document the observations, we wrote field notes (Jorgensen 1989).The reflection Ecology and Society 20(1): 43 http://www.ecologyandsociety.org/vol20/iss1/art43/session in the end of the workshop was also recorded and transcribed.
All field notes included memos, which are informal notes of preliminary interpretations of the data and a key component of grounded theory methodology (Glaser 1998).Writing memos is a way to engage in the dialogue between our preliminary understandings and the empirical world from the beginning of the research process (Wagenaar 2011).Memos capture "comparisons and connections you make, and crystallize questions and directions for you to pursue" (Charmaz 2006:72).They help with focusing further data collection and developing coding categories (Wagenaar 2011).

Semistructured interviews with key informants
We interviewed six key informants: three strategic environmental planners, including the two initiators, one spatial planner, the crisis manager, and one Municipal Commissioner who supported the project.The key informants were chosen because they both had knowledge of one of the focus areas of municipal planning, i.e., crisis management, or planning for sustainable development, and were involved to different degrees in the project.Therefore, they could answer questions of, e.g., how the resilience assessment related to their usual work and what the challenges were with using it.The interviews were semistructured (Kvale and Brinkmann 2009), using an interview schedule with key topics (description in Appendix 3).All but two interviews were conducted face-to-face, recorded, and transcribed.The other two informants were interviewed by telephone, while taking notes.

Survey
The survey provided us with an additional source of data on the participants' views of the resilience assessment.Moreover, the survey allowed us to scan the views of all the workshop participants so that the individual accounts captured in the interviews could be set in a context.Of the 23 workshop participants, 20 took part in the survey.The survey was part of an evaluation form (Appendix 4) and used mainly open questions without fixed answering alternatives, to map the participants' views of the resilience assessment and their insights from the workshop (Esaiasson et al. 2007).

Review of official documents
To understand more of how the participants related the resilience assessment to their ongoing work, we reviewed current official municipal documents related to sustainability and crisis management.The documents were, e.g., strategic environmental plans for different sectors and a crisis management plan (Appendix 1).We compiled information on the main content of each document, its connections to the focus areas of the assessment (Fig. 3), and relations to the key ideas of the resilience assessment.

Data analysis
Following the strategy of grounded theory, we coded the data into categories to move from "empirical material to generalizations" (Wagenaar 2011:261).First, we separated the data on contributions from data on challenges.Secondly, all the data was coded into categories based on themes that emerged while we reviewed the data multiple times, building on the memos written earlier in the research process.This was an iterative process of coding and recoding to find categories that both were readily applicable to the data, and provided explanation to it (Wagenaar 2011).The emergent themes on contributions (Appendix 5) were part of Sellberg 2013, but for this paper we also reviewed them to distill three main categories.

RESULTS
The participants of Eskilstuna's resilience assessment identified three main ways that the assessment contributed to existing municipal planning and management: All the identified themes of contributions of the resilience assessment, which these three categories build upon, are presented with examples in Appendix 5.

A dynamic systems perspective
The resilience assessment introduced a dynamic view of change (Appendix 5:2).Of the 20 survey respondents, 9 wrote that thinking of threshold effects was something new.Similarly, the interviews showed that threshold effects were new to crisis management and strategic environmental and comprehensive planning.One planner said that they are working with sustainable development, which he related to "closing loops and getting mechanisms to work," however the resilience assessment added "the idea of fluctuations and thresholds," which he considered critical for urban planning to take into account.
Furthermore, the resilience assessment necessitated a view of the municipality as an interconnected system across sectors and scales (Appendix 5:3 and 5).Nine of the survey respondents thought that the resilience assessment had a more comprehensive view (Appendix 5:5).The assessment drew particular attention to social-ecological interactions (Appendix 5:4), by framing ecological values "as a part of human welfare," and targeting both ecological and social issues of concern, such as eutrophication and unemployment.
This integrated systems perspective was significant for both crisis management and planning for sustainable development.
According to the strategic environmental planners, the workshop encouraged integration within sustainable development by discussing how issues were connected to one another across sectors, e.g., how employment in Eskilstuna could be affected by climate change (Table 1).For the crisis manager, the assessment had a broader scope than crisis management by targeting the geographical area of the municipality, instead of only municipal services.Moreover, it addressed the underlying events rather than their secondary consequences, e.g., climate change rather than an isolated flooding event.It also emphasized strategies for resilient ecosystems, such as ecological diversity (Appendix 5:9), which are not currently addressed within crisis management.At the workshop, the crisis manager met with sustainable development planners and discussed change in the focal systems with common concepts (Appendix 5:7).

Enabling a discussion about uncertain futures and crises
The resilience assessment enabled a discussion about global and uncertain threats (Appendix 5:6).According to the initiating planners, the municipality lacked preparedness for potential global crises.These issues had no clear organizational home and planning for worst-case scenarios was lacking.The workshop was used to discuss these issues, as well as the issue of local food security, none of which had previously been on the municipality's agenda.
Four key aspects facilitated the discussion on future threats.First, the resilience assessment encouraged a longer time perspective in planning, according to eight of the survey respondents.The crisis manager also considered the workshop to have a "much longer time horizon" than his work with crisis management.Second, the broad scope of the workshop enabled inclusion of areas outside of normal municipal services, such as food supply.Third, the idea of threshold effects helped to capture the risk of dramatic and undesired consequences of crises to society to which we cannot slowly adapt (Appendix 5:6 and 13).Finally, the assessment provided a mindset of assuming change and uncertainty (Appendix 5:1), which broadened the discussion of threats to include not only the most likely scenarios from today's perspective (Appendix 5:8).According to one of the participants, the workshop focused more on "what could happen, than on the normal state," and another described it as "a systematic way" of assessing whether the municipal plans would function even if "reality doesn't turn out as you had thought it would" (Table 1).
It is too early to tell how enabling this discussion will affect municipal planning.As of late 2014, the workshop has led to the planners continuing to work with resilience assessment, with a focus on local food security.

Implementing and advancing sustainable development work
The resilience assessment supported the implementation of sustainable development in two ways.First of all, the method, with its focus on how sustainable a system is to a specific threat, was a new way of operationalizing sustainable development and "fill the concept ... with concrete content," according to the strategic environmental planners (Appendix 5:6 and 10).They already had, e.g., sustainability principles for operationalizing sustainable development (Natural Step 2013), but according to the planners, the concept was still perceived as vague by many of the civil servants.Second, the dynamic systems perspective helped integrate sectors within sustainable development, as explained in the first category.The planners experienced that implementation of sustainable development usually is carried out in silos by different departments, which was not the case with the resilience assessment.One of the initiators said that the workshop helped put "different parts of society's functions" in a context where they "get a more comprehensive assessment." The strategic environmental planners also thought that the resilience assessment had the potential to advance their sustainability work (Appendix 5:13-14).For example, one planner stated that even though climate change is an accepted issue, little is actually being done to mitigate its impacts and the municipality continues building houses close to the water.In this context, the resilience assessment can motivate further measures toward sustainability, through the discussion of large-scale threats explained above, and by providing arguments for actions (Table 1).For example, the risk of abrupt threshold effects in apparently slow and "invisible" trends, such as eutrophication or segregation, provides stronger basis for taking action and investing resources in avoiding undesired states.One planner also mentioned that viewing society and nature as interconnected might enable investments in ecosystems as green infrastructure to address problems in other parts of society, rather than viewing ecological protection as a luxury.http://www.ecologyandsociety.org/vol20/iss1/art43/

Challenges and limitations
Although the idea of threshold effects was new to the municipal planning practices, some participants also raised concerns about its applicability.Three survey respondents stated that even though the dynamic perspective was a key part of the workshop, it was difficult to apply to their focal areas, especially the less ecological ones, such as employment.In a workshop exercise, for example, the employment group discussed variables that could prevent or trigger a regime shift to a less desirable state with higher unemployment.However, unemployment in Eskilstuna is already higher than the Swedish average and one participant stated afterward that the exercise gave a sense of things getting worse, while they are actually working toward a positive development.
The transportation group solved this by viewing transportation as a system that needs to transform to fossil-fuel independence and discussed, e.g., variables hindering that transformation.Afterward, the planners were uncertain if the thresholds discussed in the workshop actually existed and indicated the importance of threshold effects being scientifically identified.
At the workshop, we presented both the idea of cross-scale coordination, i.e., that "resilience at one scale cannot be achieved at the cost of resilience at lower or higher scales" (Wilkinson and Wagenaar 2012:4), and the concept of planetary boundaries (Rockström et al. 2009), even though they are not part of the workbook.The reason was to relate Eskilstuna's work to globalscale sustainability challenges.Nevertheless, one participant mentioned, for example, that her group had focused on Eskilstuna's interests, without discussing impacts on other municipalities or countries.Another participant stated that a resilience approach could call for a broadening of the streets in Eskilstuna City as a buffer toward traffic jams, which would conflict with the municipality's sustainability goal to decrease car use and subsequent carbon emissions.These examples show how a resilience assessment approach in practice risks being focused on the resilience of the focal system, without taking into account how it influences the resilience of other systems or scales.It also shows that cross-scale trade-offs are difficult to grasp and might require more attention in a workshop setting than our initial presentation.
The broad perspective of the workshop was evident to many of the participants, but the organizers still found it difficult to get a diverse set of people to participate.Neither economists, nor civil servants from the educational or cultural departments took part, even though they were invited.This was mentioned in the reflection round after the workshop.Four of the survey respondents also questioned the broad perspective of the workshop because it addressed areas where the municipality has little influence and knowledge, such as food supply.Nevertheless, the workshop highlighted the need to involve stakeholders in the process if they would continue working with food security issues.
Finally, the initiators acknowledged that this first workshop was mostly about learning the resilience assessment method and mindset and that further in-depth workshops were needed to develop proposals for new governance strategies.They referred this to the challenges of using a new and untried method and having little time to go deeper into broad issues.At the end of the workshop, earlier expectations from the initiators to come up with strategies for the municipality's long-term planning were not seen as reasonable within the limited timeframe.

DISCUSSION
In the results we presented the contributions of Eskilstuna's resilience assessment, according to the participants.Here we discuss how a resilience assessment can support a municipality's work with sustainable development and serve as a bridge to crisis management.We also conclude that the key ideas of the resilience assessment made a difference for the practitioners.In the end, we present some of the lessons learned from Eskilstuna's assessment and propose areas for improvement.

New perspectives in the implementation of sustainable development
The resilience assessment introduced new ideas to planning for sustainable development (Fig. 5).All the interviewed planners working with sustainable development stated that the resilience assessment added increased thinking about abrupt nonlinear changes and alternate regimes.This contribution corresponds to literature stating that the mainstream usage of sustainable development does not adequately consider system dynamics (Lélé 1998, Walker andSalt 2006).The method's focus on how a system can cope with change provided a new way of operationalizing sustainable development.Beneath this focus lies a mindset that assumes surprise and uncertainty, which scholars have argued is useful in times of looming crises (Davoudi 2012, Shaw 2012).However, the overlaps with sustainable development practices were new to crisis management, and vice versa.In this sense, the resilience assessment bridged planning for sustainable development and crisis management, which did not have any collaboration at the time of the study.The ideas of system dynamics were new to both aspects of municipal planning.
The resilience assessment also strengthened existing views within sustainable development, by re-emphasizing an integrated perspective.The Johannesburg Declaration, for example, highlights the interdependence of social, ecological, and economic dimensions, as well as our collective responsibility from local to global levels (WSSD and UN Department of Public Information 2003).However, this integration was difficult to pursue in practice, and therefore the contribution of the resilience assessment was important to the planners.Previously, resilience thinking has also been recognized for being able to connect phenomena that are isolated in different silos in mainstream http://www.ecologyandsociety.org/vol20/iss1/art43/planning (Porter and Davoudi 2012), such as ecology and urban design (Pickett et al. 2004), and provide a "common language across diverse sectoral and disciplinary interests" (Wilkinson 2012a:323).
Our findings confirm and expand on the idea that resilience assessment can be used to advance the work with sustainable development.Previously, metropolitan planners (Wilkinson et al. 2010), as well as social movement promoters (Hopkins 2009), have identified resilience as a potentially more powerful and useful concept than sustainability, e.g., for challenging status quo responses to urban problems, or finding systemic solutions to climate change.The Eskilstuna planners did not see resilience as a substitute for sustainability, but rather as an important complement, and they used the resilience assessment to bring previously ignored and complex sustainability issues up for discussion, such as how food security would be affected by future crises in energy, climate, and finances.This first workshop has led to a continued project on the resilience of the food system, a completely new area for municipal planning.This is similar to Luleå, where a resilience assessment served to frame the "deeper, more structural issues" and bring them to the planning agenda (Wilkinson 2012a:323).

Expanding crisis management and bridging to sustainable development
The resilience assessment partially overlapped with crisis management, but had a larger scope in time and space (Fig. 5).Resilience assessment's focus on how to handle change and uncertainty (Appendix 5:1) was not new to crisis management, but crisis management's focus was mostly limited to short-term crises in municipal services, rather than slow changes in ecosystems or society.The resilience assessment also introduced the idea of complex adaptive systems, corresponding to Walker and Westley's (2011) finding that the idea of complex adaptive systems with alternate regimes was rare within the disaster relief community.
Resilience assessment served as a bridge between crisis management and sustainable development (Fig. 5) because of its partial overlap with both of them.An example of the bridging function of the resilience assessment is the inclusion of both slow and fast changes.System dynamics, for example, examines interactions between slow and fast variables (Walker and Salt 2006).Currently crisis management is dealing with short-term shocks to the system, separated from strategic environmental and comprehensive planning, which focuses on longer term trends.A resilience approach could contribute to crisis management with attention to slow variables, corresponding to the conclusions of Walker and Westley (2011).Furthermore, it confirms the findings of Shaw and Maythorne (2012) that a resilience discourse could potentially integrate short-to medium-term emergency planning with medium-to long-term climate adaptation.The bridging function of the resilience assessment implies that it has the potential of providing local authorities with common strategies to handle change across sectors, in line with Shaw and Maythorne (2012).

The key ideas of resilience assessment made a difference to practitioners
The three key ideas of the resilience assessment made a difference to the participants in the project.For example, social-ecological systems and cross-scale interactions provided the comprehensive perspective necessary to integrate sectors in sustainable development planning.Moreover, complex adaptive systems gave a new dynamic perspective on change that bridged the short-and long-term perspectives of crisis management and planning for sustainable development, respectively.Compared to other approaches for operationalizing resilience in local governments, such as UNISDR (2012) and the Rockefeller Foundation ( 2013), the workbook has a stronger foundation in a theoretical framework, which emphasizes system dynamics, social-ecological feedbacks, resilience-building of ecosystems, and ecosystem services.

Lessons for resilience assessments
One of the benefits of testing a method in practice is that it clarifies possible areas for improvement.Based on our evaluation of an initial resilience assessment process in an urban planning setting we identify four weaknesses in the Resilience Assessment Workbook and suggest ways in which they could be addressed.

Identifying thresholds in practice
Even though the Eskilstuna planners found the concept of threshold effects useful, they were uncertain of whether the identified thresholds actually existed and found the concept less applicable to the focus areas of transport and employment.This points to two areas of the workbook that could be improved: (1) how to deal with uncertain thresholds, and (2) how to identify thresholds that are not biophysical.Regarding the first point, we suggest that the workbook could be improved by incorporating concepts from strategic adaptive management, which identify thresholds of potential concern and plans for how to regularly evaluate them (e.g., Biggs and Rogers 2003, Biggs et al. 2011, Roux and Foxcroft 2011), as well as Walker and Salt (2012), which includes a step process of how to identify thresholds with different degrees of uncertainty.For the second point, we suggest that the workbook should discuss this difficulty (following, e.g., Walker and Salt 2012) and suggest possible ways to navigate this process.For example, by viewing social thresholds in terms of what is collectively recognized as desirable or acceptable in a community (Christensen and Krogman 2012), or using scenario planning to explore system dynamics in complex systems in a broader sense (Walker et al. 2002, Peterson et al. 2003b).However, how to effectively identify thresholds in real world situations is an area that needs experimentation, research, and evaluation.

Including local level responses to global challenges
The Eskilstuna planners wanted to align the resilience assessment with their work with sustainable development, which includes dealing with global challenges, such as climate change mitigation.Nevertheless, the idea of cross-scale coordination was not always apparent in the discussions during the assessment.The idea that transformation of smaller scale systems can be needed to foster Earth System resilience exists in the resilience thinking framework (Folke et al. 2010), but is not included in interfaces with practice (Resilience Alliance 2010, Walker and Salt 2012).We propose that the workbook should give advice on how to address trade-offs between resilience on different scales.We also encourage resilience assessment practitioners to allow for more time to discuss crossscale trade-offs, possibly iteratively over several workshops, if this is considered to be an important part of the assessment.http://www.ecologyandsociety.org/vol20/iss1/art43/

Missing guidance on design of participatory process
The workbook does not provide guidance on how to design, manage, and facilitate a participatory assessment process.This is surprising, considering that the predecessor of the workbook (Walker et al. 2002) proposed a close involvement of stakeholders, and the workbook itself states that perspectives of multiple stakeholders are important for many of the exercises, e.g., in identifying the main issues.A participatory assessment process is necessary to successfully address complex issues ( Wagenaar 2007, Bai et al. 2010) where no single actor has the knowledge to do the assessment, nor the influence to carry through the strategies resulting from it.A participatory process also holds the potential of enabling dialogue and social learning.The social-ecological inventory (Schultz et al. 2007) can help to identify actors to include in the process, but we suggest adding a discussion of process design to the workbook with different examples of processes and how they fit with different political and cultural contexts, as well as providing links to other resources on how to manage transdisciplinary learning processes (e.g., Scholz 2011).

From learning to transformation
The planners in Eskilstuna initiated the resilience assessment process because they were interested in learning how resilience could be applied in municipal planning.They also wanted to both safeguard current values in the face of change, and identify strategies for moving Eskilstuna toward a more sustainable future.These types of multiple goals are likely widely shared among those practicing resilience assessment and the workbook would be improved if it provided more guidance on how it could be used to meet different goals.For example, a resilience assessment process focused on training people to apply the method within a municipality has quite different goals than one focused on developing an implementation plan.Moreover, training participants to apply the method could initiate a longer engagement with resilience.This was the case in Eskilstuna municipality, which now is continuing the exploration of resilience with a focus on local food security.Relating to the suggestion above on process designs in different contexts, we suggest that the workbook also advise how the assessment process can be designed for different purposes, e.g., to quickly scan local resilience, conduct an in-depth assessment, or develop transformation strategies, as well as how these different steps could build on each other in a bigger process.

CONCLUSION
We found that the resilience assessment complemented ongoing municipal planning and management by operationalizing sustainable development in a way that integrated sectors and introduced a dynamic perspective on change.The resilience assessment was a useful tool and mindset to tackle sustainability challenges that were not being addressed within the normal municipal planning or operations.Resilience assessment built a bridge between longer term sustainable development and shorter term crisis management, allowing these two sectors to develop common strategies.
Our study of the practice of resilience assessment also highlighted that the Resilience Assessment Workbook could be made more useful by providing more guidance on how to practically deal with thresholds, as well as trade-offs across scales.Additionally, it could give more guidance on how to manage transdisciplinary learning processes and how to use the workbook for different goals.
In the Swedish context, Eskilstuna municipality is a sustainability leader, however, the resilience assessment further advanced its sustainability planning and practices.We therefore expect that resilience assessments are a potentially useful approach for other municipalities in Sweden, Europe, and elsewhere.We have presented the first in-depth study of a resilience assessment process and our results demonstrate that the resilience assessment approach is useful for planning, and we urge researchers to continue developing the Resilience Assessment Workbook and engage in local transdisciplinary learning processes, to create multiple versions for a diverse set of audiences and purposes.
Responses to this article can be read online at: http://www.ecologyandsociety.org/issues/responses.php/7258 Appendix 1. Official municipal documents Here, we present a list of the official municipal documents that we reviewed in this study.See Sellberg (2013) for a more detailed description of the document review.− System dynamics framed the transformation of the transport system in a new way, and subsequently showed some of the obstacles to transformation.(Observation of workshop)

Fig. 2 .
Fig. 2. The City of Eskilstuna.The Eskilstuna River flows through the city, connecting the two lakes, Hjälmaren and Mälaren.The river as a trading route contributed to making this an attractive area for settlements, for over 3000 years.From the 16th century the river became a source of power for the metal industry, for which the City of Eskilstuna became a center.The industry declined after structural changes in the 1970s, and lately, a hotel, restaurants, an art museum, and a sports arena have moved into the old industrial buildings, some of which are shown in this photo.Photo by Göran Jonsson, Eskilstuna municipality.

Fig. 3 .
Fig. 3.The structure and scope of the resilience assessment in Eskilstuna municipality.Developed during the planning meetings with the two strategic environmental planners, Lars Wiklund and Lars-Erik Dahlin, as well as Cathy Wilkinson, Louise Hård af Segerstad, and My Sellberg.The municipality requested the content of the focal systems, specific threats, and impact dimensions.The project manager Cathy Wilkinson set the structure, which was based on the approach of Paul Ryan, an Australian expert practitioner of resilience assessments.The first two steps draw on section 1.1-1.3 in the Resilience Assessment Workbook (Resilience Alliance 2010).

Fig. 4 .
Fig. 4. The resilience assessment workshop in Eskilstuna.Louise Hård af Segerstad (research communicator) explaining an exercise to a group of civil servants discussing the transportation system.Project manager Cathy Wilkinson in the background adjusting the historical timeline.Photo by Lars Wiklund, Eskilstuna municipality.

1.
It provided a dynamic systems perspective; 2. It enabled a discussion about global and uncertain threats; 3. It helped implement and advance their sustainable development work.

Fig. 5 .
Fig. 5. Bridging sustainable development and crisis management.The resilience assessment overlapped partially both crisis management and planning for sustainable development, including both strategic environmental planning and comprehensive planning, in Eskilstuna municipality.However, the overlaps with sustainable development practices were new to crisis management, and vice versa.In this sense, the resilience assessment bridged planning for sustainable development and crisis management, which did not have any collaboration at the time of the study.The ideas of system dynamics were new to both aspects of municipal planning.

Table 1 .
Examples of the three main ways the participants considered the resilience assessment to contribute to existing planning at Eskilstuna municipality.The categories are based on a clustering of the themes in Appendix 5. Quotes are translated from Swedish by My Sellberg.holisticapproach.I think some also saw that there were links between the different focal areas.One issue affects a different area, which invites collaboration naturally.So it's a pretty good lesson to be drawn, that it becomes clear -we will not solve this issue ourselves because it affects another sector of society.Therefore, I think resilience thinking has the potential to highlight this particular holistic thinking in sustainable development.Which otherwise easily turns into that environment, social aspects, and economics become separate things, without them being discussed together."It is a systematic way to look at how it will work, if it all goes bad.It's very easy otherwise to focus on that we should go forward all the time.Often we think: 'this is how it should be, it'll be fine.'But it is not as obvious to look at what happens if it doesn't go as expected.So I think that the method has a great strength in itself." Strategic Environmental Planner 3: "It clarifies why it (business-as-usual) will not hold.And then we can also have an argument.If people say 'it doesn't matter if the oil price goes up, we will get more efficient cars, they will only consume 0.1 and then it doesn't matter so much, we are not vulnerable at all.' Then you can have a discussion about these thresholds perhaps, and get some sense of how vulnerable we are, too.Perhaps we can agree on that.So I think that would help actually."Theme 7, 10-14

Table A1 .
1. List of official documents of Eskilstuna municipality reviewed in this study.Threshold effects frame surprise and need to discuss worst-case scenarios and take drastic effects of crisis into account.Potential irreversibility of threshold effects framed a sense of urgency, especially for ecological changes (Interview SEP1).As one of the participants put it: "the ecological ball, it's on its way over" (Reflection session of workshop).You give a more concrete content to SD by going through the method with its different steps, ending in strategies.(Interview SEP1) The workshop meant working through it in more detail to explore what SD could mean.− Resilience thinking clarifies the meaning of SD, fills the SD concept with content, making it more comprehensible.(Interview SEP2) − One way of actually trying to translate SD without jumping down into the sector plans.(Interview SEP2) − The resilience assessment does not bring any new goals and does not decide what is desirable, but it could be used when planning to reach certain strategic goals in the municipality.(Observations and interview SEP3) The resilience assessment, and thinking of alternate regimes, facilitated a clarifying discussion about the desired state of the focal system, as well as the undesired.This facilitates the generation of a common, and clarified, long-term goal picture.(Observations of workshop and interview SEP3, SEP1) − Resilience thinking is one out of several things that would facilitate Themes: Examples: development of a vision of a more sustainable society.It might help us to see what the holistic picture could look like and how we should live within planetary boundaries.(Interview SEP1, SEP3) − The ideal of the resilient society is more about being resistant to change and being able to respond to changes rapidly if needed.(Interview SEP3) − A common knowledge/idea of which the most important thresholds are that we really should not pass, helps formulate the common picture of the goal, since then we have to stop before the thresholds.(Interview SEP3) A model/tool for analyzing and working with sustainability.(Survey) − The workshop highlighted interconnections between focus areas, e.g. when mapping consequences of threats connected to the focus area.This connected societal functions into a more holistic assessment.(Interview SEP2) − Getting a more holistic picture of the work of the municipality shows if some aspect is missing relative to the SD goals, and what type of threat that implies.A resilience assessment could be a tool to keep holistic perspective in planning when it comes to concrete decision-making, complementing e.g.Environmental Impact Assessments.(Interview SEP2) − "Strategies of resilience" was used as a framework to assess existing actions and identify prioritized areas for future actions.(Observation of workshop) − Resilience thinking could help assessing how far the municipality has reached relative to their SD goals, by assessing current measures and if they are enough.The focus is more on long-term goals, conditions for sustainability and planetary boundaries, than optimization of current processes.(Interview SEP2) Understanding how different parts cooperate and interact in e.g.socialecological systems might also generate recognition of investments in measures that previously were seen as luxury, e.g.new investments in ecosystems to be able to fix other problems, since they support each other.(Interview SEP2) − (Scientifically) identified thresholds would be important basis for decisionmaking.If development is seen as steps with thresholds and alternate regimes, rather than linear trends that we could adapt to, that would be a strong argument for investing more resources in avoiding undesired states.Motivating measures that previously were seen as luxury.(Interview SEP1) − System dynamics could also highlight slow negative trends that could be ticking time bombs, such as a growing discontent because of segregation The workshop was partly about daring to think more freely, letting go of margins of expenditure, etc. Thinking more broadly than your own role, and about how we must act in a wider perspective.(Interview spatial planner) − Resilience thinking is a way of coping that bridges over to a more sustainable society, challenging old systems and old way of thinking and old paradigm of more extrinsic values that did not succeed to generate any real solutions anymore.The method could open up to slowly transitioning to a more sustainable society.(Interview SEP2)