Key features for more successful place-based sustainability research on social-ecological systems: a Programme on Ecosystem Change and Society (PECS) perspective

The emerging discipline of sustainability science is focused explicitly on the dynamic interactions between nature and society and is committed to research that spans multiple scales and can support transitions toward greater sustainability. Because a growing body of place-based social-ecological sustainability research (PBSESR) has emerged in recent decades, there is a growing need to understand better how to maximize the effectiveness of this work. The Programme on Ecosystem Change and Society (PECS) provides a unique opportunity for synthesizing insights gained from this research community on key features that may contribute to the relative success of PBSESR. We surveyed the leaders of PECS-affiliated projects using a combination of open, closed, and semistructured questions to identify which features of a research project are perceived to contribute to successful research design and implementation. We assessed six types of research features: problem orientation, research team, and contextual, conceptual, methodological, and evaluative features. We examined the desirable and undesirable aspects of each feature, the enabling factors and obstacles associated with project implementation, and asked respondents to assess the performance of their own projects in relation to these features. Responses were obtained from 25 projects working in 42 social-ecological study cases within 25 countries. Factors that contribute to the overall success of PBSESR included: explicitly addressing integrated social-ecological systems; a focus on solution- and transformation-oriented research; adaptation of studies to their local context; trusted, long-term, and frequent engagement with stakeholders and partners; and an early definition of the purpose and scope of research. Factors that hindered the success of PBSESR included: the complexities inherent to social-ecological systems, the imposition of particular epistemologies and methods on the wider research group, the need for long periods of time to initiate and conduct this kind of research, and power asymmetries both within the research team and among stakeholders. In the self-assessment exercise, performance relating to team and context-related features was ranked higher than performance relating to methodological, evaluation, and problem orientation features. We discuss how these insights are relevant for balancing place-based and global perspectives in sustainability science, fostering more rapid progress toward inter- and transdisciplinary integration, redefining and measuring the success of PBSESR, and facing the challenges of academic and research funding institutions. These results highlight the valuable opportunity that the PECS community provides in helping build a community of practice for PBSESR.


INTRODUCTION
One consequence of the increased impact of human activities on the biosphere has been a growing recognition of the dependence of societal well-being on the life-support system of the planet (Millennium Ecosystem Assessment 2005). This recognition has underpinned research that views ecological, economic, and social systems as interlinked and inseparable social-ecological systems (SESs; Berkes and Folke 1998, Folke 2006, Ostrom 2009). We are increasingly aware of the multiple ways in which people shape ecosystems, from local to global scales, and how we are fundamentally dependent on the capacity of these systems to support human prosperity and societal development. This same body of research has also led to a better understanding of how environmental, economic, and societal change processes are dynamically interlinked, and how an understanding of these connections is critical in efforts to foster more sustainable environmental stewardship (Chapin et al. 2009). Despite these advances, the potential benefits of adopting a SESs perspective to improve sustainability outcomes through research are far from being fully realized , Fischer et al. 2015.
As social-ecological approaches to sustainability research are becoming increasingly prevalent, a growing body of literature is Ecology and Society 22(1): 14 http://www.ecologyandsociety.org/vol22/iss1/art14/ aimed at identifying the features that enable social-ecological research to bring about positive and tangible change toward sustainability (Folke 2006, Clark 2007, Pretty 2011, Lang et al. 2012, Fischer et al. 2014. Social-ecological research, as a form of sustainability science, is a scientific endeavor that aspires to generate knowledge through problem-or solutionoriented processes that include engagement and collaboration with actors from outside academia (Lang et al. 2012, Martín-López andMontes 2015), often with a focus on specific places and contexts (Fischer et al. 2014).
Over the past decades, various research networks have emerged to facilitate the development and synthesis of social-ecological research. Some of those networks of researchers include the Farming Systems for Development Approach (Shaner et al. 1982) and the Ecoregional approach (Sharma et al. 1996), and they have focused on agroecosystems and how sustainable agricultural production can be delivered. Other networks have focused on either the ecological or the social components of SESs. For example, Ostrom's Workshop in Political Theory and Policy Analysis at Indiana University pioneered synthetic work on smallscale common-pool resource systems that was mostly focused on governance and institutions (Brondizio et al. 2009). The International Long-Term Ecological Research (ILTER) network has focused on ecological patterns and processes within reserves, but has increasingly begun to expand its research activities beyond conservation areas and to adopt a place-based, long-term, socialecological research approach Equihua 2015, Maass et al. 2016). A number of syntheses of social-ecological dynamics across multiple case studies have been coordinated by the Resilience Alliance, a consortium of research groups and research institutes from across many disciplines (Walker et al. 2006).
The definition and assessment of the success of place-based social-ecological sustainability research (PBSESR) remains a challenge. PBSESR needs to meet the dual challenge of assessing and understanding complex and dynamic SESs while fostering a genuinely transdisciplinary process that is capable of facilitating knowledge exchange across disciplinary boundaries and between researchers and users (Miller et al. 2008, Lang et al. 2012. Current challenges for sustainability research include determining: how such research is initiated and framed, how practitioners are involved, how the research is funded, how established academic disciplines are integrated with practical knowledge and what new methods are capable of achieving such integration, what type of outreach and communication is relevant and generates impact, and how progress and success are generally measured and defined (Walter et al. 2007, Lang et al. 2012, Mori and Christodoulou 2012, Brandt et al. 2013).
Here, we adopt a working definition of successful research projects as those that enhance social-ecological understanding among both research and user communities while engendering actionable policy or management recommendations and options. Understanding the features that have enabled or prevented research projects from being more or less successful in this regard remains an urgent challenge.
Insights on what may characterize and contribute to successful PBSESR projects can be drawn from experience and comparisons across sites (Lang et al. 2012, Fischer et al. 2014 or by revising past or current sustainability research programs (Mooney 2016, Turner et al. 2016. Here, we focus on insights gained by one grouping of such projects that are associated with the Programme on Ecosystem Change and Society (PECS; ; http://www.pecs-science.org). PECS evolved from a longstanding search for increasing interdisciplinary perspectives within international global change research programs (Fig. 1) that gradually incorporated a range of scientists to address the interlinkages between climate, ecosystem function, biodiversity, and societal needs (Leemans 2016). The Millennium Ecosystem Assessment (MEA) went beyond previous evaluations, not only in its disciplinary breadth, but also in the depth of the socialecological analysis (Norgaard 2008). However, MEA participants were surprised by the still highly compartmentalized scientific approaches of much of the research that the MEA drew upon and the difficulties in obtaining integration. As a result of the insights gained from the Intergovernmental Panel on Climate Change and the MEA, a major shift toward transdisciplinary sustainability science occurred in the search to address the present and future needs of society (Mooney et al. 2013, Leemans 2016. Future Earth was then created using innovative research approaches and governance structures to bring sustainability research in developed and developing countries into the mainstream. PECS is, in a way, an early experiment toward the conceptualization and operationalization of Future Earth, where integration across disciplines, stakeholders, and study sites was seeded. The need for a new 10-yr global research program to foster coordinated research for understanding the dynamic relationship between humans and ecosystems by focusing on specific research sites emerged as a recommendation made by the ad hoc expert group assigned to evaluate the MEA process (ICSU-UNESCO-UNU 2008). Launched in 2011, the motivation for PECS is to support a more focused and in-depth understanding of SESs and opportunities to foster sustainable stewardship . The principal approach of PECS research is through comparisons of place-based, long-term, social-ecological case studies. To date, 15 projects have been endorsed by PECS, and these together cover http://www.ecologyandsociety.org/vol22/iss1/art14/ 42 regional case studies around the world that apply a SESs approach and aim to combine different processes of knowledge generation through a transdisciplinary process. A further set of case studies and researchers are involved in PECS as part of the different inter-and transdisciplinary working groups that focus on different crosscutting topics.
Here, we seek to identify key insights and opportunities for improving the practice of PBSESR that have emerged from the PECS community. We do so by surveying existing projects endorsed by and associated with PECS. We first characterized the projects that were included in this survey. A semantic network analysis based on the projects' abstracts allowed for a characterization of convergent or divergent concepts of PBSESR for the projects assessed. We then reviewed the key research features that have been considered by other scholars of sustainability science (Zierhofer and Burger 2007, Hirsch Hadorn et al. 2008, Lang et al. 2012) and conducted our assessment based on six complementary and interrelated types of research features: problem orientation; research team; and contextual, conceptual, methodological, and evaluative features. For each of these features, we surveyed respondents from different PECS projects to identify specific (desirable or undesirable) attributes considered to be important as well as the factors that either enabled or constrained the ability of researchers to improve the design and implementation of their research. We also report on subjective self-assessment measures of the performance of surveyed projects with respect to the different features examined. In summary, we reflect on the lessons that project leaders learned while undertaking PBSESR about what has been successful and what has failed.

Survey design
Our aim and general methodological approach were initially discussed at a PECS workshop held in Stockholm, Sweden, in September 2013. This was the inaugural workshop of PECS and included the Principal Investigators (PIs) and co-PIs of the projects endorsed by PECS as well as the members of the scientific committee. A pilot online survey was sent to the participants of a follow-up PECS workshop held in Moureze, France, in May 2014, including students, researchers, and project leaders.
Based on the pilot survey, we identified six overarching features that together can help describe the makeup of a given PBSESR project. These categories are closely interrelated and contribute toward work in all phases of the project, i.e., planning, development, and closure: problem orientation, contextual, conceptual, methodological, research team, and evaluative features. Problem orientation features capture how a project is conceived and designed, how the problem (or problem set) is chosen, who is involved in this process of problem identification, and what key steps are involved in project conception and design. Contextual features deal with the particular context of a research site (geographic, spatial, and temporal scales; socioeconomic, political, and historical contexts) and research process (institutional setting, funding, and connections with stakeholders) that can have a profound influence on the type of work that is conducted. Conceptual features capture the key themes, concepts, and conceptual frameworks of a given research project.
Methodological features describe the tools and types of methodological approaches of a given research project. Research team features describe the nature of the team, including which researchers and actors are included, their skills, as well as the nature of interactions among participants. Evaluative features relate to the outputs and outcomes of a given project, including those promised to the funders, those agreed upon with the stakeholders, those that emerge from the project as intended or unintended effects on local decision making and actionable policy, as well as additional goals held by the researchers involved.

Data acquisition and analysis
The full online survey (Appendix 1) was circulated to the entire PECS community (including endorsed projects and those in which members of the PECS scientific committee were involved) during September and October 2014. The survey was largely responded to by PIs and co-PIs (24) of the projects, as well as one PhD student and two postdocs.
The survey addressed the six aforementioned features for each of the projects. Information on the project objectives, location of study sites, number and type of research and stakeholder participants, start and end dates, historical legacies, and outcomes of the project were gathered and synthesized in tables. Abstracts of the projects were used to identify common keywords based on a semantic network analysis to characterize further the sets of projects assessed here and visualised with VibrantData (http:// vibrantdata.io).
We asked respondents to identify attributes they considered to be of particular importance for each of the features. Respondents also identified any desirable or undesirable aspects of these features, as well as the enabling factors and barriers that together determine the form that a given project takes. The survey was divided into sections for each of the features, with four sets of questions: (1) semistructured questions that aimed to identify desirable and undesirable aspects of the features, as well as enabling factors and obstacles associated with the features; (2) open questions that sought to obtain any other insights from respondents regarding each feature that would be useful to other scholars who undertake this kind of research; (3) closed questions that ranked the relative importance of the analyzed features and particular attributes in each feature; and (4) closed questions that asked about the current performance of the projects with respect to desirable aspects of key features.
We grouped the responses to the semistructured and open questions into similar themes, which were discovered by using the grounded theory approach (Strauss andCorbin 1990, Thomas andJames 2006). Individual responses were coded against a set of descriptors that were designed to identify common themes that emerged within and among individual responses, and to capture the key elements of such common themes. Given the large overlap of responses within and among types of features, results were reorganized into three sections: (1) What contributes to success of PBSESR? (2) What hinders the success of PBSESR (including both crosscutting and specific issues)? (3) How are current projects performing for the analyzed features? For each of these sections, we separated features that have enabled from those that have hindered social-ecological research projects to achieve success. We then compared self-attributed progress among types of features. We avoided using quantitative measures of the http://www.ecologyandsociety.org/vol22/iss1/art14/  Table 1 for individual project details. frequency of the different types of responses given the large overlaps across types of features and the largely unequal numbers of responses received per question.

Participating projects
A total of 27 researchers responded to the survey, representing 25 projects; 9 projects were endorsed by PECS, and the remainder were associated with members of the PECS scientific committee. Together, the projects represented 42 specific social-ecological case studies located in 25 different countries across five regions ( Fig. 2): Africa (13 case studies), Europe (12), Oceania (4), North America (3), Latin America (5), and Asia (3). PIs of these projects were spread across these regions, although they were biased toward Europe (16), with decreasing representation from Latin America (6), North America (5), Africa (3), Asia (3), and Oceania (1).
Although projects naturally differed in their specific research focus, they all built on a platform of place-based research that addresses different social-ecological dynamics of landscapes, seascapes, or coastal regions (Table 1). The analysis of convergence and divergence in the projects' conceptual and thematic approaches to PBSESR, mapped trough a semantic network analysis of common keywords, revealed three interconnected clusters of convergent projects (Fig. 3). The clusters focused on sustainable land management, ecosystem services, or coastal SESs. The cluster of projects around ecosystem services was the tightest; these projects are most common to each other in terms of shared thematic and conceptual approaches to PBSESR. The coastal and land-management clusters differed largely because of the type of SES and the importance of adaptation in coastal systems. The conceptual convergence among the projects is confirmed by the three conceptually bridging projects (projects 9, 15, and 25) that are thematically closer to projects of the other clusters. Although they were not the most central projects within their clusters (i.e., most demonstrative for the concepts and themes existent in the clusters and visualized by node size), the three bridging projects best encompassed the different dimensions of PBSESR, including knowledge coproduction, solutions orientation, and integration of a range of stakeholders, as do most of the other projects but to a lesser extent.
Most of the projects (20) evolved from a previous legacy (Table  1). These legacies included earlier collaborations among some of the scientists on the team, conceptual insights obtained in earlier projects, long established research sites, or earlier interactions with local stakeholders.
The size of the projects, both in terms of directly funded personnel and number of associated case studies, differed substantially. The number of people directly linked or funded by the projects ranged from 2 to 45 individuals, and the number of case studies ranged from one to five (Table 1). All of the projects directly or indirectly involved stakeholders from different sectors, including local, state, and national governments; business representatives; nongovernmental organizations (NGOs); and owners or ecosystem managers in the respective case studies. Representatives from local governments and owners or ecosystem managers were involved in 16 of the projects, making these the most common nonacademic stakeholder group. The least common stakeholder group, with involvement in only one project, was national government.
Primary funding for the projects was mostly secured from national funding agencies (17 projects; Table 1). Regional agencies (e.g., http://www.ecologyandsociety.org/vol22/iss1/art14/ Includes those who obtain their salaries as well as those who only obtain support for their work and for attendance at project meetings. § Includes those who have participated in the codesign of the proposal and those who have participated actively in the different project phases.

|
Year/month/day. ¶ Project endorsed by the Programme on Ecosystem Change and Society.
Ecology and Society 22(1): 14 http://www.ecologyandsociety.org/vol22/iss1/art14/ European Union Framework Programme 7) have been the major source of funding in the case of three projects, whereas private organizations, NGOs, or development agencies were the main form of financial support for the remaining five projects. Most of the surveyed projects are ongoing (except for five projects). The funding period varied greatly, with some projects having secured funding for 7 yr, whereas others did so only for 2 yr. Colored clusters indicate convergent projects by shared keyword-ngrams. The six most common keywords in each group are shown in bars under the cluster's title; numbers in the bars indicate the number of times the keyword occurred in that group; the size of bars indicates the importance, determined as local frequency × global frequency (i.e., the proportion in the group [xy/number of nodes in the group] times the fraction relative to the population [xy/xyN]). In other words, a tag is important if it is locally common and otherwise rare. For example, if "services" is common in the group and is also globally common, then it does not distinguish the group very well. Node size indicates the level of centrality within clusters. There are three bridging projects (9, 15, and 25) that are more similar to projects of the other clusters than the rest of the projects in their own cluster.
Stakeholders were directly involved in the funding and design of only 9 of the 25 projects. However, interactions in 22 projects occurred with a range of stakeholders, including local, state, and national government; landowners and land managers; business representatives; and NGOs.
Beyond academic products such as papers and student theses that advance knowledge on the SESs studied as well as the theory, 13 of the 25 projects have produced a range of other outputs. These include communications to nonscientific audiences (using other formats of dissemination such as popular media, books, photos, or paintings), raising awareness, increasing communication among stakeholders and participation of stakeholders in research, as well as the identification of alternative future scenarios and the design and implementation of more desirable management practices, legislation, and governance arrangements.

What contributes to the success of place-based social-ecological sustainability research?
The survey revealed a number of attributes, desirable aspects, and enabling factors that were consistently mentioned across the analyzed features in the survey. Other factors were specific to a particular feature (Fig. 4). Examples of such responses are provided (Table 2).

Crosscutting attributes
The explicit recognition of landscapes and seascapes as SESs that comprise interacting social, economic, and ecological elements was recurrently mentioned as a crosscutting feature that enabled PBSESR. In fact, a striking finding was that the different dimensions of research foci were considered, on average, to be similarly important, with almost identical rankings of importance between biodiversity, ecological processes, biophysical conditions, economic activities, human well-being, governance arrangements, and informal institutions. Similarly, respondents repeatedly highlighted the need to address multiple spatial and temporal scales and social levels of organization (including both formal and informal institutions). Another crosscutting theme emphasized was the solutions-and transformation-oriented type of research in which a transition toward sustainability was commonly suggested as a characteristic of successful PBSESR. Addressing integrated socialecological systems 6,9,16,20 • "Holistic and comprehensive understanding of the dynanics of ecosystems and ecosystem services provided and sustainable ecosystem management" • Taking into account "trade-offs among ecosystem services" • "Achieving a more realistic view of complex social-ecological systems" • "Looking at multiple levels of governance, from community to state" Solutions and transformation oriented 2,18,19,20,21 • Solution oriented • "Highly policy relevant" • Includes "history of stakeholder interest in managing and conserving the ecosystem" • Project developed to assess the social-ecological effects of a tsunami and opportunities for increased resilience Situating and adapting the study to its local context 5,7,17,22,11,19,18 • "Attaching understanding to place rather than to discipline, i.e., understanding how what happens in one area (e.g., social relations) affects other areas (e.g., drivers of change)" • "Flexibility that allows modification of research questions as research goes on, but not too much that it becomes too different from the initial research questions" • "Looking at interventions from social and ecological to institutional context" • "The contextual features need to be considered in terms of the research questions being answered" Long-term engagement with stakeholders and partners 2,9,13,14,15 • "Collaborative development objectives" • "Includes a network of local groups, interdisciplinary scientific teams, and stakeholders" • Importance of building on a past legacy of stakeholder-driven research in a region and the resulting long-standing contacts as an important enabling factor • "Previous research on political and economic context in combination with good relations with local stakeholders is relevant" Frequent and trustful interactions with stakeholders 3, 6,7,8,9,23 • Highlights the process of trust with different stakeholders that has taken place before starting the project and follows previous research in the study area • "Open attitude of local stakeholders for codesigning outreach products" • "Communicate the conceptual framework to local stakeholders before applying it" • Good relations with local stakeholders during the project • Establishing a communication network Early and clear definition of end purpose and scope 23, 13, 25 • "Focus on focal questions and thematic clustering of research projects" • Delivering scientific syntheses, general patterns toward solutions, and final products beyond the duration of the project • Having a clear "theory of change" • Clearly distinguishing between outputs and outcomes Adequate, sufficient, and timely funding 9 • Funding institution is able to give enough freedom to researchers to identify the research questions †See Table 1 for individual project details.
Respondents insisted that projects should be solutions oriented and focus on the development of actual interventions, thus going beyond basic knowledge generation. This characteristic entails situating and aligning a project within the appropriate local and regional context, including the social and political setting. This could result through building on long-standing projects in the same area or careful participatory research.
The need for establishing tight links with stakeholders was frequently mentioned as an important crosscutting feature to ensure the success of PBSESR projects. These relationships were deemed to be based on trusted partnerships, underpinned by consistent dialogue, and to be long-standing in nature. The actual nature of stakeholder involvement in the projects ranged from interactions between the research team and stakeholders in preparatory consultations to the codesign of research and coimplementation of practices and policies. Particular emphasis was placed on the desirability of giving voice to the less powerful stakeholders and the importance of paying careful attention to the often highly imbalanced power relations between different stakeholders. Many respondents viewed an iterative refinement of research questions, in collaboration with stakeholders and during the evolution of the project, as a desirable characteristic of research, and highlighted participatory methods as being essential to achieving this and in building trusted partnerships. Another highly related crosscutting theme that was often mentioned was the exploration of the perspectives of the different types of stakeholders. For the sake of engaging nonacademic stakeholders in the research, respondents also highlighted the importance of participatory processes. Such participatory processes should consistently engage team members with diverse backgrounds and areas of expertise, as well as local stakeholders and institutions. Further, the importance of epistemological agility (the ability to work across multiple knowledge domains) among team members and the use of multimethod approaches were both highlighted by several respondents. These skills and

Examples
Complexities inherent to social-ecological systems 6,9,7,16,20 • "Design can be time consuming and move project away from interesting research questions" • "Should be more than one social science element within a big project" • Perhaps consider integration as a separate project, rather than leave it all up to a single social scientist • Mismatch between scales of evaluation for ecological and socioeconomic processes Imposition of epistemologies and methods 2,18,19,20,21,23 • "Culturally inappropriate management styles" • "An 'elite' captures the monitoring system... that determines the criteria for success and has a large say in evaluating it" Long-term research and long initiation process 2,9,12,13,14,15 • Massive amount of time and organizational needs • Not enough time to go in depth into emerging research questions • Start-up time is slow and bumpy, and funding is usually short term, e.g., 3 yr • "Too many stakeholders can bring significant complexity and transaction costs" • "Significant transaction costs in engaging with multiple conceptual frameworks and approaches" Conflicts among stakeholders 5,7,17,22,11,19,18 • "Raising unrealistic expectations among stakeholders who introduce their own agenda" • Not open to exchanges with stakeholders Power asymmetries in research team and among stakeholders 3,6,7,8,9,23 • "Disrespectful attitude toward other knowledge types (local ecological knowledge or traditional knowledge)" • "Desire for strong, centralized, hierarchical control by lead PI" • "Different expectations regarding outputs and outcomes in mixed teams" Difficulty in demonstrating products 12, 13, 14 • Huge transaction costs; few organizations fund this work • Policy-relevant goals can constrain research trajectory † See Table 1 for individual project details. methods allow a range of scales and topics to be explored and integrated.
Finally, an early and clear definition of the purpose and scope of the project was deemed critical. The definition of project success was also reported to be critical for identifying the roles of different team members, as well as ownership of its different types of products and outcomes. Adequate funding was considered critical to attain these goals.

Specific attributes for each of the features
Concerning the process of problem orientation, respondents highlighted the need to align projects to focal policy issues and the importance of being able to compare results with other study regions.
Governance and institutional settings emerged as important contextual features to foster both research and management solutions. Although some survey respondents argued for the need to include sites with a diversity of institutional settings and governance aspects, others considered that a stable ("good governance") institutional setting was a precondition for effective and long-term PBSESR. Respondents also highlighted specific features related to the academic and funding contexts, such as availability of funding for and institutional openness to transdisciplinary social-ecological research, that were deemed important for PBSESR to thrive.
The understanding of the particular SES, the key issues at stake, and the opportunities for interventions toward solutions were considered to rely heavily on the adoption of an explicit visual conceptual framework. Respondents considered that this framework could describe the key phenomena being studied only if project participants invest sufficient time in its codesign. In further considering the factors that can enable a strong and constructive conceptual basis for PBSESR, respondents also underscored the importance of adopting a common language for describing the study system and any insights that emerge from the research process.
Given that the understanding of the whole system and the particular issues at stake is critical, methodological features recognized as important for PBSESR were mainly related to those that allow linking different disciplines and knowledge systems (i. e., scientific and local knowledge). These relate to the use of multiple methods for data collection (e.g., individual and deliberative techniques), the analysis of both qualitative and quantitative data, approaches for triangulating different information sources, analysis across multiple scales and levels of organization, and diverse ways of visualizing research results.
The composition of the team was deemed critical. A diversity of participants, including several thematic dimensions as well as different types of knowledge, was considered desirable, as well as the direct or indirect incorporation of stakeholders. Functional teams were considered to rely on important elements such as including a diversity of team members, open mindedness, trusting collaborative relationships, and communication. Diversity was seen as desirable mostly with regard to disciplinary background, but also seniority and nationality. Openness and interest in different disciplines and perspectives and a willingness to communicate and adapt individual agendas were considered important dimensions of a constructive research attitude. http://www.ecologyandsociety.org/vol22/iss1/art14/ Because PBSESR is not only about knowledge generation but about fostering practical solutions, the products of this type of research consistently included items beyond traditional academic products of papers, reports, and research presentations. The understanding and use of research findings by stakeholders as well as sufficient time to allow meaningful engagement with nonresearch audiences and feedback from stakeholders on the strengths and weaknesses of the project were deemed important. A wide range of communication with stakeholders and production of outreach materials such as posters, flyers, videos, postcards, blogs, and tweets, i.e., explicitly geared to what stakeholders could use, was frequently mentioned.
The concept of transformations was deemed to be critical to PBSESR, beyond tangible products and in the context of shortto long-term outcomes. Transformations were conceived of in the way that stakeholders perceive key issues and make decisions, in the capacities of the team members to address key issues, and in the opportunities to implement more sustainable pathways within the SES. Evidence of such outcomes is often difficult to gather, but one project pointed to the successful employment of an administrator that coordinates the collection of evidence of impact and outputs.

What features can hinder the success of place-based socialecological sustainability research?
The majority of the attributes, undesirable aspects, and factors that constrain successful PBSESR, as highlighted by respondents, were the opposite of desirable aspects or enabling factors. We thus focus on some of the novel identified undesirable aspects and obstacles (Fig. 5, Table 3). A key crosscutting obstacle to the success of PBSESR that was reported consistently by survey respondents was the complexity inherent in a system-wide social-ecological approach. The need for addressing multiple scales in space and time as well as multiple levels of social and institutional organization and the use of multiple methods present enormous challenges compared to more conventional disciplinary research. The successful understanding of complex SESs and the search for solutions can be constrained by biases that can emerge from insufficient attention given to developing the conceptual basis of the research program with all the team members. The imposition of epistemologies, concepts, or methods inappropriate to the local context, end users, or team members with different backgrounds was highlighted as an important obstacle. These impositions were identified as resulting from power relations among team members and from a lack of meaningful codesign with all the team members of the project.
The inherent complexity of PBSESR projects demands a long initiation period to build an effective team, appropriately align the research to the local context, and ensure that there is adequate opportunity for receiving and processing feedback from research users. These investments can often be viewed as opportunity costs to producing conventional research outputs, commonly resulting in tensions and competing priorities within and between team members.
The complexities of interpersonal relationships among stakeholders, among research team members, and between stakeholders and researchers constitute one major obstacle to the success of PBSESR. Conflicts among stakeholders, particularly those derived from a strong imbalance in power between different stakeholder groups, were consistently mentioned as disrupting attempts to foster a fair and meaningful participatory process. Similarly, conflicts among research team members and competing agendas were also reported as important obstacles to PBSESR, including a lack of commitment to the project and power asymmetries within the team because of domination by more senior researchers or those from the global North. Regarding the relationship between researchers and stakeholders, inadequate communication skills of researchers, research fatigue among respondents of social surveys, and frustration of stakeholders regarding the slow report-back time of research findings were also cited as factors that can inhibit PBSESR. Lack of time to build and nurture the relationships and address issues that can be managed was consistently considered an important obstacle.
Obstacles to the implementation of multiple methods to assess SESs included linguistic barriers between researchers and stakeholders. In addition, data acquisition was reported to be potentially constrained by inadequate access to or understanding of technological tools by stakeholders. The lack of relevant data and the existence of restrictions of access to such data because of confidentiality, legal or political dispositions, or to threats to the security of involved stakeholders were considered important obstacles.
These challenges raised by the nature of PBSESR converge into a major issue frequently mentioned by respondents: the difficulty in demonstrating the products and outcomes of this type of research. While projects experience pressure for fast and highimpact evaluations, they also aim at solutions that can be coconstructed with actors over the medium to long term. Mismatches between the expectations of funders, academic institutions, and stakeholders were often mentioned as an obstacle to PBSESR, as well as a persistent lack of clarity in evaluation criteria. Unrealistic pressure on researchers to become Ecology and Society 22(1): 14 http://www.ecologyandsociety.org/vol22/iss1/art14/ agents of change or to provide generalized one-size-fits-all solutions were also considered undesirable features.

Current self-assessed performance of the surveyed projects
In general, participants considered that their own projects were performing better for team and context features than for methods, evaluation, and problem features. With respect to problem features, participation of stakeholders was rated more favorably than a focus on solutions. In the case of team features, potential improvements were identified in stakeholder integration, communications, team size, adaptability of team members, and interdisciplinarity. Researchers perceived their performance in relation to scientific outputs to be generally good or excellent. However, the spheres in which performance was ranked as being poor were mostly related to outreach and communicating research to stakeholders, policy makers, and the broader public. In addition, organizing training courses and workshops were rated poorly.

DISCUSSION
Our study confirms a number of findings, both in early (Shaner et al. 1982, Nicolescu 1996, Sharma et al. 1996, Borda 2007, De Sousa Santos 2009) and more recent (Kueffer et al. 2012, Lang et al. 2012, Brandt et al. 2013, Mauser et al. 2013, Ruppert-Winkel et al. 2015, Scholz and Steiner 2015b, Turner et al. 2016 publications, on the particular challenges and opportunities faced by sustainability science. However, the perspective provided by the grouping of PECS-related projects offers a number of distinct contributions. This work differs from previous theoretical explorations (Lang et al. 2012, Miller 2013, Scholz and Steiner 2015a, systematic literature reviews (e.g., Yarime et al. 2010, Bettencourt and Kaur 2011, Brandt et al. 2013, and calls for action (Borda 2007, De Sousa Santos 2009 in providing a firsthand analysis of insights gained from project practitioners involved in the dedicated learning network of PBSESR, that is, PECS. The insights gained here closely mirror those obtained from a recently published synthesis on the evolution of global environmental projects, including other projects now included in Future Earth beyond PECS (Turner et al. 2016).
The emphasis on place, which is a particular characteristic of PECS, allows for the identification of the specific relationships among agents, processes, and resources at different temporal and spatial scales that together help shape a particular region . Place rarely offers an explicit focus of approaches that seek to test specific hypotheses or develop understanding (Fischer et al. 2014). The focus on place allows for the development of trusted relationships with key stakeholders, which in turn provides a basis for more meaningful processes of knowledge transfer. Moreover, the insights gained here are informed by a global network of researchers that have experienced and are based in a wide range of social-ecological contexts and places.
High stakeholder engagement in the development of the research project has been found to be key to PBSESR in three papers of this Special Feature in Ecology and Society that include many PECS-related projects , Mitchell et al. 2015, Oteros-Rozas et al. 2015. Although most of the projects assessed here reported interactions with stakeholders, different degrees of participation of stakeholders in project design were found. The projects assessed here ranged from those based on coproduction of knowledge, through those based on codesign and coimplementation of the research, to those based on coimplementation of practices and policies. The limited proportion of projects that were developed in tight collaboration with local stakeholders reflects an important lag in the reality of PBSESR relative to aspirations.
The PECS-related projects assessed here cover the different approaches of transdisciplinary sustainability science (Miller 2013): the knowledge-first approach as well as the processoriented approach. The PECS-related projects aimed at generating different types of knowledge (i.e., systems, target, and transformative knowledge; Hirsch Hadorn et al. 2006, Brandt et al. 2013, Brink et al. 2016) and research questions, including: (1) observations of the key features and drivers of a SES (e.g., projects 6, 10, and 12), (2) scope of action and problem-solving measures to identify best management practices (e.g., projects 14, 15, and 17), and (3) practical implications for identifying transitions toward alternative pathways.

Lessons for fostering international collaborations of place-based research
PECS provides a platform for contributing toward global sustainability by fostering comparisons among sites; sharing methods, hypotheses, and conceptual frameworks; and sharing strategies for understanding the connections between the local and the global (Mauser et al. 2013, Fischer et al. 2014, Liu et al. 2015. However, the results of this survey emphasize the need to tailor PBSESR, and general conceptual and methodological frameworks and stakeholder dialogue processes, to specific socialecological contexts (Lang et al. 2012, Martín-López andMontes 2015). Similarly, the survey also emphasizes the risks of imposing particular epistemologies or methods on a diverse research team, while also highlighting the benefits of having access to a diversity of methodological approaches and the insights that can be gained through efforts to uncover local expertise and perspectives (Vessuri 2014).
The challenges posed by power imbalances among researchers in terms of their different sources of knowledge, funding opportunities, and modes of communication have been highlighted as problematic by many international research initiatives (Mauser et al. 2013, Scholz andSteiner 2015a). Respondents to our survey emphasized the need to acknowledge the strengths of each of the partners, and in particular, the need to give voice to and balance international, regional, and local perspectives. Place-based research networks such as PECS can facilitate much-needed international collaborations in which place-based studies and researchers from the global South would be better represented.

Accelerating progress toward inter-and transdisciplinary integration
Integration across disciplines relies on the effective functioning of interdisciplinary teams, yet achieving this is not trivial. In particular, developing a shared understanding and appreciation of the value of different perspectives requires time, both for individuals and groups (Giri 2002, Evely et al. 2008, Miller et al. 2008, Kueffer et al. 2012. Moreover, engendering effective interdisciplinary research teams requires the definition of common objectives and establishment of trusted relationships Ecology and Society 22(1): 14 http://www.ecologyandsociety.org/vol22/iss1/art14/ and accessible modes of communication, all of which are processes that require long-term engagement (Fraser and Schalley 2009, Thompson 2009, McGreavy et al. 2015. Conflicts among team members regarding commitments to short-term data gathering vs. those committed to fostering long-term changes within the whole SES arise from contrasting perspectives and expectations among team members. The development of strong and trusted relationships between different researcher and stakeholder groups in a given region can present an even greater and more time-consuming challenge than that facing the development of interdisciplinary research teams. Several of the surveyed projects emphasized the importance of building on a past legacy of stakeholder-driven research in a region and of trusted contacts developed in this research as important enabling if not critical factors to support PBSESR. Indeed, earlier work has pointed out the essential role of longstanding relationships with strategic stakeholders who act as gatekeepers to other local actors (Enengel et al. 2012). Building trusted relationships with diverse local stakeholders relies on researchers' skills beyond the rationality and logic in which many are trained. High levels of emotional intelligence are demanded. Also, the significant time investments needed may often be seen as major opportunity costs relative to more conventional research activities toward producing peer-reviewed publications.
Conflicts and inequitable power relations among stakeholders were highlighted by the survey respondents as particular barriers to the success of PBSESR. The codesign, coproduction of knowledge, and coimplementation of practices imply the integration of multiple stakeholders' beliefs, perceptions, and interests, yet these are often conflicting (Stringer et al. 2006, Lindenfeld et al. 2014, Martín-López and Montes 2015. For example, the integration of indigenous, local, and ecological knowledge into the scientific process has been recognized recently as a crucial feature of understanding diverse SESs, but is also one of the key challenges facing PBSESR (Ifejika Speranza et al. 2010, Bohensky and Maru 2011, Tengö et al. 2014. The integration of different groups and fostering of a unified or coherent voice might be impossible or even undesirable under particular contexts (Voß and Bornemann 2011). How to best articulate differences in values, world-views, and activities is still a key challenge for PBSESR. Open questions remain in terms of how the participation of international team members is locally perceived and who has the legitimacy and capacity to deal with potential conflicts that emerge from the research process.
A common observation made by the projects surveyed is that shared conceptual frameworks can be enormously useful in facilitating communication both within research teams and with local stakeholders. Developing such frameworks often requires time and is an iterative process with the goal of building a common language and understanding. The process of building these frameworks can be as important as the end result, with their development requiring deep communication about the assumptions each stakeholder or scientist brings to the process.

Redefining and measuring the success of place-based socialecological sustainability research
The results of our survey offer some clarity as to what may be expected from a successful PBSESR project, i.e., that it can deliver progress in (1) building a strong network of interdisciplinary and transdisciplinary collaborations to foster understanding and knowledge exchange, but also ownership and trust; (2) empowering researchers to generate new scientific knowledge that is of practical utility in informing decision making; and (3) actively helping to move a given SES toward a more sustainable state.
To deliver successfully on these goals, the projects we surveyed reported on the need for progress across a range of short-and long-term objectives. In the short term, this includes the need to identify and establish an adequate multidisciplinary research team before work begins in earnest, as well as collectively to agree on the problem that is being addressed and to avoid the risks involved in setting unrealistic expectations. In the longer term, effort needs to be invested to empower the research and wider stakeholder group to have ownership of the process to help underpin tangible progress in delivering both the insights and the interventions that are needed. To date, very few PBSESR processes have been in existence for more than a decade, limiting the inferences that can be made as to how this process can be made more effective.
From a transdisciplinary perspective, one way of measuring success is to assess how much a given project supported the coproduction of knowledge, codesign of the research question(s), and codissemination of research findings to other researchers and stakeholder groups, as well as coconstruction of transformations (Mauser et al. 2013, Ruckelshaus et al. 2015. More emphasis is needed on the importance of developing an iterative and replicable approach to assessing the relevance and applicability of research for addressing sustainability issues, including the monitoring of interactions with stakeholders and measures for assessing tangible impacts on SESs. Achieving genuine transformations toward more sustainable system states are often advanced as long-term goals of PBSESR. However, the process of evaluating research contributions toward any such a transformation is complex and poorly developed. The process of conceptualizing what a transformation may mean often requires long-term investments in alternative ways of understanding a system, including ways of accounting for and reconciling the diverse and often conflicting views of different stakeholders. This suggests that entirely new ways of evaluating the success of PBSESR need to be developed. A portfolio of success measures can be used to address the often conflicting interpretations of success as perceived by project participants, funders (academic or private), and stakeholders (Kueffer et al. 2012, Mauser et al. 2013. A project could then give explicit attention to how to navigate the trade-offs among conflicting definitions of success. The portfolio of measures would be aimed at the performance of the project in general, the processes that need to be developed, the achievement of a range of different goals, and the performance of individuals that make up different teams and perform different functions (Lasén 2013). High-impact scientific products can be combined with other kinds of outputs to reach a range of audiences and user groups concerned with the sustainability issues in question (Kueffer et al. 2012). Increasing incentives for collaboration should extend evaluation metrics beyond primary authorship publications or project leadership to multiauthor publications, data-set production, outreach products, educational outputs, mentoring, http://www.ecologyandsociety.org/vol22/iss1/art14/ and contributions to actual management policies and practices . Examples from the projects surveyed here include the production of joint conceptual frameworks to inform understandings, as well as raising awareness and using pictures derived from research to communicate to wider audiences. Networks such as PECS can provide useful information on how to build such a portfolio based on the experiences of research teams across social-ecological, academic, and funding contexts. They could help identify which types of short-, medium-, and long-term products and outcomes are more feasibly attainable and provide more information on the success of PBSESR.

Strategies to foster the success of place-based-social ecological sustainability research
A careful examination of the survey responses across the PECS network suggests at least five sets of recommendations regarding strategies to foster the success of PBSESR.

Allowing enough time for better understanding of socialecological dynamics and the fostering of concrete and trusted engagements with stakeholders.
Given that PBSESR is problem and solution oriented, there is often an expectation to contribute useful information to management in the short or medium term. However, the execution of such research necessarily requires long-term time horizons. Because funding is rarely available for longer than standard 3-to 5yr project funding cycles, it is often vital to draw effectively on preexisting connections to the study region and to key stakeholders.

2.
Early identification of the role played by different project members and the scope of the project. Early identification of goals, world-views, roles, and limitations was consistently emphasized by respondents to our survey as an important factor of research success. This includes a clear delimitation of the roles played by each of the members of the research team and wider transdisciplinary network, the need to build mutual respect around the complementary roles played by different members and groups in the network, and the importance of not generating unrealistic expectations (Maass and Equihua 2015).

Identification of short-, medium-, and long-term products.
Strategies that clearly identify a realistic mix of short-, medium-, and long-term products, each of which can be targeted or reshaped to suit different audiences, can reduce pressure on the research team and its individual members to deliver tangible products quickly. Adopting such a tiered approach of deliverables can help navigate the complexities associated with bridging the different approaches to sustainability, the different types of knowledge generated, and the different research questions addressed in sustainability science. The long initiation processes needed to build effective transdisciplinary teams could be shortened through the production of these deliverables.

Adoption of internal monitoring processes to evaluate success.
Projects can promote internal monitoring systems to evaluate constructively both successes and failures and identify profitable opportunities for learning. Although monitoring of the outcomes of these projects is becoming increasingly common (e.g., Perez et al. 2010), the rigorous application of project management and performance tools such as those used in the business community are extremely rarely used in research projects. Internal monitoring of project development can help create invaluable spaces for collaborative learning (Wittmayer and Schäpke 2014), with creative and safe spaces for critical self-reflection over the roles and contributions forming a key part of this. They can also provide unique information on the dynamics of the project to identify the presence of obstacles (i.e., monitor and manage power inequalities), avoid diversions, and keep product and outcome timelines on track.

5.
Pay particular attention to the lessons that can be learned from failure. It is often the case that opportunities for new research and impact emerge more readily from experiences of relative failure than of relative success. This is particularly true given that most of the current premises of transdisciplinary research (Lang et al. 2012) have in fact not been tested. However, there is currently little incentive to record failures, and even less incentive to share such experiences, whereas there is considerable encouragement for projects to evaluate themselves in a way that reflects favorably on their achievements (for example by only evaluating the aspects of the project that have been done well). Promoting the recording and sharing of "failure reports" is only likely to be possible with encouragement (or even an obligation) from funders and academic evaluators, but it is likely to be enormously rewarding.

Addressing challenges within academic institutions and funding agencies to contribute better toward sustainability research and practice
The current structure and criteria for career advancement in scientific institutions often hinders PBSESR. Academic institutions that promote collaboration between researchers (Kueffer et al. 2012) and extend the evaluation metrics beyond primary authorship publications or project leadership to multiauthor publications, data-set production, outreach products, educational outputs, mentoring, and contributions to management should be fostered . A wider range of target journals, including those more open to sustainability research and those that are locally relevant, needs to be emphasized.
Institutional changes are needed to codevelop new career and project profiles that take into account a wider range of products and outcomes from PBSESR in research evaluation (Fischer et al. 2015). More nuanced evaluation systems are needed that give priority to both locally relevant and slowly evolving outcomes as well as more short-term and highly visible products. Such systems are particularly important for early-career researchers, who are often under particularly intense pressure to produce conventional peer-reviewed papers and yet highly motivated to be involved in PBSESR.
Universities and funding agencies are increasingly under pressure to deliver scientific results that are relevant to societies. New ways to assess the impacts of research on social networks and actual decision-making processes are urgently needed. New ways to engage their faculty in innovative, risky, but timely research, as well as the development of stimuli, are also desirable. Funding is needed to provide sufficient time to build robust transdisciplinary http://www.ecologyandsociety.org/vol22/iss1/art14/ research teams that are capable of truly codesigning projects, coproducing knowledge, and coimplementing management strategies in developing collaborative solutions-oriented research. Similarly, enough funding to secure constant communication to refine the project iteratively and to follow long-term transformations is seldom available.
Perhaps above all, new approaches to training and learning are urgently needed. Intensive learning processes have occurred as interdisciplinary and collaborative research has taken place over the past decades (Kueffer et al. 2012), but this is insufficient for addressing the huge scale and scope of the world's sustainability challenges. PBSESR projects offer excellent opportunities for trainees to experience a range of insights across contexts, disciplines, and sectors of society. More efforts should be made in providing new and multiple teaching models that foster complex thinking, stimulate collective learning, and provide an appropriate environment that engages students in reflecting about their own value systems, knowledge systems, and cultural background, as well as the learning processes (König 2015, Vilsmaier andLang 2015). Research-based learning spaces where students, researchers, and nonacademic stakeholders collaborate and engage in real solutions-oriented projects provide the setting for acquiring competences on how to address sustainability problems collectively (Evans et al. 2015, Wiek andKay 2015).

CONCLUSIONS
PBSESR has developed a strong track record of delivering key insights and creating a new generation of sustainability scientists. Such research can be rewarding for researchers because of the ability to work with many different people and to enhance real transitions toward sustainability. However, such research is also immensely challenging because of the complexity of SESs and conflicts with the way scientific funding and careers are currently organized.
We surveyed an emerging research community gathered around the PECS that is focused on PBSESR. We believe that the formation of communities of practice of such researchers, both within and outside of academia, are critical for helping generate new research approaches, new insights from comparative work across study sites and research teams, and practical tools for improving SESs and ways of envisioning solutions to sustainability problems. The community that is being formed by groups such as PECS can also play a vital role in helping catalyze change within academic institutions and funding organizations and foster new training opportunities for fostering PBSESR. It can contribute to designing funding mechanisms that are better suited to the needs and contributions of PBSESR research through improving working conditions and funding schemes for researchers working on the sustainability of SESs.
Efforts to build more sustainable approaches to managing SESs should embrace international as well as locally relevant perspectives through an inclusive approach that actively rewards respectful and collaborative behaviors within the scientific community (Tallis and Lubchenco 2014). We believe that networks such as PECS have a vital role to play in this process.
Responses to this article can be read online at: http://www.ecologyandsociety.org/issues/responses. php/8826

Research approaches for place based studies of social-ecological systems: insights gained QUESTIONNAIRE
Dear member of the PECS community, You are receiving this email because you either participate in a PECS endorsed project, and/or you are (or have been) a member of the PECS Scientific Committee.
We are writing to you to seek your support in gathering insights from researchers working in the field how to best perform place-based socialecological sustainability research (hereafter 'PECS-type research'). For the PECS' vision and definitions of this type of research we refer to the Carpenter et al (2012) paper on PECS and emphasize these three features: 1. focused on understanding linkages between key social and ecological systems in a particular place or places; 2. concerned with identifying and promoting opportunities to improve sustainability in terms of social wellbeing, and the conservation of ecosystem integrity and biodiversity; 3. working, at least minimally, in partnership with non-academic stakeholders You can fill in this survey for any project in which you have been recently involved that is consistent with the above definitions and aims. Your answers should relate to one specific project (even if you have been involved in several). If several representatives of the same project have been invited to fill this questionnaire please coordinate with colleagues to return only one survey per project.
The spirit of the survey is that you share with us your insights on what do you see now as key enabling features and key obstacles towards placed-based socialecological sustainability research.
This is a new survey based on the pilot conducted at the Moureze workshop.
We have divided the survey into six sections that relate to different aspects of the overall research approach adopted, or aspired to, within a particular study. These are described below.
1-Problem orientation features-How the project was conceived and designed, who is involved in this, and what are the key steps involved. 2-Research team features-What is the nature of the team (which researchers and stakeholders are included) as well as what is the nature of interactions between individuals and groups 3-Evaluative features-What the outputs and outcomes expected of the project, including those promised to the funders, those agreed upon with the stakeholders and those aimed for by the researchers involved.
4-Conceptual features -Which are the key themes, concepts and approaches that have been adopted and acquired during the project. 5-Contextual features-What is the context of the research site (scale, socio-economic, political and historical context, geographic, spatial and temporal) and does this, and the context of the research itself (institutional setting, funding, types of links with stakeholders) influence the dynamics of the research process 6-Methodological features-What are the kinds of tools and types of methodological approach that were adopted as part of your research process.
We will be inquiring about your general thoughts on what are key features for each of these six categories, and what are desirable and undesirable aspects of these features using an open format. Then, we will use a closed format to inquire about which features are more or less important.

Research ethics
This survey asks you about challenges and experience of PECS-type research. Please respond as candidly as possible, but be mindful that data may conceivably be sensitive or reflect unfavorably on researchers, partners or funders. To mitigate the risk of inadvertent conflict or embarrassment, we will follow these ethical procedures.
-Your names and project details will be kept with the data -The raw, non-anonymized data will be shared between the six team members only (Patty, Berta, Chinwe, Marja, Tim, Toby). -The answers will be used to write a paper in the PECS special issue and possibly follow up studies. -Completing the survey will qualify you for acknowledgement in papers that use the data; you will also be invited to coauthor the manuscript if you are interested to do contribute to the writing of the manuscript within the narrow timeline available. -Draft text for publication using these survey data will be shared with survey respondents before submission for publication. You can then clarify statements, request that you or your project remain anonymous, or that the data are removed. If you have not responded within 3 weeks we will assume that you consent for the text to be submitted for publication.
We thank you very much in advance for your support with this endeavor! Patty, Berta, Chinwe, Marja, Tim, and Toby

SURVEY INFORMED CONSENT STATEMENT
By filling out this survey you indicate that -I understand how data from this survey will stored and used -I give consent for my name and project details to be stored with these data -I will have 3 weeks to approve publication of data provided by my survey before publication. If I do not respond within three weeks my consent for publication will be assumed. -I will inform lead authors if I am interested in participating as an author and will provide contributions to the different drafts of the manuscript.

GENERAL INFORMATION ON YOUR PROJECT
Please provide us with some basic information about your project.

PROBLEM ORIENTATION FEATURES
This section is about how the project was conceived and designed, who is involved in this, and what are the key steps involved.
1-Current performance of your project Please provide us with your own list of up to three features of problem orientation features which you believe are important for PECS-type research, and rank the current performance of your project from 4 (excellent) to 1 (very poor) for each of these features. Feature a. ________________ 1 (very poor), 2 (poor), 3 (good), 4 (excellent) Feature b. ________________ 1 (very poor), 2 (poor), 3 (good), 4 (excellent) Feature c. ________________ 1 (very poor), 2 (poor), 3 (good), 4 (excellent) I'd be tempted to add an optional comments box under each of the questions 1-5. here as I think some good insights could be triggered by these questions as people go along, they might not have them to mind when they reach the end of the section.

4-Enabling factors
Please tell us what do you think have been the three key factors that have enabled a good performance of your research project with respect to problem orientation features. Enabling factor 1 ______________________________________________________________________ Enabling factor 2 ______________________________________________________________________ Enabling factor 3 ______________________________________________________________________

5-Obstacles
Please tell us what do you think have been the three key obstacles that have prevented a good performance of your research project with respect to problem orientation features. Obstacle 1 ______________________________________________________________________ Obstacle 2 ______________________________________________________________________ Obstacle 3 ______________________________________________________________________ 6-General comments Please share with us any other insights with respect to problem orientation features that you think will be very useful to others undertaking this kind of research in the future. ___________________________________________________________________________________________ ___________________________________________________________________________________________ ___________________________________________________________________________________________ ___________________________________________________________________________________________ 7-Relative importance Based on your experience, how important do you think each of these aspects of problem orientation features are for achieving successful place-based socialecological sustainability research. The possible answers are: 1-completely unimportant, 2-fairly unimportant, 3important, 4-Essential. Please do not just score every feature as 4 unless you are really convinced that they are all essential.

Problem Orientation features Project initiation
Importance Score a.
The project is triggered by a direct demand from stakeholders The project is triggered by the identification of a key social-ecological sustainability issue 1 2 3 4 c.
The project is a continuation of long-term research occurring in at least one of the research sites 1 2 3 4 d.
The project is triggered by a suitable call for proposals 1 2 3 4 Identification of the research question 1 2 3 4 e.
The research question is identified by the whole research team The research question is identified in close collaboration with the stakeholders 1 2 3 4 Iterative refinement g.
The research question is refined as the project evolves 1 2 3 4 h.
The research question and priorities within the project are refined with direct involvement of stakeholders

RESEARCH TEAM FEATURES
This section is about the research team (comprising both researchers and stakeholders) and interactions within the team.
1-Current performance of your project Please provide us with your own list of up to three features of research team features which you believe are important for PECS type research, and rank the current performance of your project from 4 (excellent) to 1 (very poor) for each of these features. Feature a. ________________ 1 (very poor), 2 (poor), 3 (good), 4 (excellent) Feature b. ________________ 1 (very poor), 2 (poor), 3 (good), 4 (excellent) Feature c. ________________ 1 (very poor), 2 (poor), 3 (good), 4 (excellent)

6-General comments
Please share with us any other insights with respect to problem orientation features that you think will be very useful to others undertaking this kind of research in the future. ___________________________________________________________________________________________ ___________________________________________________________________________________________ ___________________________________________________________________________________________ ___________________________________________________________________________________________ 7-Relative importance Based on your experience, how important do you think each of these research team features are for achieving successful place-based social-ecological sustainability research.
The possible answers are: 1-completely unimportant, 2-fairly unimportant, 3important, 4-Essential. Please do not just score every feature as 4 unless you are really convinced that they are all essential.

Composition of the research team
Importance Score a. The team incorporates researchers and students from different disciplines within the social and ecological sciences

EVALUATIVE FEATURES
This section is about outputs and outcomes expected of the project, including those promised to the funders, those agreed upon with the stakeholders and those aimed for by the researchers involved (which may be explicit or not).

6-General comments
Please share with us any other insights with respect to problem orientation features that you think will be very useful to others undertaking this kind of research in the future. ___________________________________________________________________________________________ ___________________________________________________________________________________________ ___________________________________________________________________________________________ ___________________________________________________________________________________________ 7-Relative importance Based on your experience, how important do you think each of these types of products and outcomes are important for the success of PECS-type research. The possible answers are: 1-completely unimportant, 2-fairly unimportant, 3important, 4-Essential. Please do not just score every feature as 4 unless you are really convinced that they are all essential.
Products expected from the research team Importance Score a. Scientific papers in international peer-reviewed indexed journals 1 2 3 4 b. Policy briefs aimed at local, sub-national or national level decision-makers 1 2 3 4 c. Policy support tools (e.g. decision-support systems) 1 2 3 4 d. Management guidelines and best practices manuals 1 2 3 4 e. Outreach materials (e.g. leaflets) to be distributed in the study areas 1 2 3 4 f. Outreach materials (e.g. videos) 1 2 3 4 g. Scientific papers in international peer-reviewed indexed journals 1 2 3 4 Outcomes expected from the research team and process a. Team members have good interpersonal skills (empathy, communication) 1 2 3 4 b. Building capacities within academia at academic institutions within the study sites 1 2 3 4 c. Strengthening local informal institutions to foster decisionmaking 1 2 3 4 d. Strengthening sub-national and national formal institutions to foster decision-making

CONCEPTUAL FEATURES
In this section we examine the key themes, concepts and approaches that are deemed most relevant for undertaking place-based social-ecological research.
1-Current performance of your project Please provide us with your own list of up to three features of conceptual features which you believe are important for PECS type research, and rank the current performance of your project from 4 (excellent) to 1 (very poor) for each of these features. Feature a. ________________ 1 (very poor), 2 (poor), 3 (good), 4 (excellent) Feature b. ________________ 1 (very poor), 2 (poor), 3 (good), 4 (excellent) Feature c. ________________ 1 (very poor), 2 (poor), 3 (good), 4 (excellent)

4-Enabling factors
Please tell us what do you think have been the three key factors that have enabled a good performance of your research project with respect to conceptual features. Enabling factor 1 ______________________________________________________________________ Enabling factor 2 ______________________________________________________________________ Enabling factor 3 ______________________________________________________________________

5-Obstacles
Please tell us what do you think have been the three key obstacles that have prevented a good performance of your research project with respect to conceptual features. Obstacle 1 ______________________________________________________________________ Obstacle 2 ______________________________________________________________________ Obstacle 3 ______________________________________________________________________ 6-General comments Please share with us any other insights with respect to problem orientation features that you think will be very useful to others undertaking this kind of research in the future. ___________________________________________________________________________________________ ___________________________________________________________________________________________ ___________________________________________________________________________________________ ___________________________________________________________________________________________ 7-Relative importance Based on your experience, how important do you think each of these aspects of conceptual features are for achieving successful place-based social-ecological sustainability research. The possible answers are: 1-completely unimportant, 2-fairly unimportant, 3important, 4-Essential. Please do not just score every feature as 4 unless you are really convinced that they are all essential.

METHODOLOGICAL FEATURES
In this section we explore which tools and types of methodological approaches constitute the research process. Irrespective of what actually happened in the project we are looking for what you think should have been done.
1-Current performance of your project Please provide us with your own list of up to three features of methodological features which you believe are important for PECS type research, and rank the current performance of your project from 4 (excellent) to 1 (very poor) for each of these features. Feature a. ________________ 1 (very poor), 2 (poor), 3 (good), 4 (excellent) Feature b. ________________ 1 (very poor), 2 (poor), 3 (good), 4 (excellent) Feature c. ________________ 1 (very poor), 2 (poor), 3 (good), 4 (excellent)

4-Enabling factors
Please tell us what do you think have been the three key factors that have enabled a good performance of your research project with respect to problem orientation features. Enabling factor 1 ______________________________________________________________________ Enabling factor 2 ______________________________________________________________________ Enabling factor 3 ______________________________________________________________________

5-Obstacles
Please tell us what do you think have been the three key obstacles that have prevented a good performance of your research project with respect to problem orientation features. Obstacle 1 ______________________________________________________________________ Obstacle 2 ______________________________________________________________________ Obstacle 3 ______________________________________________________________________ 6-General comments Please share with us any other insights with respect to problem orientation features that you think will be very useful to others undertaking this kind of research in the future. ___________________________________________________________________________________________ ___________________________________________________________________________________________ ___________________________________________________________________________________________ ___________________________________________________________________________________________ 7-Relative importance Based on your experience, how important do you think each of these aspects of methodological features are for achieving successful place-based socialecological sustainability research. The possible answers are: 1-completely unimportant, 2-fairly unimportant, 3important, 4-Essential. Please do not just score every feature as 4 unless you are really convinced that they are all essential.

Nature of research methods
Importance Score a. The projects uses both qualitative and quantitative methodological approaches 1 2 3 4 b. The project uses both methods from Natural and Social Science 1 2 3 4 c. The project uses participatory methods, including individual and deliberative tools 1 2 3 4 Nature of methodological approaches a. The project uses participatory action research approach 1 2 3 4 b. The project incorporates explicitly uncertainty in its methodological approaches 1 2 3 4 c. The methods allow for triangulation of the information 1 2 3 4 THANK YOU FOR YOUR TIME!