Geodesign to Tame Wicked Problems

3 downloads 159204 Views 737KB Size Report
Digital Landscape Architecture, 1-2016. © Herbert ... Story Maps® and a variety of other web- and app-based tools were used to develop a .... of individual webpages assembled using a student account with Weebly® a web-hosting site.
1

Geodesign to Tame Wicked Problems Brian Orland

1

1

The University of Georgia, United States · [email protected]

Abstract The challenges of designing within the coupled natural-human systems of contemporary cities and landscapes to respond to climate change, the risk of natural disasters and equal access to healthy environments are often termed “wicked” problems—where many interacting systems are in play, the outcomes uncertain, and the implications ambiguous. The geodesign addresses such problems well but many participants are ill-prepared to participate; planners, scientists, policy-makers and citizens are unfamiliar with each others’ core principles, values, methods and metrics for success. An introductory phase of planning comprising geo-inspired story-telling, game-playing and exploration has been proposed as a solution. With undergraduate landscape architecture students as test respondents, readily available Weebly® and Google Docs®, ESRI GeoPlanner® and Story Maps® and a variety of other web- and app-based tools were used to develop a web-based story-telling structure to address the problem of concurrently protecting and developing adjacent to the Rock and Shoals Outcrop Natural Area near Athens, Georgia, USA, a regionally-significant yet fragile biodiversity resource. The site selection for a hypothetical snail farm was used to introduce GeoPlanner® as the geodesign platform, the unfamiliar topic chosen deliberately to engage students in bringing fresh thought to design scenarios. The RSONA project provided a “double-loop” learning structure in which student participants, through repeated attempts to solve problems, modified their original goal and learned to act from the perspective of their own expertise while maintaining explicit awareness of the many others in play.

1

Introduction

The expression “wicked problem” was coined by Horst Rittel (RITTEL & WEBBER, 1973; BUCHANAN, 1992) to describe problems too complex, and engaging too many realms of knowledge, to be easily solved by small teams. Solutions to climate change, to provision of equitable healthy environments, and to the risk of natural disasters are wicked problems and among our greatest societal challenges. Solutions must acknowledge the gravity of the problems, respond in ways that are socially as well as scientifically feasible, and operate at both small, local scale and large, regional scale (YUSOFF & GABRYS, 2011; CHUN, 2015; JACKSON, 2015). The Rock and Shoals Outcrop Natural Area (RSONA) near Athens, Georgia, USA, is small scale and local, but representative of many parcels of land adjacent to urban areas. Microhabitats of shallow depressions in exposed granite support many rare and endangered species. RSONA is surrounded by privately owned land that was once cropland but is now forested, contributing to extensive woodland habitat. The owner of the private land seeks some economic benefit Digital Landscape Architecture, 1-2016. © Herbert Wichmann Verlag, VDE VERLAG GMBH, Berlin/Offenbach. ISBN 978-3-87907-612-3, ISSN xxxx-xxxx, doi:10.14627/537612xxx

2

Digital Landscape Architecture · 1-2016

by either selling for development or granting an easement for conservation. The land is zoned for agriculture or for low density housing with a minimum parcel size of 4.5ha. It could be more valuable as more numerous smaller parcels that might free more land for conservation but would add infrastructure demands far from the town’s core. Resolving competing values and governance issues are keys to the future of the land.

Fig. 1: RSONA granite outcrop

Fig.2: Site surrounded by private land

BRONDIZIO, OSTROM & YOUNG (2009) argued that even in the relatively constrained situation of the Xingu Indigenous Park in Brazil, the increasing connectivity of resourceuse systems—water, food, energy—across scales as well as locations, calls for environmental governance that also operates across scales for the long-term protection of ecosystems and populations. In complex urban and suburban settings, the burdens on governance and the need for guidance from the design and science and communities are yet greater. CUMMING et al. (2014) observed that increasing urbanization, acting at the same time as climate change, further adds to exploitation of ecosystems as urban populations prioritize socio-economic services over ecosystem services. Specifically addressing social vulnerability to climate change in Georgia, KC, SHEPHERD & GAITHER (2015) found climate vulnerability to be highest in metropolitan and coastal counties. While the science of such problems is critical to their solution, so is the social, political and cultural milieu in which the problem is situated. Solutions will not emerge until all facets are addressed simultaneously and with equal seriousness (YOUNG AND STEFFEN, 2009; CHAPIN et al., 2011.) A growing number of prominent scientists call for much greater efforts to address such change, and propose that higher education has an obligation to take a leading role (CHAPIN et al., 2011; YARIME et al., 2012.)

2

Background: Methods for Tackling Wicked Problems

BUCHANAN (1992) observed that most of the problems addressed by designers are wicked, a "class of social system problems which are ill-formulated, where the information is confusing, where there are many clients and decision makers with conflicting values, and where the ramifications in the whole system are thoroughly confusing." The wicked problems approach, he advances, accepts that even small problems possess a fundamental indeterminacy that is not amenable to linear solutions. ARGYRIS (1996), writing from a business management perspective, claimed that the causal relationships identified by empirical research are insufficient to translate directly into action and must be modified

B. Orland: Geodesign to Tame Wicked Problems

3

through a process he described as “design causality.” “Double-loop” learning is a key component of the process he proposed. In contrast to “single-loop” learning, double-loop thinking does not simply observe and apply cause-effect observations, but includes the thinking processes used to design actions and implementations. Iterative double-loop learning processes are central to design teaching (BUCHANAN, 1992) and are especially embedded in the rapid development and testing of ideas that are characteristic of design studio methods. Reflecting on successes and failures, accepting the latter as additions to knowledge and reiterating the process armed with this new knowledge, double-loop learning is increasingly involved in solving challenging environmental problems at massive scale (ZHANG, MAO & ZHANG, 2015.) SYNNOTT (2013) demonstrated the successful use of the approach in design of HS2, a proposed high-speed rail corridor through the heart of the UK. PETERSEN, MONTAMBAULT & KOOPMAN (2014) demonstrated its use in the management of Landscape Conservation Cooperatives: multi-agency, cross-boundary and multi-stakeholder planning and management agreements encompassing large areas of the USA, Mexico and Canada. Prominent ecologists have independently suggested the necessity of engaging such design thinking in the solution of problems of climate change resilience and urban sustainability (PICKETT et al., 2014; CHILDERS et al., 2015.) While processes of this kind have been successful, they nevertheless may have been biased toward “expert” knowledge and have under-valued the place-based knowledge of local stakeholders and citizens (SCHÖN, 1995.) Local stakeholders rarely possess the required knowledge of the scientific systems in play to fully participate (ORLAND, 2015) although participation could lead to closer engagement with the design process, ownership of the outcomes, and future involvement in ensuring that plans are implemented (VOINOV & BOUSQUET, 2010; PHILIPSON et al., 2012.) As expert planners, SCHÖN (1995) and DZUR & OLSON (2004) observed that scientific and professional knowledge alone cannot solve complex design and planning issues, and called for expert scientists and planners to move away from working “for” the public towards working “with” the public using narrative placemaking, participatory design and action research approaches to capture local knowledge. Other authors have suggested a hybrid approach where informed participants entrust highly structured and technocratic planning to experts, and focus on the unstructured decisions that can only be resolved through dialog and discourse (HURLBERT & GUPTA, 2015.) Our design and planning processes should respond to these concerns.

3

Extending the Geodesign Framework

Collaborative design and planning platforms must provide for information of all kinds to be shared; for participants in the process to share their own insights equitably; and for outcomes to be traced back to the evidence on which they are based. The Geodesign framework (STEINITZ, 2012) (Fig. 2a) is an example of such a general-purpose, decision-support tool for landscape-scale design and planning. It arrives at a time of great demands for stakeholder engagement in design and planning decisions, and for evidence-based design. GeodesignHub® is software derived directly from the framework to support iterative and collaborative planning via a sketch-based interface (BALLAL, 2015) (Fig. 2b.) RIVERO et al. (2015) described the successful operation of GeodesignHub in the context of futures planning for Chatham County, Georgia, a coastal county with significant environmental assets, threatened by sea-level rise and climate change, and targeted for economic development.

4

Digital Landscape Architecture · 1-2016

Fig. 2a. The geodesign framework (STEINITZ, 2012)

Fig. 2b. GeodesignHub in Chatham County, GA. (RIVERO et al., 2015)

Despite the benefits of the Geodesign framework, in specific problem-solving settings two challenges emerge. First, it is impossible to archive all the data that is needed to support all possible lines of questioning—there must be easy ways to add additional and project-relevant data. Volunteered Geographic Information (VGI) (GOODCHILD, 2007), crowdsourced geographic knowledge (SUI, ELWOOD & GOODCHILD, 2013) and Big Data (BATTY, 2012) offer ways to develop rich and extensive data but are largely missing means to make the data accessible and meaningful to non-experts. Second, even experts may be unfamiliar with the the key issues in areas other than their own when addressing trans-disciplinary concepts such as “climate change” or “ecosystem services.” To both challenges, there is a growing body of literature to support the use of game-like strategies for communicating scientific concepts (KLOPFER, 2008; CONNOLLY et al., 2012.) BROCK & DECHERT (2008) and UMPHLETT et al. (2009) specifically point to the value of games for exploring ecosystem dynamics while BISHOP (2011) and SCHROTH, POND & SHEPPARD (2015) describe game-like environments to communicate the design and planning implications of anticipated change. ORLAND (2015) proposed an extension to precede the STEINITZ framework (2012) (Fig. 2a) comprising three elements: Storytelling, System exploration games, and Group interactions (ORLAND & MURTHA, 2015; VERVOORT et al., 2014.) Storytelling reveals the values and beliefs of participants in decision-making, encouraging them to acknowledge each others’ viewpoints. Stories connect individual experience of the landscape to the circumstances and environments around and conveys meaning as well as location and physical composition. System exploration provides insights into the internal mechanisms of systems—how change in one area affects outcomes in others. Discovering how landscape systems work is essential to meaningful participation in landscape design and planning, and thus geodesign. Group interactions via games or workshops have been in use for many years for investigation of policy interventions in landscape planning—learning from the group interactions that occur as participants seek consensus among competing views and values.

4

The Snail Farming Example

My teaching assignment for Fall 2015 provided the opportunity to test this extended framework with 24 undergraduate students in their penultimate year of study, focusing on

B. Orland: Geodesign to Tame Wicked Problems

5

planning for the development of the private land adjoining the RSONA, treating the students as surrogates for residents of the area. All had taken introductory design classes but were relatively new to land suitability assessment, as the residents would be. To model the path students would follow, two graduate students developed a website “Linna and Mackenzie’s Escargots” describing our fictitious niche agricultural enterprise, including a gallery of snail portraits, recipes, and “Our Location”, a portal to class geodesign tutorials.

Figure 3. The snail farm website How should the study area be described? Having visited, hiked and photographed the site students developed personal stories that imagined the role that RSONA might play in their lives. The story assignment was modelled on the environmental autobiography, a tool used by educators in many fields to engage students in active reflection on experience (BOSCHETTI, 1987; CORCORAN, 1999, MEYER & MUNSON, 2005.) In this case the goal was to reveal the values students held for the site. We explored crowd-sourced narratives to the same end but the few on-line responses we found were technical rather than experiential in nature so this direction was not pursued. Student responses were recorded as the introductory component of individual webpages assembled using a student account with Weebly® a web-hosting site. Weebly has numerous ready-made templates and an easy-to-learn interface, thus minimizing the intrusion of website design into the work of the class.

Figure 4a. Wordle for student narratives

Figure 4b. i-Tree (USDA, 2014)

In this first iteration of the model, the content of students’ responses was manually coded for saliency: “Being in the woods is great whenever, but this spot is special. It may be the slight change of cover between tall baby oaks and early succession grasses...or the surprise of crossing the creek over mossy rocks before the water takes a ride on a small waterfall...or the novelty of seeing the preserved errors of our past as we made our way up a terraced hill...or it could be all of these things! It was so much fun to explore!” The underscored

6

Digital Landscape Architecture · 1-2016

words might then be chosen as cues to elements to be preserved, enhanced or mitigated. A second strategy, only attempted later with the data, is to use tools such as Wordle®, www.wordle.net, to create word clouds that identify common themes across numerous stories (MCNAUGHT & LAM, 2010) (Figure 4a.) How does the study area operate? In previous work the author and colleagues have had sufficient resources available to custom-make games to explore the system interactions at play in the problem (ORLAND et al., 2014; ORLAND, 2015.) In this classroom case neither time nor funds were available so free and on-line resources were sought. In this case, i-Tree Site® and i-Tree Canopy®, on-line tools created by the USDA FOREST SERVICE (2014), were used to learn ecosystem services relationships at small and large scales (Figure 4b) (HILDE & PATERSON, 2014.) The i-Tree suite reveals the relationships between land cover and ecosystem services such as provision of shade, carbon sequestration and water storage, each accompanied by an estimate of the monetary implications of changes in services generated. How might the area be altered, how should it be changed? Addressing these questions demands an interactive environment. While the GeodesignHub® (Figure 2b) (BALLAL, 2015; RIVERO, et al., 2015) would have been an ideal tool for scenario sketching and evaluation, arrangements could not be made for local server support so an alternate approach was used. For the initial consensus-building step, a modified Delphi process (WELLAR & NOVAKOWSKI, 2008) was adopted, using Google Docs®.

Figure 5. Prioritization exercise: Delphi via Google Docs® The on-line interactive spreadsheet allows each participant to remain anonymous, yet see all of the choices made by their counterparts, and change their own evaluations, or add items, to reinforce or provide alternative answers to emerging consensus. Scenario development and evaluation: To assess the capability of the land to support the prioritized land uses, another GoogleDocs spreadsheet was used to support a land suitability matrix to identify the factors that constitute acceptable ranges of values for each of the previously identified landscape characteristics, e.g., soils, slope, access to water, access to roads etc. To develop design scenarios based on the values identified, we used the ESRI GeoPlanner® tool released in 2014. Because the existing on-line tutorials were written for urban development using urban design-relevant symbol sets, tutorials were edited and new symbol templates developed that were better suited to natural area, recreational and agricultural development. To minimize the likelihood of solutions emerging from student projects based on prior knowledge, the snail farm was introduced as a land use goal for training in the tool’s use, one unlikely to be familiar to an American student.

B. Orland: Geodesign to Tame Wicked Problems

Figure 6a. site suitability GeoPlanner

6b. compare scenarios Story Maps

7

6c. the final story Weebly/ArcGIS Online

Students were required to identify three land uses for the site, e.g., snail enclosures, sales and educational areas, recreational trails and conduct suitability analyses for each of those uses (Figure 6a.) They were then required to design at least two land use allocation scenarios, conduct evaluations of each of those according to metrics such as ecosystem services and compare the two using ESRI Story Maps® (Figure 6b.) GeoPlanner accesses data via ArcGIS Online for most of its functions. As a result, each product developed in GeoPlanner can be made available to all other students in the class, resulting in the ability to share valuable products such as a soil suitability re-classification without each student replicating the laborious assignment of values to numerous soil types. It also allows all map products to be available to a range of other tools, notably ESRI Story Maps, a suite of presentation templates that supplement map tools with the ability to create stories embedding still images, video and a number of map comparison tools. Unlike conventional websites this means that map layers can be queried via the web interface enabling users to validate the results of analyses by directly accessing the underlying data. The final products of the class were websites integrating the originating stories where student values were identified and expressed; the results of interactive on-line priority-setting; the analyses that emerged; alternative scenarios interactively compared; and conclusions all presented in a single web presentation.

5

Conclusion

Snail farms are rare in the United States (an internet search in February 2016 yielded just one listing, little gray farms in Quilcene, Washington.) While growing conditions seem appropriate, escargots are not common on menus and snails are generally regarded as pests. The exercise reported here was a first proof-of-concept of a proposal advanced in 2014. It used available tools that were not designed to work together; there are advantages and disadvantages to this approach. First, the tools would be more satisfying and accessible for students if they were robustly linked, with consistent look-and-feel, albeit with substantial development costs to achieve an integrated system. On the other hand, new ideas and tools are constantly emerging that may offer better ways to conduct thought-experiments to understand ecosystem interactions. NetLogo®, an agent-based modelling application, has been used to represent a wide range of natural and social systems simulations (WILENSKY & RAND, 2015.) i-Tree, used in this class, is a robust set of tools based on substantial research and designed to address the broadest range of interested citizens. The next iteration of this class will consider these two questions. There will be a new version of GeoPlanner (release

8

Digital Landscape Architecture · 1-2016

Spring, 2016) with a different interface and new capabilities, we hopefully will be able to implement GeodesignHub as a classroom tool, and we will inevitably discover new system simulation tools to consider for inclusion. Anecdotally, the forward extension of the geodesign framework provided for identification and consideration of a broader range of values than is typical in a design studio, and the ease of re-iterating via multiple scenarios supports a key requirement of double-loop learning; all students created at least two distinct scenarios. Future classes will evaluate student (user) experience more systematically in anticipation of adopting some of these tools and approaches in community workshops.

Acknowledgements Many thanks to graduate students Mackenzie Battista and Linna Yuan who assisted in development of the class website and tutorial materials. Thanks also to Chloe Weigle and David Hasslinger, students in the class whose work is featured.

References ARGYRIS, C. (1996) Actionable knowledge: Design causality in the service of consequential theory, Journal of Applied Behavioral Science (32) 4: 390-406. BALLAL, H. (2015) Collaborative Planning with Digital Design Synthesis, Ph.D. Dissertation, University College-London. BATTY, M. (2012) Visualisation tools for understanding Big Data, Environment and Planning B: Planning and Design 39: 413 - 415. BISHOP, I. (2011) Landscape planning is not a game: Should it be? Landscape and Urban Planning. 100(4), 390-392. BOSCHETTI, M. A. (1987) Memories of childhood homes: Some contributions of environmental autobiography to interior design education and research. Journal of Interior Design 13 (2): 27-36. BROCK, W. A. & DECHERT, W. D. (2008) The polluted ecosystem game. Indian Growth and Development Review. 1(1): 7-31. BRONDIZIO, E.S., OSTROM, E. & YOUNG, O.R. (2009) Connectivity and the governance of multilevel social-ecological systems: The role of social capital. Annual Review of Environment and Resources. 34 (1): 253-78. BUCHANAN, R. (1992) Wicked problems in design thinking, Design Issues 8 (2): 5-21. The MIT Press, DOI:10.2307/1511637. CHAPIN III, F., PICKETT, S., POWER, M., JACKSON, R., CARTER, D. & DUKE, C. (2011) Earth stewardship: A strategy for social–ecological transformation to reverse planetary degradation. Journal of Environmental Studies and Sciences. (1): 44-53. CHILDERS, D., CADENASSO, M, GROVE, M.J., MARSHALL, V., MCGRATH, B. & PICKETT, S. (2015) An ecology for cities: A transformational nexus of design and ecology to advance climate change resilience and urban sustainability. Sustainability. 7 (4): 3774-91. CHUN, W.H.K. (2015) On hypo-real models or global climate change: A challenge for the humanities, Critical Inquiry 41 (3): 675-703. CONNOLLY, T.M., BOYLE, E.A., MACARTHUR, E., HAINEY T. & BOYLE, J.M. (2012) A systematic literature review of empirical evidence on computer games and serious games. Computer Education 59 (2012) 661–686. DOI:10.1016/j.compedu.2012.03.004.

B. Orland: Geodesign to Tame Wicked Problems

9

CORCORAN, P. B. (1999) Environmental autobiography in undergraduate educational studies. In G. Smith & D. R. Williams (Eds.), Ecological education in action (pp. 179188). New York: SUNY Press. CUMMING, G.S., BUERKERT, A., HOFFMANN E.M., SCHLECHT, E., VON CRAMONTAUBADEL, S. & TSCHARNTKE, T. (2014) Implications of agricultural transitions

and urbanization for ecosystem services, Nature 515 (7525): 50-7. DZUR, A.W. & OLSON, S.M. (2004) The value of community participation in restorative justice. Journal of Social Philosophy 35: 91-107. ESRI. (n.d.) Arc-GIS Online, GeoPlanner, Story Maps. ESRI, Redlands, CA. GOODCHILD, M. (2007) Citizens as sensors: The world of volunteered geography, National Center for Geographic Information and Analysis, UC-Santa Barbara, 15pp. http://www.ncgia.ucsb.edu/projects/vgi/docs/position/Goodchild_VGI2007.pdf HILDE, T. & PATERSON, R. (2014) Integrating ecosystem services analysis into scenario planning practice: Accounting for street tree benefits with i-Tree valuation in central Texas. Journal of Environmental Management 146: 524-34. HURLBERT, M. & GUPTA, J. (2015) Adaptive governance, uncertainty, and Risk: Policy framing and responses to climate change, drought, and flood. Risk Analysis. DOI: 10.1111/risa.12510. JACKSON, M. (2015) Glaciers and climate change: Narratives of ruined futures. Wiley Interdisciplinary Reviews: Climate Change 6 (5): 479-92. KC, B., SHEPHERD, J.M. & GAITHER, C. J. (2015) Climate change vulnerability assessment in Georgia. Applied Geography 62:62-74. DOI: 10.1016/j.apgeog.2015.04.007. KLOPFER, E. (2008) Augmented Learning: Research and Design of Mobile Educational Games. MIT Press. MCNAUGHT, C. & LAM, P. (2010) Using Wordle as a supplementary research tool. The Qualitative Report 15 (3): 630. MEYER, N.J. & MUNSON, B.H. (2005) Personalizing and empowering environmental education through expressive writing. The Journal of Environmental Education 36 (3): 6. ORLAND, B., RAM, N., LANG, D.H., HOUSER, K.W., COCCIA M. & KLING N. (2014) Saving Energy in an Office Environment: A Serious Game Intervention. Energy and Buildings. 74:43-52. DOI: 10.1016/j.enbuild.2014.01.036. Also: http://youtu.be/6B_ID9qhAvg. ORLAND, B. 2015. The path to Geodesign: The family car of digital landscape architecture? In, E. Buhmann (ed.) Digital Landscape Architecture 2015, Anhalt University of Applied Sciences. Wichmann/VDE, Berlin and Offenbach, Berlin. ORLAND, B. & MURTHA, T. (2015) Show me: Engaging citizens in planning for shale gas development, Environmental Practice 17(4): 245-255. PETERSEN, B., MONTAMBAULT, J.R. & KOOPMAN, M. (2014) Potential for double-loop learning to enable landscape conservation efforts. Environmental Management 54. 782794. PHILLIPSON, J., LOWE, P., PROCTOR, A., & RUTO, E. (2012) Stakeholder engagement and knowledge exchange in environmental research. Journal of Environmental Management, 95(1), 56. PICKETT, S.T.A., MCGRATH, B., CADENASSO, M.L. & FELSON, A.J. (2014) Ecological resilience and resilient cities, Building Research & Information 42 (2): 143-57. RITTEL, H. & WEBBER, M.M. (1973) Dilemmas in a general theory of planning, Policy Sciences 4 (2): 155-69.

10

Digital Landscape Architecture · 1-2016

RIVERO, R., SMITH, A., BALLAL, H. & STEINITZ, C. (2015) Promoting collaborative Geodesign in a multidisciplinary and multiscale environment: Coastal Georgia 2050, USA. Digital Landscape Architecture (DLA), Anhalt University of Applied Sciences; Dessau, Germany. June 4-6, 2015. SCHÖN, D.A. (1995) Knowing-in-action: The new scholarship requires a new epistemology, Change November/December: 27-34. SCHROTH, O., POND, E. & SHEPPARD, S.R.J. (2015) Evaluating presentation formats of local climate change in community planning with regard to process and outcomes, Landscape and Urban Planning. DOI: 10.1016/j.landurbplan.2015.03.011. STEINITZ, C. (2012) A Framework for Geodesign: Changing Geography by Design. Environmental Systems Research Institute Inc. Redlands, CA. SUI, D., ELWOOD, S. & GOODCHILD, M.F. (2013) Crowdsourcing geographic knowledge: Volunteered geographic information (VGI) in theory and practice, Dordrecht: Springer Netherlands. SYNNOTT, M. (2013) Reflection and double loop learning: The case of HS2. Teaching Public Administration. 31 (1): 124-34. UMPHLETT, N., BROSIUS, T., LAUNGANI, R., ROUSSEAU, J., & LESLIE-PELECKY, D. (2009) Ecosystem jenga! Science Scope. 33(1), 57-60. USDA FOREST SERVICE. (2014) i-Tree: Tools for Assessing and Managing Community Forests. https://www.itreetools.org (accessed 09/02/2016.) VERVOORT, J. M., KEUSKAMP, D. H., KOK, K., LAMMEREN, R. V., STOLK, T., VELDKAMP, T. A. & ROWLANDS, H. (2014) A sense of change: Media designers and artists communicating about complexity in social-ecological systems. Ecology and Society. 19(3), 1. VOINOV, A. & BOUSQUET, F. (2010) Modelling with stakeholders. Environmental Modelling and Software, 25(11): 1268-1281. WELLAR, B. & NOVAKOWSKI, N. (2009) Using the Delphi technique in normative planning research: Methodological design considerations. Environment and Planning A. 40 (6): 1485-500. WILENSKY, U. & RAND, W. (2015) Introduction to agent-based modeling: Modeling natural, social, and engineered complex systems with NetLogo. MIT Press. YARIME, M., TRENCHER, G., MINO, T., SCHOLZ, R.W., OLSSON, L., NESS, B., FRANTZESKAKI N. & ROTMANS, J. (2012) Establishing sustainability science in higher education institutions: Towards an integration of academic development, institutionalization, and stakeholder collaborations. Sustainability Science. 7 (S1): 101-13. YOUNG, O. & STEFFEN, W. (2009) The Earth System: Sustaining planetary life support systems, In, F.S. Chapin, G.P. Kofinas and C. Folke (eds.) Principles of Ecosystem Stewardship: Resilience-Based Natural Resource Management in a Changing World. Springer, New York: 295-315. YUSOFF, K. & GABRYS, J. (2011) Climate change and the imagination. Wiley Interdisciplinary Reviews: Climate Change. 2 (4): 516-34. ZHANG, H., MAO, Z. & ZHANG, W. (2015) Design charrette as methodology for post-disaster participatory reconstruction: Observations from a case study in Fukushima, Japan. Sustainability 7 (6): 6593-609.