Online design thinking in a higher educational environment. Entorno UDLAP by UDLAP2025

in a higher educational environment

Anna Herold · Manuela Gutiérrez-Leefmans

Herold, Anna y Gutiérrez-Leefmans, Manuela. (2024). Online Design Thinking in a higher educational environment. Entorno UDLAP, 23 14 de febrero de 2024 Aceptado: 12 de marzo de 2024

ABSTRACT

covid-19 brought challenges for online education at different levels. Teamwork and creativity, vital activities for innovation, were affected. Moreover, the post-pandemic emergence of hybrid work urged the need to study collaborative tools. This study does an experiment of two groups, graduate and undergraduate students, who used a software for a brainstorming activity as part of a Design Thinking (dt) approach to solve a problem. A questionnaire was applied in order to measure different variables of dt, adding the technical ability one. By running two independent samples t-tests most variables were non-significant, however, the ability to “think out of different perspectives”, part of the creativity and intuition variable, showed significant results, indicating that the software does impact each group differently when it comes

to such ability. Theoretical and practical implications for both educators and organizations are outlined.

KEYWORDS:

Design Thinking · Online education · Pandemic · Creativity · T-test

RESUMEN

El covid-19 trajo desafíos para la educación en línea en los diferentes niveles. El trabajo en equipo y la creatividad, actividades vitales para la innovación, se vieron afectadas. Además, el surgimiento del trabajo híbrido enfatizó la necesidad de analizar las herramientas colaborativas. Este estudio realiza un experimento de dos grupos de estudiantes, uno de licenciatura y otro de posgrado, que utilizaron un software para lluvia de ideas, parte del enfoque del pensamiento de diseño (dt, por sus siglas en inglés), para la solución de problemas. Nuestro cuestionario mide seis variables de la metodología

propia del dt y añade la capacidad técnica. Al ejecutar dos pruebas de t independientes de muestra, la mayoría de las variables resultaron no significativas, pero la capacidad de «pensar desde diferentes perspectivas», parte de la creatividad e intuición, resultó significativa, indicando que el software afecta de manera diferente a ambos grupos en dicha habilidad. Se describen las implicaciones teóricas y prácticas, tanto para educadores como para organizaciones.

PALABRAS CLAVE:

Pensamiento de diseño · Educación en línea · Pandemia · Creatividad · Prueba de t

INTRODUCTION

The covid-19 pandemic affected much of our behavior due to the limited contact with family and friends. Working life, especially teamwork and creative work, was also impacted, and this may have a lasting negative effect on the development of innovations and ideas, hindering the further success of universities and companies (Bertelsmann, 2020). Hence, in post-pandemic times, a trend of hybrid-working for certain industries emerged (The Oxford Group, 2023), which urged the need to validate certain collaborative tools, in particular, for brainstorming. The creativity method of Design Thinking —subject of our study— works through workshops and the joint development of ideas. Until the outbreak of covid-19, these mainly took place on-site (Brown, 2009); a condition that, in some industries, is no longer desirable today.

Another reason why dt workshops that are executed online may become more important, besides the growing relevance of flexible workplaces, is the environmental protection and cost reduction for companies. As people work further apart in an international and more flexible environment, traveling is increasingly avoided. The same applies to the field of education, in particular to universities, which are an essential hub for the development of new ideas and solutions. Hybrid master’s programs are becoming more popular, with an ascending amount of remote study programs as well as other distant learning courses (Lester, 2005; Bertelsmann, 2020).

dt has led to good ideas and solutions for problems in the past and, therefore, has become widely spread overtime (Micheli et al., 2018). However, one could assume that when adopting such practice online, there could be differences among users’ adoption and usage of certain collaborative tools. Specifically, the question to be

answered in this study is, within the university context, are there differences among the diverse educational levels when adopting online DT collaborative tools?

For this purpose, the dt method is examined. Special attention is paid to its central elements and roles. Afterward, a framework is proposed for its use in an online setting. First, we discuss assumptions about the differences between the online and offline settings, which are based on research and previous experiences in online workshops. Then, the results of the two workshops that we conducted are presented in the methodology section, together with the t-test analysis performed. The differences between the two student groups are presented, as well as a discussion section that suggests practical implications and further research venues.

Theoretical foundation and practical application of Design Thinking

During the last years, the popularity of the Design Thinking method, which was developed at Stanford in the middle of the 20th century, has been rising (Stackowiak and Kelly, 2020; Ideo, 2021; AJ&Smart, 2021). A great influence on the spread of dt was created through the foundation of the so-called d.school in Stanford, along with the agency Ideo. David Kelley, one of its developers, described it as “a method for how to come up with ideas. These are not just ideas, but breakthrough ideas that are new to the world, especially with respect to complex projects, complex problems” (Camacho, 2016, p. 88).

Depending on the source, the number of phases of dt and their labelings can vary. The model of the d.school in Potsdam, Germany consists of a six-phase model (Hasso-Plattner-Institute, 2021a; 2021b). The six phases are “understand”, “observe”, “point of view ( pov)”, “ideate”, “prototype” and “test” (2021a). The Stanford model refers to the first phase as “empathize” and does not include the “observe” phase. We decided to follow the latter model, as the extra phase in the former would require additional resources. The observation of potential user groups is difficult to organize and takes more time, as it involves gathering potential consumers. Our study focuses on the “ideate” phase, as it is concerned with the use of an online tool for idea generation. The first three phases are explained during the workshop, for practical reasons a pov is given to the students previously. The goal of dt is to develop ideas, solve problems and create innovations by combining technology, business, and the human factor.

One important role during the workshop is the facilitator. There is usually one person who moderates it and explains the exercises, keeps track of time and provides help in case of disagreements between team members. The facilitator is a kind of “referee” for the workshop (Mosely

Several authors have addressed Design Thinking in educational contexts. Coleman’s work (2020) is a good example, however, in con trast with our study, he distinguishes among first year and senior year engineering students, also contrasting gender. Additionally, few arti cles relate educational context, as we do. An example is the post-pandemic work of Shé who links the “empathize” phase to the “per sona” creation. This shows that other parts of the dt the brainstorming or ideation one.

Use of Design Thinking in practice

Because be used for almost any problem-solving or ideation situation. Its resources are not necessarily focused on a specific area or topic (Knapp et al., 2016; Camacho, 2016; Ideo, 2021; AJ&Smart, 2021; Retna, 2016; Brown, 2009). How long Design Thinking is used for depends greatly on the context. Some teams or agencies use it continuously, whereas other universities and companies may only use it for short periods of time, such as a day or a few hours (Brown, 2009; Knapp et al ., 2016; AJ&Smart, 2021). Another popular way of using it is the so-called Design Sprint, developed mainly by Jake Knapp and his colleagues at Google Ventures. It summarizes the Design Thinking process in a five-day workshop (Knapp et al., 2016).

The focus on dt in schools mostly arises in connection with a new design of education. The trend follows a focus on solving practical problems and developing new ideas that also create value in the real world and not only in the classroom (Koh et al ., 2015). One focus of dt in education is the field of management and entrepreneurship, (i.e., business schools). Hence, it has become an almost mandatory exercise in business-related majors, since this makes it easier for graduates to apply in their working life later on. Again, the approaches for its implementation differ among educational institutions (Matthews and Wrigley, 2017; Lynch et al., 2019).

A framework for online Design Thinking workshops

dt is becoming increasingly popular in the educational sector, as well as in other areas. Users in practice are, for instance, independent faculties, foundation centers of universities and lecturers (Camacho, 2016).

The Design Thinking model used in this study is mostly based on the framework of Micheli et al . (2018). They conducted a systematic review of the dt literature and identified ten principal attributes. A focus is set on the attributes and codes that are associated with Design Thinking and the frequency with which they are mentioned in articles. In addition to the attributes used by these authors, we added technical ability to our framework, since it plays a crucial role in the online setting. The technical literacy, as well as the equipment of the participants, are vital in online workshops. Experimenting is also considered in newer frameworks (Ericson, 2022), where the abilities to criticize, judge, identify and analyze arguments, as well as decision making, emerge as relevant in the dt process. This analysis measures six different aspects of the dt approach: creativity and in -

novation, problem-solving, collaboration, ability to visualize, design tools and methods, and technical ability. Creativity and innovation can be understood as the ultimate goal of the entire Design Thinking approach, and achieving it depends on the right environment and conditions. Since dt is a problem-solving method, in this context it means that a given situation which cannot be solved using classical analytical methods is framed neither too broad nor too specifically. Recent literature on dt in educational contexts, highlights the “reasoning” part of the process, (Rusmann and Ejsing-Duun, 2022), where factors, such as problem setting, modeling and process management, become relevant.

Collaboration is the successful execution of the Design Thinking process in a team and without a hierarchy, so that different perspectives on one issue can be easily provided. The ability to visualize allows students to think nonverbally. It involves listening, thinking and drawing. Design tools and methods are the exercises that are executed by the teams during the workshop ( e.g ., the use of sticky notes for brainstorming). Technical ability means that the participants have the technical skills and the needed equipment for online workshops (Brenner, 2016; Brown, 2009; Camacho, 2016; Ideo, 2021; Micheli ., 2018; Stephens, 2015). Based on the variables selected, we developed the follow-

H0 = The means of the graduate and undergraduate group does not differ in any of the variables.

H1 = The means of the graduate and undergraduate group differ in the creativity and innovation varimba students, for example, may have different abilities and perspectives due to their working experience in diverse industries, besides their different professional backgrounds.

H2 = The means of the graduate and undergraduate group differ in the problem-solving variable.

H3 = The means of the graduate and undergraduate group differ in the collaboration variable.

H4 = The means of the graduate and undergraduate group differ in the ability to visualize variable.

H5 = The means of the graduate and undergraduate group differ in the design tools and methods variable.

H6 = The means of the graduate and undergraduate group differ in the technical ability variable.

Figure 1 shows the proposed framework.

METHODOLOGY

To investigate the adoption of the Design Thinking method in an online educational setting, online workshops were conducted at different age and educational levels. The methodology is based on the work of Meinel et al . (2020). This experimental research design was selected in order to give the participating students the possibility to experience an online Design Thinking workshop before evaluating it according to the parameters of the elaborated framework through a questionnaire.

Both workshops took place in lectures in a private university, one of them in the undergraduate Marketing program, and the other one in the mba program. The participants of the undergraduate program have similar backgrounds and are in a similar range of age, while the master’s students come from a more diverse academic, as well as professional, background and a broader age bracket. Both classes were selected because the lectures have a focus on Innovation studies. Therefore, a convenience sampling design was used (Emerson, 2015).

Both workshops were conducted under the same conditions: the teams have the same amount of time, the same problem to solve, and the same resources (both used Mural boards). Mural is a software for collaborative work that uses visual aids and interactivity to facilitate teamwork. It aims to improve communication and workflow via the use of sticky notes, canvas, mapping and diagramming, images, and templates. It allows sharing ideas in real time —a very appreciated feature (Brown, 2009, p. 31). Some important features are how sticky notes can be moved around the board used for the workshop depending on the phase (Mural, 2020a; 2020b). An additional resource used was Blackboard, an educational tool for video collaboration. A general statement about the usability of online workshops that use dt in the educational sector should be possible due to the experience of both groups with online tools. The analysis of the workshop is mostly

done by means of a questionnaire, which participants filled in directly afterward.

Furthermore, the facilitators went from group to group to support the teams in case of difficulties. While doing so, one facilitator took notes, which were validated by the other after the workshop. Those observations include the assessment of the flow of the workshop, as well as the Mural boards that the groups used to elaborate their ideas. Due to the technical infrastructure of Blackboard, it was not possible to record each group’s interactions (it is not possible when breaking out into groups), hence, the evaluation can only be based on the observations of the groups.

Preparation

of the workshop and development of the Mural

We describe here the process followed for the workshop. At the beginning, the professor gave a short introduction to the topic of Design Thinking, which lasted about ten minutes. They presented the most important elements and goals of the process, as well as facts about the development and delimitation of the method. Afterward, a short introduction about the tool was given with recommendations on how

it should be used. In this case, it was a combination of Blackboard, where group spaces were formed, and Mural, a tool that allowed virtual collaboration, creating a workspace close to the dt environment, described before.

Each team had their board, and thus, its workspace, where they could move from task to task. During the introduction, the individual steps were discussed together with exercises that the participants had to perform independently. The rules for working together were also presented.

The main step was brainstorming, where solutions to the question need to be found. In English, the instruction was: What product can be developed to address the changing needs of customers during the pandemic? Each team member had four minutes to solve the task — as slight time pressure favors productive work. After an individual brainstorming exercise, then came the group one. Each participant had to present their ideas to the group. Afterward, these ideas were sorted, and so-called clusters were formed, where the same or similar ideas lay next to each other. Further time was allotted for voting, where each participant picked their favorite ideas and gave them up to three points. In the end, the idea with the most points

THIS ANALYSIS MEASURES

SIX DIFFERENT ASPECTS OF THE DT APPROACH: CREATIVITY AND INNOVATION, PROBLEM-SOLVING, COLLABORATION, ABILITY TO VISUALIZE, DESIGN TOOLS AND METHODS, AND TECHNICAL ABILITY.

Source: own elaboration.

Figure 1. Proposed online dt framework.

being part of a younger generation, are more used to technology, however, graduate students are also very used to online meetings and training. This means that, for both groups, online Design Thinking workshops are viable. This coincides with Döring and Bortz (2016) findings, who contrast offline and online dt workshops.

The salient variable on the ability to “think out of different perspectives” when using the software, indicates that the software does affect each group differently when it comes to creativity and innovation. Hence, although mba students come from a rich variety of backgrounds and working experience, they appear to have a barrier in terms of creativity and innovation (as per our results, H1 was supported). For older students, there may be contagion issues that do not let them think out of different perspectives and therefore, conform to the group. This has been wide -

Table 1. Questionnaire items according to constructs.

Framework construct

Creativity and innovation

Problem-solving

Collaboration

Ability to visualize

Design tools and methods

Technical ability

Source: own elaboration.

ly acknowledged by researchers and practitioners, claiming that in the “marshmallow challenge” (an activity where students build a spaghetti structure that should hold a marshmallow on top), young children do better than postgraduate students. The former experiment much more on their own, while the latter spend more time planning and analyzing. That is, by devoting less time to experimentation, there are fewer opportunities to think out of different perspectives.

In line with Coleman (2020) and Micheli et al (2018), who conducted offline studies on dt and highlighted the “different perspectives” role on creativity and innovation, our work adds to such body of knowledge by testing the same variable in an online setting. Also, Coleman (2020) contrasted first year versus senior year engineering students, while our study compares undergraduates and graduates. Our study also confirms the work of Gutiérrez-Leefmans (2016), who stresses that the multitasking ability and shortterm information overload of young generations

Items to test

I was able to develop ideas easily. I was able to think out of different perspectives. (Based on Coleman, 2020, Micheli et al., 2018 and Sarooghi et al., 2019).

We analyzed the problem broadly to find a solution that will have the greatest impact. It was easy for me to solve the problem in an online setting. (Based on Micheli et al., 2018 and Sarooghi et al., 2019).

I enjoyed the teamwork during the workshop. The communication between the team members worked without any problems. (Based on Blizzard et al., 2015).

My team members' visualizations were easy for me to understand. The software made it easy for me to present my ideas. (Based on Micheli et al., 2018 and Sarooghi et al., 2019).

It was easy to use the brainstorming method in the software. It was easy to use the dot voting in the software. It was easy to use the brainwriting method in the software. (Based on Micheli et al., 2018 and Sarooghi et al., 2019).

I did not have any technical issues. The combination of the work with the software and Blackboard was not a problem for me. The operation of the software was intuitive. (Own elaboration).

is a result of technology use, which can lead to different perspectives and bisociative thinking (Rawlinson, 1981) and therefore, to innovation.

Results related to gender were not evaluated, as the questionnaire did not ask for such personal information. Further studies could explore whether relevant differences exist between genders when using the software, as well as other tools to complete the remaining Design Thinking steps online. For example, to do as in offline workshops, where prototypes are developed.

Thinking out of different perspectives is key to innovation, hence, facilitators (either educators or organizational coaches) should be ready to help stimulate a diversity of re-

sponses when necessary. It is important to remember that skills are transferable, from the classroom to companies and the other way around.

Among the limitations of the study is the fact that the survey was conducted within a private university, where students are likely to have more access to developing their technical skills than in other contexts in the country. However, the differences found between undergraduate and postgraduate groups should still be salient. Other methodologies might also be used to get further insights, such as focus groups (already used in dt processes). Quantitative studies that use regressions to explore the predictability of creativity and innovation based on other variables are also encouraged.

Table 2. T-test results for variables under study. Source: own elaboration.

Anna Herold

Studied International Management in Germany (esb Business School, Reutlingen University) and Mexico (udlap). During her studies she focused on the topic of innovation in various courses and internships. Her research on Design Thinking started with her thesis, which was directed by Dr. Manuela Gutiérrez-Leefmans. Nowadays, she works as an it Business Analyst in Frankfurt, Germany, and is pursuing her master’s degree in Data Science and Business Analytics. anna.hero@web.de

Manuela Gutiérrez-Leefmans

Senior Associate Professor at the Marketing Department of udlap. She obtained her Ph. D. in Business and Management, and MSc in Information Systems from the University of Manchester in the United Kingdom. She has over ten years of experience in the food, shipbuilding, and pharmaceutical industries. Her main research interests are information systems, e-commerce, business models, and innovation. She is a member of the Mexican National System of Researchers (level 1).

maria.gutierrez@udlap.mx

REFERENCES

• AJ&Smart (2021). Better Products, Faster. https://ajsmart.com/

• Blizzard, J., Klotz, L., Potvin, G., Hazari, Z., Cribbs, J., & Godwin, A. (2015). Using survey questions to identify and learn more about those who exhibit Design Thinking traits. Design Studies, 38, 92-110.

• Brenner, W., Uebernickel, F., & Abrell, T. (2016). Design thinking as mindset, process, and toolbox. In: Brenner, W. & Uebernickel, F. (Ed.) Design thinking for innovation. Springer. https://doi.org/10.1007/9783-319-26100-3_1

• Brown, T. (2009). Change by design: how Design Thinking transforms organizations and inspires innovation. Harper Business.

• Camacho, M. (2016). David Kelley: from design to Design Thinking at stanford and IDEO. She Ji: The Journal of Design, Economics, and Innovation, 2(1), 88-101.

• Coleman, E., Shealy, T., Grohs, J., & Godwin, A. (2020). Design Thinking among first-year and senior engineering students: A cross-sectional, national study measuring perceived ability. Journal of Engineering Education, 109(1), 72-87.

• De Winter, J. C. F. & Dodou, D. (2010), Five-Point Likert Items: t test versus Mann-Whitney-Wilcoxo. Practical assessment. Research and Evaluation, 15(11).

• Döring, N. & Bortz, J. (2016). Forschungs-und Wissenschaftsethik. In Forschungsmethoden und Evaluation in den Sozial-und Humanwissenschaften (pp. 121-139). Springer.

• Emerson, R. W. (2015). Convenience sampling, random sampling, and snowball sampling: How does sampling affect the validity of research?. Journal of Visual Impairment & Blindness, 109(2), 164-168.

• Ericson, J. D. (2022). Mapping the relationship between critical thinking and Design Thinking. Journal of the Knowledge Economy, 13(1), 406-429.

• Gutiérrez-Leefmans, M. (2016). Is internet making us more creative?. CIENCIA ergo-sum: revista científica multidisciplinaria de la Universidad Autónoma del Estado de México, 23(2), 182-187.

• Hasso-Plattner-Institut of Design at Stanford University. (2021a). Die sechs Schritte im Design Thinking Innovationsprozess. Retrieved January 22, 2021, from https://hpi.de/school-of-design-thinking/design-thinking/hintergrund/design-thinking-prozess.html

• Hasso-Plattner-Institute of Design at Stanford University. (2021b). Get Started with Design Thinking. Retrieved January 21, 2021, from https:// dschool.stanford.edu/resources/getting-started-with-design-thinking

• Ideo. (2021). Work Journal Tools. https://www.ideo.com/eu

• Knapp, J., Zeratsky, J., & Kowitz, B. (2016). Sprint: Wie man in nur fünf Tagen neue Ideen testet und Probleme löst. Redline Wirtschaft.

• Koh, J. H. L., Chai, C. S., Wong, B., & Hong, H. Y. (2015). Design Thinking for education: conceptions and applications in teaching and learning Springer. https://doi.org/10.1007/978-981-287-444-3

• Lester, R. (2005). Universities, innovation, and the competitiveness of local economies. a summary report from the local innovation systems project: phase I. Massachusetts Institute of Technology, Industrial Performance Center.

• Likert, R. (1932). A technique for the measurement of attitudes. Archives of psychology.

• Lynch, M., Kamovich, U., Longva, K. K., & Steinert, M. (2019). Combining technology and entrepreneurial education through Design

Thinking: students’ reflections on the learning process. Technological Forecasting and Social Change, 119689.

• Matthews, J. & Wrigley, C. (2017). Design and Design Thinking in business and management higher education. Journal of Learning Design 10(1), 41-54.

• Meinel, M., Eismann, T. T., Baccarella, C. V., Fixson, S. K., & Voigt, K. I. (2020). Does applying Design Thinking result in better new product concepts than a traditional innovation approach? An experimental comparison study. European Management Journal, 38(4), 661-671.

• Micheli, P., Wilner, S. J., Bhatti, S. H., Mura, M., & Beverland, M. B. (2018). Doing Design Thinking: conceptual review, synthesis, and research agenda. Journal of Product Innovation Management, 36(2), 124-148.

• Minitab Blog Editor. (2016, April 6). Best Way to Analyze Likert Item Data: Two Sample T-Test versus Mann-Whitney. Retrieved 2021, from https://blog.minitab.com/en/adventures-in-statistics-2/best-way-toanalyze-likert-item-data-two-sample-t-test-versus-mann-whitney

• Mosely, G., Wright, N., & Wrigley, C. (2018). Facilitating Design Thinking: a comparison of design expertise. Thinking Skills and Creativity, 27, 177-189.

• Mural. (2020a). Put imagination to work. Retrieved March 1, 2021, from https://mural.co/features

• Mural. (2020b). Design Thinking Canvas Template. Retrieved March 1, 2021, from https://www.mural.co/templates/design-thinking-canvas

• Rawlinson, J. G. (1981) Creative thinking and brainstorming (p. 8). Routledge, https://doi.org/10.4324/9781315259000

• Rusmann, A., & Ejsing-Duun, S. (2022). When Design Thinking goes to school: a literature review of design competences for the K-12 level International Journal of Technology and Design Education, 32(4), 20632091.

• Sarooghi, H., Sunny, S., Hornsby, J., & Fernhaber, S. (2019). Design Thinking and entrepreneurship education: where are we, and what are the possibilities?. Journal of Small Business Management, 57, 78-93.

• Shé, C. N., Farrell, O., Brunton, J., & Costello, E. (2022). Integrating Design Thinking into instructional design: the #OpenTeach case study. Australasian Journal of Educational Technology, 38(1), 33-52.

• Stackowiak, R. & Kelly, T. (2020). Design Thinking in software and AI projects: proving ideas through rapid prototyping. Apress.

• Stephens, J. P. & Boland, B. J. (2015). The aesthetic knowledge problem of problem-solving with design thinking. Journal of Management Inquiry, 24(3), 219-232. https://doi.org/10.1177/1056492614564677

• The Oxford Group. (2023). The Oxford Group. A City & Guilds Business. Retrieved 2021, from https://www.oxford-group.com/insights/rise-hybrid-working-why-its-future-work/

• Utley, J., Doorley, S., Kembel, G., Klebahn, P., Hanlon, M., Chon, J., & Boyd B. (2020, April). How to Kick Off a Crash Course. Stanford d.school. Retrieved 02.02.2021 from https://dschool.stanford.edu/resources/ gear-up-how-to-kick-off-a-crash-course

• Vieira, P. C. (2016). T-test with likert scale variables. SSRN Electronic Journal. http://dx.doi.org/10.2139/ssrn.2770035

• Wintermann, O. (2020, July 27). Die Auswirkungen der Corona-Krise auf die Arbeitswelt: Was bleibt und was nicht?. Bertelsmann Stiftung. Retrieved January, 2021, from https://www.bertelsmann-stiftung.de/ de/unsere-projekte/betriebliche-arbeitswelt-digitalisierung/projektnachrichten/die-auswirkungen-der-corona-krise-auf-die-arbeitswelt

Online design thinking in a higher educational environment. Entorno UDLAP

Design Thinking en línea en la educación superior

in a higher educational environment

RESUMEN

Design Thinking en línea en la educación superior

in a higher educational environment

RESUMEN

INTRODUCTION

A framework for online Design Thinking workshops

METHODOLOGY

Preparation

REFERENCES